2024-04-26T11:08:33.520 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T11:08:33.520 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi --owner scheduled_teuthology@teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} --archive /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158 --verbose -- /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/orig.config.yaml 2024-04-26T11:08:33.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T11:08:33.640 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674158' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: reef ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dc093b5e41f728edab6e0330295fdf9156d31664 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: dc093b5e41f728edab6e0330295fdf9156d31664 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 1136 sha1: dc093b5e41f728edab6e0330295fdf9156d31664 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 targets: smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIxuNsfV0kDPVabi4qqNkM8gBJIbyKPoKP/CkfwMicQ9DVdNiyCiLxdu/OfIgV82r+ZhNDPTQDTqD1qa22vKtNE= smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDN+u2o3Jxix2q7kMmq4Yu632Df8HgN44ZfR9zF1KB7p8pLqlNOCvFtIz6vpku1Ea/Em+ZXExIOoG/7hBhXFNmU= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFjDy8oJvqBPkBHEhQ6nXrvI/ij3a0Omcgy4UA+ad9j605TJ3/CAh7a8086p9vb8wKmIUxTGQYhoPHXI1v5pTco= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLY6oAN3ghf2oxznrfpm3zRO/vxO+Tp4VIcFbQFryJqs+hj5Qj+jgokYw3glsKU01xkEyTJ2EdLfVG1OCC9kls4= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T11:08:33.641 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa; will attempt to use it 2024-04-26T11:08:33.641 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa/tasks 2024-04-26T11:08:33.642 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T11:08:33.643 INFO:teuthology.task.internal:Checking packages... 2024-04-26T11:08:33.667 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'dc093b5e41f728edab6e0330295fdf9156d31664' 2024-04-26T11:08:33.667 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T11:08:33.668 INFO:teuthology.packaging:ref: None 2024-04-26T11:08:33.668 INFO:teuthology.packaging:tag: None 2024-04-26T11:08:33.668 INFO:teuthology.packaging:branch: reef 2024-04-26T11:08:33.668 INFO:teuthology.packaging:sha1: dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:08:33.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=reef 2024-04-26T11:08:34.006 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258-g7d2137f0-1jammy 2024-04-26T11:08:34.008 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T11:08:34.014 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T11:08:34.014 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T11:08:34.048 INFO:teuthology.task.internal:Saving configuration 2024-04-26T11:08:34.061 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T11:08:34.070 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T11:08:34.097 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:02:20.792316', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIC/DFdginy0R3aFCbAq4vDYz2uvmUjo5IbYtWqps3Rqr'} 2024-04-26T11:08:34.122 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:02:20.795302', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOeLyjLR/JOHT9H0iOHmXDwh/VIq0bBf1wtT0HWMywpI'} 2024-04-26T11:08:34.141 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:02:20.796599', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJGKG7f8onc0zFQrH037pW0zQo+883PX/5+jroU5SOus'} 2024-04-26T11:08:34.166 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 11:02:20.793865', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOuRba8eTsfVs2i85ccjSM0uQBroe5ZkwvxTam2Nw9Kf'} 2024-04-26T11:08:34.166 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T11:08:34.172 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-26T11:08:34.172 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['osd.0'] 2024-04-26T11:08:34.172 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['osd.1'] 2024-04-26T11:08:34.172 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['osd.2'] 2024-04-26T11:08:34.173 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T11:08:34.374 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7edbf45280>, signals=[15]) 2024-04-26T11:08:34.375 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T11:08:34.381 INFO:teuthology.task.internal:Opening connections... 2024-04-26T11:08:34.381 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-04-26T11:08:34.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:08:34.476 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T11:08:34.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:08:34.556 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-04-26T11:08:34.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:08:34.636 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T11:08:34.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:08:34.717 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T11:08:34.727 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-04-26T11:08:34.734 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-04-26T11:08:34.734 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-04-26T11:08:34.780 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T11:08:34.780 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2024-04-26T11:08:34.780 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="22.04" 2024-04-26T11:08:34.780 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T11:08:34.780 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=jammy 2024-04-26T11:08:34.780 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2024-04-26T11:08:34.780 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2024-04-26T11:08:34.780 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T11:08:34.780 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T11:08:34.780 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T11:08:34.780 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T11:08:34.781 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=jammy 2024-04-26T11:08:34.781 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-04-26T11:08:34.802 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-04-26T11:08:34.808 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-04-26T11:08:34.808 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-04-26T11:08:34.855 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T11:08:34.855 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2024-04-26T11:08:34.855 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="22.04" 2024-04-26T11:08:34.855 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T11:08:34.856 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=jammy 2024-04-26T11:08:34.856 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2024-04-26T11:08:34.856 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2024-04-26T11:08:34.856 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T11:08:34.856 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T11:08:34.856 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T11:08:34.856 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T11:08:34.856 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=jammy 2024-04-26T11:08:34.856 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-04-26T11:08:34.876 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-04-26T11:08:34.882 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-04-26T11:08:34.882 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-04-26T11:08:34.930 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T11:08:34.930 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2024-04-26T11:08:34.930 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="22.04" 2024-04-26T11:08:34.930 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T11:08:34.930 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=jammy 2024-04-26T11:08:34.931 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2024-04-26T11:08:34.931 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2024-04-26T11:08:34.931 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T11:08:34.931 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T11:08:34.931 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T11:08:34.931 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T11:08:34.931 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=jammy 2024-04-26T11:08:34.931 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-04-26T11:08:34.960 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-04-26T11:08:34.966 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-04-26T11:08:34.966 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-26T11:08:35.013 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T11:08:35.013 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Ubuntu" 2024-04-26T11:08:35.013 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="22.04" 2024-04-26T11:08:35.013 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T11:08:35.013 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_CODENAME=jammy 2024-04-26T11:08:35.013 INFO:teuthology.orchestra.run.smithi175.stdout:ID=ubuntu 2024-04-26T11:08:35.013 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE=debian 2024-04-26T11:08:35.013 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T11:08:35.013 INFO:teuthology.orchestra.run.smithi175.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T11:08:35.013 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T11:08:35.013 INFO:teuthology.orchestra.run.smithi175.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T11:08:35.014 INFO:teuthology.orchestra.run.smithi175.stdout:UBUNTU_CODENAME=jammy 2024-04-26T11:08:35.014 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-26T11:08:35.043 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T11:08:35.052 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T11:08:35.070 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T11:08:35.070 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:08:35.073 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:08:35.075 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:08:35.078 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-04-26T11:08:35.083 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T11:08:35.094 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T11:08:35.094 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:08:35.121 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:08:35.123 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:08:35.125 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-04-26T11:08:35.142 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T11:08:35.237 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T11:08:35.250 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T11:08:35.251 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T11:08:35.251 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:08:35.253 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:08:35.253 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:08:35.254 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T11:08:35.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:08:35.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:08:35.260 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-26T11:08:35.261 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-04-26T11:08:35.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:08:35.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:08:35.262 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-04-26T11:08:35.263 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-04-26T11:08:35.306 INFO:teuthology.orchestra.run.smithi107.stdout:5.15.0-56-generic 2024-04-26T11:08:35.307 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.15.0-56-generic 2024-04-26T11:08:35.307 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get clean 2024-04-26T11:08:35.308 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-56-generic 2024-04-26T11:08:35.308 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.15.0-56-generic 2024-04-26T11:08:35.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-04-26T11:08:35.310 INFO:teuthology.orchestra.run.smithi175.stdout:5.15.0-56-generic 2024-04-26T11:08:35.310 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.15.0-56-generic 2024-04-26T11:08:35.310 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get clean 2024-04-26T11:08:35.312 INFO:teuthology.orchestra.run.smithi088.stdout:5.15.0-56-generic 2024-04-26T11:08:35.312 INFO:teuthology.task.kernel:Running kernel on smithi088: 5.15.0-56-generic 2024-04-26T11:08:35.312 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get clean 2024-04-26T11:08:35.431 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-04-26T11:08:35.435 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2024-04-26T11:08:35.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-04-26T11:08:35.440 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-04-26T11:08:35.579 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T11:08:35.584 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:08:35.588 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T11:08:35.588 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T11:08:35.596 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:08:35.598 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T11:08:35.602 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T11:08:35.617 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:08:35.617 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T11:08:35.618 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T11:08:35.666 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T11:08:35.687 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:08:35.691 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T11:08:35.691 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T11:08:35.769 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T11:08:35.813 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T11:08:35.841 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T11:08:35.850 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T11:08:35.859 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T11:08:35.882 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T11:08:35.914 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T11:08:35.930 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T11:08:35.932 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T11:08:35.937 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T11:08:35.940 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T11:08:35.940 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T11:08:35.945 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T11:08:35.945 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T11:08:35.961 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T11:08:35.973 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T11:08:35.974 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T11:08:35.980 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T11:08:35.980 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T11:08:35.995 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T11:08:35.998 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T11:08:35.999 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T11:08:36.007 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T11:08:36.011 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T11:08:36.011 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T11:08:36.012 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T11:08:36.015 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T11:08:36.015 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T11:08:36.017 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T11:08:36.017 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T11:08:36.045 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T11:08:36.050 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T11:08:36.050 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T11:08:36.061 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T11:08:36.061 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T11:08:36.062 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T11:08:36.074 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T11:08:36.082 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T11:08:36.082 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T11:08:36.084 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T11:08:36.084 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T11:08:36.088 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T11:08:36.089 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T11:08:36.094 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T11:08:36.094 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T11:08:36.095 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T11:08:36.095 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T11:08:36.108 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T11:08:36.114 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T11:08:36.118 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T11:08:36.124 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T11:08:36.126 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T11:08:36.134 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T11:08:36.136 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T11:08:36.138 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T11:08:36.140 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T11:08:36.140 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T11:08:36.141 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T11:08:36.142 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T11:08:36.143 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T11:08:36.144 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T11:08:36.144 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T11:08:36.144 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T11:08:36.152 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T11:08:36.152 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T11:08:36.156 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T11:08:36.160 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T11:08:36.160 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T11:08:36.160 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T11:08:36.161 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T11:08:36.165 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T11:08:36.166 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T11:08:36.168 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T11:08:36.168 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T11:08:36.171 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T11:08:36.171 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T11:08:36.185 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T11:08:36.187 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T11:08:36.191 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T11:08:36.199 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T11:08:36.200 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T11:08:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T11:08:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T11:08:36.201 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T11:08:36.203 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T11:08:36.208 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T11:08:36.208 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T11:08:36.209 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T11:08:36.209 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T11:08:36.210 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T11:08:36.213 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T11:08:36.215 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T11:08:36.216 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T11:08:36.217 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T11:08:36.222 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T11:08:36.223 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T11:08:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T11:08:36.230 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T11:08:36.231 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T11:08:36.232 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T11:08:36.232 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T11:08:36.232 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T11:08:36.235 INFO:teuthology.orchestra.run.smithi107.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T11:08:36.235 INFO:teuthology.orchestra.run.smithi107.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T11:08:36.239 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T11:08:36.248 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T11:08:36.251 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T11:08:36.251 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T11:08:36.252 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T11:08:36.252 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T11:08:36.253 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T11:08:36.255 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T11:08:36.263 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T11:08:36.263 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T11:08:36.264 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T11:08:36.264 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T11:08:36.267 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T11:08:36.267 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T11:08:36.275 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T11:08:36.276 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T11:08:36.276 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T11:08:36.276 INFO:teuthology.orchestra.run.smithi175.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T11:08:36.277 INFO:teuthology.orchestra.run.smithi175.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T11:08:36.277 INFO:teuthology.orchestra.run.smithi175.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T11:08:36.286 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T11:08:36.289 INFO:teuthology.orchestra.run.smithi175.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T11:08:36.290 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T11:08:36.290 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T11:08:36.291 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T11:08:36.291 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T11:08:36.310 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T11:08:36.310 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T11:08:36.312 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T11:08:36.312 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T11:08:36.312 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T11:08:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T11:08:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T11:08:36.331 INFO:teuthology.orchestra.run.smithi088.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T11:08:36.332 INFO:teuthology.orchestra.run.smithi088.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T11:08:36.454 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T11:08:36.605 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T11:08:36.619 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T11:08:36.620 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T11:08:36.682 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T11:08:36.683 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T11:08:36.690 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T11:08:36.854 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T11:08:37.435 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T11:08:37.546 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T11:08:37.566 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T11:08:37.567 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T11:08:37.568 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T11:08:37.572 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T11:08:37.573 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T11:08:37.573 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T11:08:37.577 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T11:08:37.581 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T11:08:37.747 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T11:08:37.830 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T11:08:37.931 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T11:08:37.966 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T11:08:38.017 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T11:08:41.562 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 13.2 MB in 2s (6,957 kB/s) 2024-04-26T11:08:41.630 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 13.2 MB in 2s (7,117 kB/s) 2024-04-26T11:08:41.835 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 13.2 MB in 2s (6,823 kB/s) 2024-04-26T11:08:42.195 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 13.2 MB in 3s (5,274 kB/s) 2024-04-26T11:08:42.937 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T11:08:42.954 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:08:42.983 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-04-26T11:08:43.001 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:08:43.015 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T11:08:43.062 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-04-26T11:08:43.211 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-26T11:08:43.212 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-26T11:08:43.248 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-26T11:08:43.263 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-04-26T11:08:43.264 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-04-26T11:08:43.266 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:08:43.320 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-26T11:08:43.376 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:08:43.376 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:08:43.377 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:08:43.377 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:08:43.377 INFO:teuthology.orchestra.run.smithi175.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T11:08:43.377 INFO:teuthology.orchestra.run.smithi175.stdout: python2.7-minimal 2024-04-26T11:08:43.377 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:08:43.378 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-04-26T11:08:43.378 INFO:teuthology.orchestra.run.smithi175.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T11:08:43.378 INFO:teuthology.orchestra.run.smithi175.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T11:08:43.379 INFO:teuthology.orchestra.run.smithi175.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T11:08:43.380 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-04-26T11:08:43.380 INFO:teuthology.orchestra.run.smithi175.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T11:08:43.380 INFO:teuthology.orchestra.run.smithi175.stdout:Recommended packages: 2024-04-26T11:08:43.380 INFO:teuthology.orchestra.run.smithi175.stdout: thermald 2024-04-26T11:08:43.425 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-04-26T11:08:43.426 INFO:teuthology.orchestra.run.smithi175.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T11:08:43.426 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T11:08:43.427 INFO:teuthology.orchestra.run.smithi175.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T11:08:43.427 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:08:43.427 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:08:43.427 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:08:43.428 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages will be upgraded: 2024-04-26T11:08:43.428 INFO:teuthology.orchestra.run.smithi175.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T11:08:43.428 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:08:43.429 INFO:teuthology.orchestra.run.smithi107.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T11:08:43.429 INFO:teuthology.orchestra.run.smithi107.stdout: python2.7-minimal 2024-04-26T11:08:43.429 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:08:43.429 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-04-26T11:08:43.429 INFO:teuthology.orchestra.run.smithi107.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T11:08:43.429 INFO:teuthology.orchestra.run.smithi107.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T11:08:43.430 INFO:teuthology.orchestra.run.smithi107.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T11:08:43.431 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-04-26T11:08:43.431 INFO:teuthology.orchestra.run.smithi107.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T11:08:43.431 INFO:teuthology.orchestra.run.smithi107.stdout:Recommended packages: 2024-04-26T11:08:43.431 INFO:teuthology.orchestra.run.smithi107.stdout: thermald 2024-04-26T11:08:43.483 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-04-26T11:08:43.483 INFO:teuthology.orchestra.run.smithi107.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T11:08:43.483 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T11:08:43.484 INFO:teuthology.orchestra.run.smithi107.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T11:08:43.485 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages will be upgraded: 2024-04-26T11:08:43.485 INFO:teuthology.orchestra.run.smithi107.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T11:08:43.508 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-04-26T11:08:43.509 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-04-26T11:08:43.564 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-26T11:08:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T11:08:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 113 MB of archives. 2024-04-26T11:08:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T11:08:43.569 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T11:08:43.569 INFO:teuthology.orchestra.run.smithi175.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T11:08:43.569 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 113 MB of archives. 2024-04-26T11:08:43.570 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T11:08:43.570 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T11:08:43.581 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:08:43.642 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-26T11:08:43.665 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:08:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:08:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:08:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:08:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T11:08:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: python2.7-minimal 2024-04-26T11:08:43.666 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:08:43.667 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2024-04-26T11:08:43.667 INFO:teuthology.orchestra.run.smithi088.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T11:08:43.667 INFO:teuthology.orchestra.run.smithi088.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T11:08:43.667 INFO:teuthology.orchestra.run.smithi088.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T11:08:43.668 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2024-04-26T11:08:43.668 INFO:teuthology.orchestra.run.smithi088.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T11:08:43.668 INFO:teuthology.orchestra.run.smithi088.stdout:Recommended packages: 2024-04-26T11:08:43.668 INFO:teuthology.orchestra.run.smithi088.stdout: thermald 2024-04-26T11:08:43.712 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2024-04-26T11:08:43.712 INFO:teuthology.orchestra.run.smithi088.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T11:08:43.712 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T11:08:43.713 INFO:teuthology.orchestra.run.smithi088.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T11:08:43.713 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages will be upgraded: 2024-04-26T11:08:43.714 INFO:teuthology.orchestra.run.smithi088.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T11:08:43.833 INFO:teuthology.orchestra.run.smithi088.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T11:08:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 113 MB of archives. 2024-04-26T11:08:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T11:08:43.834 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T11:08:43.843 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-26T11:08:43.845 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-26T11:08:44.009 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:08:44.009 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:08:44.009 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:08:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:08:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T11:08:44.010 INFO:teuthology.orchestra.run.smithi073.stdout: python2.7-minimal 2024-04-26T11:08:44.010 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:08:44.014 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-04-26T11:08:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T11:08:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T11:08:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T11:08:44.014 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-04-26T11:08:44.014 INFO:teuthology.orchestra.run.smithi073.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T11:08:44.014 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-04-26T11:08:44.015 INFO:teuthology.orchestra.run.smithi073.stdout: thermald 2024-04-26T11:08:44.066 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-04-26T11:08:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T11:08:44.066 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T11:08:44.067 INFO:teuthology.orchestra.run.smithi073.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T11:08:44.067 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-04-26T11:08:44.069 INFO:teuthology.orchestra.run.smithi073.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T11:08:44.184 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T11:08:44.185 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 113 MB of archives. 2024-04-26T11:08:44.185 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T11:08:44.185 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T11:08:44.288 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T11:08:44.331 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T11:08:44.713 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T11:08:44.735 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T11:08:44.952 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T11:08:45.347 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T11:08:45.832 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T11:08:46.341 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T11:08:47.050 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T11:08:47.050 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T11:08:47.051 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T11:08:47.205 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T11:08:47.205 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T11:08:47.206 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T11:08:47.534 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T11:08:47.588 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T11:08:47.588 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T11:08:47.588 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T11:08:47.596 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T11:08:47.681 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T11:08:47.713 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T11:08:47.880 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T11:08:47.960 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T11:08:48.085 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 113 MB in 4s (26.7 MB/s) 2024-04-26T11:08:48.126 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 113 MB in 4s (26.8 MB/s) 2024-04-26T11:08:48.278 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T11:08:48.293 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T11:08:48.375 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 113 MB in 4s (26.7 MB/s) 2024-04-26T11:08:48.579 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T11:08:48.836 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T11:08:48.836 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T11:08:48.836 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T11:08:49.022 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T11:08:49.066 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T11:08:49.456 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 113 MB in 5s (22.7 MB/s) 2024-04-26T11:08:49.623 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T11:08:50.178 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T11:08:50.183 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:50.241 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:50.507 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T11:08:50.511 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:50.566 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T11:08:50.570 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:50.657 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:50.678 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:51.661 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T11:08:51.665 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:51.729 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:52.750 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T11:08:52.771 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:52.783 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T11:08:52.804 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:52.852 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:52.881 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:53.270 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T11:08:53.291 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:53.336 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T11:08:53.353 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T11:08:53.357 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:53.370 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:53.374 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:53.394 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:53.411 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:53.865 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T11:08:53.886 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:53.948 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:54.039 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T11:08:54.061 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:54.154 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T11:08:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:08:54.701 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:08:59.717 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:08:59.845 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:00.153 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:09:00.273 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:00.373 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:09:00.477 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:09:00.482 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:00.560 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T11:09:00.571 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T11:09:00.601 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T11:09:00.604 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:00.704 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:09:00.831 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:00.832 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:09:00.946 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:09:00.960 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:01.058 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:01.197 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:09:01.263 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T11:09:01.285 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T11:09:01.301 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:01.327 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T11:09:01.338 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T11:09:01.346 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T11:09:01.377 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T11:09:01.579 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T11:09:01.602 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T11:09:01.646 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T11:09:05.926 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T11:09:05.964 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:09:06.001 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:07.068 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T11:09:07.105 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:09:07.132 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T11:09:07.143 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:07.170 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:09:07.206 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:07.294 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T11:09:07.331 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T11:09:07.369 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:09.090 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:09:09.214 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:09.538 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T11:09:09.635 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:09.736 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T11:09:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:09:09.754 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:09:09.865 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:09.868 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:09.877 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:10.210 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T11:09:10.227 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T11:09:10.307 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:10.340 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:10.408 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T11:09:10.466 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T11:09:10.490 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T11:09:10.528 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:10.613 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T11:09:10.619 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:10.986 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T11:09:11.273 INFO:teuthology.orchestra.run.smithi175.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:11.273 INFO:teuthology.orchestra.run.smithi175.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:11.273 INFO:teuthology.orchestra.run.smithi175.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:11.273 INFO:teuthology.orchestra.run.smithi175.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:11.871 INFO:teuthology.orchestra.run.smithi107.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:11.871 INFO:teuthology.orchestra.run.smithi107.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:11.872 INFO:teuthology.orchestra.run.smithi107.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:11.872 INFO:teuthology.orchestra.run.smithi107.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:11.938 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:11.939 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:11.939 INFO:teuthology.orchestra.run.smithi073.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:11.939 INFO:teuthology.orchestra.run.smithi073.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:11.959 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:11.973 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:12.046 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:12.100 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:12.102 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T11:09:12.230 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:13.353 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:13.448 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:13.465 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:13.593 INFO:teuthology.orchestra.run.smithi088.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:13.593 INFO:teuthology.orchestra.run.smithi088.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:13.593 INFO:teuthology.orchestra.run.smithi088.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:13.593 INFO:teuthology.orchestra.run.smithi088.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:13.749 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:14.728 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T11:09:14.840 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T11:09:14.854 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T11:09:14.966 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T11:09:14.980 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:15.046 INFO:teuthology.orchestra.run.smithi175.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T11:09:15.047 INFO:teuthology.orchestra.run.smithi175.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:15.092 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:15.133 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T11:09:15.159 INFO:teuthology.orchestra.run.smithi107.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T11:09:15.159 INFO:teuthology.orchestra.run.smithi107.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:15.167 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:15.258 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T11:09:15.385 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:15.449 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T11:09:15.449 INFO:teuthology.orchestra.run.smithi073.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:16.576 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T11:09:16.702 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T11:09:16.828 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T11:09:16.890 INFO:teuthology.orchestra.run.smithi088.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T11:09:16.890 INFO:teuthology.orchestra.run.smithi088.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:29.182 INFO:teuthology.orchestra.run.smithi073.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T11:09:29.182 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub' 2024-04-26T11:09:29.188 INFO:teuthology.orchestra.run.smithi073.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:09:29.191 INFO:teuthology.orchestra.run.smithi107.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T11:09:29.191 INFO:teuthology.orchestra.run.smithi107.stdout:Sourcing file `/etc/default/grub' 2024-04-26T11:09:29.208 INFO:teuthology.orchestra.run.smithi107.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:09:29.220 INFO:teuthology.orchestra.run.smithi073.stdout:Generating grub configuration file ... 2024-04-26T11:09:29.232 INFO:teuthology.orchestra.run.smithi107.stdout:Generating grub configuration file ... 2024-04-26T11:09:29.301 INFO:teuthology.orchestra.run.smithi175.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T11:09:29.301 INFO:teuthology.orchestra.run.smithi175.stdout:Sourcing file `/etc/default/grub' 2024-04-26T11:09:29.312 INFO:teuthology.orchestra.run.smithi175.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:09:29.328 INFO:teuthology.orchestra.run.smithi175.stdout:Generating grub configuration file ... 2024-04-26T11:09:29.494 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:29.514 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:29.559 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:29.581 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:29.637 INFO:teuthology.orchestra.run.smithi175.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:29.657 INFO:teuthology.orchestra.run.smithi175.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:29.794 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:29.800 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:29.873 INFO:teuthology.orchestra.run.smithi107.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T11:09:29.878 INFO:teuthology.orchestra.run.smithi107.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T11:09:29.961 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:29.967 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:30.035 INFO:teuthology.orchestra.run.smithi107.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T11:09:30.035 INFO:teuthology.orchestra.run.smithi107.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T11:09:30.035 INFO:teuthology.orchestra.run.smithi107.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T11:09:30.038 INFO:teuthology.orchestra.run.smithi073.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T11:09:30.044 INFO:teuthology.orchestra.run.smithi073.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T11:09:30.076 INFO:teuthology.orchestra.run.smithi107.stdout:done 2024-04-26T11:09:30.109 INFO:teuthology.orchestra.run.smithi175.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:30.115 INFO:teuthology.orchestra.run.smithi175.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:30.193 INFO:teuthology.orchestra.run.smithi175.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T11:09:30.199 INFO:teuthology.orchestra.run.smithi175.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T11:09:30.213 INFO:teuthology.orchestra.run.smithi073.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T11:09:30.213 INFO:teuthology.orchestra.run.smithi073.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T11:09:30.213 INFO:teuthology.orchestra.run.smithi073.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T11:09:30.255 INFO:teuthology.orchestra.run.smithi073.stdout:done 2024-04-26T11:09:30.361 INFO:teuthology.orchestra.run.smithi175.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T11:09:30.361 INFO:teuthology.orchestra.run.smithi175.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T11:09:30.361 INFO:teuthology.orchestra.run.smithi175.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T11:09:30.397 INFO:teuthology.orchestra.run.smithi175.stdout:done 2024-04-26T11:09:30.552 DEBUG:teuthology.orchestra.run.smithi107:> dpkg -s linux-image-generic 2024-04-26T11:09:30.569 INFO:teuthology.orchestra.run.smithi107.stdout:Package: linux-image-generic 2024-04-26T11:09:30.569 INFO:teuthology.orchestra.run.smithi107.stdout:Status: install ok installed 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout:Priority: optional 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout:Section: kernel 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout:Installed-Size: 21 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: amd64 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout:Source: linux-meta 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout:Version: 5.15.0.105.102 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout:Recommends: thermald 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout:Description: Generic Linux kernel image 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:09:30.570 INFO:teuthology.orchestra.run.smithi107.stdout: available. 2024-04-26T11:09:30.571 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T11:09:30.571 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:09:30.571 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:09:30.571 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-26T11:09:30.571 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:09:30.571 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get clean 2024-04-26T11:09:30.715 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-04-26T11:09:30.733 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-04-26T11:09:30.733 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-04-26T11:09:30.733 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.105.102 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:09:30.734 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-04-26T11:09:30.735 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T11:09:30.735 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:09:30.735 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:09:30.735 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-26T11:09:30.735 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:09:30.735 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get clean 2024-04-26T11:09:30.749 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-04-26T11:09:30.846 DEBUG:teuthology.orchestra.run.smithi175:> dpkg -s linux-image-generic 2024-04-26T11:09:30.870 INFO:teuthology.orchestra.run.smithi175.stdout:Package: linux-image-generic 2024-04-26T11:09:30.870 INFO:teuthology.orchestra.run.smithi175.stdout:Status: install ok installed 2024-04-26T11:09:30.870 INFO:teuthology.orchestra.run.smithi175.stdout:Priority: optional 2024-04-26T11:09:30.870 INFO:teuthology.orchestra.run.smithi175.stdout:Section: kernel 2024-04-26T11:09:30.871 INFO:teuthology.orchestra.run.smithi175.stdout:Installed-Size: 21 2024-04-26T11:09:30.871 INFO:teuthology.orchestra.run.smithi175.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:09:30.871 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: amd64 2024-04-26T11:09:30.871 INFO:teuthology.orchestra.run.smithi175.stdout:Source: linux-meta 2024-04-26T11:09:30.871 INFO:teuthology.orchestra.run.smithi175.stdout:Version: 5.15.0.105.102 2024-04-26T11:09:30.871 INFO:teuthology.orchestra.run.smithi175.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T11:09:30.871 INFO:teuthology.orchestra.run.smithi175.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:09:30.871 INFO:teuthology.orchestra.run.smithi175.stdout:Recommends: thermald 2024-04-26T11:09:30.871 INFO:teuthology.orchestra.run.smithi175.stdout:Description: Generic Linux kernel image 2024-04-26T11:09:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:09:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: available. 2024-04-26T11:09:30.871 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T11:09:30.871 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:09:30.872 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:09:30.872 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-26T11:09:30.872 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:09:30.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get clean 2024-04-26T11:09:30.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-04-26T11:09:30.895 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T11:09:30.997 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:09:30.997 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T11:09:31.009 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T11:09:31.030 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T11:09:31.069 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-04-26T11:09:31.074 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:09:31.155 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T11:09:31.199 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:09:31.199 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T11:09:31.209 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T11:09:31.230 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T11:09:31.257 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T11:09:31.406 INFO:teuthology.orchestra.run.smithi088.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T11:09:31.406 INFO:teuthology.orchestra.run.smithi088.stdout:Sourcing file `/etc/default/grub' 2024-04-26T11:09:31.433 INFO:teuthology.orchestra.run.smithi088.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:09:31.461 INFO:teuthology.orchestra.run.smithi088.stdout:Generating grub configuration file ... 2024-04-26T11:09:31.818 INFO:teuthology.orchestra.run.smithi088.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:31.837 INFO:teuthology.orchestra.run.smithi088.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:32.193 INFO:teuthology.orchestra.run.smithi088.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:32.198 INFO:teuthology.orchestra.run.smithi088.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:32.262 INFO:teuthology.orchestra.run.smithi088.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T11:09:32.268 INFO:teuthology.orchestra.run.smithi088.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T11:09:32.353 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-26T11:09:32.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:09:32.412 INFO:teuthology.orchestra.run.smithi088.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T11:09:32.412 INFO:teuthology.orchestra.run.smithi088.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T11:09:32.412 INFO:teuthology.orchestra.run.smithi088.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T11:09:32.425 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-04-26T11:09:32.429 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-26T11:09:32.444 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:09:32.456 INFO:teuthology.orchestra.run.smithi088.stdout:done 2024-04-26T11:09:32.505 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-04-26T11:09:32.617 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T11:09:32.630 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-26T11:09:32.632 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-26T11:09:32.636 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:09:32.686 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T11:09:32.707 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-04-26T11:09:32.707 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-04-26T11:09:32.798 INFO:teuthology.orchestra.run.smithi073.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T11:09:32.798 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:09:32.798 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:09:32.798 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:09:32.798 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:09:32.799 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:09:32.799 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:09:32.799 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:09:32.836 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T11:09:32.837 DEBUG:teuthology.orchestra.run.smithi073:> dpkg -s linux-image-generic 2024-04-26T11:09:32.876 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-26T11:09:32.876 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-26T11:09:32.879 INFO:teuthology.orchestra.run.smithi107.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T11:09:32.879 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:09:32.879 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:09:32.879 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:09:32.879 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:09:32.881 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:09:32.881 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:09:32.881 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:09:32.893 INFO:teuthology.orchestra.run.smithi073.stdout:Package: linux-image-generic 2024-04-26T11:09:32.893 INFO:teuthology.orchestra.run.smithi073.stdout:Status: install ok installed 2024-04-26T11:09:32.893 INFO:teuthology.orchestra.run.smithi073.stdout:Priority: optional 2024-04-26T11:09:32.893 INFO:teuthology.orchestra.run.smithi073.stdout:Section: kernel 2024-04-26T11:09:32.893 INFO:teuthology.orchestra.run.smithi073.stdout:Installed-Size: 21 2024-04-26T11:09:32.893 INFO:teuthology.orchestra.run.smithi073.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:09:32.893 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: amd64 2024-04-26T11:09:32.894 INFO:teuthology.orchestra.run.smithi073.stdout:Source: linux-meta 2024-04-26T11:09:32.894 INFO:teuthology.orchestra.run.smithi073.stdout:Version: 5.15.0.105.102 2024-04-26T11:09:32.894 INFO:teuthology.orchestra.run.smithi073.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T11:09:32.894 INFO:teuthology.orchestra.run.smithi073.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:09:32.894 INFO:teuthology.orchestra.run.smithi073.stdout:Recommends: thermald 2024-04-26T11:09:32.894 INFO:teuthology.orchestra.run.smithi073.stdout:Description: Generic Linux kernel image 2024-04-26T11:09:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:09:32.894 INFO:teuthology.orchestra.run.smithi073.stdout: available. 2024-04-26T11:09:32.894 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-04-26T11:09:32.900 DEBUG:teuthology.orchestra.run.smithi088:> dpkg -s linux-image-generic 2024-04-26T11:09:32.918 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T11:09:32.920 DEBUG:teuthology.orchestra.run.smithi107:> dpkg -s linux-image-generic 2024-04-26T11:09:32.925 INFO:teuthology.orchestra.run.smithi088.stdout:Package: linux-image-generic 2024-04-26T11:09:32.925 INFO:teuthology.orchestra.run.smithi088.stdout:Status: install ok installed 2024-04-26T11:09:32.925 INFO:teuthology.orchestra.run.smithi088.stdout:Priority: optional 2024-04-26T11:09:32.925 INFO:teuthology.orchestra.run.smithi088.stdout:Section: kernel 2024-04-26T11:09:32.926 INFO:teuthology.orchestra.run.smithi088.stdout:Installed-Size: 21 2024-04-26T11:09:32.926 INFO:teuthology.orchestra.run.smithi088.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:09:32.926 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: amd64 2024-04-26T11:09:32.926 INFO:teuthology.orchestra.run.smithi088.stdout:Source: linux-meta 2024-04-26T11:09:32.926 INFO:teuthology.orchestra.run.smithi088.stdout:Version: 5.15.0.105.102 2024-04-26T11:09:32.926 INFO:teuthology.orchestra.run.smithi088.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T11:09:32.926 INFO:teuthology.orchestra.run.smithi088.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:09:32.926 INFO:teuthology.orchestra.run.smithi088.stdout:Recommends: thermald 2024-04-26T11:09:32.926 INFO:teuthology.orchestra.run.smithi088.stdout:Description: Generic Linux kernel image 2024-04-26T11:09:32.926 INFO:teuthology.orchestra.run.smithi088.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:09:32.926 INFO:teuthology.orchestra.run.smithi088.stdout: available. 2024-04-26T11:09:32.927 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T11:09:32.927 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T11:09:32.928 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T11:09:32.928 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-26T11:09:32.928 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T11:09:32.928 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get clean 2024-04-26T11:09:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Package: linux-image-generic 2024-04-26T11:09:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Status: install ok installed 2024-04-26T11:09:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Priority: optional 2024-04-26T11:09:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Section: kernel 2024-04-26T11:09:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Installed-Size: 21 2024-04-26T11:09:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:09:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: amd64 2024-04-26T11:09:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Source: linux-meta 2024-04-26T11:09:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Version: 5.15.0.105.102 2024-04-26T11:09:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T11:09:32.933 INFO:teuthology.orchestra.run.smithi107.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:09:32.934 INFO:teuthology.orchestra.run.smithi107.stdout:Recommends: thermald 2024-04-26T11:09:32.934 INFO:teuthology.orchestra.run.smithi107.stdout:Description: Generic Linux kernel image 2024-04-26T11:09:32.934 INFO:teuthology.orchestra.run.smithi107.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:09:32.934 INFO:teuthology.orchestra.run.smithi107.stdout: available. 2024-04-26T11:09:32.934 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-04-26T11:09:32.938 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.ObmOCdwxUw 2024-04-26T11:09:32.939 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ObmOCdwxUw 2024-04-26T11:09:32.981 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.kqxGiQNuKF 2024-04-26T11:09:32.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub/grub.cfg /tmp/tmp.kqxGiQNuKF 2024-04-26T11:09:33.003 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.ObmOCdwxUw 2024-04-26T11:09:33.031 INFO:teuthology.orchestra.run.smithi175.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T11:09:33.031 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:09:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:09:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:09:33.031 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:09:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:09:33.032 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:09:33.032 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:09:33.038 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.kqxGiQNuKF 2024-04-26T11:09:33.071 INFO:teuthology.orchestra.run.smithi175.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T11:09:33.073 DEBUG:teuthology.orchestra.run.smithi175:> dpkg -s linux-image-generic 2024-04-26T11:09:33.121 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.ObmOCdwxUw is 10KB 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Package: linux-image-generic 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Status: install ok installed 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Priority: optional 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Section: kernel 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Installed-Size: 21 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: amd64 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Source: linux-meta 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Version: 5.15.0.105.102 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Recommends: thermald 2024-04-26T11:09:33.132 INFO:teuthology.orchestra.run.smithi175.stdout:Description: Generic Linux kernel image 2024-04-26T11:09:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:09:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: available. 2024-04-26T11:09:33.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2024-04-26T11:09:33.133 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-26T11:09:33.137 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.ObmOCdwxUw 2024-04-26T11:09:33.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T11:09:33.154 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.kqxGiQNuKF is 10KB 2024-04-26T11:09:33.167 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.kqxGiQNuKF 2024-04-26T11:09:33.172 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T11:09:33.180 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.eLTpVUy8kH 2024-04-26T11:09:33.180 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub/grub.cfg /tmp/tmp.eLTpVUy8kH 2024-04-26T11:09:33.198 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:09:33.199 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T11:09:33.199 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T11:09:33.228 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:09:33.228 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T11:09:33.228 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T11:09:33.236 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.eLTpVUy8kH 2024-04-26T11:09:33.266 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T11:09:33.267 DEBUG:teuthology.orchestra.run.smithi073:> sudo update-grub 2024-04-26T11:09:33.274 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:09:33.281 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T11:09:33.304 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T11:09:33.305 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T11:09:33.305 DEBUG:teuthology.orchestra.run.smithi107:> sudo update-grub 2024-04-26T11:09:33.364 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.eLTpVUy8kH is 10KB 2024-04-26T11:09:33.377 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.eLTpVUy8kH 2024-04-26T11:09:33.383 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T11:09:33.384 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T11:09:33.436 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:09:33.436 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T11:09:33.436 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T11:09:33.503 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T11:09:33.503 DEBUG:teuthology.orchestra.run.smithi175:> sudo update-grub 2024-04-26T11:09:34.444 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2024-04-26T11:09:34.445 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:09:34.447 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-04-26T11:09:34.545 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub' 2024-04-26T11:09:34.545 INFO:teuthology.orchestra.run.smithi107.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:09:34.548 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-04-26T11:09:34.641 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:34.647 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:34.734 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub' 2024-04-26T11:09:34.736 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:09:34.737 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-04-26T11:09:34.739 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-26T11:09:34.743 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:34.749 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:34.757 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T11:09:34.819 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-26T11:09:34.918 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:34.924 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:34.961 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:34.965 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T11:09:34.968 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:34.970 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T11:09:34.983 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:34.988 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:35.016 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-04-26T11:09:35.017 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-04-26T11:09:35.030 INFO:teuthology.orchestra.run.smithi107.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T11:09:35.035 INFO:teuthology.orchestra.run.smithi107.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T11:09:35.080 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T11:09:35.080 INFO:teuthology.orchestra.run.smithi073.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T11:09:35.080 INFO:teuthology.orchestra.run.smithi073.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T11:09:35.106 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-04-26T11:09:35.115 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-04-26T11:09:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T11:09:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T11:09:35.178 INFO:teuthology.orchestra.run.smithi107.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T11:09:35.195 INFO:teuthology.orchestra.run.smithi088.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T11:09:35.196 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:09:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:09:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:09:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:09:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:09:35.196 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:09:35.197 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:09:35.197 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-04-26T11:09:35.206 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-04-26T11:09:35.238 INFO:teuthology.orchestra.run.smithi088.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T11:09:35.239 DEBUG:teuthology.orchestra.run.smithi088:> dpkg -s linux-image-generic 2024-04-26T11:09:35.255 INFO:teuthology.orchestra.run.smithi088.stdout:Package: linux-image-generic 2024-04-26T11:09:35.255 INFO:teuthology.orchestra.run.smithi088.stdout:Status: install ok installed 2024-04-26T11:09:35.255 INFO:teuthology.orchestra.run.smithi088.stdout:Priority: optional 2024-04-26T11:09:35.255 INFO:teuthology.orchestra.run.smithi088.stdout:Section: kernel 2024-04-26T11:09:35.255 INFO:teuthology.orchestra.run.smithi088.stdout:Installed-Size: 21 2024-04-26T11:09:35.255 INFO:teuthology.orchestra.run.smithi088.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T11:09:35.255 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: amd64 2024-04-26T11:09:35.255 INFO:teuthology.orchestra.run.smithi088.stdout:Source: linux-meta 2024-04-26T11:09:35.255 INFO:teuthology.orchestra.run.smithi088.stdout:Version: 5.15.0.105.102 2024-04-26T11:09:35.255 INFO:teuthology.orchestra.run.smithi088.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T11:09:35.255 INFO:teuthology.orchestra.run.smithi088.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T11:09:35.256 INFO:teuthology.orchestra.run.smithi088.stdout:Recommends: thermald 2024-04-26T11:09:35.256 INFO:teuthology.orchestra.run.smithi088.stdout:Description: Generic Linux kernel image 2024-04-26T11:09:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: This package will always depend on the latest generic kernel image 2024-04-26T11:09:35.256 INFO:teuthology.orchestra.run.smithi088.stdout: available. 2024-04-26T11:09:35.256 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-04-26T11:09:35.257 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:35.261 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:35.301 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T11:09:35.302 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.llWZtP52da 2024-04-26T11:09:35.302 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub/grub.cfg /tmp/tmp.llWZtP52da 2024-04-26T11:09:35.306 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T11:09:35.359 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.llWZtP52da 2024-04-26T11:09:35.426 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T11:09:35.426 INFO:teuthology.orchestra.run.smithi175.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T11:09:35.426 INFO:teuthology.orchestra.run.smithi175.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T11:09:35.443 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-04-26T11:09:35.450 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2024-04-26T11:09:35.478 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.llWZtP52da is 10KB 2024-04-26T11:09:35.491 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.llWZtP52da 2024-04-26T11:09:35.496 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T11:09:35.549 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:09:35.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T11:09:35.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T11:09:35.631 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T11:09:35.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo update-grub 2024-04-26T11:09:36.970 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub' 2024-04-26T11:09:36.971 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T11:09:36.974 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-04-26T11:09:37.131 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T11:09:37.138 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T11:09:37.420 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T11:09:37.425 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T11:09:37.464 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T11:09:37.468 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T11:09:37.599 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T11:09:37.599 INFO:teuthology.orchestra.run.smithi088.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T11:09:37.599 INFO:teuthology.orchestra.run.smithi088.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T11:09:37.609 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-04-26T11:09:37.615 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2024-04-26T11:10:05.142 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T11:10:05.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-26T11:10:05.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:10:05.209 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-26T11:10:05.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-26T11:10:05.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:10:05.453 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-26T11:10:05.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T11:10:05.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:10:07.618 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-26T11:10:07.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-26T11:10:07.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:10:39.903 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-26T11:10:39.904 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-26T11:10:42.210 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-26T11:10:48.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-26T11:10:48.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:10:48.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T11:10:48.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:10:51.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-26T11:10:51.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:10:54.270 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-26T11:11:05.155 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T11:11:06.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-26T11:11:06.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:11:07.294 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-26T11:11:14.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-26T11:11:14.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:11:14.958 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-04-26T11:11:16.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-26T11:11:16.017 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-26T11:11:16.018 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-04-26T11:11:16.064 INFO:teuthology.orchestra.run.smithi073.stdout:5.15.0-105-generic 2024-04-26T11:11:16.065 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T11:11:16.065 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:11:16.065 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T11:11:17.066 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T11:11:17.066 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:11:17.437 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-04-26T11:11:17.462 DEBUG:teuthology.parallel:result is None 2024-04-26T11:11:19.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T11:11:19.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:11:20.119 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-26T11:11:20.350 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-26T11:11:21.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T11:11:21.153 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.15.0-105-generic"... 2024-04-26T11:11:21.153 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-26T11:11:21.198 INFO:teuthology.orchestra.run.smithi175.stdout:5.15.0-105-generic 2024-04-26T11:11:21.198 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T11:11:21.198 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:11:21.198 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T11:11:22.199 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-26T11:11:22.199 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:11:22.288 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-04-26T11:11:22.311 DEBUG:teuthology.parallel:result is None 2024-04-26T11:11:24.706 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-26T11:11:32.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-26T11:11:32.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:11:32.665 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-04-26T11:11:33.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-26T11:11:33.267 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.15.0-105-generic"... 2024-04-26T11:11:33.268 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-04-26T11:11:33.313 INFO:teuthology.orchestra.run.smithi107.stdout:5.15.0-105-generic 2024-04-26T11:11:33.314 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T11:11:33.314 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:11:33.314 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T11:11:34.315 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-26T11:11:34.316 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:11:34.665 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-04-26T11:11:34.691 DEBUG:teuthology.parallel:result is None 2024-04-26T11:11:39.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-26T11:11:39.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:11:39.928 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-26T11:11:40.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-26T11:11:40.518 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.15.0-105-generic"... 2024-04-26T11:11:40.519 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-04-26T11:11:40.567 INFO:teuthology.orchestra.run.smithi088.stdout:5.15.0-105-generic 2024-04-26T11:11:40.567 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T11:11:40.567 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T11:11:40.567 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T11:11:41.568 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-26T11:11:41.568 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T11:11:41.890 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2024-04-26T11:11:41.920 DEBUG:teuthology.parallel:result is None 2024-04-26T11:11:41.920 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T11:11:41.929 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T11:11:41.930 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:11:41.933 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:11:41.936 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:11:41.938 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T11:11:41.945 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T11:11:41.955 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T11:11:41.989 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T11:11:41.989 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:11:41.992 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:11:41.995 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:11:41.997 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T11:11:42.228 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T11:11:42.241 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T11:11:42.242 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:11:42.244 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:11:42.246 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:11:42.249 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T11:11:42.263 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:11:42.264 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:11:42.271 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:11:42.272 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:11:42.272 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:11:42.278 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:11:42.304 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:11:42.312 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T11:11:42.314 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T11:11:42.322 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T11:11:42.322 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:11:42.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:11:42.327 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:11:42.329 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T11:11:42.345 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T11:11:42.355 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T11:11:42.355 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:11:42.389 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:11:42.392 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:11:42.394 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T11:11:42.400 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:11:42.440 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:11:42.488 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:11:42.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:11:42.552 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:11:42.558 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:11:42.607 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:11:42.607 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:11:42.675 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:11:42.680 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:11:42.726 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:11:42.726 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:11:42.800 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T11:11:42.805 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T11:11:42.854 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:11:42.854 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T11:11:42.927 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-04-26T11:11:42.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-04-26T11:11:42.932 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-04-26T11:11:42.934 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-04-26T11:11:43.001 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T11:11:43.008 INFO:teuthology.task.internal:Starting timer... 2024-04-26T11:11:43.008 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T11:11:43.057 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T11:11:43.090 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2024-04-26T11:11:43.090 DEBUG:teuthology.task.selinux:Excluding smithi088: OS 'ubuntu' does not support SELinux 2024-04-26T11:11:43.090 DEBUG:teuthology.task.selinux:Excluding smithi107: OS 'ubuntu' does not support SELinux 2024-04-26T11:11:43.090 DEBUG:teuthology.task.selinux:Excluding smithi175: OS 'ubuntu' does not support SELinux 2024-04-26T11:11:43.090 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T11:11:43.091 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T11:11:43.091 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T11:11:43.091 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T11:11:43.123 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T11:11:43.140 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T11:11:43.141 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi088.front.sepia.ceph.com,smithi107.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T11:18:52.708 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-04-26T11:18:52.709 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-26T11:18:52.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:18:52.793 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-04-26T11:18:52.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-04-26T11:18:52.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-26T11:18:52.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:18:52.954 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-26T11:18:53.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-26T11:18:53.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-26T11:18:53.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:18:53.120 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-04-26T11:18:53.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-26T11:18:53.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T11:18:53.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:18:53.273 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-26T11:18:53.350 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T11:18:53.351 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T11:18:53.363 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T11:18:53.363 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:18:53.364 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:18:53.366 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:18:53.366 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:18:53.369 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:18:53.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:18:53.371 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T11:18:53.371 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:18:53.394 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T11:18:53.394 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: Command line: ntpd -gq 2024-04-26T11:18:53.394 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: ---------------------------------------------------- 2024-04-26T11:18:53.395 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T11:18:53.395 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T11:18:53.395 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: corporation. Support and training for ntp-4 are 2024-04-26T11:18:53.395 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: available at https://www.nwtime.org/support 2024-04-26T11:18:53.395 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: ---------------------------------------------------- 2024-04-26T11:18:53.396 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: proto: precision = 0.043 usec (-24) 2024-04-26T11:18:53.397 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: basedate set to 2022-02-04 2024-04-26T11:18:53.397 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: gps base set to 2022-02-06 (week 2196) 2024-04-26T11:18:53.397 INFO:teuthology.orchestra.run.smithi107.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:18:53.397 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T11:18:53.398 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: Command line: ntpd -gq 2024-04-26T11:18:53.398 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: ---------------------------------------------------- 2024-04-26T11:18:53.398 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T11:18:53.398 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T11:18:53.398 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: corporation. Support and training for ntp-4 are 2024-04-26T11:18:53.398 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: available at https://www.nwtime.org/support 2024-04-26T11:18:53.398 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: ---------------------------------------------------- 2024-04-26T11:18:53.398 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: proto: precision = 0.062 usec (-24) 2024-04-26T11:18:53.398 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: basedate set to 2022-02-04 2024-04-26T11:18:53.398 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: gps base set to 2022-02-06 (week 2196) 2024-04-26T11:18:53.399 INFO:teuthology.orchestra.run.smithi088.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:18:53.399 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:18:53.399 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:18:53.399 INFO:teuthology.orchestra.run.smithi107.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:18:53.399 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:18:53.400 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:18:53.400 INFO:teuthology.orchestra.run.smithi088.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:18:53.402 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T11:18:53.402 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T11:18:53.402 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T11:18:53.402 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: Listen normally on 3 enp3s0f1 172.21.15.107:123 2024-04-26T11:18:53.402 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: Listen normally on 4 lo [::1]:123 2024-04-26T11:18:53.402 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:47eb%5]:123 2024-04-26T11:18:53.402 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:18:53 ntpd[17206]: Listening on routing socket on fd #22 for interface updates 2024-04-26T11:18:53.402 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T11:18:53.403 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: Command line: ntpd -gq 2024-04-26T11:18:53.403 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: ---------------------------------------------------- 2024-04-26T11:18:53.403 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T11:18:53.403 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T11:18:53.403 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: corporation. Support and training for ntp-4 are 2024-04-26T11:18:53.403 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: available at https://www.nwtime.org/support 2024-04-26T11:18:53.403 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: ---------------------------------------------------- 2024-04-26T11:18:53.403 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: proto: precision = 0.060 usec (-24) 2024-04-26T11:18:53.403 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: basedate set to 2022-02-04 2024-04-26T11:18:53.403 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: gps base set to 2022-02-06 (week 2196) 2024-04-26T11:18:53.403 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T11:18:53.404 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T11:18:53.404 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T11:18:53.404 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: Listen normally on 3 enp3s0f1 172.21.15.88:123 2024-04-26T11:18:53.404 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: Listen normally on 4 lo [::1]:123 2024-04-26T11:18:53.404 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d42d%5]:123 2024-04-26T11:18:53.404 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:18:53 ntpd[17209]: Listening on routing socket on fd #22 for interface updates 2024-04-26T11:18:53.404 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:18:53.404 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:18:53.405 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:18:53.406 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:18:53.406 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T11:18:53.406 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T11:18:53.406 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T11:18:53.406 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2024-04-26T11:18:53.406 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: Listen normally on 4 lo [::1]:123 2024-04-26T11:18:53.406 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2024-04-26T11:18:53.406 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:18:53 ntpd[17211]: Listening on routing socket on fd #22 for interface updates 2024-04-26T11:18:53.419 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T11:18:53.419 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: Command line: ntpd -gq 2024-04-26T11:18:53.419 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: ---------------------------------------------------- 2024-04-26T11:18:53.419 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T11:18:53.419 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T11:18:53.419 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: corporation. Support and training for ntp-4 are 2024-04-26T11:18:53.420 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: available at https://www.nwtime.org/support 2024-04-26T11:18:53.420 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: ---------------------------------------------------- 2024-04-26T11:18:53.420 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: proto: precision = 0.059 usec (-24) 2024-04-26T11:18:53.420 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: basedate set to 2022-02-04 2024-04-26T11:18:53.421 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: gps base set to 2022-02-06 (week 2196) 2024-04-26T11:18:53.421 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:18:53.421 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:18:53.421 INFO:teuthology.orchestra.run.smithi175.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T11:18:53.421 INFO:teuthology.orchestra.run.smithi175.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T11:18:53.422 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T11:18:53.422 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T11:18:53.422 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T11:18:53.422 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: Listen normally on 3 enp3s0f1 172.21.15.175:123 2024-04-26T11:18:53.422 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: Listen normally on 4 lo [::1]:123 2024-04-26T11:18:53.422 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:71f1%5]:123 2024-04-26T11:18:53.422 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:18:53 ntpd[17199]: Listening on routing socket on fd #22 for interface updates 2024-04-26T11:18:54.395 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:54 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:54.395 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:54 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:54.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:54 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:54.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:54 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:54.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:54 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:54.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:54 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:54.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:54 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:54.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:54 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:54.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:54.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:54.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:54.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:54.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:54.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:54.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:54.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:54.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:54.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:54.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:54.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:54 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:55.395 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:55.395 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:55.395 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:55.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:55.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:55.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:55.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:55.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:55.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:55.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:55.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:55.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:55 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:55.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:55.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:55.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:55.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:55.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:55.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:55.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:55.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:55.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:55.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:55.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:55.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:55 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:55.419 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:55 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:55.419 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:55 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:56.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:56 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:56.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:56 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:56.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:56 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:56.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:56 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:56.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:56 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:56.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:56 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:56.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:56.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:56.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:56.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:56 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:56.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:56.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:56.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:56.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:56.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:56.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:56.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:56.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:56.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:56.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:56.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:56.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:56 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:57.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:57.398 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:57 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:57.399 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.399 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.399 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:57.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:57.401 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:57 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:57.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:57 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:57 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:57 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:57.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:57 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:57.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:57 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:57.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:57 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:58.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:58 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:58 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.396 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:58 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:58 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:58 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:58.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:58 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:58.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:58.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:58.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:58.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:58.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:58.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:18:58 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:58.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:58.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:58.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:58.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:58.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:58.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:58 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:59.399 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.399 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.399 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.399 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.399 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.399 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.399 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:59.399 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:18:59 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.400 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:59.401 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:18:59 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:18:59.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:59 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:59 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:59 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:18:59.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:59 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:18:59.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:59 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:18:59.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:18:59 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:19:00.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:19:00 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:00.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:19:00 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:00.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:19:00 ntpd[17209]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:00.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:19:00 ntpd[17209]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:00.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:19:00 ntpd[17209]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:19:00.397 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:19:00 ntpd[17209]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:19:00.397 INFO:teuthology.orchestra.run.smithi088.stdout:26 Apr 11:19:00 ntpd[17209]: ntpd: time slew -0.002582 s 2024-04-26T11:19:00.398 INFO:teuthology.orchestra.run.smithi088.stdout:ntpd: time slew -0.002582s 2024-04-26T11:19:00.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:19:00 ntpd[17209]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T11:19:00.398 INFO:teuthology.orchestra.run.smithi088.stderr:26 Apr 11:19:00 ntpd[17209]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T11:19:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:00.400 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:19:00.401 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:00 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:19:00.420 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:19:00 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:00.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:19:00 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:00.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:19:00 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:00.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:19:00 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:00.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:19:00 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:00.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:19:00 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:00.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:19:00 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:19:00.421 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:19:00 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:19:00.421 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 11:19:00 ntpd[17199]: ntpd: time slew -0.000320 s 2024-04-26T11:19:00.421 INFO:teuthology.orchestra.run.smithi175.stdout:ntpd: time slew -0.000320s 2024-04-26T11:19:00.422 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:19:00 ntpd[17199]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T11:19:00.422 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 11:19:00 ntpd[17199]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T11:19:00.449 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:19:00.450 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2024-04-26T11:19:00.450 INFO:teuthology.orchestra.run.smithi088.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:00.450 INFO:teuthology.orchestra.run.smithi088.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:00.450 INFO:teuthology.orchestra.run.smithi088.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:00.450 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:19:00.462 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2024-04-26T11:19:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:00.462 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:01.395 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:19:01.396 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:19:01.397 INFO:teuthology.orchestra.run.smithi107.stdout:26 Apr 11:19:01 ntpd[17206]: ntpd: time slew +0.000890 s 2024-04-26T11:19:01.397 INFO:teuthology.orchestra.run.smithi107.stdout:ntpd: time slew +0.000890s 2024-04-26T11:19:01.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T11:19:01.397 INFO:teuthology.orchestra.run.smithi107.stderr:26 Apr 11:19:01 ntpd[17206]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T11:19:01.451 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:19:01.451 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2024-04-26T11:19:01.451 INFO:teuthology.orchestra.run.smithi107.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:01.451 INFO:teuthology.orchestra.run.smithi107.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:01.451 INFO:teuthology.orchestra.run.smithi107.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:01.451 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:02.397 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:02.397 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:02.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:02.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:02.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:02.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:02.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T11:19:02.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T11:19:02.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T11:19:02.398 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T11:19:02.398 INFO:teuthology.orchestra.run.smithi073.stdout:26 Apr 11:19:02 ntpd[17211]: ntpd: time slew -0.002935 s 2024-04-26T11:19:02.399 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.002935s 2024-04-26T11:19:02.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T11:19:02.399 INFO:teuthology.orchestra.run.smithi073.stderr:26 Apr 11:19:02 ntpd[17211]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T11:19:02.450 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:19:02.451 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-04-26T11:19:02.451 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:02.451 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:02.451 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:02.451 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:19:02.451 INFO:teuthology.run_tasks:Running task install... 2024-04-26T11:19:02.460 DEBUG:teuthology.task.install:project ceph 2024-04-26T11:19:02.460 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}} 2024-04-26T11:19:02.460 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'} 2024-04-26T11:19:02.461 INFO:teuthology.task.install:Using flavor: default 2024-04-26T11:19:02.466 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T11:19:02.467 INFO:teuthology.task.install:extra packages: [] 2024-04-26T11:19:02.467 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2024-04-26T11:19:02.468 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-key list | grep Ceph 2024-04-26T11:19:02.468 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-key list | grep Ceph 2024-04-26T11:19:02.468 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-key list | grep Ceph 2024-04-26T11:19:02.531 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T11:19:02.534 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T11:19:02.536 INFO:teuthology.orchestra.run.smithi107.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T11:19:02.549 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T11:19:02.562 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T11:19:02.562 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T11:19:02.562 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T11:19:02.562 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T11:19:02.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:19:02.568 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T11:19:02.568 INFO:teuthology.orchestra.run.smithi107.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T11:19:02.568 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T11:19:02.568 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T11:19:02.569 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T11:19:02.569 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T11:19:02.569 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:19:02.570 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T11:19:02.570 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T11:19:02.570 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:19:02.576 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T11:19:02.576 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T11:19:02.577 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T11:19:02.577 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T11:19:02.577 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:19:02.718 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default/ 2024-04-26T11:19:02.718 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:19:02.724 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default/ 2024-04-26T11:19:02.724 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:19:02.832 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default/ 2024-04-26T11:19:02.833 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:19:02.848 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default/ 2024-04-26T11:19:02.848 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:19:02.940 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:19:02.940 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T11:19:02.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2024-04-26T11:19:02.956 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:19:02.956 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T11:19:02.961 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:19:02.961 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T11:19:02.961 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:19:02.961 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T11:19:02.975 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-04-26T11:19:02.976 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2024-04-26T11:19:02.977 DEBUG:teuthology.orchestra.run.smithi107:> sudo apt-get update 2024-04-26T11:19:03.183 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T11:19:03.184 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:19:03.184 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T11:19:03.194 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T11:19:03.194 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T11:19:03.202 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T11:19:03.215 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T11:19:03.215 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T11:19:03.222 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T11:19:03.237 INFO:teuthology.orchestra.run.smithi107.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T11:19:03.237 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T11:19:03.250 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:19:03.250 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T11:19:03.257 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T11:19:03.258 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-04-26T11:19:03.259 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-04-26T11:19:03.261 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:19:03.265 INFO:teuthology.orchestra.run.smithi107.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T11:19:03.266 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T11:19:03.277 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T11:19:03.286 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-04-26T11:19:03.286 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-04-26T11:19:03.294 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T11:19:03.313 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T11:19:03.322 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T11:19:03.332 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T11:19:03.343 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T11:19:03.344 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T11:19:03.352 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T11:19:03.373 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-04-26T11:19:03.396 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-04-26T11:19:03.403 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T11:19:03.424 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T11:19:03.425 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T11:19:03.431 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-04-26T11:19:03.452 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-04-26T11:19:03.548 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 28.8 kB in 0s (72.9 kB/s) 2024-04-26T11:19:03.562 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 28.8 kB in 0s (70.2 kB/s) 2024-04-26T11:19:03.578 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 28.8 kB in 0s (69.5 kB/s) 2024-04-26T11:19:03.627 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 28.8 kB in 0s (59.5 kB/s) 2024-04-26T11:19:04.504 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-04-26T11:19:04.521 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1jammy cephadm=18.2.2-1256-gdc093b5e-1jammy ceph-mds=18.2.2-1256-gdc093b5e-1jammy ceph-mgr=18.2.2-1256-gdc093b5e-1jammy ceph-common=18.2.2-1256-gdc093b5e-1jammy ceph-fuse=18.2.2-1256-gdc093b5e-1jammy ceph-test=18.2.2-1256-gdc093b5e-1jammy ceph-volume=18.2.2-1256-gdc093b5e-1jammy radosgw=18.2.2-1256-gdc093b5e-1jammy python3-rados=18.2.2-1256-gdc093b5e-1jammy python3-rgw=18.2.2-1256-gdc093b5e-1jammy python3-cephfs=18.2.2-1256-gdc093b5e-1jammy python3-rbd=18.2.2-1256-gdc093b5e-1jammy libcephfs2=18.2.2-1256-gdc093b5e-1jammy libcephfs-dev=18.2.2-1256-gdc093b5e-1jammy librados2=18.2.2-1256-gdc093b5e-1jammy librbd1=18.2.2-1256-gdc093b5e-1jammy rbd-fuse=18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:19:04.561 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-26T11:19:04.574 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T11:19:04.576 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1jammy cephadm=18.2.2-1256-gdc093b5e-1jammy ceph-mds=18.2.2-1256-gdc093b5e-1jammy ceph-mgr=18.2.2-1256-gdc093b5e-1jammy ceph-common=18.2.2-1256-gdc093b5e-1jammy ceph-fuse=18.2.2-1256-gdc093b5e-1jammy ceph-test=18.2.2-1256-gdc093b5e-1jammy ceph-volume=18.2.2-1256-gdc093b5e-1jammy radosgw=18.2.2-1256-gdc093b5e-1jammy python3-rados=18.2.2-1256-gdc093b5e-1jammy python3-rgw=18.2.2-1256-gdc093b5e-1jammy python3-cephfs=18.2.2-1256-gdc093b5e-1jammy python3-rbd=18.2.2-1256-gdc093b5e-1jammy libcephfs2=18.2.2-1256-gdc093b5e-1jammy libcephfs-dev=18.2.2-1256-gdc093b5e-1jammy librados2=18.2.2-1256-gdc093b5e-1jammy librbd1=18.2.2-1256-gdc093b5e-1jammy rbd-fuse=18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:19:04.582 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-04-26T11:19:04.590 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1jammy cephadm=18.2.2-1256-gdc093b5e-1jammy ceph-mds=18.2.2-1256-gdc093b5e-1jammy ceph-mgr=18.2.2-1256-gdc093b5e-1jammy ceph-common=18.2.2-1256-gdc093b5e-1jammy ceph-fuse=18.2.2-1256-gdc093b5e-1jammy ceph-test=18.2.2-1256-gdc093b5e-1jammy ceph-volume=18.2.2-1256-gdc093b5e-1jammy radosgw=18.2.2-1256-gdc093b5e-1jammy python3-rados=18.2.2-1256-gdc093b5e-1jammy python3-rgw=18.2.2-1256-gdc093b5e-1jammy python3-cephfs=18.2.2-1256-gdc093b5e-1jammy python3-rbd=18.2.2-1256-gdc093b5e-1jammy libcephfs2=18.2.2-1256-gdc093b5e-1jammy libcephfs-dev=18.2.2-1256-gdc093b5e-1jammy librados2=18.2.2-1256-gdc093b5e-1jammy librbd1=18.2.2-1256-gdc093b5e-1jammy rbd-fuse=18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:19:04.609 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-26T11:19:04.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1jammy cephadm=18.2.2-1256-gdc093b5e-1jammy ceph-mds=18.2.2-1256-gdc093b5e-1jammy ceph-mgr=18.2.2-1256-gdc093b5e-1jammy ceph-common=18.2.2-1256-gdc093b5e-1jammy ceph-fuse=18.2.2-1256-gdc093b5e-1jammy ceph-test=18.2.2-1256-gdc093b5e-1jammy ceph-volume=18.2.2-1256-gdc093b5e-1jammy radosgw=18.2.2-1256-gdc093b5e-1jammy python3-rados=18.2.2-1256-gdc093b5e-1jammy python3-rgw=18.2.2-1256-gdc093b5e-1jammy python3-cephfs=18.2.2-1256-gdc093b5e-1jammy python3-rbd=18.2.2-1256-gdc093b5e-1jammy libcephfs2=18.2.2-1256-gdc093b5e-1jammy libcephfs-dev=18.2.2-1256-gdc093b5e-1jammy librados2=18.2.2-1256-gdc093b5e-1jammy librbd1=18.2.2-1256-gdc093b5e-1jammy rbd-fuse=18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:19:04.636 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-26T11:19:04.642 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T11:19:04.683 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-26T11:19:04.782 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-04-26T11:19:04.783 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-04-26T11:19:04.818 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-26T11:19:04.819 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-26T11:19:04.831 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-26T11:19:04.832 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-26T11:19:04.880 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-04-26T11:19:04.881 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-04-26T11:19:04.976 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:19:04.977 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:19:04.977 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:19:04.977 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:19:04.977 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:19:04.977 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:19:04.977 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:19:04.978 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-04-26T11:19:04.978 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T11:19:04.978 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T11:19:04.978 INFO:teuthology.orchestra.run.smithi107.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-26T11:19:04.978 INFO:teuthology.orchestra.run.smithi107.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T11:19:04.979 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-26T11:19:04.979 INFO:teuthology.orchestra.run.smithi107.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T11:19:04.979 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T11:19:04.979 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T11:19:04.979 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T11:19:04.980 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-26T11:19:04.981 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-04-26T11:19:04.981 INFO:teuthology.orchestra.run.smithi107.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-26T11:19:04.981 INFO:teuthology.orchestra.run.smithi107.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-26T11:19:04.981 INFO:teuthology.orchestra.run.smithi107.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-26T11:19:04.981 INFO:teuthology.orchestra.run.smithi107.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-26T11:19:04.981 INFO:teuthology.orchestra.run.smithi107.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-26T11:19:04.981 INFO:teuthology.orchestra.run.smithi107.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-26T11:19:04.981 INFO:teuthology.orchestra.run.smithi107.stdout: python3-watchdog 2024-04-26T11:19:04.981 INFO:teuthology.orchestra.run.smithi107.stdout:Recommended packages: 2024-04-26T11:19:04.981 INFO:teuthology.orchestra.run.smithi107.stdout: btrfs-tools 2024-04-26T11:19:04.988 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:19:04.988 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:19:04.988 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:19:04.988 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:19:04.989 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:19:04.989 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:19:04.989 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:19:04.990 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-04-26T11:19:04.990 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T11:19:04.990 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T11:19:04.990 INFO:teuthology.orchestra.run.smithi175.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-26T11:19:04.990 INFO:teuthology.orchestra.run.smithi175.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T11:19:04.991 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-26T11:19:04.991 INFO:teuthology.orchestra.run.smithi175.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T11:19:04.991 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T11:19:04.991 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T11:19:04.991 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T11:19:04.992 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-26T11:19:04.993 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-04-26T11:19:04.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-26T11:19:04.993 INFO:teuthology.orchestra.run.smithi175.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-26T11:19:04.993 INFO:teuthology.orchestra.run.smithi175.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-26T11:19:04.993 INFO:teuthology.orchestra.run.smithi175.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-26T11:19:04.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-26T11:19:04.993 INFO:teuthology.orchestra.run.smithi175.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-26T11:19:04.993 INFO:teuthology.orchestra.run.smithi175.stdout: python3-watchdog 2024-04-26T11:19:04.993 INFO:teuthology.orchestra.run.smithi175.stdout:Recommended packages: 2024-04-26T11:19:04.993 INFO:teuthology.orchestra.run.smithi175.stdout: btrfs-tools 2024-04-26T11:19:05.025 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:19:05.025 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:19:05.025 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:19:05.025 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:19:05.026 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:19:05.026 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:19:05.026 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:19:05.026 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-04-26T11:19:05.026 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T11:19:05.027 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T11:19:05.027 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-26T11:19:05.027 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T11:19:05.028 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-26T11:19:05.028 INFO:teuthology.orchestra.run.smithi073.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T11:19:05.028 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T11:19:05.028 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T11:19:05.028 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T11:19:05.028 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T11:19:05.028 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T11:19:05.028 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T11:19:05.028 INFO:teuthology.orchestra.run.smithi073.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:19:05.029 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T11:19:05.029 INFO:teuthology.orchestra.run.smithi073.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T11:19:05.029 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T11:19:05.029 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T11:19:05.029 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T11:19:05.029 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T11:19:05.029 INFO:teuthology.orchestra.run.smithi073.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T11:19:05.029 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T11:19:05.029 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-26T11:19:05.029 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-04-26T11:19:05.030 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-26T11:19:05.030 INFO:teuthology.orchestra.run.smithi073.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-26T11:19:05.030 INFO:teuthology.orchestra.run.smithi073.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-26T11:19:05.030 INFO:teuthology.orchestra.run.smithi073.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-26T11:19:05.030 INFO:teuthology.orchestra.run.smithi073.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-26T11:19:05.030 INFO:teuthology.orchestra.run.smithi073.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-26T11:19:05.030 INFO:teuthology.orchestra.run.smithi073.stdout: python3-watchdog 2024-04-26T11:19:05.030 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2024-04-26T11:19:05.030 INFO:teuthology.orchestra.run.smithi073.stdout: btrfs-tools 2024-04-26T11:19:05.061 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:19:05.061 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:19:05.061 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:19:05.061 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:19:05.062 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:19:05.062 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:19:05.063 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:19:05.063 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2024-04-26T11:19:05.063 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T11:19:05.064 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T11:19:05.064 INFO:teuthology.orchestra.run.smithi088.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-26T11:19:05.064 INFO:teuthology.orchestra.run.smithi088.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T11:19:05.064 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T11:19:05.065 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: python3-watchdog 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout:Recommended packages: 2024-04-26T11:19:05.066 INFO:teuthology.orchestra.run.smithi088.stdout: btrfs-tools 2024-04-26T11:19:05.081 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-04-26T11:19:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T11:19:05.081 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T11:19:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T11:19:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-26T11:19:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-26T11:19:05.082 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-26T11:19:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-26T11:19:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T11:19:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T11:19:05.083 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T11:19:05.084 INFO:teuthology.orchestra.run.smithi107.stdout: socat xmlstarlet 2024-04-26T11:19:05.089 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-04-26T11:19:05.090 INFO:teuthology.orchestra.run.smithi175.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T11:19:05.090 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T11:19:05.090 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T11:19:05.091 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-26T11:19:05.091 INFO:teuthology.orchestra.run.smithi175.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-26T11:19:05.091 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-26T11:19:05.091 INFO:teuthology.orchestra.run.smithi175.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-26T11:19:05.091 INFO:teuthology.orchestra.run.smithi175.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T11:19:05.091 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T11:19:05.091 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-26T11:19:05.091 INFO:teuthology.orchestra.run.smithi175.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T11:19:05.091 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T11:19:05.091 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T11:19:05.092 INFO:teuthology.orchestra.run.smithi175.stdout: socat xmlstarlet 2024-04-26T11:19:05.129 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-04-26T11:19:05.129 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T11:19:05.129 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T11:19:05.129 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T11:19:05.129 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-26T11:19:05.129 INFO:teuthology.orchestra.run.smithi073.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-26T11:19:05.130 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-26T11:19:05.130 INFO:teuthology.orchestra.run.smithi073.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T11:19:05.131 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T11:19:05.132 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T11:19:05.132 INFO:teuthology.orchestra.run.smithi073.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T11:19:05.132 INFO:teuthology.orchestra.run.smithi073.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T11:19:05.132 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T11:19:05.132 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T11:19:05.132 INFO:teuthology.orchestra.run.smithi073.stdout: socat xmlstarlet 2024-04-26T11:19:05.149 INFO:teuthology.orchestra.run.smithi107.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T11:19:05.149 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 162 MB of archives. 2024-04-26T11:19:05.150 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-26T11:19:05.150 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-26T11:19:05.162 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2024-04-26T11:19:05.162 INFO:teuthology.orchestra.run.smithi088.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T11:19:05.163 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T11:19:05.163 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T11:19:05.163 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2024-04-26T11:19:05.163 INFO:teuthology.orchestra.run.smithi088.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-04-26T11:19:05.163 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-26T11:19:05.163 INFO:teuthology.orchestra.run.smithi175.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T11:19:05.164 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 162 MB of archives. 2024-04-26T11:19:05.164 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-26T11:19:05.164 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-26T11:19:05.164 INFO:teuthology.orchestra.run.smithi088.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-26T11:19:05.164 INFO:teuthology.orchestra.run.smithi088.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-26T11:19:05.164 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T11:19:05.164 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-26T11:19:05.165 INFO:teuthology.orchestra.run.smithi088.stdout: socat xmlstarlet 2024-04-26T11:19:05.195 INFO:teuthology.orchestra.run.smithi073.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T11:19:05.196 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 162 MB of archives. 2024-04-26T11:19:05.196 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-26T11:19:05.196 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-26T11:19:05.222 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T11:19:05.224 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1jammy [3,440 kB] 2024-04-26T11:19:05.228 INFO:teuthology.orchestra.run.smithi088.stdout:0 upgraded, 109 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T11:19:05.228 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 162 MB of archives. 2024-04-26T11:19:05.228 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 743 MB of additional disk space will be used. 2024-04-26T11:19:05.228 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-26T11:19:05.230 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T11:19:05.267 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T11:19:05.267 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T11:19:05.271 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T11:19:05.274 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T11:19:05.278 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T11:19:05.291 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T11:19:05.297 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T11:19:05.302 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T11:19:05.309 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1jammy [3,440 kB] 2024-04-26T11:19:05.320 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T11:19:05.324 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T11:19:05.355 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T11:19:05.369 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T11:19:05.370 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T11:19:05.374 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1jammy [3,440 kB] 2024-04-26T11:19:05.377 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T11:19:05.377 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T11:19:05.379 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T11:19:05.385 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T11:19:05.395 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T11:19:05.401 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T11:19:05.402 INFO:teuthology.orchestra.run.smithi107.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T11:19:05.403 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T11:19:05.403 INFO:teuthology.orchestra.run.smithi107.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T11:19:05.411 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T11:19:05.412 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T11:19:05.413 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T11:19:05.418 INFO:teuthology.orchestra.run.smithi107.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T11:19:05.419 INFO:teuthology.orchestra.run.smithi107.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T11:19:05.420 INFO:teuthology.orchestra.run.smithi107.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T11:19:05.425 INFO:teuthology.orchestra.run.smithi107.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T11:19:05.428 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T11:19:05.429 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T11:19:05.430 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T11:19:05.431 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T11:19:05.433 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T11:19:05.434 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1jammy [3,440 kB] 2024-04-26T11:19:05.450 INFO:teuthology.orchestra.run.smithi107.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T11:19:05.450 INFO:teuthology.orchestra.run.smithi107.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T11:19:05.451 INFO:teuthology.orchestra.run.smithi107.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T11:19:05.452 INFO:teuthology.orchestra.run.smithi107.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T11:19:05.452 INFO:teuthology.orchestra.run.smithi107.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T11:19:05.453 INFO:teuthology.orchestra.run.smithi107.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T11:19:05.457 INFO:teuthology.orchestra.run.smithi107.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T11:19:05.458 INFO:teuthology.orchestra.run.smithi107.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T11:19:05.459 INFO:teuthology.orchestra.run.smithi107.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T11:19:05.461 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T11:19:05.461 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T11:19:05.462 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T11:19:05.463 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T11:19:05.463 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T11:19:05.464 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T11:19:05.477 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T11:19:05.484 INFO:teuthology.orchestra.run.smithi107.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T11:19:05.484 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T11:19:05.485 INFO:teuthology.orchestra.run.smithi107.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T11:19:05.486 INFO:teuthology.orchestra.run.smithi107.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T11:19:05.487 INFO:teuthology.orchestra.run.smithi107.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T11:19:05.491 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T11:19:05.492 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T11:19:05.492 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T11:19:05.493 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T11:19:05.506 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T11:19:05.512 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T11:19:05.513 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T11:19:05.514 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T11:19:05.520 INFO:teuthology.orchestra.run.smithi107.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T11:19:05.521 INFO:teuthology.orchestra.run.smithi107.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T11:19:05.522 INFO:teuthology.orchestra.run.smithi107.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T11:19:05.529 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T11:19:05.531 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T11:19:05.531 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T11:19:05.532 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T11:19:05.533 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T11:19:05.533 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T11:19:05.533 INFO:teuthology.orchestra.run.smithi107.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T11:19:05.534 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T11:19:05.535 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T11:19:05.537 INFO:teuthology.orchestra.run.smithi107.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T11:19:05.537 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T11:19:05.538 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T11:19:05.541 INFO:teuthology.orchestra.run.smithi107.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T11:19:05.553 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T11:19:05.557 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T11:19:05.557 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T11:19:05.558 INFO:teuthology.orchestra.run.smithi107.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T11:19:05.558 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T11:19:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T11:19:05.559 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T11:19:05.560 INFO:teuthology.orchestra.run.smithi107.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T11:19:05.563 INFO:teuthology.orchestra.run.smithi107.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T11:19:05.565 INFO:teuthology.orchestra.run.smithi107.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T11:19:05.566 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T11:19:05.566 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T11:19:05.567 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T11:19:05.568 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T11:19:05.578 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T11:19:05.584 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T11:19:05.584 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T11:19:05.586 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T11:19:05.589 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T11:19:05.590 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T11:19:05.592 INFO:teuthology.orchestra.run.smithi107.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T11:19:05.595 INFO:teuthology.orchestra.run.smithi107.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T11:19:05.595 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T11:19:05.596 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T11:19:05.597 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T11:19:05.598 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T11:19:05.598 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T11:19:05.599 INFO:teuthology.orchestra.run.smithi107.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T11:19:05.599 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T11:19:05.600 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T11:19:05.600 INFO:teuthology.orchestra.run.smithi107.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T11:19:05.601 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T11:19:05.602 INFO:teuthology.orchestra.run.smithi107.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T11:19:05.606 INFO:teuthology.orchestra.run.smithi107.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T11:19:05.607 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T11:19:05.611 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T11:19:05.612 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T11:19:05.616 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T11:19:05.617 INFO:teuthology.orchestra.run.smithi175.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T11:19:05.622 INFO:teuthology.orchestra.run.smithi175.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T11:19:05.634 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T11:19:05.635 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T11:19:05.636 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T11:19:05.638 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T11:19:05.639 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T11:19:05.639 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T11:19:05.639 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T11:19:05.640 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T11:19:05.640 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T11:19:05.646 INFO:teuthology.orchestra.run.smithi175.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T11:19:05.648 INFO:teuthology.orchestra.run.smithi175.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T11:19:05.653 INFO:teuthology.orchestra.run.smithi175.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T11:19:05.682 INFO:teuthology.orchestra.run.smithi107.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1jammy [3,106 kB] 2024-04-26T11:19:05.693 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T11:19:05.694 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T11:19:05.698 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T11:19:05.704 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T11:19:05.705 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T11:19:05.705 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T11:19:05.706 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T11:19:05.706 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T11:19:05.706 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T11:19:05.707 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T11:19:05.707 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T11:19:05.743 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T11:19:05.747 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T11:19:05.747 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T11:19:05.747 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T11:19:05.748 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T11:19:05.748 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T11:19:05.751 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T11:19:05.751 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T11:19:05.752 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T11:19:05.755 INFO:teuthology.orchestra.run.smithi107.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T11:19:05.757 INFO:teuthology.orchestra.run.smithi107.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T11:19:05.759 INFO:teuthology.orchestra.run.smithi107.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T11:19:05.760 INFO:teuthology.orchestra.run.smithi107.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T11:19:05.762 INFO:teuthology.orchestra.run.smithi107.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T11:19:05.762 INFO:teuthology.orchestra.run.smithi107.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T11:19:05.763 INFO:teuthology.orchestra.run.smithi107.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T11:19:05.768 INFO:teuthology.orchestra.run.smithi107.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T11:19:05.769 INFO:teuthology.orchestra.run.smithi107.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T11:19:05.772 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T11:19:05.776 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T11:19:05.776 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T11:19:05.777 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T11:19:05.779 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T11:19:05.783 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T11:19:05.786 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T11:19:05.787 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T11:19:05.789 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T11:19:05.789 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T11:19:05.803 INFO:teuthology.orchestra.run.smithi107.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T11:19:05.804 INFO:teuthology.orchestra.run.smithi175.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T11:19:05.806 INFO:teuthology.orchestra.run.smithi175.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T11:19:05.807 INFO:teuthology.orchestra.run.smithi175.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T11:19:05.808 INFO:teuthology.orchestra.run.smithi175.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T11:19:05.809 INFO:teuthology.orchestra.run.smithi175.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T11:19:05.809 INFO:teuthology.orchestra.run.smithi175.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T11:19:05.810 INFO:teuthology.orchestra.run.smithi175.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T11:19:05.813 INFO:teuthology.orchestra.run.smithi175.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T11:19:05.814 INFO:teuthology.orchestra.run.smithi175.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T11:19:05.818 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T11:19:05.822 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T11:19:05.823 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T11:19:05.826 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T11:19:05.828 INFO:teuthology.orchestra.run.smithi088.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T11:19:05.871 INFO:teuthology.orchestra.run.smithi107.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T11:19:05.873 INFO:teuthology.orchestra.run.smithi175.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T11:19:05.873 INFO:teuthology.orchestra.run.smithi107.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1jammy [680 kB] 2024-04-26T11:19:05.875 INFO:teuthology.orchestra.run.smithi107.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T11:19:05.876 INFO:teuthology.orchestra.run.smithi107.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T11:19:05.881 INFO:teuthology.orchestra.run.smithi088.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T11:19:05.910 INFO:teuthology.orchestra.run.smithi107.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1jammy [356 kB] 2024-04-26T11:19:05.918 INFO:teuthology.orchestra.run.smithi107.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1jammy [32.8 kB] 2024-04-26T11:19:05.929 INFO:teuthology.orchestra.run.smithi088.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T11:19:05.929 INFO:teuthology.orchestra.run.smithi107.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1jammy [180 kB] 2024-04-26T11:19:05.930 INFO:teuthology.orchestra.run.smithi088.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T11:19:05.933 INFO:teuthology.orchestra.run.smithi107.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1jammy [63.7 kB] 2024-04-26T11:19:05.935 INFO:teuthology.orchestra.run.smithi107.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1jammy [330 kB] 2024-04-26T11:19:05.935 INFO:teuthology.orchestra.run.smithi088.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T11:19:05.935 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T11:19:05.937 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T11:19:05.941 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T11:19:05.953 INFO:teuthology.orchestra.run.smithi107.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1jammy [5,891 kB] 2024-04-26T11:19:05.953 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T11:19:05.955 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T11:19:05.956 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T11:19:05.957 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T11:19:05.962 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T11:19:05.963 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T11:19:05.966 INFO:teuthology.orchestra.run.smithi175.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T11:19:05.972 INFO:teuthology.orchestra.run.smithi107.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T11:19:05.972 INFO:teuthology.orchestra.run.smithi175.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T11:19:05.973 INFO:teuthology.orchestra.run.smithi107.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T11:19:05.973 INFO:teuthology.orchestra.run.smithi175.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T11:19:05.974 INFO:teuthology.orchestra.run.smithi107.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T11:19:05.975 INFO:teuthology.orchestra.run.smithi107.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T11:19:05.977 INFO:teuthology.orchestra.run.smithi107.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T11:19:05.978 INFO:teuthology.orchestra.run.smithi107.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T11:19:05.978 INFO:teuthology.orchestra.run.smithi107.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T11:19:05.980 INFO:teuthology.orchestra.run.smithi107.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T11:19:05.982 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T11:19:05.987 INFO:teuthology.orchestra.run.smithi107.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T11:19:06.019 INFO:teuthology.orchestra.run.smithi175.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T11:19:06.019 INFO:teuthology.orchestra.run.smithi175.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T11:19:06.021 INFO:teuthology.orchestra.run.smithi175.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T11:19:06.023 INFO:teuthology.orchestra.run.smithi175.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T11:19:06.024 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T11:19:06.025 INFO:teuthology.orchestra.run.smithi175.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T11:19:06.027 INFO:teuthology.orchestra.run.smithi175.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T11:19:06.028 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T11:19:06.028 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T11:19:06.037 INFO:teuthology.orchestra.run.smithi175.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T11:19:06.039 INFO:teuthology.orchestra.run.smithi107.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T11:19:06.100 INFO:teuthology.orchestra.run.smithi107.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T11:19:06.100 INFO:teuthology.orchestra.run.smithi088.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T11:19:06.101 INFO:teuthology.orchestra.run.smithi107.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T11:19:06.102 INFO:teuthology.orchestra.run.smithi088.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T11:19:06.106 INFO:teuthology.orchestra.run.smithi088.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T11:19:06.106 INFO:teuthology.orchestra.run.smithi088.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T11:19:06.108 INFO:teuthology.orchestra.run.smithi088.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T11:19:06.109 INFO:teuthology.orchestra.run.smithi088.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T11:19:06.109 INFO:teuthology.orchestra.run.smithi107.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T11:19:06.110 INFO:teuthology.orchestra.run.smithi088.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T11:19:06.110 INFO:teuthology.orchestra.run.smithi175.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T11:19:06.115 INFO:teuthology.orchestra.run.smithi088.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T11:19:06.116 INFO:teuthology.orchestra.run.smithi107.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T11:19:06.116 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T11:19:06.116 INFO:teuthology.orchestra.run.smithi088.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T11:19:06.117 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T11:19:06.118 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T11:19:06.119 INFO:teuthology.orchestra.run.smithi175.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T11:19:06.119 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T11:19:06.120 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T11:19:06.121 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T11:19:06.122 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T11:19:06.123 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T11:19:06.123 INFO:teuthology.orchestra.run.smithi175.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T11:19:06.125 INFO:teuthology.orchestra.run.smithi088.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T11:19:06.127 INFO:teuthology.orchestra.run.smithi107.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T11:19:06.127 INFO:teuthology.orchestra.run.smithi175.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T11:19:06.128 INFO:teuthology.orchestra.run.smithi175.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T11:19:06.130 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T11:19:06.134 INFO:teuthology.orchestra.run.smithi107.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T11:19:06.135 INFO:teuthology.orchestra.run.smithi107.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T11:19:06.139 INFO:teuthology.orchestra.run.smithi107.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T11:19:06.141 INFO:teuthology.orchestra.run.smithi175.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T11:19:06.142 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T11:19:06.152 INFO:teuthology.orchestra.run.smithi175.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T11:19:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T11:19:06.153 INFO:teuthology.orchestra.run.smithi107.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T11:19:06.154 INFO:teuthology.orchestra.run.smithi107.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T11:19:06.177 INFO:teuthology.orchestra.run.smithi107.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1jammy [112 kB] 2024-04-26T11:19:06.178 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T11:19:06.180 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T11:19:06.181 INFO:teuthology.orchestra.run.smithi107.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1jammy [441 kB] 2024-04-26T11:19:06.182 INFO:teuthology.orchestra.run.smithi175.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T11:19:06.187 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T11:19:06.192 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T11:19:06.198 INFO:teuthology.orchestra.run.smithi107.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1jammy [21.9 MB] 2024-04-26T11:19:06.202 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T11:19:06.204 INFO:teuthology.orchestra.run.smithi175.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T11:19:06.208 INFO:teuthology.orchestra.run.smithi175.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T11:19:06.208 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T11:19:06.209 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T11:19:06.212 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T11:19:06.291 INFO:teuthology.orchestra.run.smithi088.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T11:19:06.296 INFO:teuthology.orchestra.run.smithi088.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T11:19:06.297 INFO:teuthology.orchestra.run.smithi088.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T11:19:06.303 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T11:19:06.303 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T11:19:06.305 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T11:19:06.308 INFO:teuthology.orchestra.run.smithi175.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T11:19:06.324 INFO:teuthology.orchestra.run.smithi175.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T11:19:06.325 INFO:teuthology.orchestra.run.smithi175.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T11:19:06.327 INFO:teuthology.orchestra.run.smithi175.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T11:19:06.336 INFO:teuthology.orchestra.run.smithi088.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T11:19:06.336 INFO:teuthology.orchestra.run.smithi088.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T11:19:06.337 INFO:teuthology.orchestra.run.smithi088.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T11:19:06.338 INFO:teuthology.orchestra.run.smithi088.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T11:19:06.338 INFO:teuthology.orchestra.run.smithi088.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T11:19:06.339 INFO:teuthology.orchestra.run.smithi088.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T11:19:06.340 INFO:teuthology.orchestra.run.smithi088.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T11:19:06.341 INFO:teuthology.orchestra.run.smithi088.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T11:19:06.347 INFO:teuthology.orchestra.run.smithi088.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T11:19:06.357 INFO:teuthology.orchestra.run.smithi088.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T11:19:06.372 INFO:teuthology.orchestra.run.smithi088.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T11:19:06.373 INFO:teuthology.orchestra.run.smithi088.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T11:19:06.380 INFO:teuthology.orchestra.run.smithi088.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T11:19:06.387 INFO:teuthology.orchestra.run.smithi088.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T11:19:06.400 INFO:teuthology.orchestra.run.smithi088.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T11:19:06.412 INFO:teuthology.orchestra.run.smithi088.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T11:19:06.413 INFO:teuthology.orchestra.run.smithi088.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T11:19:06.418 INFO:teuthology.orchestra.run.smithi088.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T11:19:06.436 INFO:teuthology.orchestra.run.smithi088.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T11:19:06.436 INFO:teuthology.orchestra.run.smithi088.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T11:19:06.437 INFO:teuthology.orchestra.run.smithi088.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T11:19:06.972 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1jammy [3,106 kB] 2024-04-26T11:19:07.124 INFO:teuthology.orchestra.run.smithi107.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1jammy [5,002 kB] 2024-04-26T11:19:07.329 INFO:teuthology.orchestra.run.smithi107.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1jammy [241 kB] 2024-04-26T11:19:07.334 INFO:teuthology.orchestra.run.smithi107.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1jammy [130 kB] 2024-04-26T11:19:07.338 INFO:teuthology.orchestra.run.smithi107.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1jammy [1,490 kB] 2024-04-26T11:19:07.366 INFO:teuthology.orchestra.run.smithi107.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1jammy [6,079 kB] 2024-04-26T11:19:07.537 INFO:teuthology.orchestra.run.smithi088.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1jammy [3,106 kB] 2024-04-26T11:19:07.591 INFO:teuthology.orchestra.run.smithi107.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1jammy [22.3 MB] 2024-04-26T11:19:07.644 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1jammy [680 kB] 2024-04-26T11:19:07.758 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1jammy [356 kB] 2024-04-26T11:19:07.821 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1jammy [32.8 kB] 2024-04-26T11:19:07.824 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1jammy [180 kB] 2024-04-26T11:19:07.850 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1jammy [63.7 kB] 2024-04-26T11:19:07.857 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1jammy [330 kB] 2024-04-26T11:19:07.908 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1jammy [5,891 kB] 2024-04-26T11:19:08.671 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1jammy [112 kB] 2024-04-26T11:19:08.682 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1jammy [441 kB] 2024-04-26T11:19:08.731 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1jammy [21.9 MB] 2024-04-26T11:19:08.744 INFO:teuthology.orchestra.run.smithi107.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1jammy [14.1 kB] 2024-04-26T11:19:08.745 INFO:teuthology.orchestra.run.smithi107.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1jammy [831 kB] 2024-04-26T11:19:08.761 INFO:teuthology.orchestra.run.smithi107.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1jammy [2,154 kB] 2024-04-26T11:19:08.806 INFO:teuthology.orchestra.run.smithi107.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1jammy [238 kB] 2024-04-26T11:19:08.816 INFO:teuthology.orchestra.run.smithi107.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1jammy [144 kB] 2024-04-26T11:19:08.820 INFO:teuthology.orchestra.run.smithi107.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1jammy [2,238 kB] 2024-04-26T11:19:08.940 INFO:teuthology.orchestra.run.smithi107.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1jammy [8,625 kB] 2024-04-26T11:19:09.404 INFO:teuthology.orchestra.run.smithi107.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1jammy [14.3 kB] 2024-04-26T11:19:09.405 INFO:teuthology.orchestra.run.smithi107.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1jammy [42.6 MB] 2024-04-26T11:19:09.706 INFO:teuthology.orchestra.run.smithi088.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1jammy [680 kB] 2024-04-26T11:19:10.149 INFO:teuthology.orchestra.run.smithi088.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1jammy [356 kB] 2024-04-26T11:19:10.346 INFO:teuthology.orchestra.run.smithi175.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1jammy [3,106 kB] 2024-04-26T11:19:10.375 INFO:teuthology.orchestra.run.smithi088.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1jammy [32.8 kB] 2024-04-26T11:19:10.377 INFO:teuthology.orchestra.run.smithi088.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1jammy [180 kB] 2024-04-26T11:19:10.504 INFO:teuthology.orchestra.run.smithi088.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1jammy [63.7 kB] 2024-04-26T11:19:10.531 INFO:teuthology.orchestra.run.smithi088.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1jammy [330 kB] 2024-04-26T11:19:10.761 INFO:teuthology.orchestra.run.smithi088.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1jammy [5,891 kB] 2024-04-26T11:19:11.036 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1jammy [5,002 kB] 2024-04-26T11:19:11.441 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1jammy [241 kB] 2024-04-26T11:19:11.460 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1jammy [130 kB] 2024-04-26T11:19:11.480 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1jammy [1,490 kB] 2024-04-26T11:19:11.617 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1jammy [6,079 kB] 2024-04-26T11:19:11.943 INFO:teuthology.orchestra.run.smithi107.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1jammy [121 kB] 2024-04-26T11:19:11.945 INFO:teuthology.orchestra.run.smithi107.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1jammy [38.3 kB] 2024-04-26T11:19:11.947 INFO:teuthology.orchestra.run.smithi107.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1jammy [11.6 MB] 2024-04-26T11:19:12.175 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1jammy [22.3 MB] 2024-04-26T11:19:12.452 INFO:teuthology.orchestra.run.smithi107.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1jammy [93.2 kB] 2024-04-26T11:19:13.010 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 162 MB in 7s (22.0 MB/s) 2024-04-26T11:19:13.026 INFO:teuthology.orchestra.run.smithi175.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1jammy [680 kB] 2024-04-26T11:19:13.111 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-26T11:19:13.205 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T11:19:13.210 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-26T11:19:13.242 INFO:teuthology.orchestra.run.smithi088.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1jammy [112 kB] 2024-04-26T11:19:13.266 INFO:teuthology.orchestra.run.smithi088.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1jammy [441 kB] 2024-04-26T11:19:13.290 INFO:teuthology.orchestra.run.smithi175.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1jammy [356 kB] 2024-04-26T11:19:13.293 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-26T11:19:13.369 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1jammy [14.1 kB] 2024-04-26T11:19:13.369 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1jammy [831 kB] 2024-04-26T11:19:13.384 INFO:teuthology.orchestra.run.smithi088.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1jammy [21.9 MB] 2024-04-26T11:19:13.385 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1jammy [2,154 kB] 2024-04-26T11:19:13.433 INFO:teuthology.orchestra.run.smithi175.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1jammy [32.8 kB] 2024-04-26T11:19:13.434 INFO:teuthology.orchestra.run.smithi175.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1jammy [180 kB] 2024-04-26T11:19:13.447 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1jammy [238 kB] 2024-04-26T11:19:13.452 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1jammy [144 kB] 2024-04-26T11:19:13.455 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1jammy [2,238 kB] 2024-04-26T11:19:13.510 INFO:teuthology.orchestra.run.smithi175.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1jammy [63.7 kB] 2024-04-26T11:19:13.548 INFO:teuthology.orchestra.run.smithi175.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1jammy [330 kB] 2024-04-26T11:19:13.554 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1jammy [8,625 kB] 2024-04-26T11:19:13.622 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T11:19:13.648 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T11:19:13.665 INFO:teuthology.orchestra.run.smithi175.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1jammy [5,891 kB] 2024-04-26T11:19:13.688 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T11:19:13.918 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1jammy [14.3 kB] 2024-04-26T11:19:13.918 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1jammy [42.6 MB] 2024-04-26T11:19:14.001 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T11:19:14.027 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T11:19:14.067 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T11:19:14.395 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T11:19:14.421 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T11:19:14.462 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T11:19:14.915 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T11:19:14.942 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:14.998 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:15.377 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T11:19:15.403 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:15.443 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:15.714 INFO:teuthology.orchestra.run.smithi175.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1jammy [112 kB] 2024-04-26T11:19:15.758 INFO:teuthology.orchestra.run.smithi175.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1jammy [441 kB] 2024-04-26T11:19:15.875 INFO:teuthology.orchestra.run.smithi175.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1jammy [21.9 MB] 2024-04-26T11:19:15.991 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T11:19:16.017 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:16.096 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:16.110 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1jammy [121 kB] 2024-04-26T11:19:16.112 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1jammy [38.3 kB] 2024-04-26T11:19:16.113 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1jammy [11.6 MB] 2024-04-26T11:19:16.433 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T11:19:16.460 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T11:19:16.491 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T11:19:16.495 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1jammy [93.2 kB] 2024-04-26T11:19:16.761 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librados2. 2024-04-26T11:19:16.787 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:16.827 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:17.047 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 162 MB in 11s (14.3 MB/s) 2024-04-26T11:19:17.174 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-26T11:19:17.257 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T11:19:17.262 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-26T11:19:17.272 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librbd1. 2024-04-26T11:19:17.299 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../009-librbd1_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:17.331 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-26T11:19:17.338 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:17.651 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T11:19:17.678 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T11:19:17.718 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T11:19:17.728 INFO:teuthology.orchestra.run.smithi088.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1jammy [5,002 kB] 2024-04-26T11:19:17.775 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T11:19:17.801 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:17.858 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:18.071 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T11:19:18.098 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T11:19:18.128 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rados. 2024-04-26T11:19:18.138 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T11:19:18.154 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:18.186 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:18.239 INFO:teuthology.orchestra.run.smithi088.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1jammy [241 kB] 2024-04-26T11:19:18.270 INFO:teuthology.orchestra.run.smithi088.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1jammy [130 kB] 2024-04-26T11:19:18.275 INFO:teuthology.orchestra.run.smithi088.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1jammy [1,490 kB] 2024-04-26T11:19:18.446 INFO:teuthology.orchestra.run.smithi088.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1jammy [6,079 kB] 2024-04-26T11:19:18.474 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T11:19:18.497 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T11:19:18.501 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T11:19:18.524 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:18.541 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T11:19:18.563 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:18.783 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T11:19:18.798 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:18.841 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:18.963 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T11:19:18.990 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:19.005 INFO:teuthology.orchestra.run.smithi088.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1jammy [22.3 MB] 2024-04-26T11:19:19.038 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:19.161 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T11:19:19.187 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:19.219 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:19.315 INFO:teuthology.orchestra.run.smithi175.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1jammy [5,002 kB] 2024-04-26T11:19:19.433 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T11:19:19.460 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:19.491 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:19.530 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T11:19:19.557 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T11:19:19.597 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T11:19:19.819 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T11:19:19.846 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:19.886 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:19.891 INFO:teuthology.orchestra.run.smithi175.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1jammy [241 kB] 2024-04-26T11:19:19.902 INFO:teuthology.orchestra.run.smithi175.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1jammy [130 kB] 2024-04-26T11:19:19.908 INFO:teuthology.orchestra.run.smithi175.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1jammy [1,490 kB] 2024-04-26T11:19:19.917 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T11:19:19.943 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T11:19:19.983 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T11:19:20.122 INFO:teuthology.orchestra.run.smithi175.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1jammy [6,079 kB] 2024-04-26T11:19:20.214 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T11:19:20.227 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T11:19:20.230 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T11:19:20.243 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:20.272 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T11:19:20.277 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:20.547 INFO:teuthology.orchestra.run.smithi175.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1jammy [22.3 MB] 2024-04-26T11:19:20.567 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librados2. 2024-04-26T11:19:20.583 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:20.617 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:20.622 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T11:19:20.649 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T11:19:20.689 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T11:19:21.034 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package librgw2. 2024-04-26T11:19:21.037 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librbd1. 2024-04-26T11:19:21.061 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:21.063 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-librbd1_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:21.088 INFO:teuthology.orchestra.run.smithi088.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1jammy [14.1 kB] 2024-04-26T11:19:21.088 INFO:teuthology.orchestra.run.smithi088.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1jammy [831 kB] 2024-04-26T11:19:21.101 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:21.105 INFO:teuthology.orchestra.run.smithi088.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1jammy [2,154 kB] 2024-04-26T11:19:21.119 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:21.215 INFO:teuthology.orchestra.run.smithi088.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1jammy [238 kB] 2024-04-26T11:19:21.223 INFO:teuthology.orchestra.run.smithi088.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1jammy [144 kB] 2024-04-26T11:19:21.228 INFO:teuthology.orchestra.run.smithi088.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1jammy [2,238 kB] 2024-04-26T11:19:21.374 INFO:teuthology.orchestra.run.smithi088.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1jammy [8,625 kB] 2024-04-26T11:19:21.565 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T11:19:21.591 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:21.611 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T11:19:21.627 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:21.631 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:21.679 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:21.945 INFO:teuthology.orchestra.run.smithi088.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1jammy [14.3 kB] 2024-04-26T11:19:21.947 INFO:teuthology.orchestra.run.smithi088.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1jammy [42.6 MB] 2024-04-26T11:19:21.998 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T11:19:22.024 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T11:19:22.064 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T11:19:22.094 INFO:teuthology.orchestra.run.smithi175.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1jammy [14.1 kB] 2024-04-26T11:19:22.095 INFO:teuthology.orchestra.run.smithi175.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1jammy [831 kB] 2024-04-26T11:19:22.109 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2024-04-26T11:19:22.111 INFO:teuthology.orchestra.run.smithi175.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1jammy [2,154 kB] 2024-04-26T11:19:22.135 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:22.176 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:22.221 INFO:teuthology.orchestra.run.smithi175.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1jammy [238 kB] 2024-04-26T11:19:22.228 INFO:teuthology.orchestra.run.smithi175.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1jammy [144 kB] 2024-04-26T11:19:22.233 INFO:teuthology.orchestra.run.smithi175.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1jammy [2,238 kB] 2024-04-26T11:19:22.376 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T11:19:22.397 INFO:teuthology.orchestra.run.smithi175.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1jammy [8,625 kB] 2024-04-26T11:19:22.402 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:22.442 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:22.445 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T11:19:22.472 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:22.512 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:22.764 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T11:19:22.791 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:22.812 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-common. 2024-04-26T11:19:22.833 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:22.839 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:22.870 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:22.954 INFO:teuthology.orchestra.run.smithi175.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1jammy [14.3 kB] 2024-04-26T11:19:22.954 INFO:teuthology.orchestra.run.smithi175.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1jammy [42.6 MB] 2024-04-26T11:19:23.142 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T11:19:23.168 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:23.209 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:23.479 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T11:19:23.505 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T11:19:23.545 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T11:19:23.882 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T11:19:23.908 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T11:19:23.948 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T11:19:24.143 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-base. 2024-04-26T11:19:24.167 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T11:19:24.170 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:24.183 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:24.217 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:24.219 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:24.562 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T11:19:24.588 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T11:19:24.629 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T11:19:24.797 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T11:19:24.824 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T11:19:24.864 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T11:19:24.906 INFO:teuthology.orchestra.run.smithi088.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1jammy [121 kB] 2024-04-26T11:19:24.909 INFO:teuthology.orchestra.run.smithi088.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1jammy [38.3 kB] 2024-04-26T11:19:24.910 INFO:teuthology.orchestra.run.smithi088.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1jammy [11.6 MB] 2024-04-26T11:19:24.957 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2024-04-26T11:19:24.984 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:25.023 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:25.150 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T11:19:25.177 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T11:19:25.217 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T11:19:25.512 INFO:teuthology.orchestra.run.smithi088.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1jammy [93.2 kB] 2024-04-26T11:19:25.518 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T11:19:25.523 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T11:19:25.539 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T11:19:25.544 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:25.578 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T11:19:25.584 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:25.777 INFO:teuthology.orchestra.run.smithi175.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1jammy [121 kB] 2024-04-26T11:19:25.779 INFO:teuthology.orchestra.run.smithi175.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1jammy [38.3 kB] 2024-04-26T11:19:25.780 INFO:teuthology.orchestra.run.smithi175.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1jammy [11.6 MB] 2024-04-26T11:19:25.881 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T11:19:25.896 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T11:19:25.910 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T11:19:25.922 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T11:19:25.948 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T11:19:25.963 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T11:19:26.072 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 162 MB in 20s (7,970 kB/s) 2024-04-26T11:19:26.092 INFO:teuthology.orchestra.run.smithi175.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1jammy [93.2 kB] 2024-04-26T11:19:26.187 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-26T11:19:26.274 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T11:19:26.329 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:26.329 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T11:19:26.329 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-26T11:19:26.330 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T11:19:26.330 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T11:19:26.340 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:26.342 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T11:19:26.369 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-26T11:19:26.648 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 162 MB in 21s (7,722 kB/s) 2024-04-26T11:19:26.697 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T11:19:26.723 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T11:19:26.752 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2024-04-26T11:19:26.763 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T11:19:26.771 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T11:19:26.779 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:26.798 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T11:19:26.798 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-26T11:19:26.818 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:26.828 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T11:19:26.899 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T11:19:26.904 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-26T11:19:26.997 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-26T11:19:27.100 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T11:19:27.127 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T11:19:27.140 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-portend. 2024-04-26T11:19:27.167 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T11:19:27.167 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-26T11:19:27.207 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T11:19:27.266 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T11:19:27.293 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T11:19:27.324 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T11:19:27.460 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T11:19:27.463 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T11:19:27.486 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T11:19:27.490 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T11:19:27.518 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T11:19:27.530 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T11:19:27.611 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T11:19:27.638 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T11:19:27.677 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T11:19:27.821 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T11:19:27.848 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T11:19:27.888 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T11:19:27.975 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T11:19:28.002 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:28.005 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T11:19:28.032 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T11:19:28.050 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:28.072 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T11:19:28.108 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2024-04-26T11:19:28.135 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:28.184 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:28.208 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T11:19:28.235 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T11:19:28.266 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T11:19:28.467 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T11:19:28.478 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T11:19:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:28.504 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:28.542 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:28.544 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:28.578 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T11:19:28.605 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T11:19:28.644 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T11:19:28.763 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T11:19:28.778 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T11:19:28.821 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T11:19:28.856 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T11:19:28.883 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:28.911 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T11:19:28.922 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:28.938 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:28.947 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T11:19:28.970 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:28.974 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T11:19:29.014 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T11:19:29.115 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T11:19:29.141 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T11:19:29.182 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T11:19:29.267 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T11:19:29.272 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T11:19:29.284 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-mako. 2024-04-26T11:19:29.294 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T11:19:29.299 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T11:19:29.310 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T11:19:29.333 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T11:19:29.339 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:19:29.358 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T11:19:29.518 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T11:19:29.544 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T11:19:29.585 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T11:19:29.653 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T11:19:29.661 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librados2. 2024-04-26T11:19:29.669 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T11:19:29.683 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T11:19:29.687 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:29.710 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T11:19:29.711 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:19:29.728 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:29.750 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T11:19:29.896 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T11:19:29.922 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T11:19:29.971 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T11:19:29.998 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T11:19:30.025 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T11:19:30.064 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T11:19:30.069 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librados2. 2024-04-26T11:19:30.096 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:30.136 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:30.139 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librbd1. 2024-04-26T11:19:30.166 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../009-librbd1_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:30.197 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:30.224 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T11:19:30.250 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T11:19:30.290 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T11:19:30.368 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webob. 2024-04-26T11:19:30.394 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T11:19:30.434 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T11:19:30.547 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librbd1. 2024-04-26T11:19:30.563 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../009-librbd1_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:30.593 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T11:19:30.618 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T11:19:30.622 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T11:19:30.622 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:30.643 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:30.660 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T11:19:30.683 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:30.754 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T11:19:30.781 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T11:19:30.826 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T11:19:30.971 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-portend. 2024-04-26T11:19:30.998 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-26T11:19:31.038 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T11:19:31.041 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T11:19:31.068 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../010-libcephfs2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:31.099 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T11:19:31.108 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:31.125 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T11:19:31.136 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rados. 2024-04-26T11:19:31.162 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:31.165 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T11:19:31.202 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:31.308 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T11:19:31.334 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T11:19:31.385 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rados. 2024-04-26T11:19:31.391 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T11:19:31.401 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../011-python3-rados_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:31.443 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:31.468 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-paste. 2024-04-26T11:19:31.495 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T11:19:31.535 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T11:19:31.539 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T11:19:31.565 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:31.605 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:31.786 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T11:19:31.812 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T11:19:31.830 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T11:19:31.841 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T11:19:31.852 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T11:19:31.854 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T11:19:31.856 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:31.857 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T11:19:31.870 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:31.891 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:31.901 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T11:19:31.904 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:32.107 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T11:19:32.122 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../013-python3-cephfs_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:32.156 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:32.181 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T11:19:32.193 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T11:19:32.207 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T11:19:32.220 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:32.239 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T11:19:32.260 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:32.308 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T11:19:32.334 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T11:19:32.374 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T11:19:32.442 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T11:19:32.469 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../014-python3-ceph-common_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:32.509 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:32.526 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T11:19:32.552 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T11:19:32.592 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T11:19:32.596 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T11:19:32.623 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T11:19:32.666 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T11:19:32.678 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T11:19:32.705 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T11:19:32.744 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T11:19:32.829 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T11:19:32.855 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T11:19:32.904 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T11:19:32.991 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T11:19:33.013 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T11:19:33.017 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T11:19:33.026 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T11:19:33.057 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T11:19:33.063 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T11:19:33.087 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T11:19:33.113 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T11:19:33.170 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T11:19:33.173 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T11:19:33.200 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T11:19:33.231 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T11:19:33.310 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T11:19:33.325 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:33.360 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:33.452 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T11:19:33.475 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T11:19:33.482 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T11:19:33.482 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2024-04-26T11:19:33.491 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../017-python3-rbd_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:33.508 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T11:19:33.518 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T11:19:33.534 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:33.548 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T11:19:33.704 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T11:19:33.731 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T11:19:33.771 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T11:19:33.838 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-idna. 2024-04-26T11:19:33.851 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T11:19:33.865 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-26T11:19:33.877 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T11:19:33.903 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T11:19:33.904 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T11:19:33.918 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:19:33.929 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T11:19:33.970 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T11:19:34.116 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librgw2. 2024-04-26T11:19:34.142 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:34.174 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:34.204 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T11:19:34.225 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T11:19:34.231 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T11:19:34.252 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T11:19:34.271 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T11:19:34.289 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librgw2. 2024-04-26T11:19:34.291 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T11:19:34.315 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:34.356 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:34.574 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2024-04-26T11:19:34.586 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-requests. 2024-04-26T11:19:34.600 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T11:19:34.613 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T11:19:34.640 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T11:19:34.644 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T11:19:34.659 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T11:19:34.686 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:34.726 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:34.841 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T11:19:34.857 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:34.891 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:34.914 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T11:19:34.929 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T11:19:34.972 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T11:19:35.002 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T11:19:35.028 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T11:19:35.062 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T11:19:35.072 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T11:19:35.089 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T11:19:35.129 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T11:19:35.163 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T11:19:35.189 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T11:19:35.227 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T11:19:35.242 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T11:19:35.258 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:35.292 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:35.372 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T11:19:35.398 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T11:19:35.430 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T11:19:35.448 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T11:19:35.475 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:35.515 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:35.538 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T11:19:35.565 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:35.605 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:35.681 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T11:19:35.708 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:35.733 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2024-04-26T11:19:35.747 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:35.759 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T11:19:35.799 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T11:19:35.876 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-common. 2024-04-26T11:19:35.903 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:35.943 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:36.008 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T11:19:36.025 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-common. 2024-04-26T11:19:36.035 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T11:19:36.051 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:36.067 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T11:19:36.091 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:36.119 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T11:19:36.146 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T11:19:36.177 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T11:19:36.328 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T11:19:36.354 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T11:19:36.394 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T11:19:36.489 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T11:19:36.515 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T11:19:36.555 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T11:19:36.731 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T11:19:36.757 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../057-ceph-mgr_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:36.797 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:36.950 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T11:19:36.977 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T11:19:37.017 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T11:19:37.193 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T11:19:37.219 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../058-ceph-mon_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:37.259 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:37.328 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T11:19:37.354 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T11:19:37.395 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T11:19:37.733 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T11:19:37.759 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T11:19:37.765 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-base. 2024-04-26T11:19:37.792 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:37.799 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T11:19:37.841 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:37.880 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-base. 2024-04-26T11:19:37.907 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:37.956 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:38.119 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-idna. 2024-04-26T11:19:38.146 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-26T11:19:38.186 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T11:19:38.428 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T11:19:38.454 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T11:19:38.494 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T11:19:38.567 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T11:19:38.571 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T11:19:38.594 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T11:19:38.598 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../059-ceph-osd_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:38.634 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T11:19:38.637 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:38.755 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T11:19:38.781 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T11:19:38.830 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T11:19:38.878 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T11:19:38.904 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T11:19:38.936 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T11:19:39.217 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T11:19:39.243 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T11:19:39.266 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T11:19:39.281 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T11:19:39.291 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T11:19:39.293 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T11:19:39.308 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T11:19:39.333 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T11:19:39.348 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T11:19:39.628 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T11:19:39.635 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T11:19:39.654 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T11:19:39.662 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T11:19:39.668 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests. 2024-04-26T11:19:39.683 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph. 2024-04-26T11:19:39.694 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T11:19:39.694 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T11:19:39.699 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../060-ceph_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:39.702 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T11:19:39.734 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T11:19:39.741 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:39.963 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T11:19:39.978 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T11:19:39.997 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T11:19:40.013 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T11:19:40.019 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T11:19:40.024 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T11:19:40.046 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T11:19:40.046 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../061-ceph-fuse_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:40.064 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T11:19:40.072 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T11:19:40.077 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:40.121 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T11:19:40.299 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T11:19:40.326 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T11:19:40.366 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T11:19:40.407 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T11:19:40.408 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T11:19:40.422 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:40.435 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T11:19:40.447 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T11:19:40.465 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:40.474 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../062-ceph-mds_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:40.483 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T11:19:40.514 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:40.652 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-portend. 2024-04-26T11:19:40.678 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-26T11:19:40.718 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T11:19:40.804 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T11:19:40.811 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-portend. 2024-04-26T11:19:40.819 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:40.837 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2024-04-26T11:19:40.854 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:40.877 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T11:19:40.926 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package cephadm. 2024-04-26T11:19:40.952 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../063-cephadm_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:40.992 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:41.021 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T11:19:41.047 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T11:19:41.096 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T11:19:41.165 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T11:19:41.192 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T11:19:41.232 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T11:19:41.304 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T11:19:41.330 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T11:19:41.349 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T11:19:41.370 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T11:19:41.372 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T11:19:41.375 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T11:19:41.399 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T11:19:41.407 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T11:19:41.438 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T11:19:41.518 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T11:19:41.545 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T11:19:41.584 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T11:19:41.690 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T11:19:41.705 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T11:19:41.736 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T11:19:41.741 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T11:19:41.748 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T11:19:41.762 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T11:19:41.767 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T11:19:41.802 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T11:19:41.807 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T11:19:41.896 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T11:19:41.922 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-ceph-mgr_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:41.963 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:42.088 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T11:19:42.103 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T11:19:42.138 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T11:19:42.153 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T11:19:42.179 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T11:19:42.219 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T11:19:42.349 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T11:19:42.376 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-ceph-mon_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:42.408 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T11:19:42.416 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:42.434 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T11:19:42.474 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T11:19:42.564 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T11:19:42.590 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T11:19:42.630 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T11:19:42.777 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-mako. 2024-04-26T11:19:42.803 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T11:19:42.843 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T11:19:42.887 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-babel. 2024-04-26T11:19:42.914 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T11:19:42.933 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T11:19:42.945 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T11:19:42.960 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T11:19:43.000 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T11:19:43.036 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T11:19:43.063 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-ceph-osd_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:43.102 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:43.171 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T11:19:43.198 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T11:19:43.238 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:19:43.265 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T11:19:43.292 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T11:19:43.294 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-mako. 2024-04-26T11:19:43.309 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T11:19:43.340 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T11:19:43.344 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T11:19:43.549 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T11:19:43.575 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T11:19:43.616 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T11:19:43.622 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T11:19:43.638 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T11:19:43.668 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T11:19:43.672 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:19:43.695 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:43.735 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:43.860 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webob. 2024-04-26T11:19:43.886 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T11:19:43.918 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T11:19:43.975 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T11:19:44.001 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T11:19:44.042 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T11:19:44.063 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T11:19:44.090 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T11:19:44.130 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T11:19:44.156 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2024-04-26T11:19:44.172 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-ceph_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:44.206 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:44.237 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T11:19:44.264 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T11:19:44.307 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T11:19:44.336 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webob. 2024-04-26T11:19:44.362 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T11:19:44.403 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T11:19:44.450 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-py. 2024-04-26T11:19:44.477 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-26T11:19:44.509 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T11:19:44.516 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T11:19:44.535 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-ceph-fuse_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:44.575 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:44.640 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T11:19:44.667 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T11:19:44.707 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T11:19:44.756 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T11:19:44.782 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T11:19:44.826 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T11:19:44.862 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T11:19:44.888 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T11:19:44.928 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T11:19:44.929 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T11:19:44.955 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-ceph-mds_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:44.995 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:45.010 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-paste. 2024-04-26T11:19:45.036 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T11:19:45.076 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T11:19:45.117 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T11:19:45.143 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T11:19:45.173 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-toml. 2024-04-26T11:19:45.188 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-26T11:19:45.200 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T11:19:45.240 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T11:19:45.387 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T11:19:45.403 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T11:19:45.415 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2024-04-26T11:19:45.442 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-cephadm_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:45.446 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T11:19:45.474 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:45.478 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-paste. 2024-04-26T11:19:45.504 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T11:19:45.526 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T11:19:45.544 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T11:19:45.553 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T11:19:45.592 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T11:19:45.752 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T11:19:45.757 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T11:19:45.778 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T11:19:45.784 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T11:19:45.818 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T11:19:45.823 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T11:19:45.881 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T11:19:45.888 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T11:19:45.907 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T11:19:45.914 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T11:19:45.946 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T11:19:45.947 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T11:19:46.088 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T11:19:46.103 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T11:19:46.126 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T11:19:46.146 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T11:19:46.153 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T11:19:46.192 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T11:19:46.193 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T11:19:46.204 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T11:19:46.242 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T11:19:46.249 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-routes. 2024-04-26T11:19:46.276 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T11:19:46.316 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T11:19:46.454 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T11:19:46.480 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T11:19:46.512 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T11:19:46.570 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T11:19:46.596 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T11:19:46.636 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T11:19:46.661 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T11:19:46.688 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:46.727 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:46.875 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T11:19:46.902 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T11:19:46.948 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T11:19:46.974 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T11:19:47.014 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T11:19:47.041 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T11:19:47.168 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-babel. 2024-04-26T11:19:47.196 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T11:19:47.235 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T11:19:47.369 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T11:19:47.395 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T11:19:47.402 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-idna. 2024-04-26T11:19:47.429 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-26T11:19:47.435 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T11:19:47.469 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T11:19:47.563 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T11:19:47.590 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T11:19:47.638 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T11:19:47.755 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-idna. 2024-04-26T11:19:47.772 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T11:19:47.781 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2024-04-26T11:19:47.798 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T11:19:47.821 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T11:19:47.838 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T11:19:47.983 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T11:19:47.992 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T11:19:48.007 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T11:19:48.010 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:48.041 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:48.049 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T11:19:48.116 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T11:19:48.142 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T11:19:48.167 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-requests. 2024-04-26T11:19:48.182 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T11:19:48.193 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T11:19:48.258 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T11:19:48.336 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T11:19:48.352 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T11:19:48.386 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T11:19:48.460 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-requests. 2024-04-26T11:19:48.487 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T11:19:48.527 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T11:19:48.569 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T11:19:48.595 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T11:19:48.596 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T11:19:48.622 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T11:19:48.636 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T11:19:48.661 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T11:19:48.690 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2024-04-26T11:19:48.716 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-26T11:19:48.756 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T11:19:48.813 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T11:19:48.839 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T11:19:48.880 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T11:19:48.938 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T11:19:48.963 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:49.001 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T11:19:49.005 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:49.028 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T11:19:49.067 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T11:19:49.085 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T11:19:49.112 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T11:19:49.151 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T11:19:49.175 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T11:19:49.201 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:49.241 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:49.351 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T11:19:49.367 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:49.378 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T11:19:49.401 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:49.405 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T11:19:49.445 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T11:19:49.471 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-toml. 2024-04-26T11:19:49.499 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-26T11:19:49.538 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T11:19:49.595 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T11:19:49.622 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:49.653 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:49.696 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T11:19:49.722 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T11:19:49.762 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T11:19:49.799 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T11:19:49.815 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T11:19:49.849 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T11:19:49.957 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T11:19:49.983 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../055-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T11:19:50.023 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T11:19:50.066 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T11:19:50.091 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T11:19:50.131 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T11:19:50.161 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T11:19:50.189 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:50.194 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T11:19:50.222 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T11:19:50.227 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:50.261 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T11:19:50.326 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T11:19:50.339 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T11:19:50.375 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T11:19:50.468 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T11:19:50.494 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../057-ceph-mgr_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:50.523 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2024-04-26T11:19:50.534 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:50.550 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T11:19:50.597 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T11:19:50.712 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T11:19:50.738 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../057-ceph-mgr_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:50.795 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:50.887 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T11:19:50.902 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../058-ceph-mon_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:50.917 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T11:19:50.937 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:50.945 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:50.984 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:51.173 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T11:19:51.189 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../058-ceph-mon_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:51.205 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T11:19:51.223 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:51.232 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T11:19:51.272 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T11:19:51.508 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T11:19:51.534 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../059-ceph-osd_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:51.574 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:51.618 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T11:19:51.645 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T11:19:51.684 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T11:19:51.835 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T11:19:51.861 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../059-ceph-osd_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:51.901 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:52.013 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T11:19:52.040 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T11:19:52.079 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T11:19:52.206 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T11:19:52.233 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T11:19:52.273 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T11:19:52.415 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T11:19:52.443 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-26T11:19:52.481 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T11:19:52.577 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph. 2024-04-26T11:19:52.592 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../060-ceph_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:52.635 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:52.752 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T11:19:52.779 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T11:19:52.793 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T11:19:52.818 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T11:19:52.820 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T11:19:52.860 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T11:19:52.921 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T11:19:52.930 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph. 2024-04-26T11:19:52.948 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../061-ceph-fuse_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:52.956 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../060-ceph_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:52.988 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:52.996 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:53.181 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T11:19:53.208 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T11:19:53.240 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T11:19:53.247 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T11:19:53.267 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../061-ceph-fuse_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:53.299 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:53.316 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T11:19:53.343 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../062-ceph-mds_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:53.382 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:53.405 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T11:19:53.432 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T11:19:53.471 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T11:19:53.550 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T11:19:53.577 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T11:19:53.616 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T11:19:53.652 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T11:19:53.678 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../062-ceph-mds_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:53.710 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:53.752 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephadm. 2024-04-26T11:19:53.778 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../063-cephadm_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:53.782 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T11:19:53.809 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T11:19:53.818 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:53.849 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T11:19:54.105 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephadm. 2024-04-26T11:19:54.130 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T11:19:54.131 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../063-cephadm_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:54.156 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T11:19:54.160 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T11:19:54.171 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:54.186 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T11:19:54.196 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T11:19:54.227 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T11:19:54.451 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T11:19:54.479 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:54.491 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T11:19:54.507 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T11:19:54.508 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:54.518 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T11:19:54.534 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T11:19:54.557 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T11:19:54.574 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T11:19:54.868 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T11:19:54.882 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T11:19:54.884 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T11:19:54.910 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:54.927 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T11:19:54.948 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:55.243 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T11:19:55.270 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T11:19:55.309 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T11:19:55.455 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T11:19:55.481 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T11:19:55.519 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T11:19:55.554 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-babel. 2024-04-26T11:19:55.581 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T11:19:55.620 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T11:19:55.629 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T11:19:55.656 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T11:19:55.695 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T11:19:55.908 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T11:19:55.924 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T11:19:55.948 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-babel. 2024-04-26T11:19:55.958 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T11:19:55.964 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package jq. 2024-04-26T11:19:55.965 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T11:19:55.975 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T11:19:55.981 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T11:19:55.992 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T11:19:56.015 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T11:19:56.022 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T11:19:56.031 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T11:19:56.244 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T11:19:56.260 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T11:19:56.295 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T11:19:56.309 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package socat. 2024-04-26T11:19:56.335 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T11:19:56.337 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T11:19:56.361 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T11:19:56.376 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T11:19:56.383 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T11:19:56.403 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:56.417 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T11:19:56.444 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:56.608 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T11:19:56.636 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-26T11:19:56.674 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T11:19:56.695 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T11:19:56.723 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T11:19:56.761 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T11:19:56.771 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T11:19:56.788 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T11:19:56.798 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:56.814 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T11:19:56.838 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:56.854 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T11:19:56.978 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T11:19:57.058 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T11:19:57.058 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T11:19:57.124 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-test. 2024-04-26T11:19:57.132 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-py. 2024-04-26T11:19:57.148 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-26T11:19:57.151 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:57.166 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T11:19:57.181 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../069-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T11:19:57.182 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T11:19:57.190 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:57.216 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T11:19:57.364 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T11:19:57.392 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T11:19:57.431 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T11:19:57.569 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-py. 2024-04-26T11:19:57.596 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../070-python3-py_1.10.0-1_all.deb ... 2024-04-26T11:19:57.619 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T11:19:57.635 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T11:19:57.645 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T11:19:57.702 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T11:19:57.867 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T11:19:57.895 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T11:19:57.934 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T11:19:57.947 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T11:19:57.974 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../071-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T11:19:58.005 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-toml. 2024-04-26T11:19:58.013 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T11:19:58.031 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-26T11:19:58.071 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T11:19:58.248 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T11:19:58.276 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T11:19:58.316 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-toml. 2024-04-26T11:19:58.320 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T11:19:58.343 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../072-python3-toml_0.10.2-1_all.deb ... 2024-04-26T11:19:58.374 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T11:19:58.383 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T11:19:58.401 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T11:19:58.440 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T11:19:58.686 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T11:19:58.713 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../073-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T11:19:58.752 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T11:19:58.786 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T11:19:58.812 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T11:19:58.852 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T11:19:58.959 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T11:19:58.975 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:59.017 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:59.114 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T11:19:59.141 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../074-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T11:19:59.161 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T11:19:59.180 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-routes. 2024-04-26T11:19:59.180 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T11:19:59.188 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:59.207 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T11:19:59.227 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:59.246 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T11:19:59.353 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T11:19:59.382 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T11:19:59.420 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T11:19:59.484 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-routes. 2024-04-26T11:19:59.510 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../075-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T11:19:59.531 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T11:19:59.542 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T11:19:59.546 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:19:59.575 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T11:19:59.581 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:59.602 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:59.642 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:59.698 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T11:19:59.713 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T11:19:59.747 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T11:19:59.870 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T11:19:59.897 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../076-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:19:59.934 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T11:19:59.936 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:19:59.962 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T11:20:00.000 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T11:20:00.009 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2024-04-26T11:20:00.036 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T11:20:00.077 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T11:20:00.328 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2024-04-26T11:20:00.355 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T11:20:00.363 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T11:20:00.390 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T11:20:00.394 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T11:20:00.429 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T11:20:00.697 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T11:20:00.714 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T11:20:00.755 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T11:20:00.830 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T11:20:00.857 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T11:20:00.883 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T11:20:00.904 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T11:20:00.910 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T11:20:00.949 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T11:20:01.110 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2024-04-26T11:20:01.139 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:01.176 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:01.208 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T11:20:01.224 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../077-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T11:20:01.266 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T11:20:01.294 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T11:20:01.321 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T11:20:01.360 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T11:20:01.383 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T11:20:01.411 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T11:20:01.449 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T11:20:01.705 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T11:20:01.733 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T11:20:01.745 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T11:20:01.771 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T11:20:01.772 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../078-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T11:20:01.795 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T11:20:01.822 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T11:20:01.861 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T11:20:02.028 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T11:20:02.164 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T11:20:02.191 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T11:20:02.225 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T11:20:02.230 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T11:20:02.253 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T11:20:02.300 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T11:20:02.382 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T11:20:02.409 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../079-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T11:20:02.448 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T11:20:02.594 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T11:20:02.610 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T11:20:02.644 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T11:20:02.759 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T11:20:02.787 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../080-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T11:20:02.826 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T11:20:02.905 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T11:20:02.933 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T11:20:02.971 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T11:20:03.072 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T11:20:03.088 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:20:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T11:20:03.116 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:20:03.130 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:03.155 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:03.426 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T11:20:03.442 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:03.476 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:03.542 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T11:20:03.570 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../081-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:20:03.601 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:03.700 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package radosgw. 2024-04-26T11:20:03.728 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../107-radosgw_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:03.766 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:03.821 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T11:20:03.848 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T11:20:03.887 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T11:20:04.066 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T11:20:04.093 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T11:20:04.133 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T11:20:04.225 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T11:20:04.253 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T11:20:04.292 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T11:20:04.486 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T11:20:04.495 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T11:20:04.502 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:04.522 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T11:20:04.535 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:04.562 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T11:20:04.562 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T11:20:04.589 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../082-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T11:20:04.628 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T11:20:04.678 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T11:20:04.695 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T11:20:04.736 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T11:20:04.847 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T11:20:04.890 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T11:20:04.917 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T11:20:04.957 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T11:20:05.040 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T11:20:05.041 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T11:20:05.068 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T11:20:05.068 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../083-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T11:20:05.098 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T11:20:05.107 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T11:20:05.123 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T11:20:05.224 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T11:20:05.251 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T11:20:05.267 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-26T11:20:05.301 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T11:20:05.453 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T11:20:05.480 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../084-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T11:20:05.484 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T11:20:05.489 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T11:20:05.508 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T11:20:05.519 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T11:20:05.551 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T11:20:05.621 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T11:20:05.650 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T11:20:05.688 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T11:20:05.791 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T11:20:05.818 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../085-python3-rsa_4.8-1_all.deb ... 2024-04-26T11:20:05.823 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T11:20:05.858 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T11:20:05.991 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T11:20:06.018 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T11:20:06.038 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T11:20:06.057 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T11:20:06.066 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T11:20:06.104 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T11:20:06.161 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T11:20:06.188 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../086-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T11:20:06.227 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T11:20:06.246 INFO:teuthology.orchestra.run.smithi107.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T11:20:06.351 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:06.394 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T11:20:06.421 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T11:20:06.424 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T11:20:06.451 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T11:20:06.460 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T11:20:06.490 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T11:20:06.547 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T11:20:06.574 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T11:20:06.613 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T11:20:06.755 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T11:20:06.768 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T11:20:06.782 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T11:20:06.784 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T11:20:06.821 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T11:20:06.826 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T11:20:06.859 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user cephadm....done 2024-04-26T11:20:06.900 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T11:20:06.927 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../088-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T11:20:06.975 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T11:20:07.041 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T11:20:07.270 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T11:20:07.297 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../089-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T11:20:07.327 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T11:20:07.444 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T11:20:07.472 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:20:07.510 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:07.538 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2024-04-26T11:20:07.567 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-radosgw_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:07.605 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:07.634 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T11:20:07.838 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T11:20:07.865 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T11:20:07.906 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T11:20:07.911 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T11:20:08.012 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T11:20:08.058 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T11:20:08.087 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:20:08.124 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:08.224 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T11:20:08.251 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T11:20:08.254 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T11:20:08.290 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T11:20:08.341 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T11:20:08.357 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:08.408 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:08.444 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T11:20:08.472 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../091-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T11:20:08.510 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T11:20:08.511 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T11:20:08.534 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package jq. 2024-04-26T11:20:08.550 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T11:20:08.592 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T11:20:08.712 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T11:20:08.812 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package socat. 2024-04-26T11:20:08.822 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T11:20:08.839 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T11:20:08.849 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../092-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T11:20:08.878 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T11:20:08.888 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T11:20:08.940 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T11:20:08.979 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T11:20:09.089 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T11:20:09.133 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package jq. 2024-04-26T11:20:09.149 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../093-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T11:20:09.173 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T11:20:09.189 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T11:20:09.191 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T11:20:09.231 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T11:20:09.241 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T11:20:09.326 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T11:20:09.468 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package socat. 2024-04-26T11:20:09.496 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../094-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T11:20:09.535 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T11:20:09.585 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-test. 2024-04-26T11:20:09.601 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:09.602 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T11:20:09.643 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:09.657 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T11:20:09.846 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T11:20:09.861 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T11:20:09.873 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T11:20:09.913 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T11:20:10.102 INFO:teuthology.orchestra.run.smithi073.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T11:20:10.137 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T11:20:10.165 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:10.275 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-test. 2024-04-26T11:20:10.291 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../096-ceph-test_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:10.334 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:10.363 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T11:20:10.673 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2024-04-26T11:20:10.689 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T11:20:10.829 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T11:20:10.940 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:11.097 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T11:20:11.191 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T11:20:11.317 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T11:20:11.340 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T11:20:11.475 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T11:20:11.547 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T11:20:11.574 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:20:11.576 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T11:20:11.613 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:11.726 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T11:20:11.727 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T11:20:11.909 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T11:20:11.925 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:11.967 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:11.985 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T11:20:12.086 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T11:20:12.111 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T11:20:12.196 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T11:20:12.229 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T11:20:12.245 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../097-ceph-volume_18.2.2-1256-gdc093b5e-1jammy_all.deb ... 2024-04-26T11:20:12.270 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T11:20:12.286 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T11:20:12.320 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T11:20:12.384 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:12.422 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T11:20:12.447 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T11:20:12.642 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T11:20:12.658 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T11:20:12.697 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T11:20:12.700 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T11:20:12.750 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T11:20:12.766 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../098-libcephfs-dev_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:12.798 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T11:20:12.799 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:12.999 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T11:20:13.061 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T11:20:13.066 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T11:20:13.088 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T11:20:13.127 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T11:20:13.169 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T11:20:13.197 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T11:20:13.235 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T11:20:13.350 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T11:20:13.607 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T11:20:13.623 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T11:20:13.626 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T11:20:13.650 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T11:20:13.664 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T11:20:13.665 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T11:20:13.691 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T11:20:13.730 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T11:20:13.886 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T11:20:14.027 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T11:20:14.059 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T11:20:14.085 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T11:20:14.086 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T11:20:14.112 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../101-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T11:20:14.125 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T11:20:14.137 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:14.151 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T11:20:14.161 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T11:20:14.287 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T11:20:14.438 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T11:20:14.474 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T11:20:14.499 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../102-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T11:20:14.538 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T11:20:14.564 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T11:20:14.579 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T11:20:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T11:20:14.624 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T11:20:14.662 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T11:20:14.807 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T11:20:14.874 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T11:20:14.902 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../103-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T11:20:14.941 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T11:20:14.958 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T11:20:14.964 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T11:20:14.973 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T11:20:15.001 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T11:20:15.039 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T11:20:15.198 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T11:20:15.317 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T11:20:15.317 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T11:20:15.333 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T11:20:15.375 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T11:20:15.428 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T11:20:15.443 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T11:20:15.456 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../104-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T11:20:15.495 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T11:20:15.616 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T11:20:15.711 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T11:20:15.822 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T11:20:15.850 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T11:20:15.889 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T11:20:15.934 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T11:20:15.971 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T11:20:16.121 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package radosgw. 2024-04-26T11:20:16.149 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../107-radosgw_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:16.183 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T11:20:16.187 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:16.210 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T11:20:16.249 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T11:20:16.280 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T11:20:16.294 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T11:20:16.536 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T11:20:16.637 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:16.900 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T11:20:16.913 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T11:20:16.928 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:16.949 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T11:20:16.966 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:17.003 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package radosgw. 2024-04-26T11:20:17.031 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../107-radosgw_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:17.069 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:17.192 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T11:20:17.206 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T11:20:17.271 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T11:20:17.318 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T11:20:17.477 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T11:20:17.538 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T11:20:17.664 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T11:20:17.778 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T11:20:17.797 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T11:20:17.814 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../108-rbd-fuse_18.2.2-1256-gdc093b5e-1jammy_amd64.deb ... 2024-04-26T11:20:17.856 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:17.910 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T11:20:18.162 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T11:20:18.167 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T11:20:18.219 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T11:20:18.378 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:18.413 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T11:20:18.418 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T11:20:18.495 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T11:20:18.545 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T11:20:18.645 INFO:teuthology.orchestra.run.smithi175.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T11:20:18.738 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T11:20:18.758 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:18.782 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T11:20:18.801 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T11:20:18.847 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T11:20:18.982 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T11:20:19.049 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T11:20:19.135 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T11:20:19.300 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T11:20:19.394 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T11:20:19.559 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T11:20:19.572 INFO:teuthology.orchestra.run.smithi088.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T11:20:19.592 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user cephadm....done 2024-04-26T11:20:19.630 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:19.652 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T11:20:19.740 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T11:20:19.778 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:19.802 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:19.902 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-26T11:20:20.006 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T11:20:20.008 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T11:20:20.071 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T11:20:20.121 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user cephadm....done 2024-04-26T11:20:20.234 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T11:20:20.277 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T11:20:20.288 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T11:20:20.344 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T11:20:20.389 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T11:20:20.554 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T11:20:20.555 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T11:20:20.595 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T11:20:20.813 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T11:20:20.823 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T11:20:20.855 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T11:20:20.939 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T11:20:20.980 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T11:20:21.074 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:20:21.174 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T11:20:21.282 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T11:20:21.325 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T11:20:21.408 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T11:20:21.509 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T11:20:21.553 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:21.585 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T11:20:21.625 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T11:20:21.686 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T11:20:21.687 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T11:20:21.811 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T11:20:21.877 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T11:20:21.938 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T11:20:21.953 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T11:20:22.056 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T11:20:22.071 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T11:20:22.145 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T11:20:22.165 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T11:20:22.171 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T11:20:22.355 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T11:20:22.396 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T11:20:22.433 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T11:20:22.438 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T11:20:22.656 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T11:20:22.663 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T11:20:22.692 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T11:20:22.698 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T11:20:22.898 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:22.916 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T11:20:22.943 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:22.966 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T11:20:23.086 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-26T11:20:23.212 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T11:20:23.217 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T11:20:23.232 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T11:20:23.340 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T11:20:23.367 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T11:20:23.468 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:23.505 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T11:20:23.618 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T11:20:23.626 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T11:20:23.727 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T11:20:23.739 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T11:20:23.744 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T11:20:23.744 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T11:20:23.853 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T11:20:23.982 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T11:20:24.103 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T11:20:24.104 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T11:20:24.163 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T11:20:24.229 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T11:20:24.233 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:20:24.289 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T11:20:24.363 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T11:20:24.485 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T11:20:24.497 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T11:20:24.648 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T11:20:24.748 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T11:20:24.753 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T11:20:24.799 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T11:20:24.831 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:24.878 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T11:20:24.957 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T11:20:25.049 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T11:20:25.084 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T11:20:25.274 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T11:20:25.343 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T11:20:25.354 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T11:20:25.480 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T11:20:25.567 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T11:20:25.686 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T11:20:25.710 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T11:20:25.756 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T11:20:25.826 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T11:20:25.952 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T11:20:25.978 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T11:20:26.033 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T11:20:26.112 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T11:20:26.212 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T11:20:26.238 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T11:20:26.284 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T11:20:26.330 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T11:20:26.479 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T11:20:26.538 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T11:20:26.581 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T11:20:26.673 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T11:20:26.682 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T11:20:26.730 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T11:20:26.783 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T11:20:26.906 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T11:20:26.920 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T11:20:27.046 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T11:20:27.067 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T11:20:27.107 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T11:20:27.141 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T11:20:27.394 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T11:20:27.439 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T11:20:27.451 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T11:20:27.493 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T11:20:27.682 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T11:20:27.702 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T11:20:27.727 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T11:20:27.777 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T11:20:27.844 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:27.916 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:27.945 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:28.042 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T11:20:28.063 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:28.129 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T11:20:28.180 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:28.229 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T11:20:28.315 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:28.352 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T11:20:28.388 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T11:20:28.514 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:28.526 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T11:20:28.530 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T11:20:28.661 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T11:20:28.799 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T11:20:28.819 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:28.899 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T11:20:28.929 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T11:20:28.936 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:29.062 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:29.071 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T11:20:29.158 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T11:20:29.208 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T11:20:29.276 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:20:29.276 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:20:29.284 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:29.339 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T11:20:29.585 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T11:20:29.590 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T11:20:29.806 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:29.833 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T11:20:29.903 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T11:20:29.940 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:30.066 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T11:20:30.210 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T11:20:30.381 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:30.494 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T11:20:30.507 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T11:20:30.741 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T11:20:30.838 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T11:20:30.867 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T11:20:30.964 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:30.993 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T11:20:31.073 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:31.108 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:31.174 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:31.228 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:31.242 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T11:20:31.286 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T11:20:31.300 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:31.337 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:31.426 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:31.455 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:31.511 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T11:20:31.546 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T11:20:31.590 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:31.636 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T11:20:31.638 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T11:20:31.715 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:31.771 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T11:20:31.813 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:31.914 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:31.939 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-26T11:20:32.040 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:32.048 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T11:20:32.055 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T11:20:32.166 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:32.233 INFO:teuthology.orchestra.run.smithi107.stdout:Adding group ceph....done 2024-04-26T11:20:32.298 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T11:20:32.342 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T11:20:32.380 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:20:32.380 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:20:32.558 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:32.559 INFO:teuthology.orchestra.run.smithi107.stdout:Adding system user ceph....done 2024-04-26T11:20:32.593 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T11:20:32.683 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-26T11:20:32.728 INFO:teuthology.orchestra.run.smithi107.stdout:Setting system user ceph properties....done 2024-04-26T11:20:32.745 INFO:teuthology.orchestra.run.smithi107.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T11:20:32.809 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T11:20:32.852 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T11:20:32.884 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T11:20:32.893 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:33.019 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:33.104 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:20:33.111 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T11:20:33.145 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T11:20:33.238 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T11:20:33.363 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T11:20:33.379 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T11:20:33.631 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T11:20:33.638 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T11:20:33.732 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T11:20:33.732 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:33.834 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:33.906 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T11:20:34.008 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T11:20:34.134 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T11:20:34.174 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T11:20:34.279 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:20:34.279 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:20:34.333 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:34.418 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T11:20:34.433 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T11:20:34.459 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:34.561 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T11:20:34.585 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:34.711 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:34.719 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T11:20:34.752 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:34.837 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:34.843 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T11:20:34.969 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T11:20:34.995 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T11:20:35.094 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T11:20:35.262 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T11:20:35.321 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2024-04-26T11:20:35.419 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T11:20:35.553 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:35.563 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T11:20:35.657 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T11:20:35.673 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2024-04-26T11:20:35.766 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T11:20:35.779 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:20:35.779 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:20:35.806 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T11:20:35.817 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2024-04-26T11:20:35.830 INFO:teuthology.orchestra.run.smithi073.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T11:20:35.968 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T11:20:36.126 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T11:20:36.247 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T11:20:36.272 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:36.292 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T11:20:36.377 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T11:20:36.484 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T11:20:36.497 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:20:36.497 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:20:36.610 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T11:20:36.628 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:36.754 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T11:20:36.797 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:36.898 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:36.948 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:36.995 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T11:20:37.064 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T11:20:37.226 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:20:37.226 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:20:37.254 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T11:20:37.348 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T11:20:37.354 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:20:37.354 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:20:37.513 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T11:20:37.608 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T11:20:37.664 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T11:20:37.708 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:37.717 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T11:20:37.833 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:37.834 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:37.985 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T11:20:37.985 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:38.007 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T11:20:38.181 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T11:20:38.183 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:20:38.183 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:20:38.252 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T11:20:38.308 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T11:20:38.512 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T11:20:38.584 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T11:20:38.652 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:38.686 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:38.735 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T11:20:38.837 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:38.883 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:20:38.883 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:20:38.905 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T11:20:38.963 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:39.011 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T11:20:39.122 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:39.181 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T11:20:39.296 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T11:20:39.362 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:39.467 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T11:20:39.492 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T11:20:39.547 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T11:20:39.590 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:20:39.590 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:20:39.618 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:39.744 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:39.887 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:39.923 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T11:20:40.013 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:40.088 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:40.130 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:40.216 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T11:20:40.334 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T11:20:40.342 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:20:40.342 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:20:40.552 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T11:20:40.627 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:40.678 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:40.754 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:40.760 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T11:20:40.812 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:40.848 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:40.879 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:40.921 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:40.975 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:41.031 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:41.091 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:20:41.091 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:20:41.125 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:41.132 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:41.221 INFO:teuthology.orchestra.run.smithi107.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:20:41.224 DEBUG:teuthology.orchestra.run.smithi107:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T11:20:41.277 INFO:teuthology.orchestra.run.smithi107.stdout:Reading package lists... 2024-04-26T11:20:41.338 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:20:41.338 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:20:41.351 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T11:20:41.455 INFO:teuthology.orchestra.run.smithi107.stdout:Building dependency tree... 2024-04-26T11:20:41.455 INFO:teuthology.orchestra.run.smithi107.stdout:Reading state information... 2024-04-26T11:20:41.555 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:41.626 INFO:teuthology.orchestra.run.smithi107.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T11:20:41.626 INFO:teuthology.orchestra.run.smithi107.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T11:20:41.626 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:20:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:20:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:20:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:20:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:20:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:20:41.627 INFO:teuthology.orchestra.run.smithi107.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:20:41.627 INFO:teuthology.orchestra.run.smithi107.stdout:The following additional packages will be installed: 2024-04-26T11:20:41.628 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-26T11:20:41.629 INFO:teuthology.orchestra.run.smithi107.stdout:Suggested packages: 2024-04-26T11:20:41.629 INFO:teuthology.orchestra.run.smithi107.stdout: bison-doc flex-doc libssl-doc 2024-04-26T11:20:41.656 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:41.659 INFO:teuthology.orchestra.run.smithi107.stdout:The following NEW packages will be installed: 2024-04-26T11:20:41.660 INFO:teuthology.orchestra.run.smithi107.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-26T11:20:41.661 INFO:teuthology.orchestra.run.smithi107.stdout:The following packages will be upgraded: 2024-04-26T11:20:41.662 INFO:teuthology.orchestra.run.smithi107.stdout: libssl3 libuuid1 uuid-dev 2024-04-26T11:20:41.758 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T11:20:41.763 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:41.793 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:41.842 INFO:teuthology.orchestra.run.smithi107.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-26T11:20:41.842 INFO:teuthology.orchestra.run.smithi107.stdout:Need to get 5,495 kB of archives. 2024-04-26T11:20:41.842 INFO:teuthology.orchestra.run.smithi107.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-26T11:20:41.842 INFO:teuthology.orchestra.run.smithi107.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T11:20:41.913 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:41.945 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:42.070 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:42.146 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:20:42.146 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T11:20:42.238 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:42.325 INFO:teuthology.orchestra.run.smithi107.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T11:20:42.583 INFO:teuthology.orchestra.run.smithi107.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T11:20:42.584 INFO:teuthology.orchestra.run.smithi107.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T11:20:42.585 INFO:teuthology.orchestra.run.smithi107.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T11:20:42.599 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T11:20:42.606 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:42.619 INFO:teuthology.orchestra.run.smithi107.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T11:20:42.620 INFO:teuthology.orchestra.run.smithi107.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T11:20:42.622 INFO:teuthology.orchestra.run.smithi107.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T11:20:42.623 INFO:teuthology.orchestra.run.smithi107.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T11:20:42.623 INFO:teuthology.orchestra.run.smithi107.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T11:20:42.716 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:42.842 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T11:20:42.962 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:43.028 INFO:teuthology.orchestra.run.smithi107.stdout:Preconfiguring packages ... 2024-04-26T11:20:43.088 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:43.139 INFO:teuthology.orchestra.run.smithi107.stdout:Fetched 5,495 kB in 1s (5,357 kB/s) 2024-04-26T11:20:43.206 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:43.273 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package flex. 2024-04-26T11:20:43.306 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:43.364 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173143 files and directories currently installed.) 2024-04-26T11:20:43.369 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T11:20:43.416 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:43.422 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T11:20:43.826 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T11:20:43.959 INFO:teuthology.orchestra.run.smithi175.stdout:Adding group ceph....done 2024-04-26T11:20:44.005 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T11:20:44.054 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:44.155 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:44.177 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T11:20:44.256 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:44.261 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user ceph....done 2024-04-26T11:20:44.293 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:20:44.296 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T11:20:44.349 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2024-04-26T11:20:44.399 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:44.430 INFO:teuthology.orchestra.run.smithi175.stdout:Setting system user ceph properties....done 2024-04-26T11:20:44.449 INFO:teuthology.orchestra.run.smithi175.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T11:20:44.525 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:44.549 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2024-04-26T11:20:44.550 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2024-04-26T11:20:44.587 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T11:20:44.631 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:20:44.723 INFO:teuthology.orchestra.run.smithi073.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T11:20:44.723 INFO:teuthology.orchestra.run.smithi073.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T11:20:44.723 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:20:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:20:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:20:44.723 INFO:teuthology.orchestra.run.smithi073.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:20:44.724 INFO:teuthology.orchestra.run.smithi073.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:20:44.724 INFO:teuthology.orchestra.run.smithi073.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:20:44.724 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:20:44.724 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2024-04-26T11:20:44.725 INFO:teuthology.orchestra.run.smithi073.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-26T11:20:44.726 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2024-04-26T11:20:44.726 INFO:teuthology.orchestra.run.smithi073.stdout: bison-doc flex-doc libssl-doc 2024-04-26T11:20:44.756 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2024-04-26T11:20:44.757 INFO:teuthology.orchestra.run.smithi073.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-26T11:20:44.758 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2024-04-26T11:20:44.759 INFO:teuthology.orchestra.run.smithi073.stdout: libssl3 libuuid1 uuid-dev 2024-04-26T11:20:44.822 INFO:teuthology.orchestra.run.smithi073.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-26T11:20:44.823 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 5,495 kB of archives. 2024-04-26T11:20:44.823 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-26T11:20:44.823 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T11:20:44.885 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T11:20:44.955 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T11:20:45.037 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T11:20:45.038 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T11:20:45.039 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T11:20:45.055 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T11:20:45.056 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T11:20:45.057 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T11:20:45.058 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T11:20:45.058 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T11:20:45.118 INFO:teuthology.orchestra.run.smithi088.stdout:Adding group ceph....done 2024-04-26T11:20:45.187 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-26T11:20:45.193 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T11:20:45.309 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:45.435 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:45.440 INFO:teuthology.orchestra.run.smithi073.stdout:Preconfiguring packages ... 2024-04-26T11:20:45.511 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user ceph....done 2024-04-26T11:20:45.538 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 5,495 kB in 0s (16.0 MB/s) 2024-04-26T11:20:45.587 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T11:20:45.680 INFO:teuthology.orchestra.run.smithi088.stdout:Setting system user ceph properties....done 2024-04-26T11:20:45.698 INFO:teuthology.orchestra.run.smithi088.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T11:20:45.716 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package flex. 2024-04-26T11:20:45.820 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173143 files and directories currently installed.) 2024-04-26T11:20:45.826 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T11:20:45.833 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T11:20:45.889 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T11:20:45.919 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:20:45.919 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:20:45.988 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T11:20:46.127 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T11:20:46.139 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T11:20:46.422 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T11:20:46.471 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:46.537 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T11:20:46.570 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T11:20:46.651 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:46.777 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:46.819 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T11:20:46.911 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package bison. 2024-04-26T11:20:46.972 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:20:47.016 INFO:teuthology.orchestra.run.smithi107.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-26T11:20:47.022 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T11:20:47.072 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T11:20:47.272 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:47.273 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:20:47.274 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T11:20:47.405 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T11:20:47.422 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T11:20:47.463 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T11:20:47.496 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-26T11:20:47.502 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T11:20:47.512 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:20:47.513 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:20:47.629 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T11:20:47.718 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T11:20:47.746 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:47.746 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T11:20:47.784 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T11:20:47.983 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:48.079 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T11:20:48.088 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T11:20:48.092 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T11:20:48.107 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T11:20:48.137 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T11:20:48.189 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:20:48.190 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:20:48.236 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T11:20:48.389 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T11:20:48.406 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T11:20:48.448 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T11:20:48.554 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T11:20:48.564 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:48.642 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:48.701 INFO:teuthology.orchestra.run.smithi107.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T11:20:48.717 INFO:teuthology.orchestra.run.smithi107.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T11:20:48.759 INFO:teuthology.orchestra.run.smithi107.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:20:48.778 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:20:48.778 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T11:20:48.927 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:20:48.927 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:20:48.928 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package bison. 2024-04-26T11:20:49.033 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-26T11:20:49.039 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T11:20:49.089 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T11:20:49.257 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:49.268 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T11:20:49.380 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T11:20:49.381 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T11:20:49.394 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T11:20:49.427 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:49.430 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T11:20:49.477 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:20:49.478 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T11:20:49.489 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T11:20:49.553 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:49.624 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:20:49.684 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T11:20:49.687 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:49.712 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T11:20:49.750 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T11:20:49.751 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T11:20:49.876 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T11:20:49.880 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:20:49.880 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:20:49.966 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:50.018 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T11:20:50.088 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T11:20:50.108 INFO:teuthology.orchestra.run.smithi107.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T11:20:50.115 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T11:20:50.154 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T11:20:50.170 INFO:teuthology.orchestra.run.smithi107.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T11:20:50.233 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:20:50.233 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T11:20:50.297 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T11:20:50.347 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:50.398 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T11:20:50.414 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T11:20:50.448 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T11:20:50.448 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T11:20:50.482 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:50.608 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:50.684 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T11:20:50.700 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T11:20:50.718 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:50.759 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:50.810 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:20:50.853 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:51.004 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:51.103 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T11:20:51.216 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:20:51.216 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T11:20:51.303 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T11:20:51.423 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T11:20:51.549 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T11:20:51.584 INFO:teuthology.orchestra.run.smithi107.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T11:20:51.675 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:20:51.688 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:51.801 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T11:20:51.814 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:51.927 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T11:20:51.932 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:52.045 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T11:20:52.083 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1jammy) ... 2024-04-26T11:20:52.117 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T11:20:52.171 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T11:20:52.221 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T11:20:52.234 INFO:teuthology.orchestra.run.smithi107.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:20:52.240 DEBUG:teuthology.parallel:result is None 2024-04-26T11:20:52.298 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T11:20:52.427 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T11:20:52.449 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T11:20:52.682 INFO:teuthology.orchestra.run.smithi175.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:20:52.685 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T11:20:52.782 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T11:20:52.962 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-26T11:20:52.963 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-26T11:20:53.131 INFO:teuthology.orchestra.run.smithi175.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T11:20:53.132 INFO:teuthology.orchestra.run.smithi175.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T11:20:53.132 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:20:53.132 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:20:53.132 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:20:53.132 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:20:53.132 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:20:53.132 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:20:53.133 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:20:53.133 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-04-26T11:20:53.134 INFO:teuthology.orchestra.run.smithi175.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-26T11:20:53.135 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-04-26T11:20:53.135 INFO:teuthology.orchestra.run.smithi175.stdout: bison-doc flex-doc libssl-doc 2024-04-26T11:20:53.165 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-04-26T11:20:53.166 INFO:teuthology.orchestra.run.smithi175.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-26T11:20:53.167 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages will be upgraded: 2024-04-26T11:20:53.168 INFO:teuthology.orchestra.run.smithi175.stdout: libssl3 libuuid1 uuid-dev 2024-04-26T11:20:53.371 INFO:teuthology.orchestra.run.smithi175.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-26T11:20:53.372 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 5,495 kB of archives. 2024-04-26T11:20:53.372 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-26T11:20:53.372 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T11:20:53.445 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T11:20:53.734 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T11:20:53.915 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:20:53.917 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T11:20:53.975 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-04-26T11:20:54.042 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T11:20:54.176 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-04-26T11:20:54.177 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-04-26T11:20:54.369 INFO:teuthology.orchestra.run.smithi088.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-26T11:20:54.369 INFO:teuthology.orchestra.run.smithi088.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-26T11:20:54.369 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T11:20:54.369 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T11:20:54.369 INFO:teuthology.orchestra.run.smithi088.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T11:20:54.369 INFO:teuthology.orchestra.run.smithi088.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T11:20:54.370 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:20:54.370 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T11:20:54.370 INFO:teuthology.orchestra.run.smithi088.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T11:20:54.370 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T11:20:54.371 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2024-04-26T11:20:54.374 DEBUG:teuthology.parallel:result is None 2024-04-26T11:20:54.375 INFO:teuthology.orchestra.run.smithi088.stdout: libfl-dev libfl2 libssl3 libuuid1 2024-04-26T11:20:54.375 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2024-04-26T11:20:54.375 INFO:teuthology.orchestra.run.smithi088.stdout: bison-doc flex-doc libssl-doc 2024-04-26T11:20:54.403 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2024-04-26T11:20:54.404 INFO:teuthology.orchestra.run.smithi088.stdout: bison flex libaio-dev libelf-dev libfl-dev libfl2 libssl-dev 2024-04-26T11:20:54.406 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages will be upgraded: 2024-04-26T11:20:54.406 INFO:teuthology.orchestra.run.smithi088.stdout: libssl3 libuuid1 uuid-dev 2024-04-26T11:20:54.463 INFO:teuthology.orchestra.run.smithi088.stdout:3 upgraded, 7 newly installed, 0 to remove and 299 not upgraded. 2024-04-26T11:20:54.463 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 5,495 kB of archives. 2024-04-26T11:20:54.463 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 16.5 MB of additional disk space will be used. 2024-04-26T11:20:54.463 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-26T11:20:54.586 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-26T11:20:54.661 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T11:20:54.662 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T11:20:54.663 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T11:20:54.679 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T11:20:54.680 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T11:20:54.682 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T11:20:54.682 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T11:20:54.683 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T11:20:55.040 INFO:teuthology.orchestra.run.smithi088.stdout:Preconfiguring packages ... 2024-04-26T11:20:55.156 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 5,495 kB in 0s (18.3 MB/s) 2024-04-26T11:20:55.293 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package flex. 2024-04-26T11:20:55.396 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173143 files and directories currently installed.) 2024-04-26T11:20:55.402 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T11:20:55.458 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T11:20:56.083 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T11:20:56.256 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T11:20:56.665 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:20:57.179 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-26T11:20:57.185 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T11:20:57.297 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-26T11:20:57.306 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T11:20:57.349 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-26T11:20:57.374 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-26T11:20:57.716 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T11:20:57.847 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T11:20:58.181 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T11:20:58.564 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package bison. 2024-04-26T11:20:58.668 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-26T11:20:58.674 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T11:20:58.724 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T11:20:59.091 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-26T11:20:59.118 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-26T11:20:59.185 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T11:20:59.213 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T11:20:59.251 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T11:20:59.273 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-26T11:20:59.313 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-26T11:20:59.327 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-26T11:20:59.497 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T11:20:59.514 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T11:20:59.555 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T11:20:59.909 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T11:20:59.937 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T11:20:59.975 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T11:21:00.228 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T11:21:00.244 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T11:21:00.286 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T11:21:00.547 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T11:21:00.563 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T11:21:00.605 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:21:01.082 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T11:21:01.227 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T11:21:01.327 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T11:21:01.437 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:21:01.563 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T11:21:01.689 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T11:21:01.815 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T11:21:01.905 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T11:21:01.966 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T11:21:02.093 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T11:21:02.236 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T11:21:03.429 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T11:21:04.095 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:21:04.102 DEBUG:teuthology.parallel:result is None 2024-04-26T11:21:04.891 INFO:teuthology.orchestra.run.smithi175.stdout:Preconfiguring packages ... 2024-04-26T11:21:04.992 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 5,495 kB in 11s (483 kB/s) 2024-04-26T11:21:05.272 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package flex. 2024-04-26T11:21:05.377 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173143 files and directories currently installed.) 2024-04-26T11:21:05.383 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-26T11:21:05.420 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-26T11:21:06.095 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T11:21:06.268 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-26T11:21:06.695 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:21:07.236 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-26T11:21:07.242 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T11:21:07.392 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T11:21:07.806 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-26T11:21:07.916 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-26T11:21:08.225 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T11:21:08.616 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package bison. 2024-04-26T11:21:08.720 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173216 files and directories currently installed.) 2024-04-26T11:21:08.726 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../0-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-26T11:21:08.785 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T11:21:09.119 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T11:21:09.135 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../1-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-26T11:21:09.177 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T11:21:09.431 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T11:21:09.447 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../2-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-26T11:21:09.489 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T11:21:09.776 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-26T11:21:09.792 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../3-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-26T11:21:09.826 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T11:21:10.070 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-26T11:21:10.086 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../4-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-26T11:21:10.209 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T11:21:10.507 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T11:21:10.535 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../5-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-26T11:21:10.573 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:21:11.100 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-26T11:21:11.236 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-26T11:21:11.362 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-26T11:21:11.514 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-26T11:21:11.665 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-26T11:21:11.816 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-26T11:21:11.975 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-26T11:21:12.082 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-26T11:21:12.160 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-26T11:21:12.304 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T11:21:12.472 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T11:21:13.687 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T11:21:14.359 INFO:teuthology.orchestra.run.smithi175.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T11:21:14.365 DEBUG:teuthology.parallel:result is None 2024-04-26T11:21:14.365 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:21:14.517 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2024-04-26T11:21:14.537 INFO:teuthology.orchestra.run.smithi073.stdout:18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:21:14.537 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:21:14.537 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1jammy is installed. 2024-04-26T11:21:14.543 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:21:14.758 DEBUG:teuthology.orchestra.run.smithi088:> dpkg-query -W -f '${Version}' ceph 2024-04-26T11:21:14.778 INFO:teuthology.orchestra.run.smithi088.stdout:18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:21:14.779 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:21:14.779 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1jammy is installed. 2024-04-26T11:21:14.781 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:21:14.923 DEBUG:teuthology.orchestra.run.smithi107:> dpkg-query -W -f '${Version}' ceph 2024-04-26T11:21:14.946 INFO:teuthology.orchestra.run.smithi107.stdout:18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:21:14.946 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:21:14.946 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1jammy is installed. 2024-04-26T11:21:14.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T11:21:15.087 DEBUG:teuthology.orchestra.run.smithi175:> dpkg-query -W -f '${Version}' ceph 2024-04-26T11:21:15.107 INFO:teuthology.orchestra.run.smithi175.stdout:18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:21:15.108 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1jammy 2024-04-26T11:21:15.108 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1jammy is installed. 2024-04-26T11:21:15.110 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T11:21:15.110 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:15.110 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:21:15.124 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:21:15.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:21:15.138 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:21:15.139 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:21:15.154 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:21:15.154 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T11:21:15.167 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T11:21:15.167 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:15.167 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:21:15.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:21:15.233 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:21:15.233 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:21:15.246 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:21:15.301 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:21:15.301 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:21:15.315 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:21:15.370 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:21:15.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T11:21:15.385 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T11:21:15.440 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T11:21:15.441 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:15.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:21:15.454 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:21:15.510 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:21:15.510 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:21:15.524 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:21:15.577 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:21:15.577 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:21:15.590 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:21:15.646 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:21:15.646 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T11:21:15.658 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T11:21:15.711 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T11:21:15.712 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:15.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:21:15.725 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:21:15.779 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:21:15.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:21:15.794 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:21:15.849 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:21:15.850 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:21:15.863 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:21:15.919 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:21:15.919 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T11:21:15.932 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T11:21:15.984 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T11:21:16.076 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T11:21:16.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-04-26T11:21:16.079 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2024-04-26T11:21:16.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-04-26T11:21:16.084 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2024-04-26T11:21:16.097 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T11:21:16.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:21:16.136 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:21:16.138 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:21:16.140 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T11:21:16.153 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T11:21:16.154 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:21:16.188 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:21:16.191 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:21:16.196 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T11:21:16.220 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T11:21:16.220 INFO:tasks.ceph:config {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T11:21:16.220 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674158', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 1136, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6', 'targets': {'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIxuNsfV0kDPVabi4qqNkM8gBJIbyKPoKP/CkfwMicQ9DVdNiyCiLxdu/OfIgV82r+ZhNDPTQDTqD1qa22vKtNE=', 'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDN+u2o3Jxix2q7kMmq4Yu632Df8HgN44ZfR9zF1KB7p8pLqlNOCvFtIz6vpku1Ea/Em+ZXExIOoG/7hBhXFNmU=', 'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFjDy8oJvqBPkBHEhQ6nXrvI/ij3a0Omcgy4UA+ad9j605TJ3/CAh7a8086p9vb8wKmIUxTGQYhoPHXI1v5pTco=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLY6oAN3ghf2oxznrfpm3zRO/vxO+Tp4VIcFbQFryJqs+hj5Qj+jgokYw3glsKU01xkEyTJ2EdLfVG1OCC9kls4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T11:21:16.221 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:21:16.244 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:21:16.248 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:21:16.253 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T11:21:16.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:21:16.292 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:21:16.295 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:21:16.300 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:21:16.313 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:21:16.313 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:21:16.355 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:21:16.355 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-04-26T11:21:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:21:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:16.403 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-04-26T11:21:16.403 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:16.403 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-26 11:15:39.315188721 +0000 2024-04-26T11:21:16.403 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-26 11:15:39.079190817 +0000 2024-04-26T11:21:16.403 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-26 11:15:39.079190817 +0000 2024-04-26T11:21:16.403 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-04-26T11:21:16.404 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:21:16.457 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-26T11:21:16.457 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-26T11:21:16.457 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000448267 s, 1.1 MB/s 2024-04-26T11:21:16.459 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:21:16.508 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-04-26T11:21:16.554 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:21:16.554 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:16.554 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-04-26T11:21:16.554 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:16.554 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-26 11:15:39.863183853 +0000 2024-04-26T11:21:16.554 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-26 11:15:39.587186304 +0000 2024-04-26T11:21:16.555 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-26 11:15:39.587186304 +0000 2024-04-26T11:21:16.555 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-04-26T11:21:16.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:21:16.608 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-26T11:21:16.608 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-26T11:21:16.608 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.00039655 s, 1.3 MB/s 2024-04-26T11:21:16.609 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:21:16.659 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-04-26T11:21:16.706 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:21:16.706 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:16.707 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-26T11:21:16.707 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:16.707 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-26 11:15:40.131181473 +0000 2024-04-26T11:21:16.707 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-26 11:15:40.127181507 +0000 2024-04-26T11:21:16.707 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-26 11:15:40.127181507 +0000 2024-04-26T11:21:16.707 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-04-26T11:21:16.707 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:21:16.763 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-26T11:21:16.764 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-26T11:21:16.764 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.00042892 s, 1.2 MB/s 2024-04-26T11:21:16.765 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:21:16.815 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-04-26T11:21:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:21:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:16.864 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-04-26T11:21:16.864 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:16.864 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-04-26 11:15:40.923174437 +0000 2024-04-26T11:21:16.864 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-04-26 11:15:40.639176959 +0000 2024-04-26T11:21:16.864 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-04-26 11:15:40.639176959 +0000 2024-04-26T11:21:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-04-26T11:21:16.864 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:21:16.916 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-04-26T11:21:16.916 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-04-26T11:21:16.916 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000315895 s, 1.6 MB/s 2024-04-26T11:21:16.918 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:21:16.968 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T11:21:16.968 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:21:16.968 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:21:16.973 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:21:16.974 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-04-26T11:21:17.019 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:21:17.020 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:17.020 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-04-26T11:21:17.020 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:17.020 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-26 11:15:32.180146237 +0000 2024-04-26T11:21:17.020 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-26 11:15:31.916148594 +0000 2024-04-26T11:21:17.020 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-26 11:15:31.916148594 +0000 2024-04-26T11:21:17.020 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-04-26T11:21:17.020 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:21:17.074 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-26T11:21:17.074 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-26T11:21:17.074 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.00038167 s, 1.3 MB/s 2024-04-26T11:21:17.075 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:21:17.125 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-04-26T11:21:17.171 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:21:17.171 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:17.171 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-04-26T11:21:17.171 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:17.171 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-26 11:15:32.672141842 +0000 2024-04-26T11:21:17.171 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-26 11:15:32.424144057 +0000 2024-04-26T11:21:17.171 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-26 11:15:32.424144057 +0000 2024-04-26T11:21:17.171 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-04-26T11:21:17.172 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:21:17.225 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-26T11:21:17.226 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-26T11:21:17.226 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000342105 s, 1.5 MB/s 2024-04-26T11:21:17.227 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:21:17.276 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-04-26T11:21:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:21:17.323 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:17.323 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 917 Links: 1 2024-04-26T11:21:17.323 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:17.323 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-26 11:15:33.164137448 +0000 2024-04-26T11:21:17.324 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-26 11:15:32.916139663 +0000 2024-04-26T11:21:17.324 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-26 11:15:32.916139663 +0000 2024-04-26T11:21:17.324 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-04-26T11:21:17.324 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:21:17.378 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-26T11:21:17.379 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-26T11:21:17.379 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.00030591 s, 1.7 MB/s 2024-04-26T11:21:17.380 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:21:17.429 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-04-26T11:21:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:21:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:17.475 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-04-26T11:21:17.475 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:17.475 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-04-26 11:15:33.664132981 +0000 2024-04-26T11:21:17.475 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-04-26 11:15:33.396135375 +0000 2024-04-26T11:21:17.475 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-04-26 11:15:33.396135375 +0000 2024-04-26T11:21:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: - 2024-04-26T11:21:17.476 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:21:17.529 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-04-26T11:21:17.529 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-04-26T11:21:17.529 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000280502 s, 1.8 MB/s 2024-04-26T11:21:17.531 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:21:17.581 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T11:21:17.581 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:21:17.581 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T11:21:17.587 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T11:21:17.587 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-04-26T11:21:17.634 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T11:21:17.634 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:17.634 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 882 Links: 1 2024-04-26T11:21:17.634 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:17.634 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 11:15:34.059835121 +0000 2024-04-26T11:21:17.634 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 11:15:33.779837622 +0000 2024-04-26T11:21:17.634 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 11:15:33.779837622 +0000 2024-04-26T11:21:17.634 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-26T11:21:17.635 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T11:21:17.688 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T11:21:17.688 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T11:21:17.688 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000442071 s, 1.2 MB/s 2024-04-26T11:21:17.689 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T11:21:17.738 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-04-26T11:21:17.786 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T11:21:17.786 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:17.786 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-04-26T11:21:17.786 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:17.786 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 11:15:34.279833156 +0000 2024-04-26T11:21:17.786 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 11:15:34.275833192 +0000 2024-04-26T11:21:17.786 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 11:15:34.275833192 +0000 2024-04-26T11:21:17.787 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-26T11:21:17.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T11:21:17.839 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T11:21:17.839 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T11:21:17.839 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000375759 s, 1.4 MB/s 2024-04-26T11:21:17.841 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T11:21:17.890 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-04-26T11:21:17.937 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T11:21:17.937 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:17.937 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-04-26T11:21:17.937 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:17.938 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 11:15:35.071826080 +0000 2024-04-26T11:21:17.938 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 11:15:34.819828332 +0000 2024-04-26T11:21:17.938 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 11:15:34.819828332 +0000 2024-04-26T11:21:17.938 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-26T11:21:17.938 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T11:21:17.991 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T11:21:17.991 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T11:21:17.991 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000360758 s, 1.4 MB/s 2024-04-26T11:21:17.992 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T11:21:18.042 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-04-26T11:21:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T11:21:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T11:21:18.089 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-04-26T11:21:18.089 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:21:18.089 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 11:15:35.551821794 +0000 2024-04-26T11:21:18.089 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 11:15:35.295824079 +0000 2024-04-26T11:21:18.089 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 11:15:35.295824079 +0000 2024-04-26T11:21:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-26T11:21:18.090 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T11:21:18.143 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T11:21:18.143 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T11:21:18.143 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000283361 s, 1.8 MB/s 2024-04-26T11:21:18.144 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T11:21:18.194 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T11:21:18.194 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T11:21:18.194 INFO:tasks.ceph:Generating config... 2024-04-26T11:21:18.196 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T11:21:18.196 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T11:21:18.196 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T11:21:18.196 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T11:21:18.196 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T11:21:18.196 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T11:21:18.196 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2024-04-26T11:21:18.196 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-26T11:21:18.196 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T11:21:18.196 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T11:21:18.197 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T11:21:18.197 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T11:21:18.197 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T11:21:18.197 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T11:21:18.197 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T11:21:18.197 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T11:21:18.197 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T11:21:18.197 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T11:21:18.197 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T11:21:18.197 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T11:21:18.197 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T11:21:18.197 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T11:21:18.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T11:21:18.230 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T11:21:18.244 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T11:21:18.318 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:21:18.368 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73'), ('mon.b', '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]'), ('mon.c', '[v2:172.21.15.73:3302,v1:172.21.15.73:6791]')] 2024-04-26T11:21:18.369 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2024-04-26T11:21:18.369 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:18.369 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T11:21:18.415 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --addv b '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]' --addv c '[v2:172.21.15.73:3302,v1:172.21.15.73:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:21:18.501 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:21:18.501 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4 2024-04-26T11:21:18.501 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = pacific 2024-04-26T11:21:18.501 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2024-04-26T11:21:18.502 INFO:teuthology.orchestra.run.smithi073.stdout:fsid ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4 2024-04-26T11:21:18.502 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2024-04-26T11:21:18.502601+0000 2024-04-26T11:21:18.502 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-04-26T11:21:18.502601+0000 2024-04-26T11:21:18.502 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 16 (pacific) 2024-04-26T11:21:18.502 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2024-04-26T11:21:18.502 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2024-04-26T11:21:18.502 INFO:teuthology.orchestra.run.smithi073.stdout:1: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.b 2024-04-26T11:21:18.502 INFO:teuthology.orchestra.run.smithi073.stdout:2: [v2:172.21.15.73:3302/0,v1:172.21.15.73:6791/0] mon.c 2024-04-26T11:21:18.502 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T11:21:18.503 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T11:21:18.551 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4... 2024-04-26T11:21:18.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:21:18.596 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:21:18.598 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:21:18.600 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T11:21:18.624 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-04-26T11:21:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-04-26T11:21:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:21:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-04-26T11:21:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.624 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:21:18.625 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-04-26T11:21:18.626 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:21:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-04-26T11:21:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-04-26T11:21:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-04-26T11:21:18.627 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.628 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:21:18.629 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-04-26T11:21:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-04-26T11:21:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-04-26T11:21:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-04-26T11:21:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression algorithm = lz4 2024-04-26T11:21:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore compression mode = aggressive 2024-04-26T11:21:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-04-26T11:21:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2024-04-26T11:21:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2024-04-26T11:21:18.630 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-26T11:21:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-04-26T11:21:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2024-04-26T11:21:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:21:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-04-26T11:21:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:21:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:21:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:21:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: osd max markdown count = 1000 2024-04-26T11:21:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-04-26T11:21:18.631 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.631 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-04-26T11:21:18.632 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:21:18.633 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.634 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-04-26T11:21:18.634 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:21:18.634 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.634 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:21:18.634 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:18.634 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-04-26T11:21:18.634 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-04-26T11:21:18.634 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2024-04-26T11:21:18.634 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-04-26T11:21:18.634 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:21:18.634 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:21:18.635 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-04-26T11:21:18.635 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-04-26T11:21:18.635 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-04-26T11:21:18.635 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.636 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:21:18.637 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-04-26T11:21:18.638 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-04-26T11:21:18.639 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.640 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore compression algorithm = lz4 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore compression mode = aggressive 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:21:18.641 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: osd max markdown count = 1000 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.642 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:21:18.643 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-04-26T11:21:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.645 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.646 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-04-26T11:21:18.647 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-04-26T11:21:18.648 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-04-26T11:21:18.649 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore compression algorithm = lz4 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore compression mode = aggressive 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-04-26T11:21:18.650 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: osd max markdown count = 1000 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:21:18.651 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.652 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-04-26T11:21:18.653 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.654 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T11:21:18.655 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.656 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]" 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2024-04-26T11:21:18.657 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.658 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore compression algorithm = lz4 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore compression mode = aggressive 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2024-04-26T11:21:18.659 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 1/20 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 1/20 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 4/10 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: osd blocked scrub grace period = 3600 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: osd max markdown count = 1000 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2024-04-26T11:21:18.660 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2024-04-26T11:21:18.661 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2024-04-26T11:21:18.662 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-04-26T11:21:18.663 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2024-04-26T11:21:18.663 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2024-04-26T11:21:18.663 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2024-04-26T11:21:18.663 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2024-04-26T11:21:18.663 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T11:21:18.663 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T11:21:18.663 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2024-04-26T11:21:18.663 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2024-04-26T11:21:18.663 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2024-04-26T11:21:18.663 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-04-26T11:21:18.665 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T11:21:18.666 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T11:21:18.754 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T11:21:18.754 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:18.754 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T11:21:18.759 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:18.759 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T11:21:18.808 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-04-26T11:21:18.808 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:18.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:21:18.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:21:18.871 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:18.871 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:21:18.919 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T11:21:18.919 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:21:18.919 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:21:18.919 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:21:18.943 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:21:18.944 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:21:18.990 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-04-26T11:21:18.991 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:21:18.991 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:21:18.991 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:21:19.015 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:21:19.015 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:21:19.064 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T11:21:19.064 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:21:19.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T11:21:19.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T11:21:19.088 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:21:19.088 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:21:19.138 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T11:21:19.138 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T11:21:19.139 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T11:21:19.181 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T11:21:19.184 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T11:21:19.265 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T11:21:19.268 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T11:21:19.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T11:21:19.348 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T11:21:19.350 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T11:21:19.407 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T11:21:19.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T11:21:19.483 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T11:21:19.494 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T11:21:19.494 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T11:21:19.494 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T11:21:19.508 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T11:21:19.508 INFO:tasks.ceph:role: osd.0 2024-04-26T11:21:19.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T11:21:19.508 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T11:21:19.569 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T11:21:19.570 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T11:21:19.570 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T11:21:19.570 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T11:21:19.570 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T11:21:19.570 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-04-26T11:21:19.570 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T11:21:19.570 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T11:21:19.570 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T11:21:19.570 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T11:21:20.016 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2024-04-26T11:21:20.019 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-04-26T11:21:20.019 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T11:21:20.118 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T11:21:20.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:21:20.128 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T11:21:20.128 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:21:20.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T11:21:20.249+0000 7f8c4949c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T11:21:20.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T11:21:20.249+0000 7f8c4949c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T11:21:20.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T11:21:20.249+0000 7f8c4949c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T11:21:20.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T11:21:20.249+0000 7f8c4949c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T11:21:20.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T11:21:20.249+0000 7f8c4949c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T11:21:20.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-04-26T11:21:20.257+0000 7f8c4949c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T11:21:23.277 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T11:21:23.291 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T11:21:23.305 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T11:21:23.305 INFO:tasks.ceph:role: osd.1 2024-04-26T11:21:23.305 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-04-26T11:21:23.305 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T11:21:23.366 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T11:21:23.366 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T11:21:23.366 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T11:21:23.366 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T11:21:23.367 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T11:21:23.367 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-04-26T11:21:23.367 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T11:21:23.367 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T11:21:23.367 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T11:21:23.367 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T11:21:23.821 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-04-26T11:21:23.823 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-04-26T11:21:23.823 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T11:21:23.925 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T11:21:23.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:21:23.936 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T11:21:23.936 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:21:24.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-26T11:21:24.042+0000 7fdcd698b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T11:21:24.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-26T11:21:24.046+0000 7fdcd698b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T11:21:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-26T11:21:24.046+0000 7fdcd698b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T11:21:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-26T11:21:24.046+0000 7fdcd698b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T11:21:24.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-26T11:21:24.046+0000 7fdcd698b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T11:21:24.056 INFO:teuthology.orchestra.run.smithi107.stderr:2024-04-26T11:21:24.054+0000 7fdcd698b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T11:21:27.032 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T11:21:27.047 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T11:21:27.061 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T11:21:27.061 INFO:tasks.ceph:role: osd.2 2024-04-26T11:21:27.061 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T11:21:27.062 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T11:21:27.125 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T11:21:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T11:21:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T11:21:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T11:21:27.125 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T11:21:27.125 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-26T11:21:27.125 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T11:21:27.126 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T11:21:27.126 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T11:21:27.126 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T11:21:27.579 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-26T11:21:27.581 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-26T11:21:27.582 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T11:21:27.683 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T11:21:27.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:21:27.695 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T11:21:27.695 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:21:27.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T11:21:27.809+0000 7f847b5c27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T11:21:27.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T11:21:27.809+0000 7f847b5c27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T11:21:27.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T11:21:27.809+0000 7f847b5c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T11:21:27.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T11:21:27.809+0000 7f847b5c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T11:21:27.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T11:21:27.809+0000 7f847b5c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T11:21:27.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T11:21:27.817+0000 7f847b5c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T11:21:30.804 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T11:21:30.819 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T11:21:30.819 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:30.819 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T11:21:30.835 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:30.835 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T11:21:30.891 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:30.891 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T11:21:30.947 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:21:30.947 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T11:21:30.962 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:21:30.962 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T11:21:30.976 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:21:30.976 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T11:21:30.989 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:21:30.990 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T11:21:30.995 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T11:21:30.995 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T11:21:31.048 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-04-26T11:21:31.049 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAvjitmlxfhChAAtzXOilfhsM94if6ceh6WNw== 2024-04-26T11:21:31.049 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-04-26T11:21:31.049 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAvjitmjIDjDxAAztMMEPMXT8i184jek3s1gQ== 2024-04-26T11:21:31.049 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2024-04-26T11:21:31.049 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAvjitmGsfTFBAAuqdcyAUd+lamsht82rIS5Q== 2024-04-26T11:21:31.049 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-04-26T11:21:31.050 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAwjitmEaL8DhAAtOajc64qtmO4OjpI7ADL/g== 2024-04-26T11:21:31.050 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-04-26T11:21:31.050 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQA0jitmh3/JAhAA5OmpINw94hYqDkYbKlY6eA== 2024-04-26T11:21:31.050 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-04-26T11:21:31.050 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQA3jitmrDpgMBAAFsJ3mifIuBv9oYXOkPzjzw== 2024-04-26T11:21:31.050 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-04-26T11:21:31.051 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAvjitm4KjoHBAA9SrlKhQ39g3XcS4A/jD3AA== 2024-04-26T11:21:31.052 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T11:21:31.138 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T11:21:31.225 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T11:21:31.315 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T11:21:31.354 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T11:21:31.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T11:21:31.526 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T11:21:31.618 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T11:21:31.618 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T11:21:31.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T11:21:31.794 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T11:21:31.805 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T11:21:31.862 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T11:21:31.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T11:21:31.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T11:21:32.015 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T11:21:32.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T11:21:32.114 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T11:21:32.163 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T11:21:32.163 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T11:21:32.163 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T11:21:32.207 INFO:tasks.ceph.mon.a:Started 2024-04-26T11:21:32.207 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T11:21:32.207 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T11:21:32.209 INFO:tasks.ceph.mon.b:Started 2024-04-26T11:21:32.209 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T11:21:32.210 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T11:21:32.212 INFO:tasks.ceph.mon.c:Started 2024-04-26T11:21:32.212 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T11:21:32.212 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T11:21:32.212 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T11:21:32.214 INFO:tasks.ceph.mgr.x:Started 2024-04-26T11:21:32.214 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T11:21:32.214 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T11:21:32.216 INFO:tasks.ceph.mgr.y:Started 2024-04-26T11:21:32.216 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T11:21:32.216 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T11:21:32.787 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:32.785+0000 7f6bb8389180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:21:32.787 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:32.785+0000 7fa902ffb180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T11:21:33.057 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2024-04-26T11:21:33.074 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T11:21:33.074 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T11:21:33.075 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-04-26T11:21:33.075 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T11:21:33.089 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-04-26T11:21:33.089 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T11:21:33.102 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T11:21:33.103 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T11:21:33.116 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 8b4f67c6-5cab-46bf-b296-34fcc29c7766 0 2024-04-26T11:21:33.301 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:33.297+0000 7f6bb8389180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:21:33.305 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:33.301+0000 7fa902ffb180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T11:21:33.377 INFO:teuthology.orchestra.run.smithi175.stdout:0 2024-04-26T11:21:33.396 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new d465bcda-9e32-469e-82f3-077db852411e 1 2024-04-26T11:21:33.508 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:33.505+0000 7f6bb8389180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:21:33.510 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:33.509+0000 7fa902ffb180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T11:21:33.605 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-26T11:21:33.623 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 61e99173-e480-4da1-a95b-d98715c3e713 2 2024-04-26T11:21:33.828 INFO:teuthology.orchestra.run.smithi175.stdout:2 2024-04-26T11:21:33.844 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T11:21:33.845 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T11:21:33.847 INFO:tasks.ceph.osd.0:Started 2024-04-26T11:21:33.847 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T11:21:33.847 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T11:21:33.850 INFO:tasks.ceph.osd.1:Started 2024-04-26T11:21:33.850 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T11:21:33.850 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T11:21:33.852 INFO:tasks.ceph.osd.2:Started 2024-04-26T11:21:33.853 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:21:34.038 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:34.039 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:33.824306+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:21:34.055 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T11:21:34.055 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T11:21:34.077 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:34.073+0000 7fa902ffb180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:21:34.077 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:34.073+0000 7f6bb8389180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T11:21:34.132 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:34.129+0000 7fa902ffb180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:21:34.132 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:34.129+0000 7f6bb8389180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T11:21:34.185 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:34.181+0000 7fa902ffb180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:21:34.186 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:34.181+0000 7f6bb8389180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T11:21:34.264 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:34.261+0000 7fa902ffb180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:21:34.264 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:34.261+0000 7f6bb8389180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T11:21:34.317 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:34.313+0000 7fa902ffb180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:21:34.317 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:34.313+0000 7f6bb8389180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T11:21:34.357 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T11:21:34.397 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:34.393+0000 7fa902ffb180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:21:34.397 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:34.393+0000 7f6bb8389180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T11:21:34.452 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:34.449+0000 7fa902ffb180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:21:34.453 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:34.449+0000 7f6bb8389180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T11:21:34.466 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:21:34.465+0000 7f06335a27c0 -1 Falling back to public interface 2024-04-26T11:21:34.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:21:34.466+0000 7fdd3e11d7c0 -1 Falling back to public interface 2024-04-26T11:21:34.479 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:21:34.477+0000 7fc53affb7c0 -1 Falling back to public interface 2024-04-26T11:21:34.538 INFO:teuthology.misc.health.smithi073.stdout: 2024-04-26T11:21:34.538 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":5,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:33.824306+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:21:34.554 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T11:21:34.614 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:34.609+0000 7f6bb8389180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:21:34.614 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:34.613+0000 7fa902ffb180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T11:21:34.675 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:34.673+0000 7f6bb8389180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:21:34.675 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:34.673+0000 7fa902ffb180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T11:21:35.367 INFO:tasks.ceph.mgr.x.smithi073.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T11:21:35.367 INFO:tasks.ceph.mgr.x.smithi073.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T11:21:35.367 INFO:tasks.ceph.mgr.x.smithi073.stderr: from numpy import show_config as show_numpy_config 2024-04-26T11:21:35.367 INFO:tasks.ceph.mgr.y.smithi073.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T11:21:35.367 INFO:tasks.ceph.mgr.y.smithi073.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T11:21:35.367 INFO:tasks.ceph.mgr.y.smithi073.stderr: from numpy import show_config as show_numpy_config 2024-04-26T11:21:35.442 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:35.441+0000 7f6bb8389180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:21:35.446 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:35.445+0000 7fa902ffb180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T11:21:35.608 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:35.605+0000 7f6bb8389180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:21:35.626 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:35.625+0000 7fa902ffb180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:21:35.778 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:35.773+0000 7f6bb8389180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:21:35.778 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:35.773+0000 7fa902ffb180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T11:21:35.849 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:35.845+0000 7fa902ffb180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:21:35.849 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:35.845+0000 7f6bb8389180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T11:21:35.987 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:35.985+0000 7fa902ffb180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:21:35.994 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:35.993+0000 7f6bb8389180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T11:21:36.617 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:36.613+0000 7f6bb8389180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:21:36.617 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:36.613+0000 7fa902ffb180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T11:21:36.693 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:36.689+0000 7fa902ffb180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:21:36.694 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:36.689+0000 7f6bb8389180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T11:21:36.877 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:36.873+0000 7f6bb8389180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:21:36.877 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:36.873+0000 7fa902ffb180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T11:21:36.952 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:36.949+0000 7fa902ffb180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:21:36.953 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:36.949+0000 7f6bb8389180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T11:21:37.244 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:37.241+0000 7fa902ffb180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:21:37.244 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:37.241+0000 7f6bb8389180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T11:21:37.307 INFO:tasks.ceph.mgr.y.smithi073.stderr:2024-04-26T11:21:37.305+0000 7fa902ffb180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:21:37.307 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:37.305+0000 7f6bb8389180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T11:21:38.146 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:21:38.142+0000 7fdd3e11d7c0 -1 osd.1 0 log_to_monitors true 2024-04-26T11:21:38.165 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:21:38.161+0000 7fc53affb7c0 -1 osd.0 0 log_to_monitors true 2024-04-26T11:21:38.165 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:21:38.165+0000 7f06335a27c0 -1 osd.2 0 log_to_monitors true 2024-04-26T11:21:38.335 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:38.333+0000 7f6b5f841640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T11:21:38.337 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-04-26T11:21:38.333+0000 7f6b5f841640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T11:21:40.173 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:21:40.169+0000 7fc536fa0640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T11:21:40.181 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:21:40.178+0000 7fdd3a0c2640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T11:21:40.194 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:21:40.193+0000 7fc52edd3640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:21:40.205 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:21:40.205+0000 7f062fd5e640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T11:21:40.208 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:21:40.206+0000 7fdd31ef5640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:21:40.234 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:21:40.233+0000 7f062737a640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:21:40.856 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T11:21:41.151 INFO:teuthology.misc.health.smithi073.stdout: 2024-04-26T11:21:41.151 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":7,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:39.377736+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:21:41.168 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T11:21:47.471 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T11:21:47.772 INFO:teuthology.misc.health.smithi073.stdout: 2024-04-26T11:21:47.772 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":11,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:44.215910+0000","last_up_change":"2024-04-26T11:21:41.209558+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:21:47.790 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-26T11:21:47.790 INFO:tasks.ceph:Creating RBD pool 2024-04-26T11:21:47.790 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T11:21:48.281 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2024-04-26T11:21:48.302 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T11:21:49.284 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T11:21:49.306 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T11:21:49.307 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T11:21:49.307 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T11:21:49.310 INFO:tasks.ceph.mds.a:Started 2024-04-26T11:21:49.310 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T11:21:49.311 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:21:49.390 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-04-26T11:21:49.597 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:49.597 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":13,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:49.277919+0000","last_up_change":"2024-04-26T11:21:41.209558+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:21:49.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:21:41.373843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:21:48.112664+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:21:49.641 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:21:49.920 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-26T11:21:49.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:21:50.232 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-26T11:21:50.251 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:21:50.560 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:50.560 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4207,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6803/3100108986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3100108986},{"type":"v1","addr":"172.21.15.73:6803","nonce":3100108986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-26T11:21:50.560 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 2 2024-04-26T11:21:50.577 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:21:50.849 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:50.850 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":14,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:50.286862+0000","last_up_change":"2024-04-26T11:21:41.209558+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:21:50.866 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:21:41.373843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:21:48.112664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:21:50.867 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:21:51.132 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-26T11:21:51.150 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:21:51.431 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-26T11:21:51.449 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T11:21:51.728 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:51.728 INFO:teuthology.orchestra.run.smithi073.stdout:[ 2024-04-26T11:21:51.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:21:51.729 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 1, 2024-04-26T11:21:51.729 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": ".mgr" 2024-04-26T11:21:51.729 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:21:51.729 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:21:51.729 INFO:teuthology.orchestra.run.smithi073.stdout: "poolnum": 2, 2024-04-26T11:21:51.729 INFO:teuthology.orchestra.run.smithi073.stdout: "poolname": "rbd" 2024-04-26T11:21:51.729 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:21:51.729 INFO:teuthology.orchestra.run.smithi073.stdout:] 2024-04-26T11:21:51.745 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T11:21:51.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T11:21:52.311 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' created 2024-04-26T11:21:52.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T11:21:53.315 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' created 2024-04-26T11:21:53.340 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T11:21:53.677 INFO:teuthology.orchestra.run.smithi073.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T11:21:53.696 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:21:53.987 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:53.987 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:53.670488+0000","last_up_change":"2024-04-26T11:21:41.209558+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:21:54.005 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:21:54.282 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":17,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:53.670488+0000","last_up_change":"2024-04-26T11:21:41.209558+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:21:54.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T11:21:54.701 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T11:21:54.701 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T11:21:55.719 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T11:21:55.719 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:21:56.028 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:56.028 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:21:53.671194+0000","modified":"2024-04-26T11:21:55.684708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/3100108986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3100108986},{"type":"v1","addr":"172.21.15.73:6803","nonce":3100108986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:21:56.029 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-26T11:21:56.046 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:21:56.318 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:56.318 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:54.674778+0000","last_up_change":"2024-04-26T11:21:41.209558+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:21:56.337 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T11:21:56.337 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:21:56.640 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:56.642 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:21:56.658 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-26T11:21:55.321066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81544,"kb_used_data":480,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033976,"statfs":{"total":289910292480,"available":289826791424,"internally_reserved":0,"allocated":491520,"data_stored":1291067,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":82963795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000740"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":209,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T11:21:49.288115+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:21:49.288115+0000","last_peered":"2024-04-26T11:21:49.288115+0000","last_clean":"2024-04-26T11:21:49.288115+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:21:49.288115+0000","last_undegraded":"2024-04-26T11:21:49.288115+0000","last_fullsized":"2024-04-26T11:21:49.288115+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.291238+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:21:50.291238+0000","last_peered":"2024-04-26T11:21:50.291238+0000","last_clean":"2024-04-26T11:21:50.291238+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:21:50.291238+0000","last_undegraded":"2024-04-26T11:21:50.291238+0000","last_fullsized":"2024-04-26T11:21:50.291238+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.291249+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:21:50.291249+0000","last_peered":"2024-04-26T11:21:50.291249+0000","last_clean":"2024-04-26T11:21:50.291249+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:21:50.291249+0000","last_undegraded":"2024-04-26T11:21:50.291249+0000","last_fullsized":"2024-04-26T11:21:50.291249+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.356607+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:21:50.356607+0000","last_peered":"2024-04-26T11:21:50.356607+0000","last_clean":"2024-04-26T11:21:50.356607+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:21:50.356607+0000","last_undegraded":"2024-04-26T11:21:50.356607+0000","last_fullsized":"2024-04-26T11:21:50.356607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.291243+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:21:50.291243+0000","last_peered":"2024-04-26T11:21:50.291243+0000","last_clean":"2024-04-26T11:21:50.291243+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:21:50.291243+0000","last_undegraded":"2024-04-26T11:21:50.291243+0000","last_fullsized":"2024-04-26T11:21:50.291243+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.356578+0000","last_change":"2024-04-26T11:21:49.292007+0000","last_active":"2024-04-26T11:21:50.356578+0000","last_peered":"2024-04-26T11:21:50.356578+0000","last_clean":"2024-04-26T11:21:50.356578+0000","last_became_active":"2024-04-26T11:21:49.291100+0000","last_became_peered":"2024-04-26T11:21:49.291100+0000","last_unstale":"2024-04-26T11:21:50.356578+0000","last_undegraded":"2024-04-26T11:21:50.356578+0000","last_fullsized":"2024-04-26T11:21:50.356578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.877516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.295535+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:21:50.295535+0000","last_peered":"2024-04-26T11:21:50.295535+0000","last_clean":"2024-04-26T11:21:50.295535+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:21:50.295535+0000","last_undegraded":"2024-04-26T11:21:50.295535+0000","last_fullsized":"2024-04-26T11:21:50.295535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.356558+0000","last_change":"2024-04-26T11:21:49.292644+0000","last_active":"2024-04-26T11:21:50.356558+0000","last_peered":"2024-04-26T11:21:50.356558+0000","last_clean":"2024-04-26T11:21:50.356558+0000","last_became_active":"2024-04-26T11:21:49.291499+0000","last_became_peered":"2024-04-26T11:21:49.291499+0000","last_unstale":"2024-04-26T11:21:50.356558+0000","last_undegraded":"2024-04-26T11:21:50.356558+0000","last_fullsized":"2024-04-26T11:21:50.356558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.291265+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:21:50.291265+0000","last_peered":"2024-04-26T11:21:50.291265+0000","last_clean":"2024-04-26T11:21:50.291265+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:21:50.291265+0000","last_undegraded":"2024-04-26T11:21:50.291265+0000","last_fullsized":"2024-04-26T11:21:50.291265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":122880,"data_stored":36777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":627145,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":627145,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:21:56.662 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:21:57.007 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:57.009 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:21:57.025 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-26T11:21:55.321066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81544,"kb_used_data":480,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033976,"statfs":{"total":289910292480,"available":289826791424,"internally_reserved":0,"allocated":491520,"data_stored":1291067,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":82963795},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000740"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":209,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-26T11:21:49.288115+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:21:49.288115+0000","last_peered":"2024-04-26T11:21:49.288115+0000","last_clean":"2024-04-26T11:21:49.288115+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:21:49.288115+0000","last_undegraded":"2024-04-26T11:21:49.288115+0000","last_fullsized":"2024-04-26T11:21:49.288115+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.291238+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:21:50.291238+0000","last_peered":"2024-04-26T11:21:50.291238+0000","last_clean":"2024-04-26T11:21:50.291238+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:21:50.291238+0000","last_undegraded":"2024-04-26T11:21:50.291238+0000","last_fullsized":"2024-04-26T11:21:50.291238+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.291249+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:21:50.291249+0000","last_peered":"2024-04-26T11:21:50.291249+0000","last_clean":"2024-04-26T11:21:50.291249+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:21:50.291249+0000","last_undegraded":"2024-04-26T11:21:50.291249+0000","last_fullsized":"2024-04-26T11:21:50.291249+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.356607+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:21:50.356607+0000","last_peered":"2024-04-26T11:21:50.356607+0000","last_clean":"2024-04-26T11:21:50.356607+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:21:50.356607+0000","last_undegraded":"2024-04-26T11:21:50.356607+0000","last_fullsized":"2024-04-26T11:21:50.356607+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.291243+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:21:50.291243+0000","last_peered":"2024-04-26T11:21:50.291243+0000","last_clean":"2024-04-26T11:21:50.291243+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:21:50.291243+0000","last_undegraded":"2024-04-26T11:21:50.291243+0000","last_fullsized":"2024-04-26T11:21:50.291243+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.356578+0000","last_change":"2024-04-26T11:21:49.292007+0000","last_active":"2024-04-26T11:21:50.356578+0000","last_peered":"2024-04-26T11:21:50.356578+0000","last_clean":"2024-04-26T11:21:50.356578+0000","last_became_active":"2024-04-26T11:21:49.291100+0000","last_became_peered":"2024-04-26T11:21:49.291100+0000","last_unstale":"2024-04-26T11:21:50.356578+0000","last_undegraded":"2024-04-26T11:21:50.356578+0000","last_fullsized":"2024-04-26T11:21:50.356578+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.877516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.295535+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:21:50.295535+0000","last_peered":"2024-04-26T11:21:50.295535+0000","last_clean":"2024-04-26T11:21:50.295535+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:21:50.295535+0000","last_undegraded":"2024-04-26T11:21:50.295535+0000","last_fullsized":"2024-04-26T11:21:50.295535+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.356558+0000","last_change":"2024-04-26T11:21:49.292644+0000","last_active":"2024-04-26T11:21:50.356558+0000","last_peered":"2024-04-26T11:21:50.356558+0000","last_clean":"2024-04-26T11:21:50.356558+0000","last_became_active":"2024-04-26T11:21:49.291499+0000","last_became_peered":"2024-04-26T11:21:49.291499+0000","last_unstale":"2024-04-26T11:21:50.356558+0000","last_undegraded":"2024-04-26T11:21:50.356558+0000","last_fullsized":"2024-04-26T11:21:50.356558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-26T11:21:50.291265+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:21:50.291265+0000","last_peered":"2024-04-26T11:21:50.291265+0000","last_clean":"2024-04-26T11:21:50.291265+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:21:50.291265+0000","last_undegraded":"2024-04-26T11:21:50.291265+0000","last_fullsized":"2024-04-26T11:21:50.291265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:53.304950+0000","last_change":"2024-04-26T11:21:53.304950+0000","last_active":"2024-04-26T11:21:53.304950+0000","last_peered":"2024-04-26T11:21:53.304950+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:53.304950+0000","last_undegraded":"2024-04-26T11:21:53.304950+0000","last_fullsized":"2024-04-26T11:21:53.304950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T11:21:52.296572+0000","last_change":"2024-04-26T11:21:52.296572+0000","last_active":"2024-04-26T11:21:52.296572+0000","last_peered":"2024-04-26T11:21:52.296572+0000","last_clean":"2024-04-26T11:21:52.296572+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T11:21:52.296572+0000","last_undegraded":"2024-04-26T11:21:52.296572+0000","last_fullsized":"2024-04-26T11:21:52.296572+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":122880,"data_stored":36777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":627145,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":184320,"data_stored":627145,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:21:57.029 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:21:57.372 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:57.373 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:21:57.388 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T11:21:57.321650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85824,"kb_used_data":640,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029696,"statfs":{"total":289910292480,"available":289822408704,"internally_reserved":0,"allocated":655360,"data_stored":1350688,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.014982"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691482+0000","last_change":"2024-04-26T11:21:53.713298+0000","last_active":"2024-04-26T11:21:54.691482+0000","last_peered":"2024-04-26T11:21:54.691482+0000","last_clean":"2024-04-26T11:21:54.691482+0000","last_became_active":"2024-04-26T11:21:53.712481+0000","last_became_peered":"2024-04-26T11:21:53.712481+0000","last_unstale":"2024-04-26T11:21:54.691482+0000","last_undegraded":"2024-04-26T11:21:54.691482+0000","last_fullsized":"2024-04-26T11:21:54.691482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691323+0000","last_change":"2024-04-26T11:21:53.716754+0000","last_active":"2024-04-26T11:21:54.691323+0000","last_peered":"2024-04-26T11:21:54.691323+0000","last_clean":"2024-04-26T11:21:54.691323+0000","last_became_active":"2024-04-26T11:21:53.716109+0000","last_became_peered":"2024-04-26T11:21:53.716109+0000","last_unstale":"2024-04-26T11:21:54.691323+0000","last_undegraded":"2024-04-26T11:21:54.691323+0000","last_fullsized":"2024-04-26T11:21:54.691323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658980+0000","last_change":"2024-04-26T11:21:53.710480+0000","last_active":"2024-04-26T11:21:55.658980+0000","last_peered":"2024-04-26T11:21:55.658980+0000","last_clean":"2024-04-26T11:21:55.658980+0000","last_became_active":"2024-04-26T11:21:53.709433+0000","last_became_peered":"2024-04-26T11:21:53.709433+0000","last_unstale":"2024-04-26T11:21:55.658980+0000","last_undegraded":"2024-04-26T11:21:55.658980+0000","last_fullsized":"2024-04-26T11:21:55.658980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:11.687344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658399+0000","last_change":"2024-04-26T11:21:53.719849+0000","last_active":"2024-04-26T11:21:55.658399+0000","last_peered":"2024-04-26T11:21:55.658399+0000","last_clean":"2024-04-26T11:21:55.658399+0000","last_became_active":"2024-04-26T11:21:53.719152+0000","last_became_peered":"2024-04-26T11:21:53.719152+0000","last_unstale":"2024-04-26T11:21:55.658399+0000","last_undegraded":"2024-04-26T11:21:55.658399+0000","last_fullsized":"2024-04-26T11:21:55.658399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690467+0000","last_change":"2024-04-26T11:21:53.712493+0000","last_active":"2024-04-26T11:21:54.690467+0000","last_peered":"2024-04-26T11:21:54.690467+0000","last_clean":"2024-04-26T11:21:54.690467+0000","last_became_active":"2024-04-26T11:21:53.711704+0000","last_became_peered":"2024-04-26T11:21:53.711704+0000","last_unstale":"2024-04-26T11:21:54.690467+0000","last_undegraded":"2024-04-26T11:21:54.690467+0000","last_fullsized":"2024-04-26T11:21:54.690467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657707+0000","last_change":"2024-04-26T11:21:53.715149+0000","last_active":"2024-04-26T11:21:55.657707+0000","last_peered":"2024-04-26T11:21:55.657707+0000","last_clean":"2024-04-26T11:21:55.657707+0000","last_became_active":"2024-04-26T11:21:53.714125+0000","last_became_peered":"2024-04-26T11:21:53.714125+0000","last_unstale":"2024-04-26T11:21:55.657707+0000","last_undegraded":"2024-04-26T11:21:55.657707+0000","last_fullsized":"2024-04-26T11:21:55.657707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657112+0000","last_change":"2024-04-26T11:21:53.714653+0000","last_active":"2024-04-26T11:21:55.657112+0000","last_peered":"2024-04-26T11:21:55.657112+0000","last_clean":"2024-04-26T11:21:55.657112+0000","last_became_active":"2024-04-26T11:21:53.713586+0000","last_became_peered":"2024-04-26T11:21:53.713586+0000","last_unstale":"2024-04-26T11:21:55.657112+0000","last_undegraded":"2024-04-26T11:21:55.657112+0000","last_fullsized":"2024-04-26T11:21:55.657112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:01.563026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657099+0000","last_change":"2024-04-26T11:21:53.715422+0000","last_active":"2024-04-26T11:21:55.657099+0000","last_peered":"2024-04-26T11:21:55.657099+0000","last_clean":"2024-04-26T11:21:55.657099+0000","last_became_active":"2024-04-26T11:21:53.714329+0000","last_became_peered":"2024-04-26T11:21:53.714329+0000","last_unstale":"2024-04-26T11:21:55.657099+0000","last_undegraded":"2024-04-26T11:21:55.657099+0000","last_fullsized":"2024-04-26T11:21:55.657099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:06.981197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691270+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:21:54.691270+0000","last_peered":"2024-04-26T11:21:54.691270+0000","last_clean":"2024-04-26T11:21:54.691270+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:21:54.691270+0000","last_undegraded":"2024-04-26T11:21:54.691270+0000","last_fullsized":"2024-04-26T11:21:54.691270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691299+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:21:54.691299+0000","last_peered":"2024-04-26T11:21:54.691299+0000","last_clean":"2024-04-26T11:21:54.691299+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:21:54.691299+0000","last_undegraded":"2024-04-26T11:21:54.691299+0000","last_fullsized":"2024-04-26T11:21:54.691299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658964+0000","last_change":"2024-04-26T11:21:53.714245+0000","last_active":"2024-04-26T11:21:55.658964+0000","last_peered":"2024-04-26T11:21:55.658964+0000","last_clean":"2024-04-26T11:21:55.658964+0000","last_became_active":"2024-04-26T11:21:53.713331+0000","last_became_peered":"2024-04-26T11:21:53.713331+0000","last_unstale":"2024-04-26T11:21:55.658964+0000","last_undegraded":"2024-04-26T11:21:55.658964+0000","last_fullsized":"2024-04-26T11:21:55.658964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690847+0000","last_change":"2024-04-26T11:21:53.712269+0000","last_active":"2024-04-26T11:21:54.690847+0000","last_peered":"2024-04-26T11:21:54.690847+0000","last_clean":"2024-04-26T11:21:54.690847+0000","last_became_active":"2024-04-26T11:21:53.710740+0000","last_became_peered":"2024-04-26T11:21:53.710740+0000","last_unstale":"2024-04-26T11:21:54.690847+0000","last_undegraded":"2024-04-26T11:21:54.690847+0000","last_fullsized":"2024-04-26T11:21:54.690847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690903+0000","last_change":"2024-04-26T11:21:53.712552+0000","last_active":"2024-04-26T11:21:54.690903+0000","last_peered":"2024-04-26T11:21:54.690903+0000","last_clean":"2024-04-26T11:21:54.690903+0000","last_became_active":"2024-04-26T11:21:53.711470+0000","last_became_peered":"2024-04-26T11:21:53.711470+0000","last_unstale":"2024-04-26T11:21:54.690903+0000","last_undegraded":"2024-04-26T11:21:54.690903+0000","last_fullsized":"2024-04-26T11:21:54.690903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657972+0000","last_change":"2024-04-26T11:21:53.705872+0000","last_active":"2024-04-26T11:21:55.657972+0000","last_peered":"2024-04-26T11:21:55.657972+0000","last_clean":"2024-04-26T11:21:55.657972+0000","last_became_active":"2024-04-26T11:21:53.705040+0000","last_became_peered":"2024-04-26T11:21:53.705040+0000","last_unstale":"2024-04-26T11:21:55.657972+0000","last_undegraded":"2024-04-26T11:21:55.657972+0000","last_fullsized":"2024-04-26T11:21:55.657972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:02.015153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657316+0000","last_change":"2024-04-26T11:21:53.707324+0000","last_active":"2024-04-26T11:21:55.657316+0000","last_peered":"2024-04-26T11:21:55.657316+0000","last_clean":"2024-04-26T11:21:55.657316+0000","last_became_active":"2024-04-26T11:21:53.706602+0000","last_became_peered":"2024-04-26T11:21:53.706602+0000","last_unstale":"2024-04-26T11:21:55.657316+0000","last_undegraded":"2024-04-26T11:21:55.657316+0000","last_fullsized":"2024-04-26T11:21:55.657316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.907498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657115+0000","last_change":"2024-04-26T11:21:53.714327+0000","last_active":"2024-04-26T11:21:55.657115+0000","last_peered":"2024-04-26T11:21:55.657115+0000","last_clean":"2024-04-26T11:21:55.657115+0000","last_became_active":"2024-04-26T11:21:53.712908+0000","last_became_peered":"2024-04-26T11:21:53.712908+0000","last_unstale":"2024-04-26T11:21:55.657115+0000","last_undegraded":"2024-04-26T11:21:55.657115+0000","last_fullsized":"2024-04-26T11:21:55.657115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:31.158881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691927+0000","last_change":"2024-04-26T11:21:53.713524+0000","last_active":"2024-04-26T11:21:54.691927+0000","last_peered":"2024-04-26T11:21:54.691927+0000","last_clean":"2024-04-26T11:21:54.691927+0000","last_became_active":"2024-04-26T11:21:53.710675+0000","last_became_peered":"2024-04-26T11:21:53.710675+0000","last_unstale":"2024-04-26T11:21:54.691927+0000","last_undegraded":"2024-04-26T11:21:54.691927+0000","last_fullsized":"2024-04-26T11:21:54.691927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691739+0000","last_change":"2024-04-26T11:21:53.714983+0000","last_active":"2024-04-26T11:21:54.691739+0000","last_peered":"2024-04-26T11:21:54.691739+0000","last_clean":"2024-04-26T11:21:54.691739+0000","last_became_active":"2024-04-26T11:21:53.711987+0000","last_became_peered":"2024-04-26T11:21:53.711987+0000","last_unstale":"2024-04-26T11:21:54.691739+0000","last_undegraded":"2024-04-26T11:21:54.691739+0000","last_fullsized":"2024-04-26T11:21:54.691739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:49.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691059+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:21:54.691059+0000","last_peered":"2024-04-26T11:21:54.691059+0000","last_clean":"2024-04-26T11:21:54.691059+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:21:54.691059+0000","last_undegraded":"2024-04-26T11:21:54.691059+0000","last_fullsized":"2024-04-26T11:21:54.691059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658842+0000","last_change":"2024-04-26T11:21:53.715255+0000","last_active":"2024-04-26T11:21:55.658842+0000","last_peered":"2024-04-26T11:21:55.658842+0000","last_clean":"2024-04-26T11:21:55.658842+0000","last_became_active":"2024-04-26T11:21:53.714525+0000","last_became_peered":"2024-04-26T11:21:53.714525+0000","last_unstale":"2024-04-26T11:21:55.658842+0000","last_undegraded":"2024-04-26T11:21:55.658842+0000","last_fullsized":"2024-04-26T11:21:55.658842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658215+0000","last_change":"2024-04-26T11:21:53.714368+0000","last_active":"2024-04-26T11:21:55.658215+0000","last_peered":"2024-04-26T11:21:55.658215+0000","last_clean":"2024-04-26T11:21:55.658215+0000","last_became_active":"2024-04-26T11:21:53.713099+0000","last_became_peered":"2024-04-26T11:21:53.713099+0000","last_unstale":"2024-04-26T11:21:55.658215+0000","last_undegraded":"2024-04-26T11:21:55.658215+0000","last_fullsized":"2024-04-26T11:21:55.658215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689959+0000","last_change":"2024-04-26T11:21:53.709697+0000","last_active":"2024-04-26T11:21:54.689959+0000","last_peered":"2024-04-26T11:21:54.689959+0000","last_clean":"2024-04-26T11:21:54.689959+0000","last_became_active":"2024-04-26T11:21:53.708839+0000","last_became_peered":"2024-04-26T11:21:53.708839+0000","last_unstale":"2024-04-26T11:21:54.689959+0000","last_undegraded":"2024-04-26T11:21:54.689959+0000","last_fullsized":"2024-04-26T11:21:54.689959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689490+0000","last_change":"2024-04-26T11:21:53.705071+0000","last_active":"2024-04-26T11:21:54.689490+0000","last_peered":"2024-04-26T11:21:54.689490+0000","last_clean":"2024-04-26T11:21:54.689490+0000","last_became_active":"2024-04-26T11:21:53.704331+0000","last_became_peered":"2024-04-26T11:21:53.704331+0000","last_unstale":"2024-04-26T11:21:54.689490+0000","last_undegraded":"2024-04-26T11:21:54.689490+0000","last_fullsized":"2024-04-26T11:21:54.689490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689441+0000","last_change":"2024-04-26T11:21:53.692834+0000","last_active":"2024-04-26T11:21:54.689441+0000","last_peered":"2024-04-26T11:21:54.689441+0000","last_clean":"2024-04-26T11:21:54.689441+0000","last_became_active":"2024-04-26T11:21:53.690279+0000","last_became_peered":"2024-04-26T11:21:53.690279+0000","last_unstale":"2024-04-26T11:21:54.689441+0000","last_undegraded":"2024-04-26T11:21:54.689441+0000","last_fullsized":"2024-04-26T11:21:54.689441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691605+0000","last_change":"2024-04-26T11:21:53.698796+0000","last_active":"2024-04-26T11:21:54.691605+0000","last_peered":"2024-04-26T11:21:54.691605+0000","last_clean":"2024-04-26T11:21:54.691605+0000","last_became_active":"2024-04-26T11:21:53.697854+0000","last_became_peered":"2024-04-26T11:21:53.697854+0000","last_unstale":"2024-04-26T11:21:54.691605+0000","last_undegraded":"2024-04-26T11:21:54.691605+0000","last_fullsized":"2024-04-26T11:21:54.691605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691288+0000","last_change":"2024-04-26T11:21:53.706583+0000","last_active":"2024-04-26T11:21:54.691288+0000","last_peered":"2024-04-26T11:21:54.691288+0000","last_clean":"2024-04-26T11:21:54.691288+0000","last_became_active":"2024-04-26T11:21:53.704871+0000","last_became_peered":"2024-04-26T11:21:53.704871+0000","last_unstale":"2024-04-26T11:21:54.691288+0000","last_undegraded":"2024-04-26T11:21:54.691288+0000","last_fullsized":"2024-04-26T11:21:54.691288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659254+0000","last_change":"2024-04-26T11:21:53.709813+0000","last_active":"2024-04-26T11:21:55.659254+0000","last_peered":"2024-04-26T11:21:55.659254+0000","last_clean":"2024-04-26T11:21:55.659254+0000","last_became_active":"2024-04-26T11:21:53.708399+0000","last_became_peered":"2024-04-26T11:21:53.708399+0000","last_unstale":"2024-04-26T11:21:55.659254+0000","last_undegraded":"2024-04-26T11:21:55.659254+0000","last_fullsized":"2024-04-26T11:21:55.659254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:36.298230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691745+0000","last_change":"2024-04-26T11:21:53.710195+0000","last_active":"2024-04-26T11:21:54.691745+0000","last_peered":"2024-04-26T11:21:54.691745+0000","last_clean":"2024-04-26T11:21:54.691745+0000","last_became_active":"2024-04-26T11:21:53.709660+0000","last_became_peered":"2024-04-26T11:21:53.709660+0000","last_unstale":"2024-04-26T11:21:54.691745+0000","last_undegraded":"2024-04-26T11:21:54.691745+0000","last_fullsized":"2024-04-26T11:21:54.691745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691147+0000","last_change":"2024-04-26T11:21:53.703397+0000","last_active":"2024-04-26T11:21:54.691147+0000","last_peered":"2024-04-26T11:21:54.691147+0000","last_clean":"2024-04-26T11:21:54.691147+0000","last_became_active":"2024-04-26T11:21:53.701822+0000","last_became_peered":"2024-04-26T11:21:53.701822+0000","last_unstale":"2024-04-26T11:21:54.691147+0000","last_undegraded":"2024-04-26T11:21:54.691147+0000","last_fullsized":"2024-04-26T11:21:54.691147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690777+0000","last_change":"2024-04-26T11:21:53.709264+0000","last_active":"2024-04-26T11:21:54.690777+0000","last_peered":"2024-04-26T11:21:54.690777+0000","last_clean":"2024-04-26T11:21:54.690777+0000","last_became_active":"2024-04-26T11:21:53.708529+0000","last_became_peered":"2024-04-26T11:21:53.708529+0000","last_unstale":"2024-04-26T11:21:54.690777+0000","last_undegraded":"2024-04-26T11:21:54.690777+0000","last_fullsized":"2024-04-26T11:21:54.690777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689662+0000","last_change":"2024-04-26T11:21:53.710899+0000","last_active":"2024-04-26T11:21:54.689662+0000","last_peered":"2024-04-26T11:21:54.689662+0000","last_clean":"2024-04-26T11:21:54.689662+0000","last_became_active":"2024-04-26T11:21:53.710185+0000","last_became_peered":"2024-04-26T11:21:53.710185+0000","last_unstale":"2024-04-26T11:21:54.689662+0000","last_undegraded":"2024-04-26T11:21:54.689662+0000","last_fullsized":"2024-04-26T11:21:54.689662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657645+0000","last_change":"2024-04-26T11:21:53.708939+0000","last_active":"2024-04-26T11:21:55.657645+0000","last_peered":"2024-04-26T11:21:55.657645+0000","last_clean":"2024-04-26T11:21:55.657645+0000","last_became_active":"2024-04-26T11:21:53.708120+0000","last_became_peered":"2024-04-26T11:21:53.708120+0000","last_unstale":"2024-04-26T11:21:55.657645+0000","last_undegraded":"2024-04-26T11:21:55.657645+0000","last_fullsized":"2024-04-26T11:21:55.657645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691370+0000","last_change":"2024-04-26T11:21:53.712919+0000","last_active":"2024-04-26T11:21:54.691370+0000","last_peered":"2024-04-26T11:21:54.691370+0000","last_clean":"2024-04-26T11:21:54.691370+0000","last_became_active":"2024-04-26T11:21:53.710798+0000","last_became_peered":"2024-04-26T11:21:53.710798+0000","last_unstale":"2024-04-26T11:21:54.691370+0000","last_undegraded":"2024-04-26T11:21:54.691370+0000","last_fullsized":"2024-04-26T11:21:54.691370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658532+0000","last_change":"2024-04-26T11:21:53.343931+0000","last_active":"2024-04-26T11:21:55.658532+0000","last_peered":"2024-04-26T11:21:55.658532+0000","last_clean":"2024-04-26T11:21:55.658532+0000","last_became_active":"2024-04-26T11:21:53.342363+0000","last_became_peered":"2024-04-26T11:21:53.342363+0000","last_unstale":"2024-04-26T11:21:55.658532+0000","last_undegraded":"2024-04-26T11:21:55.658532+0000","last_fullsized":"2024-04-26T11:21:55.658532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690797+0000","last_change":"2024-04-26T11:21:53.712613+0000","last_active":"2024-04-26T11:21:54.690797+0000","last_peered":"2024-04-26T11:21:54.690797+0000","last_clean":"2024-04-26T11:21:54.690797+0000","last_became_active":"2024-04-26T11:21:53.711848+0000","last_became_peered":"2024-04-26T11:21:53.711848+0000","last_unstale":"2024-04-26T11:21:54.690797+0000","last_undegraded":"2024-04-26T11:21:54.690797+0000","last_fullsized":"2024-04-26T11:21:54.690797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:49.327612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690156+0000","last_change":"2024-04-26T11:21:53.333005+0000","last_active":"2024-04-26T11:21:54.690156+0000","last_peered":"2024-04-26T11:21:54.690156+0000","last_clean":"2024-04-26T11:21:54.690156+0000","last_became_active":"2024-04-26T11:21:53.332191+0000","last_became_peered":"2024-04-26T11:21:53.332191+0000","last_unstale":"2024-04-26T11:21:54.690156+0000","last_undegraded":"2024-04-26T11:21:54.690156+0000","last_fullsized":"2024-04-26T11:21:54.690156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691758+0000","last_change":"2024-04-26T11:21:53.707848+0000","last_active":"2024-04-26T11:21:54.691758+0000","last_peered":"2024-04-26T11:21:54.691758+0000","last_clean":"2024-04-26T11:21:54.691758+0000","last_became_active":"2024-04-26T11:21:53.706222+0000","last_became_peered":"2024-04-26T11:21:53.706222+0000","last_unstale":"2024-04-26T11:21:54.691758+0000","last_undegraded":"2024-04-26T11:21:54.691758+0000","last_fullsized":"2024-04-26T11:21:54.691758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691063+0000","last_change":"2024-04-26T11:21:53.341523+0000","last_active":"2024-04-26T11:21:54.691063+0000","last_peered":"2024-04-26T11:21:54.691063+0000","last_clean":"2024-04-26T11:21:54.691063+0000","last_became_active":"2024-04-26T11:21:53.340545+0000","last_became_peered":"2024-04-26T11:21:53.340545+0000","last_unstale":"2024-04-26T11:21:54.691063+0000","last_undegraded":"2024-04-26T11:21:54.691063+0000","last_fullsized":"2024-04-26T11:21:54.691063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.907675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691390+0000","last_change":"2024-04-26T11:21:53.706879+0000","last_active":"2024-04-26T11:21:54.691390+0000","last_peered":"2024-04-26T11:21:54.691390+0000","last_clean":"2024-04-26T11:21:54.691390+0000","last_became_active":"2024-04-26T11:21:53.705082+0000","last_became_peered":"2024-04-26T11:21:53.705082+0000","last_unstale":"2024-04-26T11:21:54.691390+0000","last_undegraded":"2024-04-26T11:21:54.691390+0000","last_fullsized":"2024-04-26T11:21:54.691390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657400+0000","last_change":"2024-04-26T11:21:53.341655+0000","last_active":"2024-04-26T11:21:55.657400+0000","last_peered":"2024-04-26T11:21:55.657400+0000","last_clean":"2024-04-26T11:21:55.657400+0000","last_became_active":"2024-04-26T11:21:53.340085+0000","last_became_peered":"2024-04-26T11:21:53.340085+0000","last_unstale":"2024-04-26T11:21:55.657400+0000","last_undegraded":"2024-04-26T11:21:55.657400+0000","last_fullsized":"2024-04-26T11:21:55.657400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659421+0000","last_change":"2024-04-26T11:21:53.340063+0000","last_active":"2024-04-26T11:21:55.659421+0000","last_peered":"2024-04-26T11:21:55.659421+0000","last_clean":"2024-04-26T11:21:55.659421+0000","last_became_active":"2024-04-26T11:21:53.339256+0000","last_became_peered":"2024-04-26T11:21:53.339256+0000","last_unstale":"2024-04-26T11:21:55.659421+0000","last_undegraded":"2024-04-26T11:21:55.659421+0000","last_fullsized":"2024-04-26T11:21:55.659421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689561+0000","last_change":"2024-04-26T11:21:53.697700+0000","last_active":"2024-04-26T11:21:54.689561+0000","last_peered":"2024-04-26T11:21:54.689561+0000","last_clean":"2024-04-26T11:21:54.689561+0000","last_became_active":"2024-04-26T11:21:53.696789+0000","last_became_peered":"2024-04-26T11:21:53.696789+0000","last_unstale":"2024-04-26T11:21:54.689561+0000","last_undegraded":"2024-04-26T11:21:54.689561+0000","last_fullsized":"2024-04-26T11:21:54.689561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691980+0000","last_change":"2024-04-26T11:21:53.341302+0000","last_active":"2024-04-26T11:21:54.691980+0000","last_peered":"2024-04-26T11:21:54.691980+0000","last_clean":"2024-04-26T11:21:54.691980+0000","last_became_active":"2024-04-26T11:21:53.340509+0000","last_became_peered":"2024-04-26T11:21:53.340509+0000","last_unstale":"2024-04-26T11:21:54.691980+0000","last_undegraded":"2024-04-26T11:21:54.691980+0000","last_fullsized":"2024-04-26T11:21:54.691980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:16.781849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689756+0000","last_change":"2024-04-26T11:21:53.716075+0000","last_active":"2024-04-26T11:21:54.689756+0000","last_peered":"2024-04-26T11:21:54.689756+0000","last_clean":"2024-04-26T11:21:54.689756+0000","last_became_active":"2024-04-26T11:21:53.714328+0000","last_became_peered":"2024-04-26T11:21:53.714328+0000","last_unstale":"2024-04-26T11:21:54.689756+0000","last_undegraded":"2024-04-26T11:21:54.689756+0000","last_fullsized":"2024-04-26T11:21:54.689756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:54.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659565+0000","last_change":"2024-04-26T11:21:53.339171+0000","last_active":"2024-04-26T11:21:55.659565+0000","last_peered":"2024-04-26T11:21:55.659565+0000","last_clean":"2024-04-26T11:21:55.659565+0000","last_became_active":"2024-04-26T11:21:53.337433+0000","last_became_peered":"2024-04-26T11:21:53.337433+0000","last_unstale":"2024-04-26T11:21:55.659565+0000","last_undegraded":"2024-04-26T11:21:55.659565+0000","last_fullsized":"2024-04-26T11:21:55.659565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658299+0000","last_change":"2024-04-26T11:21:53.719666+0000","last_active":"2024-04-26T11:21:55.658299+0000","last_peered":"2024-04-26T11:21:55.658299+0000","last_clean":"2024-04-26T11:21:55.658299+0000","last_became_active":"2024-04-26T11:21:53.718871+0000","last_became_peered":"2024-04-26T11:21:53.718871+0000","last_unstale":"2024-04-26T11:21:55.658299+0000","last_undegraded":"2024-04-26T11:21:55.658299+0000","last_fullsized":"2024-04-26T11:21:55.658299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659351+0000","last_change":"2024-04-26T11:21:53.344744+0000","last_active":"2024-04-26T11:21:55.659351+0000","last_peered":"2024-04-26T11:21:55.659351+0000","last_clean":"2024-04-26T11:21:55.659351+0000","last_became_active":"2024-04-26T11:21:53.344055+0000","last_became_peered":"2024-04-26T11:21:53.344055+0000","last_unstale":"2024-04-26T11:21:55.659351+0000","last_undegraded":"2024-04-26T11:21:55.659351+0000","last_fullsized":"2024-04-26T11:21:55.659351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690681+0000","last_change":"2024-04-26T11:21:53.709563+0000","last_active":"2024-04-26T11:21:54.690681+0000","last_peered":"2024-04-26T11:21:54.690681+0000","last_clean":"2024-04-26T11:21:54.690681+0000","last_became_active":"2024-04-26T11:21:53.706598+0000","last_became_peered":"2024-04-26T11:21:53.706598+0000","last_unstale":"2024-04-26T11:21:54.690681+0000","last_undegraded":"2024-04-26T11:21:54.690681+0000","last_fullsized":"2024-04-26T11:21:54.690681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691180+0000","last_change":"2024-04-26T11:21:53.330145+0000","last_active":"2024-04-26T11:21:54.691180+0000","last_peered":"2024-04-26T11:21:54.691180+0000","last_clean":"2024-04-26T11:21:54.691180+0000","last_became_active":"2024-04-26T11:21:53.329256+0000","last_became_peered":"2024-04-26T11:21:53.329256+0000","last_unstale":"2024-04-26T11:21:54.691180+0000","last_undegraded":"2024-04-26T11:21:54.691180+0000","last_fullsized":"2024-04-26T11:21:54.691180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658841+0000","last_change":"2024-04-26T11:21:53.715233+0000","last_active":"2024-04-26T11:21:55.658841+0000","last_peered":"2024-04-26T11:21:55.658841+0000","last_clean":"2024-04-26T11:21:55.658841+0000","last_became_active":"2024-04-26T11:21:53.714405+0000","last_became_peered":"2024-04-26T11:21:53.714405+0000","last_unstale":"2024-04-26T11:21:55.658841+0000","last_undegraded":"2024-04-26T11:21:55.658841+0000","last_fullsized":"2024-04-26T11:21:55.658841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659404+0000","last_change":"2024-04-26T11:21:53.344659+0000","last_active":"2024-04-26T11:21:55.659404+0000","last_peered":"2024-04-26T11:21:55.659404+0000","last_clean":"2024-04-26T11:21:55.659404+0000","last_became_active":"2024-04-26T11:21:53.344024+0000","last_became_peered":"2024-04-26T11:21:53.344024+0000","last_unstale":"2024-04-26T11:21:55.659404+0000","last_undegraded":"2024-04-26T11:21:55.659404+0000","last_fullsized":"2024-04-26T11:21:55.659404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:53.053244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659429+0000","last_change":"2024-04-26T11:21:53.710093+0000","last_active":"2024-04-26T11:21:55.659429+0000","last_peered":"2024-04-26T11:21:55.659429+0000","last_clean":"2024-04-26T11:21:55.659429+0000","last_became_active":"2024-04-26T11:21:53.709020+0000","last_became_peered":"2024-04-26T11:21:53.709020+0000","last_unstale":"2024-04-26T11:21:55.659429+0000","last_undegraded":"2024-04-26T11:21:55.659429+0000","last_fullsized":"2024-04-26T11:21:55.659429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690297+0000","last_change":"2024-04-26T11:21:53.341961+0000","last_active":"2024-04-26T11:21:54.690297+0000","last_peered":"2024-04-26T11:21:54.690297+0000","last_clean":"2024-04-26T11:21:54.690297+0000","last_became_active":"2024-04-26T11:21:53.340768+0000","last_became_peered":"2024-04-26T11:21:53.340768+0000","last_unstale":"2024-04-26T11:21:54.690297+0000","last_undegraded":"2024-04-26T11:21:54.690297+0000","last_fullsized":"2024-04-26T11:21:54.690297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659841+0000","last_change":"2024-04-26T11:21:53.706161+0000","last_active":"2024-04-26T11:21:55.659841+0000","last_peered":"2024-04-26T11:21:55.659841+0000","last_clean":"2024-04-26T11:21:55.659841+0000","last_became_active":"2024-04-26T11:21:53.705388+0000","last_became_peered":"2024-04-26T11:21:53.705388+0000","last_unstale":"2024-04-26T11:21:55.659841+0000","last_undegraded":"2024-04-26T11:21:55.659841+0000","last_fullsized":"2024-04-26T11:21:55.659841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690017+0000","last_change":"2024-04-26T11:21:53.328489+0000","last_active":"2024-04-26T11:21:54.690017+0000","last_peered":"2024-04-26T11:21:54.690017+0000","last_clean":"2024-04-26T11:21:54.690017+0000","last_became_active":"2024-04-26T11:21:53.327836+0000","last_became_peered":"2024-04-26T11:21:53.327836+0000","last_unstale":"2024-04-26T11:21:54.690017+0000","last_undegraded":"2024-04-26T11:21:54.690017+0000","last_fullsized":"2024-04-26T11:21:54.690017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:32.644217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691473+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:21:54.691473+0000","last_peered":"2024-04-26T11:21:54.691473+0000","last_clean":"2024-04-26T11:21:54.691473+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:21:54.691473+0000","last_undegraded":"2024-04-26T11:21:54.691473+0000","last_fullsized":"2024-04-26T11:21:54.691473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693986+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:21:53.693986+0000","last_peered":"2024-04-26T11:21:53.693986+0000","last_clean":"2024-04-26T11:21:53.693986+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:21:53.693986+0000","last_undegraded":"2024-04-26T11:21:53.693986+0000","last_fullsized":"2024-04-26T11:21:53.693986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694913+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:21:53.694913+0000","last_peered":"2024-04-26T11:21:53.694913+0000","last_clean":"2024-04-26T11:21:53.694913+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:21:53.694913+0000","last_undegraded":"2024-04-26T11:21:53.694913+0000","last_fullsized":"2024-04-26T11:21:53.694913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690419+0000","last_change":"2024-04-26T11:21:53.326934+0000","last_active":"2024-04-26T11:21:54.690419+0000","last_peered":"2024-04-26T11:21:54.690419+0000","last_clean":"2024-04-26T11:21:54.690419+0000","last_became_active":"2024-04-26T11:21:53.325342+0000","last_became_peered":"2024-04-26T11:21:53.325342+0000","last_unstale":"2024-04-26T11:21:54.690419+0000","last_undegraded":"2024-04-26T11:21:54.690419+0000","last_fullsized":"2024-04-26T11:21:54.690419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659521+0000","last_change":"2024-04-26T11:21:53.709499+0000","last_active":"2024-04-26T11:21:55.659521+0000","last_peered":"2024-04-26T11:21:55.659521+0000","last_clean":"2024-04-26T11:21:55.659521+0000","last_became_active":"2024-04-26T11:21:53.707573+0000","last_became_peered":"2024-04-26T11:21:53.707573+0000","last_unstale":"2024-04-26T11:21:55.659521+0000","last_undegraded":"2024-04-26T11:21:55.659521+0000","last_fullsized":"2024-04-26T11:21:55.659521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693364+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:21:53.693364+0000","last_peered":"2024-04-26T11:21:53.693364+0000","last_clean":"2024-04-26T11:21:53.693364+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:21:53.693364+0000","last_undegraded":"2024-04-26T11:21:53.693364+0000","last_fullsized":"2024-04-26T11:21:53.693364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690244+0000","last_change":"2024-04-26T11:21:53.330362+0000","last_active":"2024-04-26T11:21:54.690244+0000","last_peered":"2024-04-26T11:21:54.690244+0000","last_clean":"2024-04-26T11:21:54.690244+0000","last_became_active":"2024-04-26T11:21:53.329383+0000","last_became_peered":"2024-04-26T11:21:53.329383+0000","last_unstale":"2024-04-26T11:21:54.690244+0000","last_undegraded":"2024-04-26T11:21:54.690244+0000","last_fullsized":"2024-04-26T11:21:54.690244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691659+0000","last_change":"2024-04-26T11:21:53.716469+0000","last_active":"2024-04-26T11:21:54.691659+0000","last_peered":"2024-04-26T11:21:54.691659+0000","last_clean":"2024-04-26T11:21:54.691659+0000","last_became_active":"2024-04-26T11:21:53.715684+0000","last_became_peered":"2024-04-26T11:21:53.715684+0000","last_unstale":"2024-04-26T11:21:54.691659+0000","last_undegraded":"2024-04-26T11:21:54.691659+0000","last_fullsized":"2024-04-26T11:21:54.691659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.683688+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:21:53.683688+0000","last_peered":"2024-04-26T11:21:53.683688+0000","last_clean":"2024-04-26T11:21:53.683688+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:21:53.683688+0000","last_undegraded":"2024-04-26T11:21:53.683688+0000","last_fullsized":"2024-04-26T11:21:53.683688+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689798+0000","last_change":"2024-04-26T11:21:53.345743+0000","last_active":"2024-04-26T11:21:54.689798+0000","last_peered":"2024-04-26T11:21:54.689798+0000","last_clean":"2024-04-26T11:21:54.689798+0000","last_became_active":"2024-04-26T11:21:53.344967+0000","last_became_peered":"2024-04-26T11:21:53.344967+0000","last_unstale":"2024-04-26T11:21:54.689798+0000","last_undegraded":"2024-04-26T11:21:54.689798+0000","last_fullsized":"2024-04-26T11:21:54.689798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:08.280572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691663+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:21:54.691663+0000","last_peered":"2024-04-26T11:21:54.691663+0000","last_clean":"2024-04-26T11:21:54.691663+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:21:54.691663+0000","last_undegraded":"2024-04-26T11:21:54.691663+0000","last_fullsized":"2024-04-26T11:21:54.691663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694282+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:21:53.694282+0000","last_peered":"2024-04-26T11:21:53.694282+0000","last_clean":"2024-04-26T11:21:53.694282+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:21:53.694282+0000","last_undegraded":"2024-04-26T11:21:53.694282+0000","last_fullsized":"2024-04-26T11:21:53.694282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658670+0000","last_change":"2024-04-26T11:21:53.338037+0000","last_active":"2024-04-26T11:21:55.658670+0000","last_peered":"2024-04-26T11:21:55.658670+0000","last_clean":"2024-04-26T11:21:55.658670+0000","last_became_active":"2024-04-26T11:21:53.337004+0000","last_became_peered":"2024-04-26T11:21:53.337004+0000","last_unstale":"2024-04-26T11:21:55.658670+0000","last_undegraded":"2024-04-26T11:21:55.658670+0000","last_fullsized":"2024-04-26T11:21:55.658670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691854+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:21:54.691854+0000","last_peered":"2024-04-26T11:21:54.691854+0000","last_clean":"2024-04-26T11:21:54.691854+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:21:54.691854+0000","last_undegraded":"2024-04-26T11:21:54.691854+0000","last_fullsized":"2024-04-26T11:21:54.691854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659642+0000","last_change":"2024-04-26T11:21:53.337312+0000","last_active":"2024-04-26T11:21:55.659642+0000","last_peered":"2024-04-26T11:21:55.659642+0000","last_clean":"2024-04-26T11:21:55.659642+0000","last_became_active":"2024-04-26T11:21:53.336587+0000","last_became_peered":"2024-04-26T11:21:53.336587+0000","last_unstale":"2024-04-26T11:21:55.659642+0000","last_undegraded":"2024-04-26T11:21:55.659642+0000","last_fullsized":"2024-04-26T11:21:55.659642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.681538+0000","last_change":"2024-04-26T11:21:49.292007+0000","last_active":"2024-04-26T11:21:53.681538+0000","last_peered":"2024-04-26T11:21:53.681538+0000","last_clean":"2024-04-26T11:21:53.681538+0000","last_became_active":"2024-04-26T11:21:49.291100+0000","last_became_peered":"2024-04-26T11:21:49.291100+0000","last_unstale":"2024-04-26T11:21:53.681538+0000","last_undegraded":"2024-04-26T11:21:53.681538+0000","last_fullsized":"2024-04-26T11:21:53.681538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.877516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690182+0000","last_change":"2024-04-26T11:21:53.697386+0000","last_active":"2024-04-26T11:21:54.690182+0000","last_peered":"2024-04-26T11:21:54.690182+0000","last_clean":"2024-04-26T11:21:54.690182+0000","last_became_active":"2024-04-26T11:21:53.695847+0000","last_became_peered":"2024-04-26T11:21:53.695847+0000","last_unstale":"2024-04-26T11:21:54.690182+0000","last_undegraded":"2024-04-26T11:21:54.690182+0000","last_fullsized":"2024-04-26T11:21:54.690182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691993+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:21:54.691993+0000","last_peered":"2024-04-26T11:21:54.691993+0000","last_clean":"2024-04-26T11:21:54.691993+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:21:54.691993+0000","last_undegraded":"2024-04-26T11:21:54.691993+0000","last_fullsized":"2024-04-26T11:21:54.691993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.688099+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:21:53.688099+0000","last_peered":"2024-04-26T11:21:53.688099+0000","last_clean":"2024-04-26T11:21:53.688099+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:21:53.688099+0000","last_undegraded":"2024-04-26T11:21:53.688099+0000","last_fullsized":"2024-04-26T11:21:53.688099+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690179+0000","last_change":"2024-04-26T11:21:53.696563+0000","last_active":"2024-04-26T11:21:54.690179+0000","last_peered":"2024-04-26T11:21:54.690179+0000","last_clean":"2024-04-26T11:21:54.690179+0000","last_became_active":"2024-04-26T11:21:53.695678+0000","last_became_peered":"2024-04-26T11:21:53.695678+0000","last_unstale":"2024-04-26T11:21:54.690179+0000","last_undegraded":"2024-04-26T11:21:54.690179+0000","last_fullsized":"2024-04-26T11:21:54.690179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.692075+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:21:54.692075+0000","last_peered":"2024-04-26T11:21:54.692075+0000","last_clean":"2024-04-26T11:21:54.692075+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:21:54.692075+0000","last_undegraded":"2024-04-26T11:21:54.692075+0000","last_fullsized":"2024-04-26T11:21:54.692075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.684028+0000","last_change":"2024-04-26T11:21:49.292644+0000","last_active":"2024-04-26T11:21:53.684028+0000","last_peered":"2024-04-26T11:21:53.684028+0000","last_clean":"2024-04-26T11:21:53.684028+0000","last_became_active":"2024-04-26T11:21:49.291499+0000","last_became_peered":"2024-04-26T11:21:49.291499+0000","last_unstale":"2024-04-26T11:21:53.684028+0000","last_undegraded":"2024-04-26T11:21:53.684028+0000","last_fullsized":"2024-04-26T11:21:53.684028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689637+0000","last_change":"2024-04-26T11:21:53.705104+0000","last_active":"2024-04-26T11:21:54.689637+0000","last_peered":"2024-04-26T11:21:54.689637+0000","last_clean":"2024-04-26T11:21:54.689637+0000","last_became_active":"2024-04-26T11:21:53.704282+0000","last_became_peered":"2024-04-26T11:21:53.704282+0000","last_unstale":"2024-04-26T11:21:54.689637+0000","last_undegraded":"2024-04-26T11:21:54.689637+0000","last_fullsized":"2024-04-26T11:21:54.689637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691859+0000","last_change":"2024-04-26T11:21:53.332815+0000","last_active":"2024-04-26T11:21:54.691859+0000","last_peered":"2024-04-26T11:21:54.691859+0000","last_clean":"2024-04-26T11:21:54.691859+0000","last_became_active":"2024-04-26T11:21:53.332020+0000","last_became_peered":"2024-04-26T11:21:53.332020+0000","last_unstale":"2024-04-26T11:21:54.691859+0000","last_undegraded":"2024-04-26T11:21:54.691859+0000","last_fullsized":"2024-04-26T11:21:54.691859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.700312+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:21:53.700312+0000","last_peered":"2024-04-26T11:21:53.700312+0000","last_clean":"2024-04-26T11:21:53.700312+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:21:53.700312+0000","last_undegraded":"2024-04-26T11:21:53.700312+0000","last_fullsized":"2024-04-26T11:21:53.700312+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689824+0000","last_change":"2024-04-26T11:21:53.696546+0000","last_active":"2024-04-26T11:21:54.689824+0000","last_peered":"2024-04-26T11:21:54.689824+0000","last_clean":"2024-04-26T11:21:54.689824+0000","last_became_active":"2024-04-26T11:21:53.695670+0000","last_became_peered":"2024-04-26T11:21:53.695670+0000","last_unstale":"2024-04-26T11:21:54.689824+0000","last_undegraded":"2024-04-26T11:21:54.689824+0000","last_fullsized":"2024-04-26T11:21:54.689824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658127+0000","last_change":"2024-04-26T11:21:53.703599+0000","last_active":"2024-04-26T11:21:55.658127+0000","last_peered":"2024-04-26T11:21:55.658127+0000","last_clean":"2024-04-26T11:21:55.658127+0000","last_became_active":"2024-04-26T11:21:53.702893+0000","last_became_peered":"2024-04-26T11:21:53.702893+0000","last_unstale":"2024-04-26T11:21:55.658127+0000","last_undegraded":"2024-04-26T11:21:55.658127+0000","last_fullsized":"2024-04-26T11:21:55.658127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659192+0000","last_change":"2024-04-26T11:21:53.340288+0000","last_active":"2024-04-26T11:21:55.659192+0000","last_peered":"2024-04-26T11:21:55.659192+0000","last_clean":"2024-04-26T11:21:55.659192+0000","last_became_active":"2024-04-26T11:21:53.339414+0000","last_became_peered":"2024-04-26T11:21:53.339414+0000","last_unstale":"2024-04-26T11:21:55.659192+0000","last_undegraded":"2024-04-26T11:21:55.659192+0000","last_fullsized":"2024-04-26T11:21:55.659192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689909+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:21:54.689909+0000","last_peered":"2024-04-26T11:21:54.689909+0000","last_clean":"2024-04-26T11:21:54.689909+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:21:54.689909+0000","last_undegraded":"2024-04-26T11:21:54.689909+0000","last_fullsized":"2024-04-26T11:21:54.689909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691341+0000","last_change":"2024-04-26T11:21:53.343465+0000","last_active":"2024-04-26T11:21:54.691341+0000","last_peered":"2024-04-26T11:21:54.691341+0000","last_clean":"2024-04-26T11:21:54.691341+0000","last_became_active":"2024-04-26T11:21:53.342882+0000","last_became_peered":"2024-04-26T11:21:53.342882+0000","last_unstale":"2024-04-26T11:21:54.691341+0000","last_undegraded":"2024-04-26T11:21:54.691341+0000","last_fullsized":"2024-04-26T11:21:54.691341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:41.508747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.660158+0000","last_change":"2024-04-26T11:21:53.344846+0000","last_active":"2024-04-26T11:21:55.660158+0000","last_peered":"2024-04-26T11:21:55.660158+0000","last_clean":"2024-04-26T11:21:55.660158+0000","last_became_active":"2024-04-26T11:21:53.342981+0000","last_became_peered":"2024-04-26T11:21:53.342981+0000","last_unstale":"2024-04-26T11:21:55.660158+0000","last_undegraded":"2024-04-26T11:21:55.660158+0000","last_fullsized":"2024-04-26T11:21:55.660158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689736+0000","last_change":"2024-04-26T11:21:53.706890+0000","last_active":"2024-04-26T11:21:54.689736+0000","last_peered":"2024-04-26T11:21:54.689736+0000","last_clean":"2024-04-26T11:21:54.689736+0000","last_became_active":"2024-04-26T11:21:53.705229+0000","last_became_peered":"2024-04-26T11:21:53.705229+0000","last_unstale":"2024-04-26T11:21:54.689736+0000","last_undegraded":"2024-04-26T11:21:54.689736+0000","last_fullsized":"2024-04-26T11:21:54.689736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691905+0000","last_change":"2024-04-26T11:21:53.334527+0000","last_active":"2024-04-26T11:21:54.691905+0000","last_peered":"2024-04-26T11:21:54.691905+0000","last_clean":"2024-04-26T11:21:54.691905+0000","last_became_active":"2024-04-26T11:21:53.332325+0000","last_became_peered":"2024-04-26T11:21:53.332325+0000","last_unstale":"2024-04-26T11:21:54.691905+0000","last_undegraded":"2024-04-26T11:21:54.691905+0000","last_fullsized":"2024-04-26T11:21:54.691905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689613+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:21:54.689613+0000","last_peered":"2024-04-26T11:21:54.689613+0000","last_clean":"2024-04-26T11:21:54.689613+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:21:54.689613+0000","last_undegraded":"2024-04-26T11:21:54.689613+0000","last_fullsized":"2024-04-26T11:21:54.689613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691804+0000","last_change":"2024-04-26T11:21:53.696949+0000","last_active":"2024-04-26T11:21:54.691804+0000","last_peered":"2024-04-26T11:21:54.691804+0000","last_clean":"2024-04-26T11:21:54.691804+0000","last_became_active":"2024-04-26T11:21:53.696068+0000","last_became_peered":"2024-04-26T11:21:53.696068+0000","last_unstale":"2024-04-26T11:21:54.691804+0000","last_undegraded":"2024-04-26T11:21:54.691804+0000","last_fullsized":"2024-04-26T11:21:54.691804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689833+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:21:54.689833+0000","last_peered":"2024-04-26T11:21:54.689833+0000","last_clean":"2024-04-26T11:21:54.689833+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:21:54.689833+0000","last_undegraded":"2024-04-26T11:21:54.689833+0000","last_fullsized":"2024-04-26T11:21:54.689833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691375+0000","last_change":"2024-04-26T11:21:53.710749+0000","last_active":"2024-04-26T11:21:54.691375+0000","last_peered":"2024-04-26T11:21:54.691375+0000","last_clean":"2024-04-26T11:21:54.691375+0000","last_became_active":"2024-04-26T11:21:53.707330+0000","last_became_peered":"2024-04-26T11:21:53.707330+0000","last_unstale":"2024-04-26T11:21:54.691375+0000","last_undegraded":"2024-04-26T11:21:54.691375+0000","last_fullsized":"2024-04-26T11:21:54.691375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690082+0000","last_change":"2024-04-26T11:21:53.334972+0000","last_active":"2024-04-26T11:21:54.690082+0000","last_peered":"2024-04-26T11:21:54.690082+0000","last_clean":"2024-04-26T11:21:54.690082+0000","last_became_active":"2024-04-26T11:21:53.332642+0000","last_became_peered":"2024-04-26T11:21:53.332642+0000","last_unstale":"2024-04-26T11:21:54.690082+0000","last_undegraded":"2024-04-26T11:21:54.690082+0000","last_fullsized":"2024-04-26T11:21:54.690082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691006+0000","last_change":"2024-04-26T11:21:53.709701+0000","last_active":"2024-04-26T11:21:54.691006+0000","last_peered":"2024-04-26T11:21:54.691006+0000","last_clean":"2024-04-26T11:21:54.691006+0000","last_became_active":"2024-04-26T11:21:53.708905+0000","last_became_peered":"2024-04-26T11:21:53.708905+0000","last_unstale":"2024-04-26T11:21:54.691006+0000","last_undegraded":"2024-04-26T11:21:54.691006+0000","last_fullsized":"2024-04-26T11:21:54.691006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691004+0000","last_change":"2024-04-26T11:21:53.330226+0000","last_active":"2024-04-26T11:21:54.691004+0000","last_peered":"2024-04-26T11:21:54.691004+0000","last_clean":"2024-04-26T11:21:54.691004+0000","last_became_active":"2024-04-26T11:21:53.329446+0000","last_became_peered":"2024-04-26T11:21:53.329446+0000","last_unstale":"2024-04-26T11:21:54.691004+0000","last_undegraded":"2024-04-26T11:21:54.691004+0000","last_fullsized":"2024-04-26T11:21:54.691004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:52.599214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691125+0000","last_change":"2024-04-26T11:21:53.716629+0000","last_active":"2024-04-26T11:21:54.691125+0000","last_peered":"2024-04-26T11:21:54.691125+0000","last_clean":"2024-04-26T11:21:54.691125+0000","last_became_active":"2024-04-26T11:21:53.714799+0000","last_became_peered":"2024-04-26T11:21:53.714799+0000","last_unstale":"2024-04-26T11:21:54.691125+0000","last_undegraded":"2024-04-26T11:21:54.691125+0000","last_fullsized":"2024-04-26T11:21:54.691125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:54.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690731+0000","last_change":"2024-04-26T11:21:53.343318+0000","last_active":"2024-04-26T11:21:54.690731+0000","last_peered":"2024-04-26T11:21:54.690731+0000","last_clean":"2024-04-26T11:21:54.690731+0000","last_became_active":"2024-04-26T11:21:53.342789+0000","last_became_peered":"2024-04-26T11:21:53.342789+0000","last_unstale":"2024-04-26T11:21:54.690731+0000","last_undegraded":"2024-04-26T11:21:54.690731+0000","last_fullsized":"2024-04-26T11:21:54.690731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657848+0000","last_change":"2024-04-26T11:21:53.715726+0000","last_active":"2024-04-26T11:21:55.657848+0000","last_peered":"2024-04-26T11:21:55.657848+0000","last_clean":"2024-04-26T11:21:55.657848+0000","last_became_active":"2024-04-26T11:21:53.715126+0000","last_became_peered":"2024-04-26T11:21:53.715126+0000","last_unstale":"2024-04-26T11:21:55.657848+0000","last_undegraded":"2024-04-26T11:21:55.657848+0000","last_fullsized":"2024-04-26T11:21:55.657848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659105+0000","last_change":"2024-04-26T11:21:53.343934+0000","last_active":"2024-04-26T11:21:55.659105+0000","last_peered":"2024-04-26T11:21:55.659105+0000","last_clean":"2024-04-26T11:21:55.659105+0000","last_became_active":"2024-04-26T11:21:53.342401+0000","last_became_peered":"2024-04-26T11:21:53.342401+0000","last_unstale":"2024-04-26T11:21:55.659105+0000","last_undegraded":"2024-04-26T11:21:55.659105+0000","last_fullsized":"2024-04-26T11:21:55.659105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658676+0000","last_change":"2024-04-26T11:21:53.713092+0000","last_active":"2024-04-26T11:21:55.658676+0000","last_peered":"2024-04-26T11:21:55.658676+0000","last_clean":"2024-04-26T11:21:55.658676+0000","last_became_active":"2024-04-26T11:21:53.712207+0000","last_became_peered":"2024-04-26T11:21:53.712207+0000","last_unstale":"2024-04-26T11:21:55.658676+0000","last_undegraded":"2024-04-26T11:21:55.658676+0000","last_fullsized":"2024-04-26T11:21:55.658676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691034+0000","last_change":"2024-04-26T11:21:53.345453+0000","last_active":"2024-04-26T11:21:54.691034+0000","last_peered":"2024-04-26T11:21:54.691034+0000","last_clean":"2024-04-26T11:21:54.691034+0000","last_became_active":"2024-04-26T11:21:53.344468+0000","last_became_peered":"2024-04-26T11:21:53.344468+0000","last_unstale":"2024-04-26T11:21:54.691034+0000","last_undegraded":"2024-04-26T11:21:54.691034+0000","last_fullsized":"2024-04-26T11:21:54.691034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.295739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690674+0000","last_change":"2024-04-26T11:21:53.712311+0000","last_active":"2024-04-26T11:21:54.690674+0000","last_peered":"2024-04-26T11:21:54.690674+0000","last_clean":"2024-04-26T11:21:54.690674+0000","last_became_active":"2024-04-26T11:21:53.711195+0000","last_became_peered":"2024-04-26T11:21:53.711195+0000","last_unstale":"2024-04-26T11:21:54.690674+0000","last_undegraded":"2024-04-26T11:21:54.690674+0000","last_fullsized":"2024-04-26T11:21:54.690674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:50.973181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691630+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:21:54.691630+0000","last_peered":"2024-04-26T11:21:54.691630+0000","last_clean":"2024-04-26T11:21:54.691630+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:21:54.691630+0000","last_undegraded":"2024-04-26T11:21:54.691630+0000","last_fullsized":"2024-04-26T11:21:54.691630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657705+0000","last_change":"2024-04-26T11:21:53.713610+0000","last_active":"2024-04-26T11:21:55.657705+0000","last_peered":"2024-04-26T11:21:55.657705+0000","last_clean":"2024-04-26T11:21:55.657705+0000","last_became_active":"2024-04-26T11:21:53.712396+0000","last_became_peered":"2024-04-26T11:21:53.712396+0000","last_unstale":"2024-04-26T11:21:55.657705+0000","last_undegraded":"2024-04-26T11:21:55.657705+0000","last_fullsized":"2024-04-26T11:21:55.657705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691634+0000","last_change":"2024-04-26T11:21:53.334939+0000","last_active":"2024-04-26T11:21:54.691634+0000","last_peered":"2024-04-26T11:21:54.691634+0000","last_clean":"2024-04-26T11:21:54.691634+0000","last_became_active":"2024-04-26T11:21:53.332735+0000","last_became_peered":"2024-04-26T11:21:53.332735+0000","last_unstale":"2024-04-26T11:21:54.691634+0000","last_undegraded":"2024-04-26T11:21:54.691634+0000","last_fullsized":"2024-04-26T11:21:54.691634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":647190,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":249856,"data_stored":647806,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:21:57.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:21:57.780 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:57.781 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":25,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":18,"num_osds":3,"num_up_osds":3,"osd_up_since":1714130501,"num_in_osds":3,"osd_in_since":1714130493,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":87883776,"bytes_avail":289822408704,"bytes_total":289910292480,"write_bytes_sec":2858,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4207}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-26T11:21:32.562824+0000","services":{}},"progress_events":{}} 2024-04-26T11:21:57.799 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T11:21:57.799 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:21:58.094 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:21:58.096 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:21:58.110 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-26T11:21:57.321650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85824,"kb_used_data":640,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029696,"statfs":{"total":289910292480,"available":289822408704,"internally_reserved":0,"allocated":655360,"data_stored":1350688,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.014982"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691482+0000","last_change":"2024-04-26T11:21:53.713298+0000","last_active":"2024-04-26T11:21:54.691482+0000","last_peered":"2024-04-26T11:21:54.691482+0000","last_clean":"2024-04-26T11:21:54.691482+0000","last_became_active":"2024-04-26T11:21:53.712481+0000","last_became_peered":"2024-04-26T11:21:53.712481+0000","last_unstale":"2024-04-26T11:21:54.691482+0000","last_undegraded":"2024-04-26T11:21:54.691482+0000","last_fullsized":"2024-04-26T11:21:54.691482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691323+0000","last_change":"2024-04-26T11:21:53.716754+0000","last_active":"2024-04-26T11:21:54.691323+0000","last_peered":"2024-04-26T11:21:54.691323+0000","last_clean":"2024-04-26T11:21:54.691323+0000","last_became_active":"2024-04-26T11:21:53.716109+0000","last_became_peered":"2024-04-26T11:21:53.716109+0000","last_unstale":"2024-04-26T11:21:54.691323+0000","last_undegraded":"2024-04-26T11:21:54.691323+0000","last_fullsized":"2024-04-26T11:21:54.691323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658980+0000","last_change":"2024-04-26T11:21:53.710480+0000","last_active":"2024-04-26T11:21:55.658980+0000","last_peered":"2024-04-26T11:21:55.658980+0000","last_clean":"2024-04-26T11:21:55.658980+0000","last_became_active":"2024-04-26T11:21:53.709433+0000","last_became_peered":"2024-04-26T11:21:53.709433+0000","last_unstale":"2024-04-26T11:21:55.658980+0000","last_undegraded":"2024-04-26T11:21:55.658980+0000","last_fullsized":"2024-04-26T11:21:55.658980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:11.687344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658399+0000","last_change":"2024-04-26T11:21:53.719849+0000","last_active":"2024-04-26T11:21:55.658399+0000","last_peered":"2024-04-26T11:21:55.658399+0000","last_clean":"2024-04-26T11:21:55.658399+0000","last_became_active":"2024-04-26T11:21:53.719152+0000","last_became_peered":"2024-04-26T11:21:53.719152+0000","last_unstale":"2024-04-26T11:21:55.658399+0000","last_undegraded":"2024-04-26T11:21:55.658399+0000","last_fullsized":"2024-04-26T11:21:55.658399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690467+0000","last_change":"2024-04-26T11:21:53.712493+0000","last_active":"2024-04-26T11:21:54.690467+0000","last_peered":"2024-04-26T11:21:54.690467+0000","last_clean":"2024-04-26T11:21:54.690467+0000","last_became_active":"2024-04-26T11:21:53.711704+0000","last_became_peered":"2024-04-26T11:21:53.711704+0000","last_unstale":"2024-04-26T11:21:54.690467+0000","last_undegraded":"2024-04-26T11:21:54.690467+0000","last_fullsized":"2024-04-26T11:21:54.690467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657707+0000","last_change":"2024-04-26T11:21:53.715149+0000","last_active":"2024-04-26T11:21:55.657707+0000","last_peered":"2024-04-26T11:21:55.657707+0000","last_clean":"2024-04-26T11:21:55.657707+0000","last_became_active":"2024-04-26T11:21:53.714125+0000","last_became_peered":"2024-04-26T11:21:53.714125+0000","last_unstale":"2024-04-26T11:21:55.657707+0000","last_undegraded":"2024-04-26T11:21:55.657707+0000","last_fullsized":"2024-04-26T11:21:55.657707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657112+0000","last_change":"2024-04-26T11:21:53.714653+0000","last_active":"2024-04-26T11:21:55.657112+0000","last_peered":"2024-04-26T11:21:55.657112+0000","last_clean":"2024-04-26T11:21:55.657112+0000","last_became_active":"2024-04-26T11:21:53.713586+0000","last_became_peered":"2024-04-26T11:21:53.713586+0000","last_unstale":"2024-04-26T11:21:55.657112+0000","last_undegraded":"2024-04-26T11:21:55.657112+0000","last_fullsized":"2024-04-26T11:21:55.657112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:01.563026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657099+0000","last_change":"2024-04-26T11:21:53.715422+0000","last_active":"2024-04-26T11:21:55.657099+0000","last_peered":"2024-04-26T11:21:55.657099+0000","last_clean":"2024-04-26T11:21:55.657099+0000","last_became_active":"2024-04-26T11:21:53.714329+0000","last_became_peered":"2024-04-26T11:21:53.714329+0000","last_unstale":"2024-04-26T11:21:55.657099+0000","last_undegraded":"2024-04-26T11:21:55.657099+0000","last_fullsized":"2024-04-26T11:21:55.657099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:06.981197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691270+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:21:54.691270+0000","last_peered":"2024-04-26T11:21:54.691270+0000","last_clean":"2024-04-26T11:21:54.691270+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:21:54.691270+0000","last_undegraded":"2024-04-26T11:21:54.691270+0000","last_fullsized":"2024-04-26T11:21:54.691270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691299+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:21:54.691299+0000","last_peered":"2024-04-26T11:21:54.691299+0000","last_clean":"2024-04-26T11:21:54.691299+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:21:54.691299+0000","last_undegraded":"2024-04-26T11:21:54.691299+0000","last_fullsized":"2024-04-26T11:21:54.691299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658964+0000","last_change":"2024-04-26T11:21:53.714245+0000","last_active":"2024-04-26T11:21:55.658964+0000","last_peered":"2024-04-26T11:21:55.658964+0000","last_clean":"2024-04-26T11:21:55.658964+0000","last_became_active":"2024-04-26T11:21:53.713331+0000","last_became_peered":"2024-04-26T11:21:53.713331+0000","last_unstale":"2024-04-26T11:21:55.658964+0000","last_undegraded":"2024-04-26T11:21:55.658964+0000","last_fullsized":"2024-04-26T11:21:55.658964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690847+0000","last_change":"2024-04-26T11:21:53.712269+0000","last_active":"2024-04-26T11:21:54.690847+0000","last_peered":"2024-04-26T11:21:54.690847+0000","last_clean":"2024-04-26T11:21:54.690847+0000","last_became_active":"2024-04-26T11:21:53.710740+0000","last_became_peered":"2024-04-26T11:21:53.710740+0000","last_unstale":"2024-04-26T11:21:54.690847+0000","last_undegraded":"2024-04-26T11:21:54.690847+0000","last_fullsized":"2024-04-26T11:21:54.690847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690903+0000","last_change":"2024-04-26T11:21:53.712552+0000","last_active":"2024-04-26T11:21:54.690903+0000","last_peered":"2024-04-26T11:21:54.690903+0000","last_clean":"2024-04-26T11:21:54.690903+0000","last_became_active":"2024-04-26T11:21:53.711470+0000","last_became_peered":"2024-04-26T11:21:53.711470+0000","last_unstale":"2024-04-26T11:21:54.690903+0000","last_undegraded":"2024-04-26T11:21:54.690903+0000","last_fullsized":"2024-04-26T11:21:54.690903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657972+0000","last_change":"2024-04-26T11:21:53.705872+0000","last_active":"2024-04-26T11:21:55.657972+0000","last_peered":"2024-04-26T11:21:55.657972+0000","last_clean":"2024-04-26T11:21:55.657972+0000","last_became_active":"2024-04-26T11:21:53.705040+0000","last_became_peered":"2024-04-26T11:21:53.705040+0000","last_unstale":"2024-04-26T11:21:55.657972+0000","last_undegraded":"2024-04-26T11:21:55.657972+0000","last_fullsized":"2024-04-26T11:21:55.657972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:02.015153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657316+0000","last_change":"2024-04-26T11:21:53.707324+0000","last_active":"2024-04-26T11:21:55.657316+0000","last_peered":"2024-04-26T11:21:55.657316+0000","last_clean":"2024-04-26T11:21:55.657316+0000","last_became_active":"2024-04-26T11:21:53.706602+0000","last_became_peered":"2024-04-26T11:21:53.706602+0000","last_unstale":"2024-04-26T11:21:55.657316+0000","last_undegraded":"2024-04-26T11:21:55.657316+0000","last_fullsized":"2024-04-26T11:21:55.657316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.907498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657115+0000","last_change":"2024-04-26T11:21:53.714327+0000","last_active":"2024-04-26T11:21:55.657115+0000","last_peered":"2024-04-26T11:21:55.657115+0000","last_clean":"2024-04-26T11:21:55.657115+0000","last_became_active":"2024-04-26T11:21:53.712908+0000","last_became_peered":"2024-04-26T11:21:53.712908+0000","last_unstale":"2024-04-26T11:21:55.657115+0000","last_undegraded":"2024-04-26T11:21:55.657115+0000","last_fullsized":"2024-04-26T11:21:55.657115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:31.158881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691927+0000","last_change":"2024-04-26T11:21:53.713524+0000","last_active":"2024-04-26T11:21:54.691927+0000","last_peered":"2024-04-26T11:21:54.691927+0000","last_clean":"2024-04-26T11:21:54.691927+0000","last_became_active":"2024-04-26T11:21:53.710675+0000","last_became_peered":"2024-04-26T11:21:53.710675+0000","last_unstale":"2024-04-26T11:21:54.691927+0000","last_undegraded":"2024-04-26T11:21:54.691927+0000","last_fullsized":"2024-04-26T11:21:54.691927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691739+0000","last_change":"2024-04-26T11:21:53.714983+0000","last_active":"2024-04-26T11:21:54.691739+0000","last_peered":"2024-04-26T11:21:54.691739+0000","last_clean":"2024-04-26T11:21:54.691739+0000","last_became_active":"2024-04-26T11:21:53.711987+0000","last_became_peered":"2024-04-26T11:21:53.711987+0000","last_unstale":"2024-04-26T11:21:54.691739+0000","last_undegraded":"2024-04-26T11:21:54.691739+0000","last_fullsized":"2024-04-26T11:21:54.691739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:49.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691059+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:21:54.691059+0000","last_peered":"2024-04-26T11:21:54.691059+0000","last_clean":"2024-04-26T11:21:54.691059+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:21:54.691059+0000","last_undegraded":"2024-04-26T11:21:54.691059+0000","last_fullsized":"2024-04-26T11:21:54.691059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658842+0000","last_change":"2024-04-26T11:21:53.715255+0000","last_active":"2024-04-26T11:21:55.658842+0000","last_peered":"2024-04-26T11:21:55.658842+0000","last_clean":"2024-04-26T11:21:55.658842+0000","last_became_active":"2024-04-26T11:21:53.714525+0000","last_became_peered":"2024-04-26T11:21:53.714525+0000","last_unstale":"2024-04-26T11:21:55.658842+0000","last_undegraded":"2024-04-26T11:21:55.658842+0000","last_fullsized":"2024-04-26T11:21:55.658842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658215+0000","last_change":"2024-04-26T11:21:53.714368+0000","last_active":"2024-04-26T11:21:55.658215+0000","last_peered":"2024-04-26T11:21:55.658215+0000","last_clean":"2024-04-26T11:21:55.658215+0000","last_became_active":"2024-04-26T11:21:53.713099+0000","last_became_peered":"2024-04-26T11:21:53.713099+0000","last_unstale":"2024-04-26T11:21:55.658215+0000","last_undegraded":"2024-04-26T11:21:55.658215+0000","last_fullsized":"2024-04-26T11:21:55.658215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689959+0000","last_change":"2024-04-26T11:21:53.709697+0000","last_active":"2024-04-26T11:21:54.689959+0000","last_peered":"2024-04-26T11:21:54.689959+0000","last_clean":"2024-04-26T11:21:54.689959+0000","last_became_active":"2024-04-26T11:21:53.708839+0000","last_became_peered":"2024-04-26T11:21:53.708839+0000","last_unstale":"2024-04-26T11:21:54.689959+0000","last_undegraded":"2024-04-26T11:21:54.689959+0000","last_fullsized":"2024-04-26T11:21:54.689959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689490+0000","last_change":"2024-04-26T11:21:53.705071+0000","last_active":"2024-04-26T11:21:54.689490+0000","last_peered":"2024-04-26T11:21:54.689490+0000","last_clean":"2024-04-26T11:21:54.689490+0000","last_became_active":"2024-04-26T11:21:53.704331+0000","last_became_peered":"2024-04-26T11:21:53.704331+0000","last_unstale":"2024-04-26T11:21:54.689490+0000","last_undegraded":"2024-04-26T11:21:54.689490+0000","last_fullsized":"2024-04-26T11:21:54.689490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689441+0000","last_change":"2024-04-26T11:21:53.692834+0000","last_active":"2024-04-26T11:21:54.689441+0000","last_peered":"2024-04-26T11:21:54.689441+0000","last_clean":"2024-04-26T11:21:54.689441+0000","last_became_active":"2024-04-26T11:21:53.690279+0000","last_became_peered":"2024-04-26T11:21:53.690279+0000","last_unstale":"2024-04-26T11:21:54.689441+0000","last_undegraded":"2024-04-26T11:21:54.689441+0000","last_fullsized":"2024-04-26T11:21:54.689441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691605+0000","last_change":"2024-04-26T11:21:53.698796+0000","last_active":"2024-04-26T11:21:54.691605+0000","last_peered":"2024-04-26T11:21:54.691605+0000","last_clean":"2024-04-26T11:21:54.691605+0000","last_became_active":"2024-04-26T11:21:53.697854+0000","last_became_peered":"2024-04-26T11:21:53.697854+0000","last_unstale":"2024-04-26T11:21:54.691605+0000","last_undegraded":"2024-04-26T11:21:54.691605+0000","last_fullsized":"2024-04-26T11:21:54.691605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691288+0000","last_change":"2024-04-26T11:21:53.706583+0000","last_active":"2024-04-26T11:21:54.691288+0000","last_peered":"2024-04-26T11:21:54.691288+0000","last_clean":"2024-04-26T11:21:54.691288+0000","last_became_active":"2024-04-26T11:21:53.704871+0000","last_became_peered":"2024-04-26T11:21:53.704871+0000","last_unstale":"2024-04-26T11:21:54.691288+0000","last_undegraded":"2024-04-26T11:21:54.691288+0000","last_fullsized":"2024-04-26T11:21:54.691288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659254+0000","last_change":"2024-04-26T11:21:53.709813+0000","last_active":"2024-04-26T11:21:55.659254+0000","last_peered":"2024-04-26T11:21:55.659254+0000","last_clean":"2024-04-26T11:21:55.659254+0000","last_became_active":"2024-04-26T11:21:53.708399+0000","last_became_peered":"2024-04-26T11:21:53.708399+0000","last_unstale":"2024-04-26T11:21:55.659254+0000","last_undegraded":"2024-04-26T11:21:55.659254+0000","last_fullsized":"2024-04-26T11:21:55.659254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:36.298230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691745+0000","last_change":"2024-04-26T11:21:53.710195+0000","last_active":"2024-04-26T11:21:54.691745+0000","last_peered":"2024-04-26T11:21:54.691745+0000","last_clean":"2024-04-26T11:21:54.691745+0000","last_became_active":"2024-04-26T11:21:53.709660+0000","last_became_peered":"2024-04-26T11:21:53.709660+0000","last_unstale":"2024-04-26T11:21:54.691745+0000","last_undegraded":"2024-04-26T11:21:54.691745+0000","last_fullsized":"2024-04-26T11:21:54.691745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691147+0000","last_change":"2024-04-26T11:21:53.703397+0000","last_active":"2024-04-26T11:21:54.691147+0000","last_peered":"2024-04-26T11:21:54.691147+0000","last_clean":"2024-04-26T11:21:54.691147+0000","last_became_active":"2024-04-26T11:21:53.701822+0000","last_became_peered":"2024-04-26T11:21:53.701822+0000","last_unstale":"2024-04-26T11:21:54.691147+0000","last_undegraded":"2024-04-26T11:21:54.691147+0000","last_fullsized":"2024-04-26T11:21:54.691147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690777+0000","last_change":"2024-04-26T11:21:53.709264+0000","last_active":"2024-04-26T11:21:54.690777+0000","last_peered":"2024-04-26T11:21:54.690777+0000","last_clean":"2024-04-26T11:21:54.690777+0000","last_became_active":"2024-04-26T11:21:53.708529+0000","last_became_peered":"2024-04-26T11:21:53.708529+0000","last_unstale":"2024-04-26T11:21:54.690777+0000","last_undegraded":"2024-04-26T11:21:54.690777+0000","last_fullsized":"2024-04-26T11:21:54.690777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689662+0000","last_change":"2024-04-26T11:21:53.710899+0000","last_active":"2024-04-26T11:21:54.689662+0000","last_peered":"2024-04-26T11:21:54.689662+0000","last_clean":"2024-04-26T11:21:54.689662+0000","last_became_active":"2024-04-26T11:21:53.710185+0000","last_became_peered":"2024-04-26T11:21:53.710185+0000","last_unstale":"2024-04-26T11:21:54.689662+0000","last_undegraded":"2024-04-26T11:21:54.689662+0000","last_fullsized":"2024-04-26T11:21:54.689662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657645+0000","last_change":"2024-04-26T11:21:53.708939+0000","last_active":"2024-04-26T11:21:55.657645+0000","last_peered":"2024-04-26T11:21:55.657645+0000","last_clean":"2024-04-26T11:21:55.657645+0000","last_became_active":"2024-04-26T11:21:53.708120+0000","last_became_peered":"2024-04-26T11:21:53.708120+0000","last_unstale":"2024-04-26T11:21:55.657645+0000","last_undegraded":"2024-04-26T11:21:55.657645+0000","last_fullsized":"2024-04-26T11:21:55.657645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691370+0000","last_change":"2024-04-26T11:21:53.712919+0000","last_active":"2024-04-26T11:21:54.691370+0000","last_peered":"2024-04-26T11:21:54.691370+0000","last_clean":"2024-04-26T11:21:54.691370+0000","last_became_active":"2024-04-26T11:21:53.710798+0000","last_became_peered":"2024-04-26T11:21:53.710798+0000","last_unstale":"2024-04-26T11:21:54.691370+0000","last_undegraded":"2024-04-26T11:21:54.691370+0000","last_fullsized":"2024-04-26T11:21:54.691370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658532+0000","last_change":"2024-04-26T11:21:53.343931+0000","last_active":"2024-04-26T11:21:55.658532+0000","last_peered":"2024-04-26T11:21:55.658532+0000","last_clean":"2024-04-26T11:21:55.658532+0000","last_became_active":"2024-04-26T11:21:53.342363+0000","last_became_peered":"2024-04-26T11:21:53.342363+0000","last_unstale":"2024-04-26T11:21:55.658532+0000","last_undegraded":"2024-04-26T11:21:55.658532+0000","last_fullsized":"2024-04-26T11:21:55.658532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690797+0000","last_change":"2024-04-26T11:21:53.712613+0000","last_active":"2024-04-26T11:21:54.690797+0000","last_peered":"2024-04-26T11:21:54.690797+0000","last_clean":"2024-04-26T11:21:54.690797+0000","last_became_active":"2024-04-26T11:21:53.711848+0000","last_became_peered":"2024-04-26T11:21:53.711848+0000","last_unstale":"2024-04-26T11:21:54.690797+0000","last_undegraded":"2024-04-26T11:21:54.690797+0000","last_fullsized":"2024-04-26T11:21:54.690797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:49.327612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690156+0000","last_change":"2024-04-26T11:21:53.333005+0000","last_active":"2024-04-26T11:21:54.690156+0000","last_peered":"2024-04-26T11:21:54.690156+0000","last_clean":"2024-04-26T11:21:54.690156+0000","last_became_active":"2024-04-26T11:21:53.332191+0000","last_became_peered":"2024-04-26T11:21:53.332191+0000","last_unstale":"2024-04-26T11:21:54.690156+0000","last_undegraded":"2024-04-26T11:21:54.690156+0000","last_fullsized":"2024-04-26T11:21:54.690156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691758+0000","last_change":"2024-04-26T11:21:53.707848+0000","last_active":"2024-04-26T11:21:54.691758+0000","last_peered":"2024-04-26T11:21:54.691758+0000","last_clean":"2024-04-26T11:21:54.691758+0000","last_became_active":"2024-04-26T11:21:53.706222+0000","last_became_peered":"2024-04-26T11:21:53.706222+0000","last_unstale":"2024-04-26T11:21:54.691758+0000","last_undegraded":"2024-04-26T11:21:54.691758+0000","last_fullsized":"2024-04-26T11:21:54.691758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691063+0000","last_change":"2024-04-26T11:21:53.341523+0000","last_active":"2024-04-26T11:21:54.691063+0000","last_peered":"2024-04-26T11:21:54.691063+0000","last_clean":"2024-04-26T11:21:54.691063+0000","last_became_active":"2024-04-26T11:21:53.340545+0000","last_became_peered":"2024-04-26T11:21:53.340545+0000","last_unstale":"2024-04-26T11:21:54.691063+0000","last_undegraded":"2024-04-26T11:21:54.691063+0000","last_fullsized":"2024-04-26T11:21:54.691063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.907675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691390+0000","last_change":"2024-04-26T11:21:53.706879+0000","last_active":"2024-04-26T11:21:54.691390+0000","last_peered":"2024-04-26T11:21:54.691390+0000","last_clean":"2024-04-26T11:21:54.691390+0000","last_became_active":"2024-04-26T11:21:53.705082+0000","last_became_peered":"2024-04-26T11:21:53.705082+0000","last_unstale":"2024-04-26T11:21:54.691390+0000","last_undegraded":"2024-04-26T11:21:54.691390+0000","last_fullsized":"2024-04-26T11:21:54.691390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657400+0000","last_change":"2024-04-26T11:21:53.341655+0000","last_active":"2024-04-26T11:21:55.657400+0000","last_peered":"2024-04-26T11:21:55.657400+0000","last_clean":"2024-04-26T11:21:55.657400+0000","last_became_active":"2024-04-26T11:21:53.340085+0000","last_became_peered":"2024-04-26T11:21:53.340085+0000","last_unstale":"2024-04-26T11:21:55.657400+0000","last_undegraded":"2024-04-26T11:21:55.657400+0000","last_fullsized":"2024-04-26T11:21:55.657400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659421+0000","last_change":"2024-04-26T11:21:53.340063+0000","last_active":"2024-04-26T11:21:55.659421+0000","last_peered":"2024-04-26T11:21:55.659421+0000","last_clean":"2024-04-26T11:21:55.659421+0000","last_became_active":"2024-04-26T11:21:53.339256+0000","last_became_peered":"2024-04-26T11:21:53.339256+0000","last_unstale":"2024-04-26T11:21:55.659421+0000","last_undegraded":"2024-04-26T11:21:55.659421+0000","last_fullsized":"2024-04-26T11:21:55.659421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689561+0000","last_change":"2024-04-26T11:21:53.697700+0000","last_active":"2024-04-26T11:21:54.689561+0000","last_peered":"2024-04-26T11:21:54.689561+0000","last_clean":"2024-04-26T11:21:54.689561+0000","last_became_active":"2024-04-26T11:21:53.696789+0000","last_became_peered":"2024-04-26T11:21:53.696789+0000","last_unstale":"2024-04-26T11:21:54.689561+0000","last_undegraded":"2024-04-26T11:21:54.689561+0000","last_fullsized":"2024-04-26T11:21:54.689561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691980+0000","last_change":"2024-04-26T11:21:53.341302+0000","last_active":"2024-04-26T11:21:54.691980+0000","last_peered":"2024-04-26T11:21:54.691980+0000","last_clean":"2024-04-26T11:21:54.691980+0000","last_became_active":"2024-04-26T11:21:53.340509+0000","last_became_peered":"2024-04-26T11:21:53.340509+0000","last_unstale":"2024-04-26T11:21:54.691980+0000","last_undegraded":"2024-04-26T11:21:54.691980+0000","last_fullsized":"2024-04-26T11:21:54.691980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:16.781849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689756+0000","last_change":"2024-04-26T11:21:53.716075+0000","last_active":"2024-04-26T11:21:54.689756+0000","last_peered":"2024-04-26T11:21:54.689756+0000","last_clean":"2024-04-26T11:21:54.689756+0000","last_became_active":"2024-04-26T11:21:53.714328+0000","last_became_peered":"2024-04-26T11:21:53.714328+0000","last_unstale":"2024-04-26T11:21:54.689756+0000","last_undegraded":"2024-04-26T11:21:54.689756+0000","last_fullsized":"2024-04-26T11:21:54.689756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:54.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659565+0000","last_change":"2024-04-26T11:21:53.339171+0000","last_active":"2024-04-26T11:21:55.659565+0000","last_peered":"2024-04-26T11:21:55.659565+0000","last_clean":"2024-04-26T11:21:55.659565+0000","last_became_active":"2024-04-26T11:21:53.337433+0000","last_became_peered":"2024-04-26T11:21:53.337433+0000","last_unstale":"2024-04-26T11:21:55.659565+0000","last_undegraded":"2024-04-26T11:21:55.659565+0000","last_fullsized":"2024-04-26T11:21:55.659565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658299+0000","last_change":"2024-04-26T11:21:53.719666+0000","last_active":"2024-04-26T11:21:55.658299+0000","last_peered":"2024-04-26T11:21:55.658299+0000","last_clean":"2024-04-26T11:21:55.658299+0000","last_became_active":"2024-04-26T11:21:53.718871+0000","last_became_peered":"2024-04-26T11:21:53.718871+0000","last_unstale":"2024-04-26T11:21:55.658299+0000","last_undegraded":"2024-04-26T11:21:55.658299+0000","last_fullsized":"2024-04-26T11:21:55.658299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659351+0000","last_change":"2024-04-26T11:21:53.344744+0000","last_active":"2024-04-26T11:21:55.659351+0000","last_peered":"2024-04-26T11:21:55.659351+0000","last_clean":"2024-04-26T11:21:55.659351+0000","last_became_active":"2024-04-26T11:21:53.344055+0000","last_became_peered":"2024-04-26T11:21:53.344055+0000","last_unstale":"2024-04-26T11:21:55.659351+0000","last_undegraded":"2024-04-26T11:21:55.659351+0000","last_fullsized":"2024-04-26T11:21:55.659351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690681+0000","last_change":"2024-04-26T11:21:53.709563+0000","last_active":"2024-04-26T11:21:54.690681+0000","last_peered":"2024-04-26T11:21:54.690681+0000","last_clean":"2024-04-26T11:21:54.690681+0000","last_became_active":"2024-04-26T11:21:53.706598+0000","last_became_peered":"2024-04-26T11:21:53.706598+0000","last_unstale":"2024-04-26T11:21:54.690681+0000","last_undegraded":"2024-04-26T11:21:54.690681+0000","last_fullsized":"2024-04-26T11:21:54.690681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691180+0000","last_change":"2024-04-26T11:21:53.330145+0000","last_active":"2024-04-26T11:21:54.691180+0000","last_peered":"2024-04-26T11:21:54.691180+0000","last_clean":"2024-04-26T11:21:54.691180+0000","last_became_active":"2024-04-26T11:21:53.329256+0000","last_became_peered":"2024-04-26T11:21:53.329256+0000","last_unstale":"2024-04-26T11:21:54.691180+0000","last_undegraded":"2024-04-26T11:21:54.691180+0000","last_fullsized":"2024-04-26T11:21:54.691180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658841+0000","last_change":"2024-04-26T11:21:53.715233+0000","last_active":"2024-04-26T11:21:55.658841+0000","last_peered":"2024-04-26T11:21:55.658841+0000","last_clean":"2024-04-26T11:21:55.658841+0000","last_became_active":"2024-04-26T11:21:53.714405+0000","last_became_peered":"2024-04-26T11:21:53.714405+0000","last_unstale":"2024-04-26T11:21:55.658841+0000","last_undegraded":"2024-04-26T11:21:55.658841+0000","last_fullsized":"2024-04-26T11:21:55.658841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659404+0000","last_change":"2024-04-26T11:21:53.344659+0000","last_active":"2024-04-26T11:21:55.659404+0000","last_peered":"2024-04-26T11:21:55.659404+0000","last_clean":"2024-04-26T11:21:55.659404+0000","last_became_active":"2024-04-26T11:21:53.344024+0000","last_became_peered":"2024-04-26T11:21:53.344024+0000","last_unstale":"2024-04-26T11:21:55.659404+0000","last_undegraded":"2024-04-26T11:21:55.659404+0000","last_fullsized":"2024-04-26T11:21:55.659404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:53.053244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659429+0000","last_change":"2024-04-26T11:21:53.710093+0000","last_active":"2024-04-26T11:21:55.659429+0000","last_peered":"2024-04-26T11:21:55.659429+0000","last_clean":"2024-04-26T11:21:55.659429+0000","last_became_active":"2024-04-26T11:21:53.709020+0000","last_became_peered":"2024-04-26T11:21:53.709020+0000","last_unstale":"2024-04-26T11:21:55.659429+0000","last_undegraded":"2024-04-26T11:21:55.659429+0000","last_fullsized":"2024-04-26T11:21:55.659429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690297+0000","last_change":"2024-04-26T11:21:53.341961+0000","last_active":"2024-04-26T11:21:54.690297+0000","last_peered":"2024-04-26T11:21:54.690297+0000","last_clean":"2024-04-26T11:21:54.690297+0000","last_became_active":"2024-04-26T11:21:53.340768+0000","last_became_peered":"2024-04-26T11:21:53.340768+0000","last_unstale":"2024-04-26T11:21:54.690297+0000","last_undegraded":"2024-04-26T11:21:54.690297+0000","last_fullsized":"2024-04-26T11:21:54.690297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659841+0000","last_change":"2024-04-26T11:21:53.706161+0000","last_active":"2024-04-26T11:21:55.659841+0000","last_peered":"2024-04-26T11:21:55.659841+0000","last_clean":"2024-04-26T11:21:55.659841+0000","last_became_active":"2024-04-26T11:21:53.705388+0000","last_became_peered":"2024-04-26T11:21:53.705388+0000","last_unstale":"2024-04-26T11:21:55.659841+0000","last_undegraded":"2024-04-26T11:21:55.659841+0000","last_fullsized":"2024-04-26T11:21:55.659841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690017+0000","last_change":"2024-04-26T11:21:53.328489+0000","last_active":"2024-04-26T11:21:54.690017+0000","last_peered":"2024-04-26T11:21:54.690017+0000","last_clean":"2024-04-26T11:21:54.690017+0000","last_became_active":"2024-04-26T11:21:53.327836+0000","last_became_peered":"2024-04-26T11:21:53.327836+0000","last_unstale":"2024-04-26T11:21:54.690017+0000","last_undegraded":"2024-04-26T11:21:54.690017+0000","last_fullsized":"2024-04-26T11:21:54.690017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:32.644217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691473+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:21:54.691473+0000","last_peered":"2024-04-26T11:21:54.691473+0000","last_clean":"2024-04-26T11:21:54.691473+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:21:54.691473+0000","last_undegraded":"2024-04-26T11:21:54.691473+0000","last_fullsized":"2024-04-26T11:21:54.691473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693986+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:21:53.693986+0000","last_peered":"2024-04-26T11:21:53.693986+0000","last_clean":"2024-04-26T11:21:53.693986+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:21:53.693986+0000","last_undegraded":"2024-04-26T11:21:53.693986+0000","last_fullsized":"2024-04-26T11:21:53.693986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694913+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:21:53.694913+0000","last_peered":"2024-04-26T11:21:53.694913+0000","last_clean":"2024-04-26T11:21:53.694913+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:21:53.694913+0000","last_undegraded":"2024-04-26T11:21:53.694913+0000","last_fullsized":"2024-04-26T11:21:53.694913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690419+0000","last_change":"2024-04-26T11:21:53.326934+0000","last_active":"2024-04-26T11:21:54.690419+0000","last_peered":"2024-04-26T11:21:54.690419+0000","last_clean":"2024-04-26T11:21:54.690419+0000","last_became_active":"2024-04-26T11:21:53.325342+0000","last_became_peered":"2024-04-26T11:21:53.325342+0000","last_unstale":"2024-04-26T11:21:54.690419+0000","last_undegraded":"2024-04-26T11:21:54.690419+0000","last_fullsized":"2024-04-26T11:21:54.690419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659521+0000","last_change":"2024-04-26T11:21:53.709499+0000","last_active":"2024-04-26T11:21:55.659521+0000","last_peered":"2024-04-26T11:21:55.659521+0000","last_clean":"2024-04-26T11:21:55.659521+0000","last_became_active":"2024-04-26T11:21:53.707573+0000","last_became_peered":"2024-04-26T11:21:53.707573+0000","last_unstale":"2024-04-26T11:21:55.659521+0000","last_undegraded":"2024-04-26T11:21:55.659521+0000","last_fullsized":"2024-04-26T11:21:55.659521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693364+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:21:53.693364+0000","last_peered":"2024-04-26T11:21:53.693364+0000","last_clean":"2024-04-26T11:21:53.693364+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:21:53.693364+0000","last_undegraded":"2024-04-26T11:21:53.693364+0000","last_fullsized":"2024-04-26T11:21:53.693364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690244+0000","last_change":"2024-04-26T11:21:53.330362+0000","last_active":"2024-04-26T11:21:54.690244+0000","last_peered":"2024-04-26T11:21:54.690244+0000","last_clean":"2024-04-26T11:21:54.690244+0000","last_became_active":"2024-04-26T11:21:53.329383+0000","last_became_peered":"2024-04-26T11:21:53.329383+0000","last_unstale":"2024-04-26T11:21:54.690244+0000","last_undegraded":"2024-04-26T11:21:54.690244+0000","last_fullsized":"2024-04-26T11:21:54.690244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691659+0000","last_change":"2024-04-26T11:21:53.716469+0000","last_active":"2024-04-26T11:21:54.691659+0000","last_peered":"2024-04-26T11:21:54.691659+0000","last_clean":"2024-04-26T11:21:54.691659+0000","last_became_active":"2024-04-26T11:21:53.715684+0000","last_became_peered":"2024-04-26T11:21:53.715684+0000","last_unstale":"2024-04-26T11:21:54.691659+0000","last_undegraded":"2024-04-26T11:21:54.691659+0000","last_fullsized":"2024-04-26T11:21:54.691659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.683688+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:21:53.683688+0000","last_peered":"2024-04-26T11:21:53.683688+0000","last_clean":"2024-04-26T11:21:53.683688+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:21:53.683688+0000","last_undegraded":"2024-04-26T11:21:53.683688+0000","last_fullsized":"2024-04-26T11:21:53.683688+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689798+0000","last_change":"2024-04-26T11:21:53.345743+0000","last_active":"2024-04-26T11:21:54.689798+0000","last_peered":"2024-04-26T11:21:54.689798+0000","last_clean":"2024-04-26T11:21:54.689798+0000","last_became_active":"2024-04-26T11:21:53.344967+0000","last_became_peered":"2024-04-26T11:21:53.344967+0000","last_unstale":"2024-04-26T11:21:54.689798+0000","last_undegraded":"2024-04-26T11:21:54.689798+0000","last_fullsized":"2024-04-26T11:21:54.689798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:08.280572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691663+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:21:54.691663+0000","last_peered":"2024-04-26T11:21:54.691663+0000","last_clean":"2024-04-26T11:21:54.691663+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:21:54.691663+0000","last_undegraded":"2024-04-26T11:21:54.691663+0000","last_fullsized":"2024-04-26T11:21:54.691663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694282+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:21:53.694282+0000","last_peered":"2024-04-26T11:21:53.694282+0000","last_clean":"2024-04-26T11:21:53.694282+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:21:53.694282+0000","last_undegraded":"2024-04-26T11:21:53.694282+0000","last_fullsized":"2024-04-26T11:21:53.694282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658670+0000","last_change":"2024-04-26T11:21:53.338037+0000","last_active":"2024-04-26T11:21:55.658670+0000","last_peered":"2024-04-26T11:21:55.658670+0000","last_clean":"2024-04-26T11:21:55.658670+0000","last_became_active":"2024-04-26T11:21:53.337004+0000","last_became_peered":"2024-04-26T11:21:53.337004+0000","last_unstale":"2024-04-26T11:21:55.658670+0000","last_undegraded":"2024-04-26T11:21:55.658670+0000","last_fullsized":"2024-04-26T11:21:55.658670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691854+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:21:54.691854+0000","last_peered":"2024-04-26T11:21:54.691854+0000","last_clean":"2024-04-26T11:21:54.691854+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:21:54.691854+0000","last_undegraded":"2024-04-26T11:21:54.691854+0000","last_fullsized":"2024-04-26T11:21:54.691854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659642+0000","last_change":"2024-04-26T11:21:53.337312+0000","last_active":"2024-04-26T11:21:55.659642+0000","last_peered":"2024-04-26T11:21:55.659642+0000","last_clean":"2024-04-26T11:21:55.659642+0000","last_became_active":"2024-04-26T11:21:53.336587+0000","last_became_peered":"2024-04-26T11:21:53.336587+0000","last_unstale":"2024-04-26T11:21:55.659642+0000","last_undegraded":"2024-04-26T11:21:55.659642+0000","last_fullsized":"2024-04-26T11:21:55.659642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.681538+0000","last_change":"2024-04-26T11:21:49.292007+0000","last_active":"2024-04-26T11:21:53.681538+0000","last_peered":"2024-04-26T11:21:53.681538+0000","last_clean":"2024-04-26T11:21:53.681538+0000","last_became_active":"2024-04-26T11:21:49.291100+0000","last_became_peered":"2024-04-26T11:21:49.291100+0000","last_unstale":"2024-04-26T11:21:53.681538+0000","last_undegraded":"2024-04-26T11:21:53.681538+0000","last_fullsized":"2024-04-26T11:21:53.681538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.877516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690182+0000","last_change":"2024-04-26T11:21:53.697386+0000","last_active":"2024-04-26T11:21:54.690182+0000","last_peered":"2024-04-26T11:21:54.690182+0000","last_clean":"2024-04-26T11:21:54.690182+0000","last_became_active":"2024-04-26T11:21:53.695847+0000","last_became_peered":"2024-04-26T11:21:53.695847+0000","last_unstale":"2024-04-26T11:21:54.690182+0000","last_undegraded":"2024-04-26T11:21:54.690182+0000","last_fullsized":"2024-04-26T11:21:54.690182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691993+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:21:54.691993+0000","last_peered":"2024-04-26T11:21:54.691993+0000","last_clean":"2024-04-26T11:21:54.691993+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:21:54.691993+0000","last_undegraded":"2024-04-26T11:21:54.691993+0000","last_fullsized":"2024-04-26T11:21:54.691993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.688099+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:21:53.688099+0000","last_peered":"2024-04-26T11:21:53.688099+0000","last_clean":"2024-04-26T11:21:53.688099+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:21:53.688099+0000","last_undegraded":"2024-04-26T11:21:53.688099+0000","last_fullsized":"2024-04-26T11:21:53.688099+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690179+0000","last_change":"2024-04-26T11:21:53.696563+0000","last_active":"2024-04-26T11:21:54.690179+0000","last_peered":"2024-04-26T11:21:54.690179+0000","last_clean":"2024-04-26T11:21:54.690179+0000","last_became_active":"2024-04-26T11:21:53.695678+0000","last_became_peered":"2024-04-26T11:21:53.695678+0000","last_unstale":"2024-04-26T11:21:54.690179+0000","last_undegraded":"2024-04-26T11:21:54.690179+0000","last_fullsized":"2024-04-26T11:21:54.690179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.692075+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:21:54.692075+0000","last_peered":"2024-04-26T11:21:54.692075+0000","last_clean":"2024-04-26T11:21:54.692075+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:21:54.692075+0000","last_undegraded":"2024-04-26T11:21:54.692075+0000","last_fullsized":"2024-04-26T11:21:54.692075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.684028+0000","last_change":"2024-04-26T11:21:49.292644+0000","last_active":"2024-04-26T11:21:53.684028+0000","last_peered":"2024-04-26T11:21:53.684028+0000","last_clean":"2024-04-26T11:21:53.684028+0000","last_became_active":"2024-04-26T11:21:49.291499+0000","last_became_peered":"2024-04-26T11:21:49.291499+0000","last_unstale":"2024-04-26T11:21:53.684028+0000","last_undegraded":"2024-04-26T11:21:53.684028+0000","last_fullsized":"2024-04-26T11:21:53.684028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689637+0000","last_change":"2024-04-26T11:21:53.705104+0000","last_active":"2024-04-26T11:21:54.689637+0000","last_peered":"2024-04-26T11:21:54.689637+0000","last_clean":"2024-04-26T11:21:54.689637+0000","last_became_active":"2024-04-26T11:21:53.704282+0000","last_became_peered":"2024-04-26T11:21:53.704282+0000","last_unstale":"2024-04-26T11:21:54.689637+0000","last_undegraded":"2024-04-26T11:21:54.689637+0000","last_fullsized":"2024-04-26T11:21:54.689637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691859+0000","last_change":"2024-04-26T11:21:53.332815+0000","last_active":"2024-04-26T11:21:54.691859+0000","last_peered":"2024-04-26T11:21:54.691859+0000","last_clean":"2024-04-26T11:21:54.691859+0000","last_became_active":"2024-04-26T11:21:53.332020+0000","last_became_peered":"2024-04-26T11:21:53.332020+0000","last_unstale":"2024-04-26T11:21:54.691859+0000","last_undegraded":"2024-04-26T11:21:54.691859+0000","last_fullsized":"2024-04-26T11:21:54.691859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.700312+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:21:53.700312+0000","last_peered":"2024-04-26T11:21:53.700312+0000","last_clean":"2024-04-26T11:21:53.700312+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:21:53.700312+0000","last_undegraded":"2024-04-26T11:21:53.700312+0000","last_fullsized":"2024-04-26T11:21:53.700312+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689824+0000","last_change":"2024-04-26T11:21:53.696546+0000","last_active":"2024-04-26T11:21:54.689824+0000","last_peered":"2024-04-26T11:21:54.689824+0000","last_clean":"2024-04-26T11:21:54.689824+0000","last_became_active":"2024-04-26T11:21:53.695670+0000","last_became_peered":"2024-04-26T11:21:53.695670+0000","last_unstale":"2024-04-26T11:21:54.689824+0000","last_undegraded":"2024-04-26T11:21:54.689824+0000","last_fullsized":"2024-04-26T11:21:54.689824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658127+0000","last_change":"2024-04-26T11:21:53.703599+0000","last_active":"2024-04-26T11:21:55.658127+0000","last_peered":"2024-04-26T11:21:55.658127+0000","last_clean":"2024-04-26T11:21:55.658127+0000","last_became_active":"2024-04-26T11:21:53.702893+0000","last_became_peered":"2024-04-26T11:21:53.702893+0000","last_unstale":"2024-04-26T11:21:55.658127+0000","last_undegraded":"2024-04-26T11:21:55.658127+0000","last_fullsized":"2024-04-26T11:21:55.658127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659192+0000","last_change":"2024-04-26T11:21:53.340288+0000","last_active":"2024-04-26T11:21:55.659192+0000","last_peered":"2024-04-26T11:21:55.659192+0000","last_clean":"2024-04-26T11:21:55.659192+0000","last_became_active":"2024-04-26T11:21:53.339414+0000","last_became_peered":"2024-04-26T11:21:53.339414+0000","last_unstale":"2024-04-26T11:21:55.659192+0000","last_undegraded":"2024-04-26T11:21:55.659192+0000","last_fullsized":"2024-04-26T11:21:55.659192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689909+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:21:54.689909+0000","last_peered":"2024-04-26T11:21:54.689909+0000","last_clean":"2024-04-26T11:21:54.689909+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:21:54.689909+0000","last_undegraded":"2024-04-26T11:21:54.689909+0000","last_fullsized":"2024-04-26T11:21:54.689909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691341+0000","last_change":"2024-04-26T11:21:53.343465+0000","last_active":"2024-04-26T11:21:54.691341+0000","last_peered":"2024-04-26T11:21:54.691341+0000","last_clean":"2024-04-26T11:21:54.691341+0000","last_became_active":"2024-04-26T11:21:53.342882+0000","last_became_peered":"2024-04-26T11:21:53.342882+0000","last_unstale":"2024-04-26T11:21:54.691341+0000","last_undegraded":"2024-04-26T11:21:54.691341+0000","last_fullsized":"2024-04-26T11:21:54.691341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:41.508747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.660158+0000","last_change":"2024-04-26T11:21:53.344846+0000","last_active":"2024-04-26T11:21:55.660158+0000","last_peered":"2024-04-26T11:21:55.660158+0000","last_clean":"2024-04-26T11:21:55.660158+0000","last_became_active":"2024-04-26T11:21:53.342981+0000","last_became_peered":"2024-04-26T11:21:53.342981+0000","last_unstale":"2024-04-26T11:21:55.660158+0000","last_undegraded":"2024-04-26T11:21:55.660158+0000","last_fullsized":"2024-04-26T11:21:55.660158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689736+0000","last_change":"2024-04-26T11:21:53.706890+0000","last_active":"2024-04-26T11:21:54.689736+0000","last_peered":"2024-04-26T11:21:54.689736+0000","last_clean":"2024-04-26T11:21:54.689736+0000","last_became_active":"2024-04-26T11:21:53.705229+0000","last_became_peered":"2024-04-26T11:21:53.705229+0000","last_unstale":"2024-04-26T11:21:54.689736+0000","last_undegraded":"2024-04-26T11:21:54.689736+0000","last_fullsized":"2024-04-26T11:21:54.689736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691905+0000","last_change":"2024-04-26T11:21:53.334527+0000","last_active":"2024-04-26T11:21:54.691905+0000","last_peered":"2024-04-26T11:21:54.691905+0000","last_clean":"2024-04-26T11:21:54.691905+0000","last_became_active":"2024-04-26T11:21:53.332325+0000","last_became_peered":"2024-04-26T11:21:53.332325+0000","last_unstale":"2024-04-26T11:21:54.691905+0000","last_undegraded":"2024-04-26T11:21:54.691905+0000","last_fullsized":"2024-04-26T11:21:54.691905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689613+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:21:54.689613+0000","last_peered":"2024-04-26T11:21:54.689613+0000","last_clean":"2024-04-26T11:21:54.689613+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:21:54.689613+0000","last_undegraded":"2024-04-26T11:21:54.689613+0000","last_fullsized":"2024-04-26T11:21:54.689613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691804+0000","last_change":"2024-04-26T11:21:53.696949+0000","last_active":"2024-04-26T11:21:54.691804+0000","last_peered":"2024-04-26T11:21:54.691804+0000","last_clean":"2024-04-26T11:21:54.691804+0000","last_became_active":"2024-04-26T11:21:53.696068+0000","last_became_peered":"2024-04-26T11:21:53.696068+0000","last_unstale":"2024-04-26T11:21:54.691804+0000","last_undegraded":"2024-04-26T11:21:54.691804+0000","last_fullsized":"2024-04-26T11:21:54.691804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689833+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:21:54.689833+0000","last_peered":"2024-04-26T11:21:54.689833+0000","last_clean":"2024-04-26T11:21:54.689833+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:21:54.689833+0000","last_undegraded":"2024-04-26T11:21:54.689833+0000","last_fullsized":"2024-04-26T11:21:54.689833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691375+0000","last_change":"2024-04-26T11:21:53.710749+0000","last_active":"2024-04-26T11:21:54.691375+0000","last_peered":"2024-04-26T11:21:54.691375+0000","last_clean":"2024-04-26T11:21:54.691375+0000","last_became_active":"2024-04-26T11:21:53.707330+0000","last_became_peered":"2024-04-26T11:21:53.707330+0000","last_unstale":"2024-04-26T11:21:54.691375+0000","last_undegraded":"2024-04-26T11:21:54.691375+0000","last_fullsized":"2024-04-26T11:21:54.691375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690082+0000","last_change":"2024-04-26T11:21:53.334972+0000","last_active":"2024-04-26T11:21:54.690082+0000","last_peered":"2024-04-26T11:21:54.690082+0000","last_clean":"2024-04-26T11:21:54.690082+0000","last_became_active":"2024-04-26T11:21:53.332642+0000","last_became_peered":"2024-04-26T11:21:53.332642+0000","last_unstale":"2024-04-26T11:21:54.690082+0000","last_undegraded":"2024-04-26T11:21:54.690082+0000","last_fullsized":"2024-04-26T11:21:54.690082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691006+0000","last_change":"2024-04-26T11:21:53.709701+0000","last_active":"2024-04-26T11:21:54.691006+0000","last_peered":"2024-04-26T11:21:54.691006+0000","last_clean":"2024-04-26T11:21:54.691006+0000","last_became_active":"2024-04-26T11:21:53.708905+0000","last_became_peered":"2024-04-26T11:21:53.708905+0000","last_unstale":"2024-04-26T11:21:54.691006+0000","last_undegraded":"2024-04-26T11:21:54.691006+0000","last_fullsized":"2024-04-26T11:21:54.691006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691004+0000","last_change":"2024-04-26T11:21:53.330226+0000","last_active":"2024-04-26T11:21:54.691004+0000","last_peered":"2024-04-26T11:21:54.691004+0000","last_clean":"2024-04-26T11:21:54.691004+0000","last_became_active":"2024-04-26T11:21:53.329446+0000","last_became_peered":"2024-04-26T11:21:53.329446+0000","last_unstale":"2024-04-26T11:21:54.691004+0000","last_undegraded":"2024-04-26T11:21:54.691004+0000","last_fullsized":"2024-04-26T11:21:54.691004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:52.599214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691125+0000","last_change":"2024-04-26T11:21:53.716629+0000","last_active":"2024-04-26T11:21:54.691125+0000","last_peered":"2024-04-26T11:21:54.691125+0000","last_clean":"2024-04-26T11:21:54.691125+0000","last_became_active":"2024-04-26T11:21:53.714799+0000","last_became_peered":"2024-04-26T11:21:53.714799+0000","last_unstale":"2024-04-26T11:21:54.691125+0000","last_undegraded":"2024-04-26T11:21:54.691125+0000","last_fullsized":"2024-04-26T11:21:54.691125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:54.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690731+0000","last_change":"2024-04-26T11:21:53.343318+0000","last_active":"2024-04-26T11:21:54.690731+0000","last_peered":"2024-04-26T11:21:54.690731+0000","last_clean":"2024-04-26T11:21:54.690731+0000","last_became_active":"2024-04-26T11:21:53.342789+0000","last_became_peered":"2024-04-26T11:21:53.342789+0000","last_unstale":"2024-04-26T11:21:54.690731+0000","last_undegraded":"2024-04-26T11:21:54.690731+0000","last_fullsized":"2024-04-26T11:21:54.690731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657848+0000","last_change":"2024-04-26T11:21:53.715726+0000","last_active":"2024-04-26T11:21:55.657848+0000","last_peered":"2024-04-26T11:21:55.657848+0000","last_clean":"2024-04-26T11:21:55.657848+0000","last_became_active":"2024-04-26T11:21:53.715126+0000","last_became_peered":"2024-04-26T11:21:53.715126+0000","last_unstale":"2024-04-26T11:21:55.657848+0000","last_undegraded":"2024-04-26T11:21:55.657848+0000","last_fullsized":"2024-04-26T11:21:55.657848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659105+0000","last_change":"2024-04-26T11:21:53.343934+0000","last_active":"2024-04-26T11:21:55.659105+0000","last_peered":"2024-04-26T11:21:55.659105+0000","last_clean":"2024-04-26T11:21:55.659105+0000","last_became_active":"2024-04-26T11:21:53.342401+0000","last_became_peered":"2024-04-26T11:21:53.342401+0000","last_unstale":"2024-04-26T11:21:55.659105+0000","last_undegraded":"2024-04-26T11:21:55.659105+0000","last_fullsized":"2024-04-26T11:21:55.659105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658676+0000","last_change":"2024-04-26T11:21:53.713092+0000","last_active":"2024-04-26T11:21:55.658676+0000","last_peered":"2024-04-26T11:21:55.658676+0000","last_clean":"2024-04-26T11:21:55.658676+0000","last_became_active":"2024-04-26T11:21:53.712207+0000","last_became_peered":"2024-04-26T11:21:53.712207+0000","last_unstale":"2024-04-26T11:21:55.658676+0000","last_undegraded":"2024-04-26T11:21:55.658676+0000","last_fullsized":"2024-04-26T11:21:55.658676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691034+0000","last_change":"2024-04-26T11:21:53.345453+0000","last_active":"2024-04-26T11:21:54.691034+0000","last_peered":"2024-04-26T11:21:54.691034+0000","last_clean":"2024-04-26T11:21:54.691034+0000","last_became_active":"2024-04-26T11:21:53.344468+0000","last_became_peered":"2024-04-26T11:21:53.344468+0000","last_unstale":"2024-04-26T11:21:54.691034+0000","last_undegraded":"2024-04-26T11:21:54.691034+0000","last_fullsized":"2024-04-26T11:21:54.691034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.295739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690674+0000","last_change":"2024-04-26T11:21:53.712311+0000","last_active":"2024-04-26T11:21:54.690674+0000","last_peered":"2024-04-26T11:21:54.690674+0000","last_clean":"2024-04-26T11:21:54.690674+0000","last_became_active":"2024-04-26T11:21:53.711195+0000","last_became_peered":"2024-04-26T11:21:53.711195+0000","last_unstale":"2024-04-26T11:21:54.690674+0000","last_undegraded":"2024-04-26T11:21:54.690674+0000","last_fullsized":"2024-04-26T11:21:54.690674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:50.973181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691630+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:21:54.691630+0000","last_peered":"2024-04-26T11:21:54.691630+0000","last_clean":"2024-04-26T11:21:54.691630+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:21:54.691630+0000","last_undegraded":"2024-04-26T11:21:54.691630+0000","last_fullsized":"2024-04-26T11:21:54.691630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657705+0000","last_change":"2024-04-26T11:21:53.713610+0000","last_active":"2024-04-26T11:21:55.657705+0000","last_peered":"2024-04-26T11:21:55.657705+0000","last_clean":"2024-04-26T11:21:55.657705+0000","last_became_active":"2024-04-26T11:21:53.712396+0000","last_became_peered":"2024-04-26T11:21:53.712396+0000","last_unstale":"2024-04-26T11:21:55.657705+0000","last_undegraded":"2024-04-26T11:21:55.657705+0000","last_fullsized":"2024-04-26T11:21:55.657705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691634+0000","last_change":"2024-04-26T11:21:53.334939+0000","last_active":"2024-04-26T11:21:54.691634+0000","last_peered":"2024-04-26T11:21:54.691634+0000","last_clean":"2024-04-26T11:21:54.691634+0000","last_became_active":"2024-04-26T11:21:53.332735+0000","last_became_peered":"2024-04-26T11:21:53.332735+0000","last_unstale":"2024-04-26T11:21:54.691634+0000","last_undegraded":"2024-04-26T11:21:54.691634+0000","last_fullsized":"2024-04-26T11:21:54.691634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":647190,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":249856,"data_stored":647806,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:21:59.421 INFO:tasks.ceph.mds.a.smithi073.stderr:2024-04-26T11:21:59.416+0000 7fe5af056640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T11:22:01.115 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:22:01.435 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:01.437 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:22:01.452 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-26T11:22:01.323010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":156,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85824,"kb_used_data":640,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029696,"statfs":{"total":289910292480,"available":289822408704,"internally_reserved":0,"allocated":655360,"data_stored":1350688,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002419"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691482+0000","last_change":"2024-04-26T11:21:53.713298+0000","last_active":"2024-04-26T11:21:54.691482+0000","last_peered":"2024-04-26T11:21:54.691482+0000","last_clean":"2024-04-26T11:21:54.691482+0000","last_became_active":"2024-04-26T11:21:53.712481+0000","last_became_peered":"2024-04-26T11:21:53.712481+0000","last_unstale":"2024-04-26T11:21:54.691482+0000","last_undegraded":"2024-04-26T11:21:54.691482+0000","last_fullsized":"2024-04-26T11:21:54.691482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691323+0000","last_change":"2024-04-26T11:21:53.716754+0000","last_active":"2024-04-26T11:21:54.691323+0000","last_peered":"2024-04-26T11:21:54.691323+0000","last_clean":"2024-04-26T11:21:54.691323+0000","last_became_active":"2024-04-26T11:21:53.716109+0000","last_became_peered":"2024-04-26T11:21:53.716109+0000","last_unstale":"2024-04-26T11:21:54.691323+0000","last_undegraded":"2024-04-26T11:21:54.691323+0000","last_fullsized":"2024-04-26T11:21:54.691323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658980+0000","last_change":"2024-04-26T11:21:53.710480+0000","last_active":"2024-04-26T11:21:55.658980+0000","last_peered":"2024-04-26T11:21:55.658980+0000","last_clean":"2024-04-26T11:21:55.658980+0000","last_became_active":"2024-04-26T11:21:53.709433+0000","last_became_peered":"2024-04-26T11:21:53.709433+0000","last_unstale":"2024-04-26T11:21:55.658980+0000","last_undegraded":"2024-04-26T11:21:55.658980+0000","last_fullsized":"2024-04-26T11:21:55.658980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:11.687344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658399+0000","last_change":"2024-04-26T11:21:53.719849+0000","last_active":"2024-04-26T11:21:55.658399+0000","last_peered":"2024-04-26T11:21:55.658399+0000","last_clean":"2024-04-26T11:21:55.658399+0000","last_became_active":"2024-04-26T11:21:53.719152+0000","last_became_peered":"2024-04-26T11:21:53.719152+0000","last_unstale":"2024-04-26T11:21:55.658399+0000","last_undegraded":"2024-04-26T11:21:55.658399+0000","last_fullsized":"2024-04-26T11:21:55.658399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690467+0000","last_change":"2024-04-26T11:21:53.712493+0000","last_active":"2024-04-26T11:21:54.690467+0000","last_peered":"2024-04-26T11:21:54.690467+0000","last_clean":"2024-04-26T11:21:54.690467+0000","last_became_active":"2024-04-26T11:21:53.711704+0000","last_became_peered":"2024-04-26T11:21:53.711704+0000","last_unstale":"2024-04-26T11:21:54.690467+0000","last_undegraded":"2024-04-26T11:21:54.690467+0000","last_fullsized":"2024-04-26T11:21:54.690467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657707+0000","last_change":"2024-04-26T11:21:53.715149+0000","last_active":"2024-04-26T11:21:55.657707+0000","last_peered":"2024-04-26T11:21:55.657707+0000","last_clean":"2024-04-26T11:21:55.657707+0000","last_became_active":"2024-04-26T11:21:53.714125+0000","last_became_peered":"2024-04-26T11:21:53.714125+0000","last_unstale":"2024-04-26T11:21:55.657707+0000","last_undegraded":"2024-04-26T11:21:55.657707+0000","last_fullsized":"2024-04-26T11:21:55.657707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657112+0000","last_change":"2024-04-26T11:21:53.714653+0000","last_active":"2024-04-26T11:21:55.657112+0000","last_peered":"2024-04-26T11:21:55.657112+0000","last_clean":"2024-04-26T11:21:55.657112+0000","last_became_active":"2024-04-26T11:21:53.713586+0000","last_became_peered":"2024-04-26T11:21:53.713586+0000","last_unstale":"2024-04-26T11:21:55.657112+0000","last_undegraded":"2024-04-26T11:21:55.657112+0000","last_fullsized":"2024-04-26T11:21:55.657112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:01.563026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657099+0000","last_change":"2024-04-26T11:21:53.715422+0000","last_active":"2024-04-26T11:21:55.657099+0000","last_peered":"2024-04-26T11:21:55.657099+0000","last_clean":"2024-04-26T11:21:55.657099+0000","last_became_active":"2024-04-26T11:21:53.714329+0000","last_became_peered":"2024-04-26T11:21:53.714329+0000","last_unstale":"2024-04-26T11:21:55.657099+0000","last_undegraded":"2024-04-26T11:21:55.657099+0000","last_fullsized":"2024-04-26T11:21:55.657099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:06.981197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691270+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:21:54.691270+0000","last_peered":"2024-04-26T11:21:54.691270+0000","last_clean":"2024-04-26T11:21:54.691270+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:21:54.691270+0000","last_undegraded":"2024-04-26T11:21:54.691270+0000","last_fullsized":"2024-04-26T11:21:54.691270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691299+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:21:54.691299+0000","last_peered":"2024-04-26T11:21:54.691299+0000","last_clean":"2024-04-26T11:21:54.691299+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:21:54.691299+0000","last_undegraded":"2024-04-26T11:21:54.691299+0000","last_fullsized":"2024-04-26T11:21:54.691299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658964+0000","last_change":"2024-04-26T11:21:53.714245+0000","last_active":"2024-04-26T11:21:55.658964+0000","last_peered":"2024-04-26T11:21:55.658964+0000","last_clean":"2024-04-26T11:21:55.658964+0000","last_became_active":"2024-04-26T11:21:53.713331+0000","last_became_peered":"2024-04-26T11:21:53.713331+0000","last_unstale":"2024-04-26T11:21:55.658964+0000","last_undegraded":"2024-04-26T11:21:55.658964+0000","last_fullsized":"2024-04-26T11:21:55.658964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690847+0000","last_change":"2024-04-26T11:21:53.712269+0000","last_active":"2024-04-26T11:21:54.690847+0000","last_peered":"2024-04-26T11:21:54.690847+0000","last_clean":"2024-04-26T11:21:54.690847+0000","last_became_active":"2024-04-26T11:21:53.710740+0000","last_became_peered":"2024-04-26T11:21:53.710740+0000","last_unstale":"2024-04-26T11:21:54.690847+0000","last_undegraded":"2024-04-26T11:21:54.690847+0000","last_fullsized":"2024-04-26T11:21:54.690847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690903+0000","last_change":"2024-04-26T11:21:53.712552+0000","last_active":"2024-04-26T11:21:54.690903+0000","last_peered":"2024-04-26T11:21:54.690903+0000","last_clean":"2024-04-26T11:21:54.690903+0000","last_became_active":"2024-04-26T11:21:53.711470+0000","last_became_peered":"2024-04-26T11:21:53.711470+0000","last_unstale":"2024-04-26T11:21:54.690903+0000","last_undegraded":"2024-04-26T11:21:54.690903+0000","last_fullsized":"2024-04-26T11:21:54.690903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657972+0000","last_change":"2024-04-26T11:21:53.705872+0000","last_active":"2024-04-26T11:21:55.657972+0000","last_peered":"2024-04-26T11:21:55.657972+0000","last_clean":"2024-04-26T11:21:55.657972+0000","last_became_active":"2024-04-26T11:21:53.705040+0000","last_became_peered":"2024-04-26T11:21:53.705040+0000","last_unstale":"2024-04-26T11:21:55.657972+0000","last_undegraded":"2024-04-26T11:21:55.657972+0000","last_fullsized":"2024-04-26T11:21:55.657972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:02.015153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657316+0000","last_change":"2024-04-26T11:21:53.707324+0000","last_active":"2024-04-26T11:21:55.657316+0000","last_peered":"2024-04-26T11:21:55.657316+0000","last_clean":"2024-04-26T11:21:55.657316+0000","last_became_active":"2024-04-26T11:21:53.706602+0000","last_became_peered":"2024-04-26T11:21:53.706602+0000","last_unstale":"2024-04-26T11:21:55.657316+0000","last_undegraded":"2024-04-26T11:21:55.657316+0000","last_fullsized":"2024-04-26T11:21:55.657316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.907498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657115+0000","last_change":"2024-04-26T11:21:53.714327+0000","last_active":"2024-04-26T11:21:55.657115+0000","last_peered":"2024-04-26T11:21:55.657115+0000","last_clean":"2024-04-26T11:21:55.657115+0000","last_became_active":"2024-04-26T11:21:53.712908+0000","last_became_peered":"2024-04-26T11:21:53.712908+0000","last_unstale":"2024-04-26T11:21:55.657115+0000","last_undegraded":"2024-04-26T11:21:55.657115+0000","last_fullsized":"2024-04-26T11:21:55.657115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:31.158881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691927+0000","last_change":"2024-04-26T11:21:53.713524+0000","last_active":"2024-04-26T11:21:54.691927+0000","last_peered":"2024-04-26T11:21:54.691927+0000","last_clean":"2024-04-26T11:21:54.691927+0000","last_became_active":"2024-04-26T11:21:53.710675+0000","last_became_peered":"2024-04-26T11:21:53.710675+0000","last_unstale":"2024-04-26T11:21:54.691927+0000","last_undegraded":"2024-04-26T11:21:54.691927+0000","last_fullsized":"2024-04-26T11:21:54.691927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691739+0000","last_change":"2024-04-26T11:21:53.714983+0000","last_active":"2024-04-26T11:21:54.691739+0000","last_peered":"2024-04-26T11:21:54.691739+0000","last_clean":"2024-04-26T11:21:54.691739+0000","last_became_active":"2024-04-26T11:21:53.711987+0000","last_became_peered":"2024-04-26T11:21:53.711987+0000","last_unstale":"2024-04-26T11:21:54.691739+0000","last_undegraded":"2024-04-26T11:21:54.691739+0000","last_fullsized":"2024-04-26T11:21:54.691739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:49.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691059+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:21:54.691059+0000","last_peered":"2024-04-26T11:21:54.691059+0000","last_clean":"2024-04-26T11:21:54.691059+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:21:54.691059+0000","last_undegraded":"2024-04-26T11:21:54.691059+0000","last_fullsized":"2024-04-26T11:21:54.691059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658842+0000","last_change":"2024-04-26T11:21:53.715255+0000","last_active":"2024-04-26T11:21:55.658842+0000","last_peered":"2024-04-26T11:21:55.658842+0000","last_clean":"2024-04-26T11:21:55.658842+0000","last_became_active":"2024-04-26T11:21:53.714525+0000","last_became_peered":"2024-04-26T11:21:53.714525+0000","last_unstale":"2024-04-26T11:21:55.658842+0000","last_undegraded":"2024-04-26T11:21:55.658842+0000","last_fullsized":"2024-04-26T11:21:55.658842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658215+0000","last_change":"2024-04-26T11:21:53.714368+0000","last_active":"2024-04-26T11:21:55.658215+0000","last_peered":"2024-04-26T11:21:55.658215+0000","last_clean":"2024-04-26T11:21:55.658215+0000","last_became_active":"2024-04-26T11:21:53.713099+0000","last_became_peered":"2024-04-26T11:21:53.713099+0000","last_unstale":"2024-04-26T11:21:55.658215+0000","last_undegraded":"2024-04-26T11:21:55.658215+0000","last_fullsized":"2024-04-26T11:21:55.658215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689959+0000","last_change":"2024-04-26T11:21:53.709697+0000","last_active":"2024-04-26T11:21:54.689959+0000","last_peered":"2024-04-26T11:21:54.689959+0000","last_clean":"2024-04-26T11:21:54.689959+0000","last_became_active":"2024-04-26T11:21:53.708839+0000","last_became_peered":"2024-04-26T11:21:53.708839+0000","last_unstale":"2024-04-26T11:21:54.689959+0000","last_undegraded":"2024-04-26T11:21:54.689959+0000","last_fullsized":"2024-04-26T11:21:54.689959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689490+0000","last_change":"2024-04-26T11:21:53.705071+0000","last_active":"2024-04-26T11:21:54.689490+0000","last_peered":"2024-04-26T11:21:54.689490+0000","last_clean":"2024-04-26T11:21:54.689490+0000","last_became_active":"2024-04-26T11:21:53.704331+0000","last_became_peered":"2024-04-26T11:21:53.704331+0000","last_unstale":"2024-04-26T11:21:54.689490+0000","last_undegraded":"2024-04-26T11:21:54.689490+0000","last_fullsized":"2024-04-26T11:21:54.689490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689441+0000","last_change":"2024-04-26T11:21:53.692834+0000","last_active":"2024-04-26T11:21:54.689441+0000","last_peered":"2024-04-26T11:21:54.689441+0000","last_clean":"2024-04-26T11:21:54.689441+0000","last_became_active":"2024-04-26T11:21:53.690279+0000","last_became_peered":"2024-04-26T11:21:53.690279+0000","last_unstale":"2024-04-26T11:21:54.689441+0000","last_undegraded":"2024-04-26T11:21:54.689441+0000","last_fullsized":"2024-04-26T11:21:54.689441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691605+0000","last_change":"2024-04-26T11:21:53.698796+0000","last_active":"2024-04-26T11:21:54.691605+0000","last_peered":"2024-04-26T11:21:54.691605+0000","last_clean":"2024-04-26T11:21:54.691605+0000","last_became_active":"2024-04-26T11:21:53.697854+0000","last_became_peered":"2024-04-26T11:21:53.697854+0000","last_unstale":"2024-04-26T11:21:54.691605+0000","last_undegraded":"2024-04-26T11:21:54.691605+0000","last_fullsized":"2024-04-26T11:21:54.691605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691288+0000","last_change":"2024-04-26T11:21:53.706583+0000","last_active":"2024-04-26T11:21:54.691288+0000","last_peered":"2024-04-26T11:21:54.691288+0000","last_clean":"2024-04-26T11:21:54.691288+0000","last_became_active":"2024-04-26T11:21:53.704871+0000","last_became_peered":"2024-04-26T11:21:53.704871+0000","last_unstale":"2024-04-26T11:21:54.691288+0000","last_undegraded":"2024-04-26T11:21:54.691288+0000","last_fullsized":"2024-04-26T11:21:54.691288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659254+0000","last_change":"2024-04-26T11:21:53.709813+0000","last_active":"2024-04-26T11:21:55.659254+0000","last_peered":"2024-04-26T11:21:55.659254+0000","last_clean":"2024-04-26T11:21:55.659254+0000","last_became_active":"2024-04-26T11:21:53.708399+0000","last_became_peered":"2024-04-26T11:21:53.708399+0000","last_unstale":"2024-04-26T11:21:55.659254+0000","last_undegraded":"2024-04-26T11:21:55.659254+0000","last_fullsized":"2024-04-26T11:21:55.659254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:36.298230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691745+0000","last_change":"2024-04-26T11:21:53.710195+0000","last_active":"2024-04-26T11:21:54.691745+0000","last_peered":"2024-04-26T11:21:54.691745+0000","last_clean":"2024-04-26T11:21:54.691745+0000","last_became_active":"2024-04-26T11:21:53.709660+0000","last_became_peered":"2024-04-26T11:21:53.709660+0000","last_unstale":"2024-04-26T11:21:54.691745+0000","last_undegraded":"2024-04-26T11:21:54.691745+0000","last_fullsized":"2024-04-26T11:21:54.691745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691147+0000","last_change":"2024-04-26T11:21:53.703397+0000","last_active":"2024-04-26T11:21:54.691147+0000","last_peered":"2024-04-26T11:21:54.691147+0000","last_clean":"2024-04-26T11:21:54.691147+0000","last_became_active":"2024-04-26T11:21:53.701822+0000","last_became_peered":"2024-04-26T11:21:53.701822+0000","last_unstale":"2024-04-26T11:21:54.691147+0000","last_undegraded":"2024-04-26T11:21:54.691147+0000","last_fullsized":"2024-04-26T11:21:54.691147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690777+0000","last_change":"2024-04-26T11:21:53.709264+0000","last_active":"2024-04-26T11:21:54.690777+0000","last_peered":"2024-04-26T11:21:54.690777+0000","last_clean":"2024-04-26T11:21:54.690777+0000","last_became_active":"2024-04-26T11:21:53.708529+0000","last_became_peered":"2024-04-26T11:21:53.708529+0000","last_unstale":"2024-04-26T11:21:54.690777+0000","last_undegraded":"2024-04-26T11:21:54.690777+0000","last_fullsized":"2024-04-26T11:21:54.690777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689662+0000","last_change":"2024-04-26T11:21:53.710899+0000","last_active":"2024-04-26T11:21:54.689662+0000","last_peered":"2024-04-26T11:21:54.689662+0000","last_clean":"2024-04-26T11:21:54.689662+0000","last_became_active":"2024-04-26T11:21:53.710185+0000","last_became_peered":"2024-04-26T11:21:53.710185+0000","last_unstale":"2024-04-26T11:21:54.689662+0000","last_undegraded":"2024-04-26T11:21:54.689662+0000","last_fullsized":"2024-04-26T11:21:54.689662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657645+0000","last_change":"2024-04-26T11:21:53.708939+0000","last_active":"2024-04-26T11:21:55.657645+0000","last_peered":"2024-04-26T11:21:55.657645+0000","last_clean":"2024-04-26T11:21:55.657645+0000","last_became_active":"2024-04-26T11:21:53.708120+0000","last_became_peered":"2024-04-26T11:21:53.708120+0000","last_unstale":"2024-04-26T11:21:55.657645+0000","last_undegraded":"2024-04-26T11:21:55.657645+0000","last_fullsized":"2024-04-26T11:21:55.657645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691370+0000","last_change":"2024-04-26T11:21:53.712919+0000","last_active":"2024-04-26T11:21:54.691370+0000","last_peered":"2024-04-26T11:21:54.691370+0000","last_clean":"2024-04-26T11:21:54.691370+0000","last_became_active":"2024-04-26T11:21:53.710798+0000","last_became_peered":"2024-04-26T11:21:53.710798+0000","last_unstale":"2024-04-26T11:21:54.691370+0000","last_undegraded":"2024-04-26T11:21:54.691370+0000","last_fullsized":"2024-04-26T11:21:54.691370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658532+0000","last_change":"2024-04-26T11:21:53.343931+0000","last_active":"2024-04-26T11:21:55.658532+0000","last_peered":"2024-04-26T11:21:55.658532+0000","last_clean":"2024-04-26T11:21:55.658532+0000","last_became_active":"2024-04-26T11:21:53.342363+0000","last_became_peered":"2024-04-26T11:21:53.342363+0000","last_unstale":"2024-04-26T11:21:55.658532+0000","last_undegraded":"2024-04-26T11:21:55.658532+0000","last_fullsized":"2024-04-26T11:21:55.658532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690797+0000","last_change":"2024-04-26T11:21:53.712613+0000","last_active":"2024-04-26T11:21:54.690797+0000","last_peered":"2024-04-26T11:21:54.690797+0000","last_clean":"2024-04-26T11:21:54.690797+0000","last_became_active":"2024-04-26T11:21:53.711848+0000","last_became_peered":"2024-04-26T11:21:53.711848+0000","last_unstale":"2024-04-26T11:21:54.690797+0000","last_undegraded":"2024-04-26T11:21:54.690797+0000","last_fullsized":"2024-04-26T11:21:54.690797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:49.327612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690156+0000","last_change":"2024-04-26T11:21:53.333005+0000","last_active":"2024-04-26T11:21:54.690156+0000","last_peered":"2024-04-26T11:21:54.690156+0000","last_clean":"2024-04-26T11:21:54.690156+0000","last_became_active":"2024-04-26T11:21:53.332191+0000","last_became_peered":"2024-04-26T11:21:53.332191+0000","last_unstale":"2024-04-26T11:21:54.690156+0000","last_undegraded":"2024-04-26T11:21:54.690156+0000","last_fullsized":"2024-04-26T11:21:54.690156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691758+0000","last_change":"2024-04-26T11:21:53.707848+0000","last_active":"2024-04-26T11:21:54.691758+0000","last_peered":"2024-04-26T11:21:54.691758+0000","last_clean":"2024-04-26T11:21:54.691758+0000","last_became_active":"2024-04-26T11:21:53.706222+0000","last_became_peered":"2024-04-26T11:21:53.706222+0000","last_unstale":"2024-04-26T11:21:54.691758+0000","last_undegraded":"2024-04-26T11:21:54.691758+0000","last_fullsized":"2024-04-26T11:21:54.691758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691063+0000","last_change":"2024-04-26T11:21:53.341523+0000","last_active":"2024-04-26T11:21:54.691063+0000","last_peered":"2024-04-26T11:21:54.691063+0000","last_clean":"2024-04-26T11:21:54.691063+0000","last_became_active":"2024-04-26T11:21:53.340545+0000","last_became_peered":"2024-04-26T11:21:53.340545+0000","last_unstale":"2024-04-26T11:21:54.691063+0000","last_undegraded":"2024-04-26T11:21:54.691063+0000","last_fullsized":"2024-04-26T11:21:54.691063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.907675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691390+0000","last_change":"2024-04-26T11:21:53.706879+0000","last_active":"2024-04-26T11:21:54.691390+0000","last_peered":"2024-04-26T11:21:54.691390+0000","last_clean":"2024-04-26T11:21:54.691390+0000","last_became_active":"2024-04-26T11:21:53.705082+0000","last_became_peered":"2024-04-26T11:21:53.705082+0000","last_unstale":"2024-04-26T11:21:54.691390+0000","last_undegraded":"2024-04-26T11:21:54.691390+0000","last_fullsized":"2024-04-26T11:21:54.691390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657400+0000","last_change":"2024-04-26T11:21:53.341655+0000","last_active":"2024-04-26T11:21:55.657400+0000","last_peered":"2024-04-26T11:21:55.657400+0000","last_clean":"2024-04-26T11:21:55.657400+0000","last_became_active":"2024-04-26T11:21:53.340085+0000","last_became_peered":"2024-04-26T11:21:53.340085+0000","last_unstale":"2024-04-26T11:21:55.657400+0000","last_undegraded":"2024-04-26T11:21:55.657400+0000","last_fullsized":"2024-04-26T11:21:55.657400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659421+0000","last_change":"2024-04-26T11:21:53.340063+0000","last_active":"2024-04-26T11:21:55.659421+0000","last_peered":"2024-04-26T11:21:55.659421+0000","last_clean":"2024-04-26T11:21:55.659421+0000","last_became_active":"2024-04-26T11:21:53.339256+0000","last_became_peered":"2024-04-26T11:21:53.339256+0000","last_unstale":"2024-04-26T11:21:55.659421+0000","last_undegraded":"2024-04-26T11:21:55.659421+0000","last_fullsized":"2024-04-26T11:21:55.659421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689561+0000","last_change":"2024-04-26T11:21:53.697700+0000","last_active":"2024-04-26T11:21:54.689561+0000","last_peered":"2024-04-26T11:21:54.689561+0000","last_clean":"2024-04-26T11:21:54.689561+0000","last_became_active":"2024-04-26T11:21:53.696789+0000","last_became_peered":"2024-04-26T11:21:53.696789+0000","last_unstale":"2024-04-26T11:21:54.689561+0000","last_undegraded":"2024-04-26T11:21:54.689561+0000","last_fullsized":"2024-04-26T11:21:54.689561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691980+0000","last_change":"2024-04-26T11:21:53.341302+0000","last_active":"2024-04-26T11:21:54.691980+0000","last_peered":"2024-04-26T11:21:54.691980+0000","last_clean":"2024-04-26T11:21:54.691980+0000","last_became_active":"2024-04-26T11:21:53.340509+0000","last_became_peered":"2024-04-26T11:21:53.340509+0000","last_unstale":"2024-04-26T11:21:54.691980+0000","last_undegraded":"2024-04-26T11:21:54.691980+0000","last_fullsized":"2024-04-26T11:21:54.691980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:16.781849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689756+0000","last_change":"2024-04-26T11:21:53.716075+0000","last_active":"2024-04-26T11:21:54.689756+0000","last_peered":"2024-04-26T11:21:54.689756+0000","last_clean":"2024-04-26T11:21:54.689756+0000","last_became_active":"2024-04-26T11:21:53.714328+0000","last_became_peered":"2024-04-26T11:21:53.714328+0000","last_unstale":"2024-04-26T11:21:54.689756+0000","last_undegraded":"2024-04-26T11:21:54.689756+0000","last_fullsized":"2024-04-26T11:21:54.689756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:54.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659565+0000","last_change":"2024-04-26T11:21:53.339171+0000","last_active":"2024-04-26T11:21:55.659565+0000","last_peered":"2024-04-26T11:21:55.659565+0000","last_clean":"2024-04-26T11:21:55.659565+0000","last_became_active":"2024-04-26T11:21:53.337433+0000","last_became_peered":"2024-04-26T11:21:53.337433+0000","last_unstale":"2024-04-26T11:21:55.659565+0000","last_undegraded":"2024-04-26T11:21:55.659565+0000","last_fullsized":"2024-04-26T11:21:55.659565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658299+0000","last_change":"2024-04-26T11:21:53.719666+0000","last_active":"2024-04-26T11:21:55.658299+0000","last_peered":"2024-04-26T11:21:55.658299+0000","last_clean":"2024-04-26T11:21:55.658299+0000","last_became_active":"2024-04-26T11:21:53.718871+0000","last_became_peered":"2024-04-26T11:21:53.718871+0000","last_unstale":"2024-04-26T11:21:55.658299+0000","last_undegraded":"2024-04-26T11:21:55.658299+0000","last_fullsized":"2024-04-26T11:21:55.658299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659351+0000","last_change":"2024-04-26T11:21:53.344744+0000","last_active":"2024-04-26T11:21:55.659351+0000","last_peered":"2024-04-26T11:21:55.659351+0000","last_clean":"2024-04-26T11:21:55.659351+0000","last_became_active":"2024-04-26T11:21:53.344055+0000","last_became_peered":"2024-04-26T11:21:53.344055+0000","last_unstale":"2024-04-26T11:21:55.659351+0000","last_undegraded":"2024-04-26T11:21:55.659351+0000","last_fullsized":"2024-04-26T11:21:55.659351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690681+0000","last_change":"2024-04-26T11:21:53.709563+0000","last_active":"2024-04-26T11:21:54.690681+0000","last_peered":"2024-04-26T11:21:54.690681+0000","last_clean":"2024-04-26T11:21:54.690681+0000","last_became_active":"2024-04-26T11:21:53.706598+0000","last_became_peered":"2024-04-26T11:21:53.706598+0000","last_unstale":"2024-04-26T11:21:54.690681+0000","last_undegraded":"2024-04-26T11:21:54.690681+0000","last_fullsized":"2024-04-26T11:21:54.690681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691180+0000","last_change":"2024-04-26T11:21:53.330145+0000","last_active":"2024-04-26T11:21:54.691180+0000","last_peered":"2024-04-26T11:21:54.691180+0000","last_clean":"2024-04-26T11:21:54.691180+0000","last_became_active":"2024-04-26T11:21:53.329256+0000","last_became_peered":"2024-04-26T11:21:53.329256+0000","last_unstale":"2024-04-26T11:21:54.691180+0000","last_undegraded":"2024-04-26T11:21:54.691180+0000","last_fullsized":"2024-04-26T11:21:54.691180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658841+0000","last_change":"2024-04-26T11:21:53.715233+0000","last_active":"2024-04-26T11:21:55.658841+0000","last_peered":"2024-04-26T11:21:55.658841+0000","last_clean":"2024-04-26T11:21:55.658841+0000","last_became_active":"2024-04-26T11:21:53.714405+0000","last_became_peered":"2024-04-26T11:21:53.714405+0000","last_unstale":"2024-04-26T11:21:55.658841+0000","last_undegraded":"2024-04-26T11:21:55.658841+0000","last_fullsized":"2024-04-26T11:21:55.658841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659404+0000","last_change":"2024-04-26T11:21:53.344659+0000","last_active":"2024-04-26T11:21:55.659404+0000","last_peered":"2024-04-26T11:21:55.659404+0000","last_clean":"2024-04-26T11:21:55.659404+0000","last_became_active":"2024-04-26T11:21:53.344024+0000","last_became_peered":"2024-04-26T11:21:53.344024+0000","last_unstale":"2024-04-26T11:21:55.659404+0000","last_undegraded":"2024-04-26T11:21:55.659404+0000","last_fullsized":"2024-04-26T11:21:55.659404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:53.053244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659429+0000","last_change":"2024-04-26T11:21:53.710093+0000","last_active":"2024-04-26T11:21:55.659429+0000","last_peered":"2024-04-26T11:21:55.659429+0000","last_clean":"2024-04-26T11:21:55.659429+0000","last_became_active":"2024-04-26T11:21:53.709020+0000","last_became_peered":"2024-04-26T11:21:53.709020+0000","last_unstale":"2024-04-26T11:21:55.659429+0000","last_undegraded":"2024-04-26T11:21:55.659429+0000","last_fullsized":"2024-04-26T11:21:55.659429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690297+0000","last_change":"2024-04-26T11:21:53.341961+0000","last_active":"2024-04-26T11:21:54.690297+0000","last_peered":"2024-04-26T11:21:54.690297+0000","last_clean":"2024-04-26T11:21:54.690297+0000","last_became_active":"2024-04-26T11:21:53.340768+0000","last_became_peered":"2024-04-26T11:21:53.340768+0000","last_unstale":"2024-04-26T11:21:54.690297+0000","last_undegraded":"2024-04-26T11:21:54.690297+0000","last_fullsized":"2024-04-26T11:21:54.690297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659841+0000","last_change":"2024-04-26T11:21:53.706161+0000","last_active":"2024-04-26T11:21:55.659841+0000","last_peered":"2024-04-26T11:21:55.659841+0000","last_clean":"2024-04-26T11:21:55.659841+0000","last_became_active":"2024-04-26T11:21:53.705388+0000","last_became_peered":"2024-04-26T11:21:53.705388+0000","last_unstale":"2024-04-26T11:21:55.659841+0000","last_undegraded":"2024-04-26T11:21:55.659841+0000","last_fullsized":"2024-04-26T11:21:55.659841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690017+0000","last_change":"2024-04-26T11:21:53.328489+0000","last_active":"2024-04-26T11:21:54.690017+0000","last_peered":"2024-04-26T11:21:54.690017+0000","last_clean":"2024-04-26T11:21:54.690017+0000","last_became_active":"2024-04-26T11:21:53.327836+0000","last_became_peered":"2024-04-26T11:21:53.327836+0000","last_unstale":"2024-04-26T11:21:54.690017+0000","last_undegraded":"2024-04-26T11:21:54.690017+0000","last_fullsized":"2024-04-26T11:21:54.690017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:32.644217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691473+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:21:54.691473+0000","last_peered":"2024-04-26T11:21:54.691473+0000","last_clean":"2024-04-26T11:21:54.691473+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:21:54.691473+0000","last_undegraded":"2024-04-26T11:21:54.691473+0000","last_fullsized":"2024-04-26T11:21:54.691473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693986+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:21:53.693986+0000","last_peered":"2024-04-26T11:21:53.693986+0000","last_clean":"2024-04-26T11:21:53.693986+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:21:53.693986+0000","last_undegraded":"2024-04-26T11:21:53.693986+0000","last_fullsized":"2024-04-26T11:21:53.693986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694913+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:21:53.694913+0000","last_peered":"2024-04-26T11:21:53.694913+0000","last_clean":"2024-04-26T11:21:53.694913+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:21:53.694913+0000","last_undegraded":"2024-04-26T11:21:53.694913+0000","last_fullsized":"2024-04-26T11:21:53.694913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690419+0000","last_change":"2024-04-26T11:21:53.326934+0000","last_active":"2024-04-26T11:21:54.690419+0000","last_peered":"2024-04-26T11:21:54.690419+0000","last_clean":"2024-04-26T11:21:54.690419+0000","last_became_active":"2024-04-26T11:21:53.325342+0000","last_became_peered":"2024-04-26T11:21:53.325342+0000","last_unstale":"2024-04-26T11:21:54.690419+0000","last_undegraded":"2024-04-26T11:21:54.690419+0000","last_fullsized":"2024-04-26T11:21:54.690419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659521+0000","last_change":"2024-04-26T11:21:53.709499+0000","last_active":"2024-04-26T11:21:55.659521+0000","last_peered":"2024-04-26T11:21:55.659521+0000","last_clean":"2024-04-26T11:21:55.659521+0000","last_became_active":"2024-04-26T11:21:53.707573+0000","last_became_peered":"2024-04-26T11:21:53.707573+0000","last_unstale":"2024-04-26T11:21:55.659521+0000","last_undegraded":"2024-04-26T11:21:55.659521+0000","last_fullsized":"2024-04-26T11:21:55.659521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693364+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:21:53.693364+0000","last_peered":"2024-04-26T11:21:53.693364+0000","last_clean":"2024-04-26T11:21:53.693364+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:21:53.693364+0000","last_undegraded":"2024-04-26T11:21:53.693364+0000","last_fullsized":"2024-04-26T11:21:53.693364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690244+0000","last_change":"2024-04-26T11:21:53.330362+0000","last_active":"2024-04-26T11:21:54.690244+0000","last_peered":"2024-04-26T11:21:54.690244+0000","last_clean":"2024-04-26T11:21:54.690244+0000","last_became_active":"2024-04-26T11:21:53.329383+0000","last_became_peered":"2024-04-26T11:21:53.329383+0000","last_unstale":"2024-04-26T11:21:54.690244+0000","last_undegraded":"2024-04-26T11:21:54.690244+0000","last_fullsized":"2024-04-26T11:21:54.690244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691659+0000","last_change":"2024-04-26T11:21:53.716469+0000","last_active":"2024-04-26T11:21:54.691659+0000","last_peered":"2024-04-26T11:21:54.691659+0000","last_clean":"2024-04-26T11:21:54.691659+0000","last_became_active":"2024-04-26T11:21:53.715684+0000","last_became_peered":"2024-04-26T11:21:53.715684+0000","last_unstale":"2024-04-26T11:21:54.691659+0000","last_undegraded":"2024-04-26T11:21:54.691659+0000","last_fullsized":"2024-04-26T11:21:54.691659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.683688+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:21:53.683688+0000","last_peered":"2024-04-26T11:21:53.683688+0000","last_clean":"2024-04-26T11:21:53.683688+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:21:53.683688+0000","last_undegraded":"2024-04-26T11:21:53.683688+0000","last_fullsized":"2024-04-26T11:21:53.683688+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689798+0000","last_change":"2024-04-26T11:21:53.345743+0000","last_active":"2024-04-26T11:21:54.689798+0000","last_peered":"2024-04-26T11:21:54.689798+0000","last_clean":"2024-04-26T11:21:54.689798+0000","last_became_active":"2024-04-26T11:21:53.344967+0000","last_became_peered":"2024-04-26T11:21:53.344967+0000","last_unstale":"2024-04-26T11:21:54.689798+0000","last_undegraded":"2024-04-26T11:21:54.689798+0000","last_fullsized":"2024-04-26T11:21:54.689798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:08.280572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691663+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:21:54.691663+0000","last_peered":"2024-04-26T11:21:54.691663+0000","last_clean":"2024-04-26T11:21:54.691663+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:21:54.691663+0000","last_undegraded":"2024-04-26T11:21:54.691663+0000","last_fullsized":"2024-04-26T11:21:54.691663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694282+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:21:53.694282+0000","last_peered":"2024-04-26T11:21:53.694282+0000","last_clean":"2024-04-26T11:21:53.694282+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:21:53.694282+0000","last_undegraded":"2024-04-26T11:21:53.694282+0000","last_fullsized":"2024-04-26T11:21:53.694282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658670+0000","last_change":"2024-04-26T11:21:53.338037+0000","last_active":"2024-04-26T11:21:55.658670+0000","last_peered":"2024-04-26T11:21:55.658670+0000","last_clean":"2024-04-26T11:21:55.658670+0000","last_became_active":"2024-04-26T11:21:53.337004+0000","last_became_peered":"2024-04-26T11:21:53.337004+0000","last_unstale":"2024-04-26T11:21:55.658670+0000","last_undegraded":"2024-04-26T11:21:55.658670+0000","last_fullsized":"2024-04-26T11:21:55.658670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691854+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:21:54.691854+0000","last_peered":"2024-04-26T11:21:54.691854+0000","last_clean":"2024-04-26T11:21:54.691854+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:21:54.691854+0000","last_undegraded":"2024-04-26T11:21:54.691854+0000","last_fullsized":"2024-04-26T11:21:54.691854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659642+0000","last_change":"2024-04-26T11:21:53.337312+0000","last_active":"2024-04-26T11:21:55.659642+0000","last_peered":"2024-04-26T11:21:55.659642+0000","last_clean":"2024-04-26T11:21:55.659642+0000","last_became_active":"2024-04-26T11:21:53.336587+0000","last_became_peered":"2024-04-26T11:21:53.336587+0000","last_unstale":"2024-04-26T11:21:55.659642+0000","last_undegraded":"2024-04-26T11:21:55.659642+0000","last_fullsized":"2024-04-26T11:21:55.659642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.681538+0000","last_change":"2024-04-26T11:21:49.292007+0000","last_active":"2024-04-26T11:21:53.681538+0000","last_peered":"2024-04-26T11:21:53.681538+0000","last_clean":"2024-04-26T11:21:53.681538+0000","last_became_active":"2024-04-26T11:21:49.291100+0000","last_became_peered":"2024-04-26T11:21:49.291100+0000","last_unstale":"2024-04-26T11:21:53.681538+0000","last_undegraded":"2024-04-26T11:21:53.681538+0000","last_fullsized":"2024-04-26T11:21:53.681538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.877516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690182+0000","last_change":"2024-04-26T11:21:53.697386+0000","last_active":"2024-04-26T11:21:54.690182+0000","last_peered":"2024-04-26T11:21:54.690182+0000","last_clean":"2024-04-26T11:21:54.690182+0000","last_became_active":"2024-04-26T11:21:53.695847+0000","last_became_peered":"2024-04-26T11:21:53.695847+0000","last_unstale":"2024-04-26T11:21:54.690182+0000","last_undegraded":"2024-04-26T11:21:54.690182+0000","last_fullsized":"2024-04-26T11:21:54.690182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691993+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:21:54.691993+0000","last_peered":"2024-04-26T11:21:54.691993+0000","last_clean":"2024-04-26T11:21:54.691993+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:21:54.691993+0000","last_undegraded":"2024-04-26T11:21:54.691993+0000","last_fullsized":"2024-04-26T11:21:54.691993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.688099+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:21:53.688099+0000","last_peered":"2024-04-26T11:21:53.688099+0000","last_clean":"2024-04-26T11:21:53.688099+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:21:53.688099+0000","last_undegraded":"2024-04-26T11:21:53.688099+0000","last_fullsized":"2024-04-26T11:21:53.688099+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690179+0000","last_change":"2024-04-26T11:21:53.696563+0000","last_active":"2024-04-26T11:21:54.690179+0000","last_peered":"2024-04-26T11:21:54.690179+0000","last_clean":"2024-04-26T11:21:54.690179+0000","last_became_active":"2024-04-26T11:21:53.695678+0000","last_became_peered":"2024-04-26T11:21:53.695678+0000","last_unstale":"2024-04-26T11:21:54.690179+0000","last_undegraded":"2024-04-26T11:21:54.690179+0000","last_fullsized":"2024-04-26T11:21:54.690179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.692075+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:21:54.692075+0000","last_peered":"2024-04-26T11:21:54.692075+0000","last_clean":"2024-04-26T11:21:54.692075+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:21:54.692075+0000","last_undegraded":"2024-04-26T11:21:54.692075+0000","last_fullsized":"2024-04-26T11:21:54.692075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.684028+0000","last_change":"2024-04-26T11:21:49.292644+0000","last_active":"2024-04-26T11:21:53.684028+0000","last_peered":"2024-04-26T11:21:53.684028+0000","last_clean":"2024-04-26T11:21:53.684028+0000","last_became_active":"2024-04-26T11:21:49.291499+0000","last_became_peered":"2024-04-26T11:21:49.291499+0000","last_unstale":"2024-04-26T11:21:53.684028+0000","last_undegraded":"2024-04-26T11:21:53.684028+0000","last_fullsized":"2024-04-26T11:21:53.684028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689637+0000","last_change":"2024-04-26T11:21:53.705104+0000","last_active":"2024-04-26T11:21:54.689637+0000","last_peered":"2024-04-26T11:21:54.689637+0000","last_clean":"2024-04-26T11:21:54.689637+0000","last_became_active":"2024-04-26T11:21:53.704282+0000","last_became_peered":"2024-04-26T11:21:53.704282+0000","last_unstale":"2024-04-26T11:21:54.689637+0000","last_undegraded":"2024-04-26T11:21:54.689637+0000","last_fullsized":"2024-04-26T11:21:54.689637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691859+0000","last_change":"2024-04-26T11:21:53.332815+0000","last_active":"2024-04-26T11:21:54.691859+0000","last_peered":"2024-04-26T11:21:54.691859+0000","last_clean":"2024-04-26T11:21:54.691859+0000","last_became_active":"2024-04-26T11:21:53.332020+0000","last_became_peered":"2024-04-26T11:21:53.332020+0000","last_unstale":"2024-04-26T11:21:54.691859+0000","last_undegraded":"2024-04-26T11:21:54.691859+0000","last_fullsized":"2024-04-26T11:21:54.691859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.700312+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:21:53.700312+0000","last_peered":"2024-04-26T11:21:53.700312+0000","last_clean":"2024-04-26T11:21:53.700312+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:21:53.700312+0000","last_undegraded":"2024-04-26T11:21:53.700312+0000","last_fullsized":"2024-04-26T11:21:53.700312+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689824+0000","last_change":"2024-04-26T11:21:53.696546+0000","last_active":"2024-04-26T11:21:54.689824+0000","last_peered":"2024-04-26T11:21:54.689824+0000","last_clean":"2024-04-26T11:21:54.689824+0000","last_became_active":"2024-04-26T11:21:53.695670+0000","last_became_peered":"2024-04-26T11:21:53.695670+0000","last_unstale":"2024-04-26T11:21:54.689824+0000","last_undegraded":"2024-04-26T11:21:54.689824+0000","last_fullsized":"2024-04-26T11:21:54.689824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658127+0000","last_change":"2024-04-26T11:21:53.703599+0000","last_active":"2024-04-26T11:21:55.658127+0000","last_peered":"2024-04-26T11:21:55.658127+0000","last_clean":"2024-04-26T11:21:55.658127+0000","last_became_active":"2024-04-26T11:21:53.702893+0000","last_became_peered":"2024-04-26T11:21:53.702893+0000","last_unstale":"2024-04-26T11:21:55.658127+0000","last_undegraded":"2024-04-26T11:21:55.658127+0000","last_fullsized":"2024-04-26T11:21:55.658127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659192+0000","last_change":"2024-04-26T11:21:53.340288+0000","last_active":"2024-04-26T11:21:55.659192+0000","last_peered":"2024-04-26T11:21:55.659192+0000","last_clean":"2024-04-26T11:21:55.659192+0000","last_became_active":"2024-04-26T11:21:53.339414+0000","last_became_peered":"2024-04-26T11:21:53.339414+0000","last_unstale":"2024-04-26T11:21:55.659192+0000","last_undegraded":"2024-04-26T11:21:55.659192+0000","last_fullsized":"2024-04-26T11:21:55.659192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689909+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:21:54.689909+0000","last_peered":"2024-04-26T11:21:54.689909+0000","last_clean":"2024-04-26T11:21:54.689909+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:21:54.689909+0000","last_undegraded":"2024-04-26T11:21:54.689909+0000","last_fullsized":"2024-04-26T11:21:54.689909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691341+0000","last_change":"2024-04-26T11:21:53.343465+0000","last_active":"2024-04-26T11:21:54.691341+0000","last_peered":"2024-04-26T11:21:54.691341+0000","last_clean":"2024-04-26T11:21:54.691341+0000","last_became_active":"2024-04-26T11:21:53.342882+0000","last_became_peered":"2024-04-26T11:21:53.342882+0000","last_unstale":"2024-04-26T11:21:54.691341+0000","last_undegraded":"2024-04-26T11:21:54.691341+0000","last_fullsized":"2024-04-26T11:21:54.691341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:41.508747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.660158+0000","last_change":"2024-04-26T11:21:53.344846+0000","last_active":"2024-04-26T11:21:55.660158+0000","last_peered":"2024-04-26T11:21:55.660158+0000","last_clean":"2024-04-26T11:21:55.660158+0000","last_became_active":"2024-04-26T11:21:53.342981+0000","last_became_peered":"2024-04-26T11:21:53.342981+0000","last_unstale":"2024-04-26T11:21:55.660158+0000","last_undegraded":"2024-04-26T11:21:55.660158+0000","last_fullsized":"2024-04-26T11:21:55.660158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689736+0000","last_change":"2024-04-26T11:21:53.706890+0000","last_active":"2024-04-26T11:21:54.689736+0000","last_peered":"2024-04-26T11:21:54.689736+0000","last_clean":"2024-04-26T11:21:54.689736+0000","last_became_active":"2024-04-26T11:21:53.705229+0000","last_became_peered":"2024-04-26T11:21:53.705229+0000","last_unstale":"2024-04-26T11:21:54.689736+0000","last_undegraded":"2024-04-26T11:21:54.689736+0000","last_fullsized":"2024-04-26T11:21:54.689736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691905+0000","last_change":"2024-04-26T11:21:53.334527+0000","last_active":"2024-04-26T11:21:54.691905+0000","last_peered":"2024-04-26T11:21:54.691905+0000","last_clean":"2024-04-26T11:21:54.691905+0000","last_became_active":"2024-04-26T11:21:53.332325+0000","last_became_peered":"2024-04-26T11:21:53.332325+0000","last_unstale":"2024-04-26T11:21:54.691905+0000","last_undegraded":"2024-04-26T11:21:54.691905+0000","last_fullsized":"2024-04-26T11:21:54.691905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689613+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:21:54.689613+0000","last_peered":"2024-04-26T11:21:54.689613+0000","last_clean":"2024-04-26T11:21:54.689613+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:21:54.689613+0000","last_undegraded":"2024-04-26T11:21:54.689613+0000","last_fullsized":"2024-04-26T11:21:54.689613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691804+0000","last_change":"2024-04-26T11:21:53.696949+0000","last_active":"2024-04-26T11:21:54.691804+0000","last_peered":"2024-04-26T11:21:54.691804+0000","last_clean":"2024-04-26T11:21:54.691804+0000","last_became_active":"2024-04-26T11:21:53.696068+0000","last_became_peered":"2024-04-26T11:21:53.696068+0000","last_unstale":"2024-04-26T11:21:54.691804+0000","last_undegraded":"2024-04-26T11:21:54.691804+0000","last_fullsized":"2024-04-26T11:21:54.691804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689833+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:21:54.689833+0000","last_peered":"2024-04-26T11:21:54.689833+0000","last_clean":"2024-04-26T11:21:54.689833+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:21:54.689833+0000","last_undegraded":"2024-04-26T11:21:54.689833+0000","last_fullsized":"2024-04-26T11:21:54.689833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691375+0000","last_change":"2024-04-26T11:21:53.710749+0000","last_active":"2024-04-26T11:21:54.691375+0000","last_peered":"2024-04-26T11:21:54.691375+0000","last_clean":"2024-04-26T11:21:54.691375+0000","last_became_active":"2024-04-26T11:21:53.707330+0000","last_became_peered":"2024-04-26T11:21:53.707330+0000","last_unstale":"2024-04-26T11:21:54.691375+0000","last_undegraded":"2024-04-26T11:21:54.691375+0000","last_fullsized":"2024-04-26T11:21:54.691375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690082+0000","last_change":"2024-04-26T11:21:53.334972+0000","last_active":"2024-04-26T11:21:54.690082+0000","last_peered":"2024-04-26T11:21:54.690082+0000","last_clean":"2024-04-26T11:21:54.690082+0000","last_became_active":"2024-04-26T11:21:53.332642+0000","last_became_peered":"2024-04-26T11:21:53.332642+0000","last_unstale":"2024-04-26T11:21:54.690082+0000","last_undegraded":"2024-04-26T11:21:54.690082+0000","last_fullsized":"2024-04-26T11:21:54.690082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691006+0000","last_change":"2024-04-26T11:21:53.709701+0000","last_active":"2024-04-26T11:21:54.691006+0000","last_peered":"2024-04-26T11:21:54.691006+0000","last_clean":"2024-04-26T11:21:54.691006+0000","last_became_active":"2024-04-26T11:21:53.708905+0000","last_became_peered":"2024-04-26T11:21:53.708905+0000","last_unstale":"2024-04-26T11:21:54.691006+0000","last_undegraded":"2024-04-26T11:21:54.691006+0000","last_fullsized":"2024-04-26T11:21:54.691006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691004+0000","last_change":"2024-04-26T11:21:53.330226+0000","last_active":"2024-04-26T11:21:54.691004+0000","last_peered":"2024-04-26T11:21:54.691004+0000","last_clean":"2024-04-26T11:21:54.691004+0000","last_became_active":"2024-04-26T11:21:53.329446+0000","last_became_peered":"2024-04-26T11:21:53.329446+0000","last_unstale":"2024-04-26T11:21:54.691004+0000","last_undegraded":"2024-04-26T11:21:54.691004+0000","last_fullsized":"2024-04-26T11:21:54.691004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:52.599214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691125+0000","last_change":"2024-04-26T11:21:53.716629+0000","last_active":"2024-04-26T11:21:54.691125+0000","last_peered":"2024-04-26T11:21:54.691125+0000","last_clean":"2024-04-26T11:21:54.691125+0000","last_became_active":"2024-04-26T11:21:53.714799+0000","last_became_peered":"2024-04-26T11:21:53.714799+0000","last_unstale":"2024-04-26T11:21:54.691125+0000","last_undegraded":"2024-04-26T11:21:54.691125+0000","last_fullsized":"2024-04-26T11:21:54.691125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:54.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690731+0000","last_change":"2024-04-26T11:21:53.343318+0000","last_active":"2024-04-26T11:21:54.690731+0000","last_peered":"2024-04-26T11:21:54.690731+0000","last_clean":"2024-04-26T11:21:54.690731+0000","last_became_active":"2024-04-26T11:21:53.342789+0000","last_became_peered":"2024-04-26T11:21:53.342789+0000","last_unstale":"2024-04-26T11:21:54.690731+0000","last_undegraded":"2024-04-26T11:21:54.690731+0000","last_fullsized":"2024-04-26T11:21:54.690731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657848+0000","last_change":"2024-04-26T11:21:53.715726+0000","last_active":"2024-04-26T11:21:55.657848+0000","last_peered":"2024-04-26T11:21:55.657848+0000","last_clean":"2024-04-26T11:21:55.657848+0000","last_became_active":"2024-04-26T11:21:53.715126+0000","last_became_peered":"2024-04-26T11:21:53.715126+0000","last_unstale":"2024-04-26T11:21:55.657848+0000","last_undegraded":"2024-04-26T11:21:55.657848+0000","last_fullsized":"2024-04-26T11:21:55.657848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659105+0000","last_change":"2024-04-26T11:21:53.343934+0000","last_active":"2024-04-26T11:21:55.659105+0000","last_peered":"2024-04-26T11:21:55.659105+0000","last_clean":"2024-04-26T11:21:55.659105+0000","last_became_active":"2024-04-26T11:21:53.342401+0000","last_became_peered":"2024-04-26T11:21:53.342401+0000","last_unstale":"2024-04-26T11:21:55.659105+0000","last_undegraded":"2024-04-26T11:21:55.659105+0000","last_fullsized":"2024-04-26T11:21:55.659105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658676+0000","last_change":"2024-04-26T11:21:53.713092+0000","last_active":"2024-04-26T11:21:55.658676+0000","last_peered":"2024-04-26T11:21:55.658676+0000","last_clean":"2024-04-26T11:21:55.658676+0000","last_became_active":"2024-04-26T11:21:53.712207+0000","last_became_peered":"2024-04-26T11:21:53.712207+0000","last_unstale":"2024-04-26T11:21:55.658676+0000","last_undegraded":"2024-04-26T11:21:55.658676+0000","last_fullsized":"2024-04-26T11:21:55.658676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691034+0000","last_change":"2024-04-26T11:21:53.345453+0000","last_active":"2024-04-26T11:21:54.691034+0000","last_peered":"2024-04-26T11:21:54.691034+0000","last_clean":"2024-04-26T11:21:54.691034+0000","last_became_active":"2024-04-26T11:21:53.344468+0000","last_became_peered":"2024-04-26T11:21:53.344468+0000","last_unstale":"2024-04-26T11:21:54.691034+0000","last_undegraded":"2024-04-26T11:21:54.691034+0000","last_fullsized":"2024-04-26T11:21:54.691034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.295739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690674+0000","last_change":"2024-04-26T11:21:53.712311+0000","last_active":"2024-04-26T11:21:54.690674+0000","last_peered":"2024-04-26T11:21:54.690674+0000","last_clean":"2024-04-26T11:21:54.690674+0000","last_became_active":"2024-04-26T11:21:53.711195+0000","last_became_peered":"2024-04-26T11:21:53.711195+0000","last_unstale":"2024-04-26T11:21:54.690674+0000","last_undegraded":"2024-04-26T11:21:54.690674+0000","last_fullsized":"2024-04-26T11:21:54.690674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:50.973181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691630+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:21:54.691630+0000","last_peered":"2024-04-26T11:21:54.691630+0000","last_clean":"2024-04-26T11:21:54.691630+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:21:54.691630+0000","last_undegraded":"2024-04-26T11:21:54.691630+0000","last_fullsized":"2024-04-26T11:21:54.691630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657705+0000","last_change":"2024-04-26T11:21:53.713610+0000","last_active":"2024-04-26T11:21:55.657705+0000","last_peered":"2024-04-26T11:21:55.657705+0000","last_clean":"2024-04-26T11:21:55.657705+0000","last_became_active":"2024-04-26T11:21:53.712396+0000","last_became_peered":"2024-04-26T11:21:53.712396+0000","last_unstale":"2024-04-26T11:21:55.657705+0000","last_undegraded":"2024-04-26T11:21:55.657705+0000","last_fullsized":"2024-04-26T11:21:55.657705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691634+0000","last_change":"2024-04-26T11:21:53.334939+0000","last_active":"2024-04-26T11:21:54.691634+0000","last_peered":"2024-04-26T11:21:54.691634+0000","last_clean":"2024-04-26T11:21:54.691634+0000","last_became_active":"2024-04-26T11:21:53.332735+0000","last_became_peered":"2024-04-26T11:21:53.332735+0000","last_unstale":"2024-04-26T11:21:54.691634+0000","last_undegraded":"2024-04-26T11:21:54.691634+0000","last_fullsized":"2024-04-26T11:21:54.691634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":1,"up_from":8,"seq":34359738374,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":647190,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":249856,"data_stored":647806,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:22:01.457 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T11:22:01.457 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T11:22:01.458 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T11:22:01.458 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T11:22:01.458 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T11:22:01.825 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:01.841 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":20501},{"type":"v1","addr":"172.21.15.73:6801","nonce":20501}]},"active_addr":"172.21.15.73:6801/20501","active_change":"2024-04-26T11:21:37.311301+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4099,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2005534900}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2774352951}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3911313207}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3483553614}]}]} 2024-04-26T11:22:01.844 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T11:22:01.844 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T11:22:01.844 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:22:02.109 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:02.109 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:54.674778+0000","last_up_change":"2024-04-26T11:21:41.209558+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:22:02.126 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T11:22:02.126 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:22:02.416 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:02.416 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:54.674778+0000","last_up_change":"2024-04-26T11:21:41.209558+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:22:02.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T11:22:02.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T11:22:02.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T11:22:02.599 INFO:teuthology.orchestra.run.smithi073.stdout:34359738376 2024-04-26T11:22:02.599 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:22:02.602 INFO:teuthology.orchestra.run.smithi073.stdout:34359738376 2024-04-26T11:22:02.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:22:02.603 INFO:teuthology.orchestra.run.smithi073.stdout:34359738376 2024-04-26T11:22:02.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:22:02.876 INFO:teuthology.orchestra.run.smithi073.stdout:34359738374 2024-04-26T11:22:02.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738374 for osd.0 2024-04-26T11:22:02.916 INFO:teuthology.orchestra.run.smithi073.stdout:34359738374 2024-04-26T11:22:02.921 INFO:teuthology.orchestra.run.smithi073.stdout:34359738374 2024-04-26T11:22:02.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738374 for osd.1 2024-04-26T11:22:02.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738374 for osd.2 2024-04-26T11:22:03.895 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:22:03.937 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:22:03.941 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:22:04.201 INFO:teuthology.orchestra.run.smithi073.stdout:34359738376 2024-04-26T11:22:04.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.0 2024-04-26T11:22:04.218 DEBUG:teuthology.parallel:result is None 2024-04-26T11:22:04.224 INFO:teuthology.orchestra.run.smithi073.stdout:34359738376 2024-04-26T11:22:04.240 INFO:teuthology.orchestra.run.smithi073.stdout:34359738376 2024-04-26T11:22:04.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.2 2024-04-26T11:22:04.246 DEBUG:teuthology.parallel:result is None 2024-04-26T11:22:04.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.1 2024-04-26T11:22:04.258 DEBUG:teuthology.parallel:result is None 2024-04-26T11:22:04.258 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T11:22:04.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:22:04.580 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:04.582 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:22:04.596 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-26T11:22:03.323410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85824,"kb_used_data":640,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029696,"statfs":{"total":289910292480,"available":289822408704,"internally_reserved":0,"allocated":655360,"data_stored":1350688,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.646931"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691482+0000","last_change":"2024-04-26T11:21:53.713298+0000","last_active":"2024-04-26T11:21:54.691482+0000","last_peered":"2024-04-26T11:21:54.691482+0000","last_clean":"2024-04-26T11:21:54.691482+0000","last_became_active":"2024-04-26T11:21:53.712481+0000","last_became_peered":"2024-04-26T11:21:53.712481+0000","last_unstale":"2024-04-26T11:21:54.691482+0000","last_undegraded":"2024-04-26T11:21:54.691482+0000","last_fullsized":"2024-04-26T11:21:54.691482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691323+0000","last_change":"2024-04-26T11:21:53.716754+0000","last_active":"2024-04-26T11:21:54.691323+0000","last_peered":"2024-04-26T11:21:54.691323+0000","last_clean":"2024-04-26T11:21:54.691323+0000","last_became_active":"2024-04-26T11:21:53.716109+0000","last_became_peered":"2024-04-26T11:21:53.716109+0000","last_unstale":"2024-04-26T11:21:54.691323+0000","last_undegraded":"2024-04-26T11:21:54.691323+0000","last_fullsized":"2024-04-26T11:21:54.691323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658980+0000","last_change":"2024-04-26T11:21:53.710480+0000","last_active":"2024-04-26T11:21:55.658980+0000","last_peered":"2024-04-26T11:21:55.658980+0000","last_clean":"2024-04-26T11:21:55.658980+0000","last_became_active":"2024-04-26T11:21:53.709433+0000","last_became_peered":"2024-04-26T11:21:53.709433+0000","last_unstale":"2024-04-26T11:21:55.658980+0000","last_undegraded":"2024-04-26T11:21:55.658980+0000","last_fullsized":"2024-04-26T11:21:55.658980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:11.687344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658399+0000","last_change":"2024-04-26T11:21:53.719849+0000","last_active":"2024-04-26T11:21:55.658399+0000","last_peered":"2024-04-26T11:21:55.658399+0000","last_clean":"2024-04-26T11:21:55.658399+0000","last_became_active":"2024-04-26T11:21:53.719152+0000","last_became_peered":"2024-04-26T11:21:53.719152+0000","last_unstale":"2024-04-26T11:21:55.658399+0000","last_undegraded":"2024-04-26T11:21:55.658399+0000","last_fullsized":"2024-04-26T11:21:55.658399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690467+0000","last_change":"2024-04-26T11:21:53.712493+0000","last_active":"2024-04-26T11:21:54.690467+0000","last_peered":"2024-04-26T11:21:54.690467+0000","last_clean":"2024-04-26T11:21:54.690467+0000","last_became_active":"2024-04-26T11:21:53.711704+0000","last_became_peered":"2024-04-26T11:21:53.711704+0000","last_unstale":"2024-04-26T11:21:54.690467+0000","last_undegraded":"2024-04-26T11:21:54.690467+0000","last_fullsized":"2024-04-26T11:21:54.690467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657707+0000","last_change":"2024-04-26T11:21:53.715149+0000","last_active":"2024-04-26T11:21:55.657707+0000","last_peered":"2024-04-26T11:21:55.657707+0000","last_clean":"2024-04-26T11:21:55.657707+0000","last_became_active":"2024-04-26T11:21:53.714125+0000","last_became_peered":"2024-04-26T11:21:53.714125+0000","last_unstale":"2024-04-26T11:21:55.657707+0000","last_undegraded":"2024-04-26T11:21:55.657707+0000","last_fullsized":"2024-04-26T11:21:55.657707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657112+0000","last_change":"2024-04-26T11:21:53.714653+0000","last_active":"2024-04-26T11:21:55.657112+0000","last_peered":"2024-04-26T11:21:55.657112+0000","last_clean":"2024-04-26T11:21:55.657112+0000","last_became_active":"2024-04-26T11:21:53.713586+0000","last_became_peered":"2024-04-26T11:21:53.713586+0000","last_unstale":"2024-04-26T11:21:55.657112+0000","last_undegraded":"2024-04-26T11:21:55.657112+0000","last_fullsized":"2024-04-26T11:21:55.657112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:01.563026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657099+0000","last_change":"2024-04-26T11:21:53.715422+0000","last_active":"2024-04-26T11:21:55.657099+0000","last_peered":"2024-04-26T11:21:55.657099+0000","last_clean":"2024-04-26T11:21:55.657099+0000","last_became_active":"2024-04-26T11:21:53.714329+0000","last_became_peered":"2024-04-26T11:21:53.714329+0000","last_unstale":"2024-04-26T11:21:55.657099+0000","last_undegraded":"2024-04-26T11:21:55.657099+0000","last_fullsized":"2024-04-26T11:21:55.657099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:06.981197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691270+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:21:54.691270+0000","last_peered":"2024-04-26T11:21:54.691270+0000","last_clean":"2024-04-26T11:21:54.691270+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:21:54.691270+0000","last_undegraded":"2024-04-26T11:21:54.691270+0000","last_fullsized":"2024-04-26T11:21:54.691270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691299+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:21:54.691299+0000","last_peered":"2024-04-26T11:21:54.691299+0000","last_clean":"2024-04-26T11:21:54.691299+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:21:54.691299+0000","last_undegraded":"2024-04-26T11:21:54.691299+0000","last_fullsized":"2024-04-26T11:21:54.691299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658964+0000","last_change":"2024-04-26T11:21:53.714245+0000","last_active":"2024-04-26T11:21:55.658964+0000","last_peered":"2024-04-26T11:21:55.658964+0000","last_clean":"2024-04-26T11:21:55.658964+0000","last_became_active":"2024-04-26T11:21:53.713331+0000","last_became_peered":"2024-04-26T11:21:53.713331+0000","last_unstale":"2024-04-26T11:21:55.658964+0000","last_undegraded":"2024-04-26T11:21:55.658964+0000","last_fullsized":"2024-04-26T11:21:55.658964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690847+0000","last_change":"2024-04-26T11:21:53.712269+0000","last_active":"2024-04-26T11:21:54.690847+0000","last_peered":"2024-04-26T11:21:54.690847+0000","last_clean":"2024-04-26T11:21:54.690847+0000","last_became_active":"2024-04-26T11:21:53.710740+0000","last_became_peered":"2024-04-26T11:21:53.710740+0000","last_unstale":"2024-04-26T11:21:54.690847+0000","last_undegraded":"2024-04-26T11:21:54.690847+0000","last_fullsized":"2024-04-26T11:21:54.690847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690903+0000","last_change":"2024-04-26T11:21:53.712552+0000","last_active":"2024-04-26T11:21:54.690903+0000","last_peered":"2024-04-26T11:21:54.690903+0000","last_clean":"2024-04-26T11:21:54.690903+0000","last_became_active":"2024-04-26T11:21:53.711470+0000","last_became_peered":"2024-04-26T11:21:53.711470+0000","last_unstale":"2024-04-26T11:21:54.690903+0000","last_undegraded":"2024-04-26T11:21:54.690903+0000","last_fullsized":"2024-04-26T11:21:54.690903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657972+0000","last_change":"2024-04-26T11:21:53.705872+0000","last_active":"2024-04-26T11:21:55.657972+0000","last_peered":"2024-04-26T11:21:55.657972+0000","last_clean":"2024-04-26T11:21:55.657972+0000","last_became_active":"2024-04-26T11:21:53.705040+0000","last_became_peered":"2024-04-26T11:21:53.705040+0000","last_unstale":"2024-04-26T11:21:55.657972+0000","last_undegraded":"2024-04-26T11:21:55.657972+0000","last_fullsized":"2024-04-26T11:21:55.657972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:02.015153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657316+0000","last_change":"2024-04-26T11:21:53.707324+0000","last_active":"2024-04-26T11:21:55.657316+0000","last_peered":"2024-04-26T11:21:55.657316+0000","last_clean":"2024-04-26T11:21:55.657316+0000","last_became_active":"2024-04-26T11:21:53.706602+0000","last_became_peered":"2024-04-26T11:21:53.706602+0000","last_unstale":"2024-04-26T11:21:55.657316+0000","last_undegraded":"2024-04-26T11:21:55.657316+0000","last_fullsized":"2024-04-26T11:21:55.657316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.907498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657115+0000","last_change":"2024-04-26T11:21:53.714327+0000","last_active":"2024-04-26T11:21:55.657115+0000","last_peered":"2024-04-26T11:21:55.657115+0000","last_clean":"2024-04-26T11:21:55.657115+0000","last_became_active":"2024-04-26T11:21:53.712908+0000","last_became_peered":"2024-04-26T11:21:53.712908+0000","last_unstale":"2024-04-26T11:21:55.657115+0000","last_undegraded":"2024-04-26T11:21:55.657115+0000","last_fullsized":"2024-04-26T11:21:55.657115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:31.158881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691927+0000","last_change":"2024-04-26T11:21:53.713524+0000","last_active":"2024-04-26T11:21:54.691927+0000","last_peered":"2024-04-26T11:21:54.691927+0000","last_clean":"2024-04-26T11:21:54.691927+0000","last_became_active":"2024-04-26T11:21:53.710675+0000","last_became_peered":"2024-04-26T11:21:53.710675+0000","last_unstale":"2024-04-26T11:21:54.691927+0000","last_undegraded":"2024-04-26T11:21:54.691927+0000","last_fullsized":"2024-04-26T11:21:54.691927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691739+0000","last_change":"2024-04-26T11:21:53.714983+0000","last_active":"2024-04-26T11:21:54.691739+0000","last_peered":"2024-04-26T11:21:54.691739+0000","last_clean":"2024-04-26T11:21:54.691739+0000","last_became_active":"2024-04-26T11:21:53.711987+0000","last_became_peered":"2024-04-26T11:21:53.711987+0000","last_unstale":"2024-04-26T11:21:54.691739+0000","last_undegraded":"2024-04-26T11:21:54.691739+0000","last_fullsized":"2024-04-26T11:21:54.691739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:49.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691059+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:21:54.691059+0000","last_peered":"2024-04-26T11:21:54.691059+0000","last_clean":"2024-04-26T11:21:54.691059+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:21:54.691059+0000","last_undegraded":"2024-04-26T11:21:54.691059+0000","last_fullsized":"2024-04-26T11:21:54.691059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658842+0000","last_change":"2024-04-26T11:21:53.715255+0000","last_active":"2024-04-26T11:21:55.658842+0000","last_peered":"2024-04-26T11:21:55.658842+0000","last_clean":"2024-04-26T11:21:55.658842+0000","last_became_active":"2024-04-26T11:21:53.714525+0000","last_became_peered":"2024-04-26T11:21:53.714525+0000","last_unstale":"2024-04-26T11:21:55.658842+0000","last_undegraded":"2024-04-26T11:21:55.658842+0000","last_fullsized":"2024-04-26T11:21:55.658842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658215+0000","last_change":"2024-04-26T11:21:53.714368+0000","last_active":"2024-04-26T11:21:55.658215+0000","last_peered":"2024-04-26T11:21:55.658215+0000","last_clean":"2024-04-26T11:21:55.658215+0000","last_became_active":"2024-04-26T11:21:53.713099+0000","last_became_peered":"2024-04-26T11:21:53.713099+0000","last_unstale":"2024-04-26T11:21:55.658215+0000","last_undegraded":"2024-04-26T11:21:55.658215+0000","last_fullsized":"2024-04-26T11:21:55.658215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689959+0000","last_change":"2024-04-26T11:21:53.709697+0000","last_active":"2024-04-26T11:21:54.689959+0000","last_peered":"2024-04-26T11:21:54.689959+0000","last_clean":"2024-04-26T11:21:54.689959+0000","last_became_active":"2024-04-26T11:21:53.708839+0000","last_became_peered":"2024-04-26T11:21:53.708839+0000","last_unstale":"2024-04-26T11:21:54.689959+0000","last_undegraded":"2024-04-26T11:21:54.689959+0000","last_fullsized":"2024-04-26T11:21:54.689959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689490+0000","last_change":"2024-04-26T11:21:53.705071+0000","last_active":"2024-04-26T11:21:54.689490+0000","last_peered":"2024-04-26T11:21:54.689490+0000","last_clean":"2024-04-26T11:21:54.689490+0000","last_became_active":"2024-04-26T11:21:53.704331+0000","last_became_peered":"2024-04-26T11:21:53.704331+0000","last_unstale":"2024-04-26T11:21:54.689490+0000","last_undegraded":"2024-04-26T11:21:54.689490+0000","last_fullsized":"2024-04-26T11:21:54.689490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689441+0000","last_change":"2024-04-26T11:21:53.692834+0000","last_active":"2024-04-26T11:21:54.689441+0000","last_peered":"2024-04-26T11:21:54.689441+0000","last_clean":"2024-04-26T11:21:54.689441+0000","last_became_active":"2024-04-26T11:21:53.690279+0000","last_became_peered":"2024-04-26T11:21:53.690279+0000","last_unstale":"2024-04-26T11:21:54.689441+0000","last_undegraded":"2024-04-26T11:21:54.689441+0000","last_fullsized":"2024-04-26T11:21:54.689441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691605+0000","last_change":"2024-04-26T11:21:53.698796+0000","last_active":"2024-04-26T11:21:54.691605+0000","last_peered":"2024-04-26T11:21:54.691605+0000","last_clean":"2024-04-26T11:21:54.691605+0000","last_became_active":"2024-04-26T11:21:53.697854+0000","last_became_peered":"2024-04-26T11:21:53.697854+0000","last_unstale":"2024-04-26T11:21:54.691605+0000","last_undegraded":"2024-04-26T11:21:54.691605+0000","last_fullsized":"2024-04-26T11:21:54.691605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691288+0000","last_change":"2024-04-26T11:21:53.706583+0000","last_active":"2024-04-26T11:21:54.691288+0000","last_peered":"2024-04-26T11:21:54.691288+0000","last_clean":"2024-04-26T11:21:54.691288+0000","last_became_active":"2024-04-26T11:21:53.704871+0000","last_became_peered":"2024-04-26T11:21:53.704871+0000","last_unstale":"2024-04-26T11:21:54.691288+0000","last_undegraded":"2024-04-26T11:21:54.691288+0000","last_fullsized":"2024-04-26T11:21:54.691288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659254+0000","last_change":"2024-04-26T11:21:53.709813+0000","last_active":"2024-04-26T11:21:55.659254+0000","last_peered":"2024-04-26T11:21:55.659254+0000","last_clean":"2024-04-26T11:21:55.659254+0000","last_became_active":"2024-04-26T11:21:53.708399+0000","last_became_peered":"2024-04-26T11:21:53.708399+0000","last_unstale":"2024-04-26T11:21:55.659254+0000","last_undegraded":"2024-04-26T11:21:55.659254+0000","last_fullsized":"2024-04-26T11:21:55.659254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:36.298230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691745+0000","last_change":"2024-04-26T11:21:53.710195+0000","last_active":"2024-04-26T11:21:54.691745+0000","last_peered":"2024-04-26T11:21:54.691745+0000","last_clean":"2024-04-26T11:21:54.691745+0000","last_became_active":"2024-04-26T11:21:53.709660+0000","last_became_peered":"2024-04-26T11:21:53.709660+0000","last_unstale":"2024-04-26T11:21:54.691745+0000","last_undegraded":"2024-04-26T11:21:54.691745+0000","last_fullsized":"2024-04-26T11:21:54.691745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691147+0000","last_change":"2024-04-26T11:21:53.703397+0000","last_active":"2024-04-26T11:21:54.691147+0000","last_peered":"2024-04-26T11:21:54.691147+0000","last_clean":"2024-04-26T11:21:54.691147+0000","last_became_active":"2024-04-26T11:21:53.701822+0000","last_became_peered":"2024-04-26T11:21:53.701822+0000","last_unstale":"2024-04-26T11:21:54.691147+0000","last_undegraded":"2024-04-26T11:21:54.691147+0000","last_fullsized":"2024-04-26T11:21:54.691147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690777+0000","last_change":"2024-04-26T11:21:53.709264+0000","last_active":"2024-04-26T11:21:54.690777+0000","last_peered":"2024-04-26T11:21:54.690777+0000","last_clean":"2024-04-26T11:21:54.690777+0000","last_became_active":"2024-04-26T11:21:53.708529+0000","last_became_peered":"2024-04-26T11:21:53.708529+0000","last_unstale":"2024-04-26T11:21:54.690777+0000","last_undegraded":"2024-04-26T11:21:54.690777+0000","last_fullsized":"2024-04-26T11:21:54.690777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689662+0000","last_change":"2024-04-26T11:21:53.710899+0000","last_active":"2024-04-26T11:21:54.689662+0000","last_peered":"2024-04-26T11:21:54.689662+0000","last_clean":"2024-04-26T11:21:54.689662+0000","last_became_active":"2024-04-26T11:21:53.710185+0000","last_became_peered":"2024-04-26T11:21:53.710185+0000","last_unstale":"2024-04-26T11:21:54.689662+0000","last_undegraded":"2024-04-26T11:21:54.689662+0000","last_fullsized":"2024-04-26T11:21:54.689662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657645+0000","last_change":"2024-04-26T11:21:53.708939+0000","last_active":"2024-04-26T11:21:55.657645+0000","last_peered":"2024-04-26T11:21:55.657645+0000","last_clean":"2024-04-26T11:21:55.657645+0000","last_became_active":"2024-04-26T11:21:53.708120+0000","last_became_peered":"2024-04-26T11:21:53.708120+0000","last_unstale":"2024-04-26T11:21:55.657645+0000","last_undegraded":"2024-04-26T11:21:55.657645+0000","last_fullsized":"2024-04-26T11:21:55.657645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691370+0000","last_change":"2024-04-26T11:21:53.712919+0000","last_active":"2024-04-26T11:21:54.691370+0000","last_peered":"2024-04-26T11:21:54.691370+0000","last_clean":"2024-04-26T11:21:54.691370+0000","last_became_active":"2024-04-26T11:21:53.710798+0000","last_became_peered":"2024-04-26T11:21:53.710798+0000","last_unstale":"2024-04-26T11:21:54.691370+0000","last_undegraded":"2024-04-26T11:21:54.691370+0000","last_fullsized":"2024-04-26T11:21:54.691370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658532+0000","last_change":"2024-04-26T11:21:53.343931+0000","last_active":"2024-04-26T11:21:55.658532+0000","last_peered":"2024-04-26T11:21:55.658532+0000","last_clean":"2024-04-26T11:21:55.658532+0000","last_became_active":"2024-04-26T11:21:53.342363+0000","last_became_peered":"2024-04-26T11:21:53.342363+0000","last_unstale":"2024-04-26T11:21:55.658532+0000","last_undegraded":"2024-04-26T11:21:55.658532+0000","last_fullsized":"2024-04-26T11:21:55.658532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690797+0000","last_change":"2024-04-26T11:21:53.712613+0000","last_active":"2024-04-26T11:21:54.690797+0000","last_peered":"2024-04-26T11:21:54.690797+0000","last_clean":"2024-04-26T11:21:54.690797+0000","last_became_active":"2024-04-26T11:21:53.711848+0000","last_became_peered":"2024-04-26T11:21:53.711848+0000","last_unstale":"2024-04-26T11:21:54.690797+0000","last_undegraded":"2024-04-26T11:21:54.690797+0000","last_fullsized":"2024-04-26T11:21:54.690797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:49.327612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690156+0000","last_change":"2024-04-26T11:21:53.333005+0000","last_active":"2024-04-26T11:21:54.690156+0000","last_peered":"2024-04-26T11:21:54.690156+0000","last_clean":"2024-04-26T11:21:54.690156+0000","last_became_active":"2024-04-26T11:21:53.332191+0000","last_became_peered":"2024-04-26T11:21:53.332191+0000","last_unstale":"2024-04-26T11:21:54.690156+0000","last_undegraded":"2024-04-26T11:21:54.690156+0000","last_fullsized":"2024-04-26T11:21:54.690156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691758+0000","last_change":"2024-04-26T11:21:53.707848+0000","last_active":"2024-04-26T11:21:54.691758+0000","last_peered":"2024-04-26T11:21:54.691758+0000","last_clean":"2024-04-26T11:21:54.691758+0000","last_became_active":"2024-04-26T11:21:53.706222+0000","last_became_peered":"2024-04-26T11:21:53.706222+0000","last_unstale":"2024-04-26T11:21:54.691758+0000","last_undegraded":"2024-04-26T11:21:54.691758+0000","last_fullsized":"2024-04-26T11:21:54.691758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691063+0000","last_change":"2024-04-26T11:21:53.341523+0000","last_active":"2024-04-26T11:21:54.691063+0000","last_peered":"2024-04-26T11:21:54.691063+0000","last_clean":"2024-04-26T11:21:54.691063+0000","last_became_active":"2024-04-26T11:21:53.340545+0000","last_became_peered":"2024-04-26T11:21:53.340545+0000","last_unstale":"2024-04-26T11:21:54.691063+0000","last_undegraded":"2024-04-26T11:21:54.691063+0000","last_fullsized":"2024-04-26T11:21:54.691063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.907675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691390+0000","last_change":"2024-04-26T11:21:53.706879+0000","last_active":"2024-04-26T11:21:54.691390+0000","last_peered":"2024-04-26T11:21:54.691390+0000","last_clean":"2024-04-26T11:21:54.691390+0000","last_became_active":"2024-04-26T11:21:53.705082+0000","last_became_peered":"2024-04-26T11:21:53.705082+0000","last_unstale":"2024-04-26T11:21:54.691390+0000","last_undegraded":"2024-04-26T11:21:54.691390+0000","last_fullsized":"2024-04-26T11:21:54.691390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657400+0000","last_change":"2024-04-26T11:21:53.341655+0000","last_active":"2024-04-26T11:21:55.657400+0000","last_peered":"2024-04-26T11:21:55.657400+0000","last_clean":"2024-04-26T11:21:55.657400+0000","last_became_active":"2024-04-26T11:21:53.340085+0000","last_became_peered":"2024-04-26T11:21:53.340085+0000","last_unstale":"2024-04-26T11:21:55.657400+0000","last_undegraded":"2024-04-26T11:21:55.657400+0000","last_fullsized":"2024-04-26T11:21:55.657400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659421+0000","last_change":"2024-04-26T11:21:53.340063+0000","last_active":"2024-04-26T11:21:55.659421+0000","last_peered":"2024-04-26T11:21:55.659421+0000","last_clean":"2024-04-26T11:21:55.659421+0000","last_became_active":"2024-04-26T11:21:53.339256+0000","last_became_peered":"2024-04-26T11:21:53.339256+0000","last_unstale":"2024-04-26T11:21:55.659421+0000","last_undegraded":"2024-04-26T11:21:55.659421+0000","last_fullsized":"2024-04-26T11:21:55.659421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689561+0000","last_change":"2024-04-26T11:21:53.697700+0000","last_active":"2024-04-26T11:21:54.689561+0000","last_peered":"2024-04-26T11:21:54.689561+0000","last_clean":"2024-04-26T11:21:54.689561+0000","last_became_active":"2024-04-26T11:21:53.696789+0000","last_became_peered":"2024-04-26T11:21:53.696789+0000","last_unstale":"2024-04-26T11:21:54.689561+0000","last_undegraded":"2024-04-26T11:21:54.689561+0000","last_fullsized":"2024-04-26T11:21:54.689561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691980+0000","last_change":"2024-04-26T11:21:53.341302+0000","last_active":"2024-04-26T11:21:54.691980+0000","last_peered":"2024-04-26T11:21:54.691980+0000","last_clean":"2024-04-26T11:21:54.691980+0000","last_became_active":"2024-04-26T11:21:53.340509+0000","last_became_peered":"2024-04-26T11:21:53.340509+0000","last_unstale":"2024-04-26T11:21:54.691980+0000","last_undegraded":"2024-04-26T11:21:54.691980+0000","last_fullsized":"2024-04-26T11:21:54.691980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:16.781849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689756+0000","last_change":"2024-04-26T11:21:53.716075+0000","last_active":"2024-04-26T11:21:54.689756+0000","last_peered":"2024-04-26T11:21:54.689756+0000","last_clean":"2024-04-26T11:21:54.689756+0000","last_became_active":"2024-04-26T11:21:53.714328+0000","last_became_peered":"2024-04-26T11:21:53.714328+0000","last_unstale":"2024-04-26T11:21:54.689756+0000","last_undegraded":"2024-04-26T11:21:54.689756+0000","last_fullsized":"2024-04-26T11:21:54.689756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:54.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659565+0000","last_change":"2024-04-26T11:21:53.339171+0000","last_active":"2024-04-26T11:21:55.659565+0000","last_peered":"2024-04-26T11:21:55.659565+0000","last_clean":"2024-04-26T11:21:55.659565+0000","last_became_active":"2024-04-26T11:21:53.337433+0000","last_became_peered":"2024-04-26T11:21:53.337433+0000","last_unstale":"2024-04-26T11:21:55.659565+0000","last_undegraded":"2024-04-26T11:21:55.659565+0000","last_fullsized":"2024-04-26T11:21:55.659565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658299+0000","last_change":"2024-04-26T11:21:53.719666+0000","last_active":"2024-04-26T11:21:55.658299+0000","last_peered":"2024-04-26T11:21:55.658299+0000","last_clean":"2024-04-26T11:21:55.658299+0000","last_became_active":"2024-04-26T11:21:53.718871+0000","last_became_peered":"2024-04-26T11:21:53.718871+0000","last_unstale":"2024-04-26T11:21:55.658299+0000","last_undegraded":"2024-04-26T11:21:55.658299+0000","last_fullsized":"2024-04-26T11:21:55.658299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659351+0000","last_change":"2024-04-26T11:21:53.344744+0000","last_active":"2024-04-26T11:21:55.659351+0000","last_peered":"2024-04-26T11:21:55.659351+0000","last_clean":"2024-04-26T11:21:55.659351+0000","last_became_active":"2024-04-26T11:21:53.344055+0000","last_became_peered":"2024-04-26T11:21:53.344055+0000","last_unstale":"2024-04-26T11:21:55.659351+0000","last_undegraded":"2024-04-26T11:21:55.659351+0000","last_fullsized":"2024-04-26T11:21:55.659351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690681+0000","last_change":"2024-04-26T11:21:53.709563+0000","last_active":"2024-04-26T11:21:54.690681+0000","last_peered":"2024-04-26T11:21:54.690681+0000","last_clean":"2024-04-26T11:21:54.690681+0000","last_became_active":"2024-04-26T11:21:53.706598+0000","last_became_peered":"2024-04-26T11:21:53.706598+0000","last_unstale":"2024-04-26T11:21:54.690681+0000","last_undegraded":"2024-04-26T11:21:54.690681+0000","last_fullsized":"2024-04-26T11:21:54.690681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691180+0000","last_change":"2024-04-26T11:21:53.330145+0000","last_active":"2024-04-26T11:21:54.691180+0000","last_peered":"2024-04-26T11:21:54.691180+0000","last_clean":"2024-04-26T11:21:54.691180+0000","last_became_active":"2024-04-26T11:21:53.329256+0000","last_became_peered":"2024-04-26T11:21:53.329256+0000","last_unstale":"2024-04-26T11:21:54.691180+0000","last_undegraded":"2024-04-26T11:21:54.691180+0000","last_fullsized":"2024-04-26T11:21:54.691180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658841+0000","last_change":"2024-04-26T11:21:53.715233+0000","last_active":"2024-04-26T11:21:55.658841+0000","last_peered":"2024-04-26T11:21:55.658841+0000","last_clean":"2024-04-26T11:21:55.658841+0000","last_became_active":"2024-04-26T11:21:53.714405+0000","last_became_peered":"2024-04-26T11:21:53.714405+0000","last_unstale":"2024-04-26T11:21:55.658841+0000","last_undegraded":"2024-04-26T11:21:55.658841+0000","last_fullsized":"2024-04-26T11:21:55.658841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659404+0000","last_change":"2024-04-26T11:21:53.344659+0000","last_active":"2024-04-26T11:21:55.659404+0000","last_peered":"2024-04-26T11:21:55.659404+0000","last_clean":"2024-04-26T11:21:55.659404+0000","last_became_active":"2024-04-26T11:21:53.344024+0000","last_became_peered":"2024-04-26T11:21:53.344024+0000","last_unstale":"2024-04-26T11:21:55.659404+0000","last_undegraded":"2024-04-26T11:21:55.659404+0000","last_fullsized":"2024-04-26T11:21:55.659404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:53.053244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659429+0000","last_change":"2024-04-26T11:21:53.710093+0000","last_active":"2024-04-26T11:21:55.659429+0000","last_peered":"2024-04-26T11:21:55.659429+0000","last_clean":"2024-04-26T11:21:55.659429+0000","last_became_active":"2024-04-26T11:21:53.709020+0000","last_became_peered":"2024-04-26T11:21:53.709020+0000","last_unstale":"2024-04-26T11:21:55.659429+0000","last_undegraded":"2024-04-26T11:21:55.659429+0000","last_fullsized":"2024-04-26T11:21:55.659429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690297+0000","last_change":"2024-04-26T11:21:53.341961+0000","last_active":"2024-04-26T11:21:54.690297+0000","last_peered":"2024-04-26T11:21:54.690297+0000","last_clean":"2024-04-26T11:21:54.690297+0000","last_became_active":"2024-04-26T11:21:53.340768+0000","last_became_peered":"2024-04-26T11:21:53.340768+0000","last_unstale":"2024-04-26T11:21:54.690297+0000","last_undegraded":"2024-04-26T11:21:54.690297+0000","last_fullsized":"2024-04-26T11:21:54.690297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659841+0000","last_change":"2024-04-26T11:21:53.706161+0000","last_active":"2024-04-26T11:21:55.659841+0000","last_peered":"2024-04-26T11:21:55.659841+0000","last_clean":"2024-04-26T11:21:55.659841+0000","last_became_active":"2024-04-26T11:21:53.705388+0000","last_became_peered":"2024-04-26T11:21:53.705388+0000","last_unstale":"2024-04-26T11:21:55.659841+0000","last_undegraded":"2024-04-26T11:21:55.659841+0000","last_fullsized":"2024-04-26T11:21:55.659841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690017+0000","last_change":"2024-04-26T11:21:53.328489+0000","last_active":"2024-04-26T11:21:54.690017+0000","last_peered":"2024-04-26T11:21:54.690017+0000","last_clean":"2024-04-26T11:21:54.690017+0000","last_became_active":"2024-04-26T11:21:53.327836+0000","last_became_peered":"2024-04-26T11:21:53.327836+0000","last_unstale":"2024-04-26T11:21:54.690017+0000","last_undegraded":"2024-04-26T11:21:54.690017+0000","last_fullsized":"2024-04-26T11:21:54.690017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:32.644217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691473+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:21:54.691473+0000","last_peered":"2024-04-26T11:21:54.691473+0000","last_clean":"2024-04-26T11:21:54.691473+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:21:54.691473+0000","last_undegraded":"2024-04-26T11:21:54.691473+0000","last_fullsized":"2024-04-26T11:21:54.691473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693986+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:21:53.693986+0000","last_peered":"2024-04-26T11:21:53.693986+0000","last_clean":"2024-04-26T11:21:53.693986+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:21:53.693986+0000","last_undegraded":"2024-04-26T11:21:53.693986+0000","last_fullsized":"2024-04-26T11:21:53.693986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694913+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:21:53.694913+0000","last_peered":"2024-04-26T11:21:53.694913+0000","last_clean":"2024-04-26T11:21:53.694913+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:21:53.694913+0000","last_undegraded":"2024-04-26T11:21:53.694913+0000","last_fullsized":"2024-04-26T11:21:53.694913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690419+0000","last_change":"2024-04-26T11:21:53.326934+0000","last_active":"2024-04-26T11:21:54.690419+0000","last_peered":"2024-04-26T11:21:54.690419+0000","last_clean":"2024-04-26T11:21:54.690419+0000","last_became_active":"2024-04-26T11:21:53.325342+0000","last_became_peered":"2024-04-26T11:21:53.325342+0000","last_unstale":"2024-04-26T11:21:54.690419+0000","last_undegraded":"2024-04-26T11:21:54.690419+0000","last_fullsized":"2024-04-26T11:21:54.690419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659521+0000","last_change":"2024-04-26T11:21:53.709499+0000","last_active":"2024-04-26T11:21:55.659521+0000","last_peered":"2024-04-26T11:21:55.659521+0000","last_clean":"2024-04-26T11:21:55.659521+0000","last_became_active":"2024-04-26T11:21:53.707573+0000","last_became_peered":"2024-04-26T11:21:53.707573+0000","last_unstale":"2024-04-26T11:21:55.659521+0000","last_undegraded":"2024-04-26T11:21:55.659521+0000","last_fullsized":"2024-04-26T11:21:55.659521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693364+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:21:53.693364+0000","last_peered":"2024-04-26T11:21:53.693364+0000","last_clean":"2024-04-26T11:21:53.693364+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:21:53.693364+0000","last_undegraded":"2024-04-26T11:21:53.693364+0000","last_fullsized":"2024-04-26T11:21:53.693364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690244+0000","last_change":"2024-04-26T11:21:53.330362+0000","last_active":"2024-04-26T11:21:54.690244+0000","last_peered":"2024-04-26T11:21:54.690244+0000","last_clean":"2024-04-26T11:21:54.690244+0000","last_became_active":"2024-04-26T11:21:53.329383+0000","last_became_peered":"2024-04-26T11:21:53.329383+0000","last_unstale":"2024-04-26T11:21:54.690244+0000","last_undegraded":"2024-04-26T11:21:54.690244+0000","last_fullsized":"2024-04-26T11:21:54.690244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691659+0000","last_change":"2024-04-26T11:21:53.716469+0000","last_active":"2024-04-26T11:21:54.691659+0000","last_peered":"2024-04-26T11:21:54.691659+0000","last_clean":"2024-04-26T11:21:54.691659+0000","last_became_active":"2024-04-26T11:21:53.715684+0000","last_became_peered":"2024-04-26T11:21:53.715684+0000","last_unstale":"2024-04-26T11:21:54.691659+0000","last_undegraded":"2024-04-26T11:21:54.691659+0000","last_fullsized":"2024-04-26T11:21:54.691659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.683688+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:21:53.683688+0000","last_peered":"2024-04-26T11:21:53.683688+0000","last_clean":"2024-04-26T11:21:53.683688+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:21:53.683688+0000","last_undegraded":"2024-04-26T11:21:53.683688+0000","last_fullsized":"2024-04-26T11:21:53.683688+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689798+0000","last_change":"2024-04-26T11:21:53.345743+0000","last_active":"2024-04-26T11:21:54.689798+0000","last_peered":"2024-04-26T11:21:54.689798+0000","last_clean":"2024-04-26T11:21:54.689798+0000","last_became_active":"2024-04-26T11:21:53.344967+0000","last_became_peered":"2024-04-26T11:21:53.344967+0000","last_unstale":"2024-04-26T11:21:54.689798+0000","last_undegraded":"2024-04-26T11:21:54.689798+0000","last_fullsized":"2024-04-26T11:21:54.689798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:08.280572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691663+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:21:54.691663+0000","last_peered":"2024-04-26T11:21:54.691663+0000","last_clean":"2024-04-26T11:21:54.691663+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:21:54.691663+0000","last_undegraded":"2024-04-26T11:21:54.691663+0000","last_fullsized":"2024-04-26T11:21:54.691663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694282+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:21:53.694282+0000","last_peered":"2024-04-26T11:21:53.694282+0000","last_clean":"2024-04-26T11:21:53.694282+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:21:53.694282+0000","last_undegraded":"2024-04-26T11:21:53.694282+0000","last_fullsized":"2024-04-26T11:21:53.694282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658670+0000","last_change":"2024-04-26T11:21:53.338037+0000","last_active":"2024-04-26T11:21:55.658670+0000","last_peered":"2024-04-26T11:21:55.658670+0000","last_clean":"2024-04-26T11:21:55.658670+0000","last_became_active":"2024-04-26T11:21:53.337004+0000","last_became_peered":"2024-04-26T11:21:53.337004+0000","last_unstale":"2024-04-26T11:21:55.658670+0000","last_undegraded":"2024-04-26T11:21:55.658670+0000","last_fullsized":"2024-04-26T11:21:55.658670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691854+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:21:54.691854+0000","last_peered":"2024-04-26T11:21:54.691854+0000","last_clean":"2024-04-26T11:21:54.691854+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:21:54.691854+0000","last_undegraded":"2024-04-26T11:21:54.691854+0000","last_fullsized":"2024-04-26T11:21:54.691854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659642+0000","last_change":"2024-04-26T11:21:53.337312+0000","last_active":"2024-04-26T11:21:55.659642+0000","last_peered":"2024-04-26T11:21:55.659642+0000","last_clean":"2024-04-26T11:21:55.659642+0000","last_became_active":"2024-04-26T11:21:53.336587+0000","last_became_peered":"2024-04-26T11:21:53.336587+0000","last_unstale":"2024-04-26T11:21:55.659642+0000","last_undegraded":"2024-04-26T11:21:55.659642+0000","last_fullsized":"2024-04-26T11:21:55.659642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.681538+0000","last_change":"2024-04-26T11:21:49.292007+0000","last_active":"2024-04-26T11:21:53.681538+0000","last_peered":"2024-04-26T11:21:53.681538+0000","last_clean":"2024-04-26T11:21:53.681538+0000","last_became_active":"2024-04-26T11:21:49.291100+0000","last_became_peered":"2024-04-26T11:21:49.291100+0000","last_unstale":"2024-04-26T11:21:53.681538+0000","last_undegraded":"2024-04-26T11:21:53.681538+0000","last_fullsized":"2024-04-26T11:21:53.681538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.877516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690182+0000","last_change":"2024-04-26T11:21:53.697386+0000","last_active":"2024-04-26T11:21:54.690182+0000","last_peered":"2024-04-26T11:21:54.690182+0000","last_clean":"2024-04-26T11:21:54.690182+0000","last_became_active":"2024-04-26T11:21:53.695847+0000","last_became_peered":"2024-04-26T11:21:53.695847+0000","last_unstale":"2024-04-26T11:21:54.690182+0000","last_undegraded":"2024-04-26T11:21:54.690182+0000","last_fullsized":"2024-04-26T11:21:54.690182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691993+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:21:54.691993+0000","last_peered":"2024-04-26T11:21:54.691993+0000","last_clean":"2024-04-26T11:21:54.691993+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:21:54.691993+0000","last_undegraded":"2024-04-26T11:21:54.691993+0000","last_fullsized":"2024-04-26T11:21:54.691993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.688099+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:21:53.688099+0000","last_peered":"2024-04-26T11:21:53.688099+0000","last_clean":"2024-04-26T11:21:53.688099+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:21:53.688099+0000","last_undegraded":"2024-04-26T11:21:53.688099+0000","last_fullsized":"2024-04-26T11:21:53.688099+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690179+0000","last_change":"2024-04-26T11:21:53.696563+0000","last_active":"2024-04-26T11:21:54.690179+0000","last_peered":"2024-04-26T11:21:54.690179+0000","last_clean":"2024-04-26T11:21:54.690179+0000","last_became_active":"2024-04-26T11:21:53.695678+0000","last_became_peered":"2024-04-26T11:21:53.695678+0000","last_unstale":"2024-04-26T11:21:54.690179+0000","last_undegraded":"2024-04-26T11:21:54.690179+0000","last_fullsized":"2024-04-26T11:21:54.690179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.692075+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:21:54.692075+0000","last_peered":"2024-04-26T11:21:54.692075+0000","last_clean":"2024-04-26T11:21:54.692075+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:21:54.692075+0000","last_undegraded":"2024-04-26T11:21:54.692075+0000","last_fullsized":"2024-04-26T11:21:54.692075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.684028+0000","last_change":"2024-04-26T11:21:49.292644+0000","last_active":"2024-04-26T11:21:53.684028+0000","last_peered":"2024-04-26T11:21:53.684028+0000","last_clean":"2024-04-26T11:21:53.684028+0000","last_became_active":"2024-04-26T11:21:49.291499+0000","last_became_peered":"2024-04-26T11:21:49.291499+0000","last_unstale":"2024-04-26T11:21:53.684028+0000","last_undegraded":"2024-04-26T11:21:53.684028+0000","last_fullsized":"2024-04-26T11:21:53.684028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689637+0000","last_change":"2024-04-26T11:21:53.705104+0000","last_active":"2024-04-26T11:21:54.689637+0000","last_peered":"2024-04-26T11:21:54.689637+0000","last_clean":"2024-04-26T11:21:54.689637+0000","last_became_active":"2024-04-26T11:21:53.704282+0000","last_became_peered":"2024-04-26T11:21:53.704282+0000","last_unstale":"2024-04-26T11:21:54.689637+0000","last_undegraded":"2024-04-26T11:21:54.689637+0000","last_fullsized":"2024-04-26T11:21:54.689637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:56.396012+0000","last_change":"2024-04-26T11:21:53.332815+0000","last_active":"2024-04-26T11:21:56.396012+0000","last_peered":"2024-04-26T11:21:56.396012+0000","last_clean":"2024-04-26T11:21:56.396012+0000","last_became_active":"2024-04-26T11:21:53.332020+0000","last_became_peered":"2024-04-26T11:21:53.332020+0000","last_unstale":"2024-04-26T11:21:56.396012+0000","last_undegraded":"2024-04-26T11:21:56.396012+0000","last_fullsized":"2024-04-26T11:21:56.396012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.700312+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:21:53.700312+0000","last_peered":"2024-04-26T11:21:53.700312+0000","last_clean":"2024-04-26T11:21:53.700312+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:21:53.700312+0000","last_undegraded":"2024-04-26T11:21:53.700312+0000","last_fullsized":"2024-04-26T11:21:53.700312+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689824+0000","last_change":"2024-04-26T11:21:53.696546+0000","last_active":"2024-04-26T11:21:54.689824+0000","last_peered":"2024-04-26T11:21:54.689824+0000","last_clean":"2024-04-26T11:21:54.689824+0000","last_became_active":"2024-04-26T11:21:53.695670+0000","last_became_peered":"2024-04-26T11:21:53.695670+0000","last_unstale":"2024-04-26T11:21:54.689824+0000","last_undegraded":"2024-04-26T11:21:54.689824+0000","last_fullsized":"2024-04-26T11:21:54.689824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658127+0000","last_change":"2024-04-26T11:21:53.703599+0000","last_active":"2024-04-26T11:21:55.658127+0000","last_peered":"2024-04-26T11:21:55.658127+0000","last_clean":"2024-04-26T11:21:55.658127+0000","last_became_active":"2024-04-26T11:21:53.702893+0000","last_became_peered":"2024-04-26T11:21:53.702893+0000","last_unstale":"2024-04-26T11:21:55.658127+0000","last_undegraded":"2024-04-26T11:21:55.658127+0000","last_fullsized":"2024-04-26T11:21:55.658127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659192+0000","last_change":"2024-04-26T11:21:53.340288+0000","last_active":"2024-04-26T11:21:55.659192+0000","last_peered":"2024-04-26T11:21:55.659192+0000","last_clean":"2024-04-26T11:21:55.659192+0000","last_became_active":"2024-04-26T11:21:53.339414+0000","last_became_peered":"2024-04-26T11:21:53.339414+0000","last_unstale":"2024-04-26T11:21:55.659192+0000","last_undegraded":"2024-04-26T11:21:55.659192+0000","last_fullsized":"2024-04-26T11:21:55.659192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689909+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:21:54.689909+0000","last_peered":"2024-04-26T11:21:54.689909+0000","last_clean":"2024-04-26T11:21:54.689909+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:21:54.689909+0000","last_undegraded":"2024-04-26T11:21:54.689909+0000","last_fullsized":"2024-04-26T11:21:54.689909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691341+0000","last_change":"2024-04-26T11:21:53.343465+0000","last_active":"2024-04-26T11:21:54.691341+0000","last_peered":"2024-04-26T11:21:54.691341+0000","last_clean":"2024-04-26T11:21:54.691341+0000","last_became_active":"2024-04-26T11:21:53.342882+0000","last_became_peered":"2024-04-26T11:21:53.342882+0000","last_unstale":"2024-04-26T11:21:54.691341+0000","last_undegraded":"2024-04-26T11:21:54.691341+0000","last_fullsized":"2024-04-26T11:21:54.691341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:41.508747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.660158+0000","last_change":"2024-04-26T11:21:53.344846+0000","last_active":"2024-04-26T11:21:55.660158+0000","last_peered":"2024-04-26T11:21:55.660158+0000","last_clean":"2024-04-26T11:21:55.660158+0000","last_became_active":"2024-04-26T11:21:53.342981+0000","last_became_peered":"2024-04-26T11:21:53.342981+0000","last_unstale":"2024-04-26T11:21:55.660158+0000","last_undegraded":"2024-04-26T11:21:55.660158+0000","last_fullsized":"2024-04-26T11:21:55.660158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689736+0000","last_change":"2024-04-26T11:21:53.706890+0000","last_active":"2024-04-26T11:21:54.689736+0000","last_peered":"2024-04-26T11:21:54.689736+0000","last_clean":"2024-04-26T11:21:54.689736+0000","last_became_active":"2024-04-26T11:21:53.705229+0000","last_became_peered":"2024-04-26T11:21:53.705229+0000","last_unstale":"2024-04-26T11:21:54.689736+0000","last_undegraded":"2024-04-26T11:21:54.689736+0000","last_fullsized":"2024-04-26T11:21:54.689736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691905+0000","last_change":"2024-04-26T11:21:53.334527+0000","last_active":"2024-04-26T11:21:54.691905+0000","last_peered":"2024-04-26T11:21:54.691905+0000","last_clean":"2024-04-26T11:21:54.691905+0000","last_became_active":"2024-04-26T11:21:53.332325+0000","last_became_peered":"2024-04-26T11:21:53.332325+0000","last_unstale":"2024-04-26T11:21:54.691905+0000","last_undegraded":"2024-04-26T11:21:54.691905+0000","last_fullsized":"2024-04-26T11:21:54.691905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689613+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:21:54.689613+0000","last_peered":"2024-04-26T11:21:54.689613+0000","last_clean":"2024-04-26T11:21:54.689613+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:21:54.689613+0000","last_undegraded":"2024-04-26T11:21:54.689613+0000","last_fullsized":"2024-04-26T11:21:54.689613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691804+0000","last_change":"2024-04-26T11:21:53.696949+0000","last_active":"2024-04-26T11:21:54.691804+0000","last_peered":"2024-04-26T11:21:54.691804+0000","last_clean":"2024-04-26T11:21:54.691804+0000","last_became_active":"2024-04-26T11:21:53.696068+0000","last_became_peered":"2024-04-26T11:21:53.696068+0000","last_unstale":"2024-04-26T11:21:54.691804+0000","last_undegraded":"2024-04-26T11:21:54.691804+0000","last_fullsized":"2024-04-26T11:21:54.691804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689833+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:21:54.689833+0000","last_peered":"2024-04-26T11:21:54.689833+0000","last_clean":"2024-04-26T11:21:54.689833+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:21:54.689833+0000","last_undegraded":"2024-04-26T11:21:54.689833+0000","last_fullsized":"2024-04-26T11:21:54.689833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691375+0000","last_change":"2024-04-26T11:21:53.710749+0000","last_active":"2024-04-26T11:21:54.691375+0000","last_peered":"2024-04-26T11:21:54.691375+0000","last_clean":"2024-04-26T11:21:54.691375+0000","last_became_active":"2024-04-26T11:21:53.707330+0000","last_became_peered":"2024-04-26T11:21:53.707330+0000","last_unstale":"2024-04-26T11:21:54.691375+0000","last_undegraded":"2024-04-26T11:21:54.691375+0000","last_fullsized":"2024-04-26T11:21:54.691375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690082+0000","last_change":"2024-04-26T11:21:53.334972+0000","last_active":"2024-04-26T11:21:54.690082+0000","last_peered":"2024-04-26T11:21:54.690082+0000","last_clean":"2024-04-26T11:21:54.690082+0000","last_became_active":"2024-04-26T11:21:53.332642+0000","last_became_peered":"2024-04-26T11:21:53.332642+0000","last_unstale":"2024-04-26T11:21:54.690082+0000","last_undegraded":"2024-04-26T11:21:54.690082+0000","last_fullsized":"2024-04-26T11:21:54.690082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691006+0000","last_change":"2024-04-26T11:21:53.709701+0000","last_active":"2024-04-26T11:21:54.691006+0000","last_peered":"2024-04-26T11:21:54.691006+0000","last_clean":"2024-04-26T11:21:54.691006+0000","last_became_active":"2024-04-26T11:21:53.708905+0000","last_became_peered":"2024-04-26T11:21:53.708905+0000","last_unstale":"2024-04-26T11:21:54.691006+0000","last_undegraded":"2024-04-26T11:21:54.691006+0000","last_fullsized":"2024-04-26T11:21:54.691006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691004+0000","last_change":"2024-04-26T11:21:53.330226+0000","last_active":"2024-04-26T11:21:54.691004+0000","last_peered":"2024-04-26T11:21:54.691004+0000","last_clean":"2024-04-26T11:21:54.691004+0000","last_became_active":"2024-04-26T11:21:53.329446+0000","last_became_peered":"2024-04-26T11:21:53.329446+0000","last_unstale":"2024-04-26T11:21:54.691004+0000","last_undegraded":"2024-04-26T11:21:54.691004+0000","last_fullsized":"2024-04-26T11:21:54.691004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:52.599214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691125+0000","last_change":"2024-04-26T11:21:53.716629+0000","last_active":"2024-04-26T11:21:54.691125+0000","last_peered":"2024-04-26T11:21:54.691125+0000","last_clean":"2024-04-26T11:21:54.691125+0000","last_became_active":"2024-04-26T11:21:53.714799+0000","last_became_peered":"2024-04-26T11:21:53.714799+0000","last_unstale":"2024-04-26T11:21:54.691125+0000","last_undegraded":"2024-04-26T11:21:54.691125+0000","last_fullsized":"2024-04-26T11:21:54.691125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:54.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690731+0000","last_change":"2024-04-26T11:21:53.343318+0000","last_active":"2024-04-26T11:21:54.690731+0000","last_peered":"2024-04-26T11:21:54.690731+0000","last_clean":"2024-04-26T11:21:54.690731+0000","last_became_active":"2024-04-26T11:21:53.342789+0000","last_became_peered":"2024-04-26T11:21:53.342789+0000","last_unstale":"2024-04-26T11:21:54.690731+0000","last_undegraded":"2024-04-26T11:21:54.690731+0000","last_fullsized":"2024-04-26T11:21:54.690731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657848+0000","last_change":"2024-04-26T11:21:53.715726+0000","last_active":"2024-04-26T11:21:55.657848+0000","last_peered":"2024-04-26T11:21:55.657848+0000","last_clean":"2024-04-26T11:21:55.657848+0000","last_became_active":"2024-04-26T11:21:53.715126+0000","last_became_peered":"2024-04-26T11:21:53.715126+0000","last_unstale":"2024-04-26T11:21:55.657848+0000","last_undegraded":"2024-04-26T11:21:55.657848+0000","last_fullsized":"2024-04-26T11:21:55.657848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659105+0000","last_change":"2024-04-26T11:21:53.343934+0000","last_active":"2024-04-26T11:21:55.659105+0000","last_peered":"2024-04-26T11:21:55.659105+0000","last_clean":"2024-04-26T11:21:55.659105+0000","last_became_active":"2024-04-26T11:21:53.342401+0000","last_became_peered":"2024-04-26T11:21:53.342401+0000","last_unstale":"2024-04-26T11:21:55.659105+0000","last_undegraded":"2024-04-26T11:21:55.659105+0000","last_fullsized":"2024-04-26T11:21:55.659105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658676+0000","last_change":"2024-04-26T11:21:53.713092+0000","last_active":"2024-04-26T11:21:55.658676+0000","last_peered":"2024-04-26T11:21:55.658676+0000","last_clean":"2024-04-26T11:21:55.658676+0000","last_became_active":"2024-04-26T11:21:53.712207+0000","last_became_peered":"2024-04-26T11:21:53.712207+0000","last_unstale":"2024-04-26T11:21:55.658676+0000","last_undegraded":"2024-04-26T11:21:55.658676+0000","last_fullsized":"2024-04-26T11:21:55.658676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691034+0000","last_change":"2024-04-26T11:21:53.345453+0000","last_active":"2024-04-26T11:21:54.691034+0000","last_peered":"2024-04-26T11:21:54.691034+0000","last_clean":"2024-04-26T11:21:54.691034+0000","last_became_active":"2024-04-26T11:21:53.344468+0000","last_became_peered":"2024-04-26T11:21:53.344468+0000","last_unstale":"2024-04-26T11:21:54.691034+0000","last_undegraded":"2024-04-26T11:21:54.691034+0000","last_fullsized":"2024-04-26T11:21:54.691034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.295739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690674+0000","last_change":"2024-04-26T11:21:53.712311+0000","last_active":"2024-04-26T11:21:54.690674+0000","last_peered":"2024-04-26T11:21:54.690674+0000","last_clean":"2024-04-26T11:21:54.690674+0000","last_became_active":"2024-04-26T11:21:53.711195+0000","last_became_peered":"2024-04-26T11:21:53.711195+0000","last_unstale":"2024-04-26T11:21:54.690674+0000","last_undegraded":"2024-04-26T11:21:54.690674+0000","last_fullsized":"2024-04-26T11:21:54.690674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:50.973181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691630+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:21:54.691630+0000","last_peered":"2024-04-26T11:21:54.691630+0000","last_clean":"2024-04-26T11:21:54.691630+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:21:54.691630+0000","last_undegraded":"2024-04-26T11:21:54.691630+0000","last_fullsized":"2024-04-26T11:21:54.691630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657705+0000","last_change":"2024-04-26T11:21:53.713610+0000","last_active":"2024-04-26T11:21:55.657705+0000","last_peered":"2024-04-26T11:21:55.657705+0000","last_clean":"2024-04-26T11:21:55.657705+0000","last_became_active":"2024-04-26T11:21:53.712396+0000","last_became_peered":"2024-04-26T11:21:53.712396+0000","last_unstale":"2024-04-26T11:21:55.657705+0000","last_undegraded":"2024-04-26T11:21:55.657705+0000","last_fullsized":"2024-04-26T11:21:55.657705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691634+0000","last_change":"2024-04-26T11:21:53.334939+0000","last_active":"2024-04-26T11:21:54.691634+0000","last_peered":"2024-04-26T11:21:54.691634+0000","last_clean":"2024-04-26T11:21:54.691634+0000","last_became_active":"2024-04-26T11:21:53.332735+0000","last_became_peered":"2024-04-26T11:21:53.332735+0000","last_unstale":"2024-04-26T11:21:54.691634+0000","last_undegraded":"2024-04-26T11:21:54.691634+0000","last_fullsized":"2024-04-26T11:21:54.691634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":647190,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":249856,"data_stored":647806,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:22:04.601 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:22:04.915 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:04.916 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:22:04.930 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-26T11:22:03.323410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85824,"kb_used_data":640,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029696,"statfs":{"total":289910292480,"available":289822408704,"internally_reserved":0,"allocated":655360,"data_stored":1350688,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.646931"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691482+0000","last_change":"2024-04-26T11:21:53.713298+0000","last_active":"2024-04-26T11:21:54.691482+0000","last_peered":"2024-04-26T11:21:54.691482+0000","last_clean":"2024-04-26T11:21:54.691482+0000","last_became_active":"2024-04-26T11:21:53.712481+0000","last_became_peered":"2024-04-26T11:21:53.712481+0000","last_unstale":"2024-04-26T11:21:54.691482+0000","last_undegraded":"2024-04-26T11:21:54.691482+0000","last_fullsized":"2024-04-26T11:21:54.691482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691323+0000","last_change":"2024-04-26T11:21:53.716754+0000","last_active":"2024-04-26T11:21:54.691323+0000","last_peered":"2024-04-26T11:21:54.691323+0000","last_clean":"2024-04-26T11:21:54.691323+0000","last_became_active":"2024-04-26T11:21:53.716109+0000","last_became_peered":"2024-04-26T11:21:53.716109+0000","last_unstale":"2024-04-26T11:21:54.691323+0000","last_undegraded":"2024-04-26T11:21:54.691323+0000","last_fullsized":"2024-04-26T11:21:54.691323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658980+0000","last_change":"2024-04-26T11:21:53.710480+0000","last_active":"2024-04-26T11:21:55.658980+0000","last_peered":"2024-04-26T11:21:55.658980+0000","last_clean":"2024-04-26T11:21:55.658980+0000","last_became_active":"2024-04-26T11:21:53.709433+0000","last_became_peered":"2024-04-26T11:21:53.709433+0000","last_unstale":"2024-04-26T11:21:55.658980+0000","last_undegraded":"2024-04-26T11:21:55.658980+0000","last_fullsized":"2024-04-26T11:21:55.658980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:11.687344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658399+0000","last_change":"2024-04-26T11:21:53.719849+0000","last_active":"2024-04-26T11:21:55.658399+0000","last_peered":"2024-04-26T11:21:55.658399+0000","last_clean":"2024-04-26T11:21:55.658399+0000","last_became_active":"2024-04-26T11:21:53.719152+0000","last_became_peered":"2024-04-26T11:21:53.719152+0000","last_unstale":"2024-04-26T11:21:55.658399+0000","last_undegraded":"2024-04-26T11:21:55.658399+0000","last_fullsized":"2024-04-26T11:21:55.658399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690467+0000","last_change":"2024-04-26T11:21:53.712493+0000","last_active":"2024-04-26T11:21:54.690467+0000","last_peered":"2024-04-26T11:21:54.690467+0000","last_clean":"2024-04-26T11:21:54.690467+0000","last_became_active":"2024-04-26T11:21:53.711704+0000","last_became_peered":"2024-04-26T11:21:53.711704+0000","last_unstale":"2024-04-26T11:21:54.690467+0000","last_undegraded":"2024-04-26T11:21:54.690467+0000","last_fullsized":"2024-04-26T11:21:54.690467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657707+0000","last_change":"2024-04-26T11:21:53.715149+0000","last_active":"2024-04-26T11:21:55.657707+0000","last_peered":"2024-04-26T11:21:55.657707+0000","last_clean":"2024-04-26T11:21:55.657707+0000","last_became_active":"2024-04-26T11:21:53.714125+0000","last_became_peered":"2024-04-26T11:21:53.714125+0000","last_unstale":"2024-04-26T11:21:55.657707+0000","last_undegraded":"2024-04-26T11:21:55.657707+0000","last_fullsized":"2024-04-26T11:21:55.657707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657112+0000","last_change":"2024-04-26T11:21:53.714653+0000","last_active":"2024-04-26T11:21:55.657112+0000","last_peered":"2024-04-26T11:21:55.657112+0000","last_clean":"2024-04-26T11:21:55.657112+0000","last_became_active":"2024-04-26T11:21:53.713586+0000","last_became_peered":"2024-04-26T11:21:53.713586+0000","last_unstale":"2024-04-26T11:21:55.657112+0000","last_undegraded":"2024-04-26T11:21:55.657112+0000","last_fullsized":"2024-04-26T11:21:55.657112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:01.563026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657099+0000","last_change":"2024-04-26T11:21:53.715422+0000","last_active":"2024-04-26T11:21:55.657099+0000","last_peered":"2024-04-26T11:21:55.657099+0000","last_clean":"2024-04-26T11:21:55.657099+0000","last_became_active":"2024-04-26T11:21:53.714329+0000","last_became_peered":"2024-04-26T11:21:53.714329+0000","last_unstale":"2024-04-26T11:21:55.657099+0000","last_undegraded":"2024-04-26T11:21:55.657099+0000","last_fullsized":"2024-04-26T11:21:55.657099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:06.981197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691270+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:21:54.691270+0000","last_peered":"2024-04-26T11:21:54.691270+0000","last_clean":"2024-04-26T11:21:54.691270+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:21:54.691270+0000","last_undegraded":"2024-04-26T11:21:54.691270+0000","last_fullsized":"2024-04-26T11:21:54.691270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691299+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:21:54.691299+0000","last_peered":"2024-04-26T11:21:54.691299+0000","last_clean":"2024-04-26T11:21:54.691299+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:21:54.691299+0000","last_undegraded":"2024-04-26T11:21:54.691299+0000","last_fullsized":"2024-04-26T11:21:54.691299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658964+0000","last_change":"2024-04-26T11:21:53.714245+0000","last_active":"2024-04-26T11:21:55.658964+0000","last_peered":"2024-04-26T11:21:55.658964+0000","last_clean":"2024-04-26T11:21:55.658964+0000","last_became_active":"2024-04-26T11:21:53.713331+0000","last_became_peered":"2024-04-26T11:21:53.713331+0000","last_unstale":"2024-04-26T11:21:55.658964+0000","last_undegraded":"2024-04-26T11:21:55.658964+0000","last_fullsized":"2024-04-26T11:21:55.658964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690847+0000","last_change":"2024-04-26T11:21:53.712269+0000","last_active":"2024-04-26T11:21:54.690847+0000","last_peered":"2024-04-26T11:21:54.690847+0000","last_clean":"2024-04-26T11:21:54.690847+0000","last_became_active":"2024-04-26T11:21:53.710740+0000","last_became_peered":"2024-04-26T11:21:53.710740+0000","last_unstale":"2024-04-26T11:21:54.690847+0000","last_undegraded":"2024-04-26T11:21:54.690847+0000","last_fullsized":"2024-04-26T11:21:54.690847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690903+0000","last_change":"2024-04-26T11:21:53.712552+0000","last_active":"2024-04-26T11:21:54.690903+0000","last_peered":"2024-04-26T11:21:54.690903+0000","last_clean":"2024-04-26T11:21:54.690903+0000","last_became_active":"2024-04-26T11:21:53.711470+0000","last_became_peered":"2024-04-26T11:21:53.711470+0000","last_unstale":"2024-04-26T11:21:54.690903+0000","last_undegraded":"2024-04-26T11:21:54.690903+0000","last_fullsized":"2024-04-26T11:21:54.690903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657972+0000","last_change":"2024-04-26T11:21:53.705872+0000","last_active":"2024-04-26T11:21:55.657972+0000","last_peered":"2024-04-26T11:21:55.657972+0000","last_clean":"2024-04-26T11:21:55.657972+0000","last_became_active":"2024-04-26T11:21:53.705040+0000","last_became_peered":"2024-04-26T11:21:53.705040+0000","last_unstale":"2024-04-26T11:21:55.657972+0000","last_undegraded":"2024-04-26T11:21:55.657972+0000","last_fullsized":"2024-04-26T11:21:55.657972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:02.015153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657316+0000","last_change":"2024-04-26T11:21:53.707324+0000","last_active":"2024-04-26T11:21:55.657316+0000","last_peered":"2024-04-26T11:21:55.657316+0000","last_clean":"2024-04-26T11:21:55.657316+0000","last_became_active":"2024-04-26T11:21:53.706602+0000","last_became_peered":"2024-04-26T11:21:53.706602+0000","last_unstale":"2024-04-26T11:21:55.657316+0000","last_undegraded":"2024-04-26T11:21:55.657316+0000","last_fullsized":"2024-04-26T11:21:55.657316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.907498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657115+0000","last_change":"2024-04-26T11:21:53.714327+0000","last_active":"2024-04-26T11:21:55.657115+0000","last_peered":"2024-04-26T11:21:55.657115+0000","last_clean":"2024-04-26T11:21:55.657115+0000","last_became_active":"2024-04-26T11:21:53.712908+0000","last_became_peered":"2024-04-26T11:21:53.712908+0000","last_unstale":"2024-04-26T11:21:55.657115+0000","last_undegraded":"2024-04-26T11:21:55.657115+0000","last_fullsized":"2024-04-26T11:21:55.657115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:31.158881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691927+0000","last_change":"2024-04-26T11:21:53.713524+0000","last_active":"2024-04-26T11:21:54.691927+0000","last_peered":"2024-04-26T11:21:54.691927+0000","last_clean":"2024-04-26T11:21:54.691927+0000","last_became_active":"2024-04-26T11:21:53.710675+0000","last_became_peered":"2024-04-26T11:21:53.710675+0000","last_unstale":"2024-04-26T11:21:54.691927+0000","last_undegraded":"2024-04-26T11:21:54.691927+0000","last_fullsized":"2024-04-26T11:21:54.691927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691739+0000","last_change":"2024-04-26T11:21:53.714983+0000","last_active":"2024-04-26T11:21:54.691739+0000","last_peered":"2024-04-26T11:21:54.691739+0000","last_clean":"2024-04-26T11:21:54.691739+0000","last_became_active":"2024-04-26T11:21:53.711987+0000","last_became_peered":"2024-04-26T11:21:53.711987+0000","last_unstale":"2024-04-26T11:21:54.691739+0000","last_undegraded":"2024-04-26T11:21:54.691739+0000","last_fullsized":"2024-04-26T11:21:54.691739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:49.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691059+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:21:54.691059+0000","last_peered":"2024-04-26T11:21:54.691059+0000","last_clean":"2024-04-26T11:21:54.691059+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:21:54.691059+0000","last_undegraded":"2024-04-26T11:21:54.691059+0000","last_fullsized":"2024-04-26T11:21:54.691059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658842+0000","last_change":"2024-04-26T11:21:53.715255+0000","last_active":"2024-04-26T11:21:55.658842+0000","last_peered":"2024-04-26T11:21:55.658842+0000","last_clean":"2024-04-26T11:21:55.658842+0000","last_became_active":"2024-04-26T11:21:53.714525+0000","last_became_peered":"2024-04-26T11:21:53.714525+0000","last_unstale":"2024-04-26T11:21:55.658842+0000","last_undegraded":"2024-04-26T11:21:55.658842+0000","last_fullsized":"2024-04-26T11:21:55.658842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658215+0000","last_change":"2024-04-26T11:21:53.714368+0000","last_active":"2024-04-26T11:21:55.658215+0000","last_peered":"2024-04-26T11:21:55.658215+0000","last_clean":"2024-04-26T11:21:55.658215+0000","last_became_active":"2024-04-26T11:21:53.713099+0000","last_became_peered":"2024-04-26T11:21:53.713099+0000","last_unstale":"2024-04-26T11:21:55.658215+0000","last_undegraded":"2024-04-26T11:21:55.658215+0000","last_fullsized":"2024-04-26T11:21:55.658215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689959+0000","last_change":"2024-04-26T11:21:53.709697+0000","last_active":"2024-04-26T11:21:54.689959+0000","last_peered":"2024-04-26T11:21:54.689959+0000","last_clean":"2024-04-26T11:21:54.689959+0000","last_became_active":"2024-04-26T11:21:53.708839+0000","last_became_peered":"2024-04-26T11:21:53.708839+0000","last_unstale":"2024-04-26T11:21:54.689959+0000","last_undegraded":"2024-04-26T11:21:54.689959+0000","last_fullsized":"2024-04-26T11:21:54.689959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689490+0000","last_change":"2024-04-26T11:21:53.705071+0000","last_active":"2024-04-26T11:21:54.689490+0000","last_peered":"2024-04-26T11:21:54.689490+0000","last_clean":"2024-04-26T11:21:54.689490+0000","last_became_active":"2024-04-26T11:21:53.704331+0000","last_became_peered":"2024-04-26T11:21:53.704331+0000","last_unstale":"2024-04-26T11:21:54.689490+0000","last_undegraded":"2024-04-26T11:21:54.689490+0000","last_fullsized":"2024-04-26T11:21:54.689490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689441+0000","last_change":"2024-04-26T11:21:53.692834+0000","last_active":"2024-04-26T11:21:54.689441+0000","last_peered":"2024-04-26T11:21:54.689441+0000","last_clean":"2024-04-26T11:21:54.689441+0000","last_became_active":"2024-04-26T11:21:53.690279+0000","last_became_peered":"2024-04-26T11:21:53.690279+0000","last_unstale":"2024-04-26T11:21:54.689441+0000","last_undegraded":"2024-04-26T11:21:54.689441+0000","last_fullsized":"2024-04-26T11:21:54.689441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691605+0000","last_change":"2024-04-26T11:21:53.698796+0000","last_active":"2024-04-26T11:21:54.691605+0000","last_peered":"2024-04-26T11:21:54.691605+0000","last_clean":"2024-04-26T11:21:54.691605+0000","last_became_active":"2024-04-26T11:21:53.697854+0000","last_became_peered":"2024-04-26T11:21:53.697854+0000","last_unstale":"2024-04-26T11:21:54.691605+0000","last_undegraded":"2024-04-26T11:21:54.691605+0000","last_fullsized":"2024-04-26T11:21:54.691605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691288+0000","last_change":"2024-04-26T11:21:53.706583+0000","last_active":"2024-04-26T11:21:54.691288+0000","last_peered":"2024-04-26T11:21:54.691288+0000","last_clean":"2024-04-26T11:21:54.691288+0000","last_became_active":"2024-04-26T11:21:53.704871+0000","last_became_peered":"2024-04-26T11:21:53.704871+0000","last_unstale":"2024-04-26T11:21:54.691288+0000","last_undegraded":"2024-04-26T11:21:54.691288+0000","last_fullsized":"2024-04-26T11:21:54.691288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659254+0000","last_change":"2024-04-26T11:21:53.709813+0000","last_active":"2024-04-26T11:21:55.659254+0000","last_peered":"2024-04-26T11:21:55.659254+0000","last_clean":"2024-04-26T11:21:55.659254+0000","last_became_active":"2024-04-26T11:21:53.708399+0000","last_became_peered":"2024-04-26T11:21:53.708399+0000","last_unstale":"2024-04-26T11:21:55.659254+0000","last_undegraded":"2024-04-26T11:21:55.659254+0000","last_fullsized":"2024-04-26T11:21:55.659254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:36.298230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691745+0000","last_change":"2024-04-26T11:21:53.710195+0000","last_active":"2024-04-26T11:21:54.691745+0000","last_peered":"2024-04-26T11:21:54.691745+0000","last_clean":"2024-04-26T11:21:54.691745+0000","last_became_active":"2024-04-26T11:21:53.709660+0000","last_became_peered":"2024-04-26T11:21:53.709660+0000","last_unstale":"2024-04-26T11:21:54.691745+0000","last_undegraded":"2024-04-26T11:21:54.691745+0000","last_fullsized":"2024-04-26T11:21:54.691745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691147+0000","last_change":"2024-04-26T11:21:53.703397+0000","last_active":"2024-04-26T11:21:54.691147+0000","last_peered":"2024-04-26T11:21:54.691147+0000","last_clean":"2024-04-26T11:21:54.691147+0000","last_became_active":"2024-04-26T11:21:53.701822+0000","last_became_peered":"2024-04-26T11:21:53.701822+0000","last_unstale":"2024-04-26T11:21:54.691147+0000","last_undegraded":"2024-04-26T11:21:54.691147+0000","last_fullsized":"2024-04-26T11:21:54.691147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690777+0000","last_change":"2024-04-26T11:21:53.709264+0000","last_active":"2024-04-26T11:21:54.690777+0000","last_peered":"2024-04-26T11:21:54.690777+0000","last_clean":"2024-04-26T11:21:54.690777+0000","last_became_active":"2024-04-26T11:21:53.708529+0000","last_became_peered":"2024-04-26T11:21:53.708529+0000","last_unstale":"2024-04-26T11:21:54.690777+0000","last_undegraded":"2024-04-26T11:21:54.690777+0000","last_fullsized":"2024-04-26T11:21:54.690777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689662+0000","last_change":"2024-04-26T11:21:53.710899+0000","last_active":"2024-04-26T11:21:54.689662+0000","last_peered":"2024-04-26T11:21:54.689662+0000","last_clean":"2024-04-26T11:21:54.689662+0000","last_became_active":"2024-04-26T11:21:53.710185+0000","last_became_peered":"2024-04-26T11:21:53.710185+0000","last_unstale":"2024-04-26T11:21:54.689662+0000","last_undegraded":"2024-04-26T11:21:54.689662+0000","last_fullsized":"2024-04-26T11:21:54.689662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657645+0000","last_change":"2024-04-26T11:21:53.708939+0000","last_active":"2024-04-26T11:21:55.657645+0000","last_peered":"2024-04-26T11:21:55.657645+0000","last_clean":"2024-04-26T11:21:55.657645+0000","last_became_active":"2024-04-26T11:21:53.708120+0000","last_became_peered":"2024-04-26T11:21:53.708120+0000","last_unstale":"2024-04-26T11:21:55.657645+0000","last_undegraded":"2024-04-26T11:21:55.657645+0000","last_fullsized":"2024-04-26T11:21:55.657645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691370+0000","last_change":"2024-04-26T11:21:53.712919+0000","last_active":"2024-04-26T11:21:54.691370+0000","last_peered":"2024-04-26T11:21:54.691370+0000","last_clean":"2024-04-26T11:21:54.691370+0000","last_became_active":"2024-04-26T11:21:53.710798+0000","last_became_peered":"2024-04-26T11:21:53.710798+0000","last_unstale":"2024-04-26T11:21:54.691370+0000","last_undegraded":"2024-04-26T11:21:54.691370+0000","last_fullsized":"2024-04-26T11:21:54.691370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658532+0000","last_change":"2024-04-26T11:21:53.343931+0000","last_active":"2024-04-26T11:21:55.658532+0000","last_peered":"2024-04-26T11:21:55.658532+0000","last_clean":"2024-04-26T11:21:55.658532+0000","last_became_active":"2024-04-26T11:21:53.342363+0000","last_became_peered":"2024-04-26T11:21:53.342363+0000","last_unstale":"2024-04-26T11:21:55.658532+0000","last_undegraded":"2024-04-26T11:21:55.658532+0000","last_fullsized":"2024-04-26T11:21:55.658532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690797+0000","last_change":"2024-04-26T11:21:53.712613+0000","last_active":"2024-04-26T11:21:54.690797+0000","last_peered":"2024-04-26T11:21:54.690797+0000","last_clean":"2024-04-26T11:21:54.690797+0000","last_became_active":"2024-04-26T11:21:53.711848+0000","last_became_peered":"2024-04-26T11:21:53.711848+0000","last_unstale":"2024-04-26T11:21:54.690797+0000","last_undegraded":"2024-04-26T11:21:54.690797+0000","last_fullsized":"2024-04-26T11:21:54.690797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:49.327612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690156+0000","last_change":"2024-04-26T11:21:53.333005+0000","last_active":"2024-04-26T11:21:54.690156+0000","last_peered":"2024-04-26T11:21:54.690156+0000","last_clean":"2024-04-26T11:21:54.690156+0000","last_became_active":"2024-04-26T11:21:53.332191+0000","last_became_peered":"2024-04-26T11:21:53.332191+0000","last_unstale":"2024-04-26T11:21:54.690156+0000","last_undegraded":"2024-04-26T11:21:54.690156+0000","last_fullsized":"2024-04-26T11:21:54.690156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691758+0000","last_change":"2024-04-26T11:21:53.707848+0000","last_active":"2024-04-26T11:21:54.691758+0000","last_peered":"2024-04-26T11:21:54.691758+0000","last_clean":"2024-04-26T11:21:54.691758+0000","last_became_active":"2024-04-26T11:21:53.706222+0000","last_became_peered":"2024-04-26T11:21:53.706222+0000","last_unstale":"2024-04-26T11:21:54.691758+0000","last_undegraded":"2024-04-26T11:21:54.691758+0000","last_fullsized":"2024-04-26T11:21:54.691758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691063+0000","last_change":"2024-04-26T11:21:53.341523+0000","last_active":"2024-04-26T11:21:54.691063+0000","last_peered":"2024-04-26T11:21:54.691063+0000","last_clean":"2024-04-26T11:21:54.691063+0000","last_became_active":"2024-04-26T11:21:53.340545+0000","last_became_peered":"2024-04-26T11:21:53.340545+0000","last_unstale":"2024-04-26T11:21:54.691063+0000","last_undegraded":"2024-04-26T11:21:54.691063+0000","last_fullsized":"2024-04-26T11:21:54.691063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.907675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691390+0000","last_change":"2024-04-26T11:21:53.706879+0000","last_active":"2024-04-26T11:21:54.691390+0000","last_peered":"2024-04-26T11:21:54.691390+0000","last_clean":"2024-04-26T11:21:54.691390+0000","last_became_active":"2024-04-26T11:21:53.705082+0000","last_became_peered":"2024-04-26T11:21:53.705082+0000","last_unstale":"2024-04-26T11:21:54.691390+0000","last_undegraded":"2024-04-26T11:21:54.691390+0000","last_fullsized":"2024-04-26T11:21:54.691390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657400+0000","last_change":"2024-04-26T11:21:53.341655+0000","last_active":"2024-04-26T11:21:55.657400+0000","last_peered":"2024-04-26T11:21:55.657400+0000","last_clean":"2024-04-26T11:21:55.657400+0000","last_became_active":"2024-04-26T11:21:53.340085+0000","last_became_peered":"2024-04-26T11:21:53.340085+0000","last_unstale":"2024-04-26T11:21:55.657400+0000","last_undegraded":"2024-04-26T11:21:55.657400+0000","last_fullsized":"2024-04-26T11:21:55.657400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659421+0000","last_change":"2024-04-26T11:21:53.340063+0000","last_active":"2024-04-26T11:21:55.659421+0000","last_peered":"2024-04-26T11:21:55.659421+0000","last_clean":"2024-04-26T11:21:55.659421+0000","last_became_active":"2024-04-26T11:21:53.339256+0000","last_became_peered":"2024-04-26T11:21:53.339256+0000","last_unstale":"2024-04-26T11:21:55.659421+0000","last_undegraded":"2024-04-26T11:21:55.659421+0000","last_fullsized":"2024-04-26T11:21:55.659421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689561+0000","last_change":"2024-04-26T11:21:53.697700+0000","last_active":"2024-04-26T11:21:54.689561+0000","last_peered":"2024-04-26T11:21:54.689561+0000","last_clean":"2024-04-26T11:21:54.689561+0000","last_became_active":"2024-04-26T11:21:53.696789+0000","last_became_peered":"2024-04-26T11:21:53.696789+0000","last_unstale":"2024-04-26T11:21:54.689561+0000","last_undegraded":"2024-04-26T11:21:54.689561+0000","last_fullsized":"2024-04-26T11:21:54.689561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691980+0000","last_change":"2024-04-26T11:21:53.341302+0000","last_active":"2024-04-26T11:21:54.691980+0000","last_peered":"2024-04-26T11:21:54.691980+0000","last_clean":"2024-04-26T11:21:54.691980+0000","last_became_active":"2024-04-26T11:21:53.340509+0000","last_became_peered":"2024-04-26T11:21:53.340509+0000","last_unstale":"2024-04-26T11:21:54.691980+0000","last_undegraded":"2024-04-26T11:21:54.691980+0000","last_fullsized":"2024-04-26T11:21:54.691980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:16.781849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689756+0000","last_change":"2024-04-26T11:21:53.716075+0000","last_active":"2024-04-26T11:21:54.689756+0000","last_peered":"2024-04-26T11:21:54.689756+0000","last_clean":"2024-04-26T11:21:54.689756+0000","last_became_active":"2024-04-26T11:21:53.714328+0000","last_became_peered":"2024-04-26T11:21:53.714328+0000","last_unstale":"2024-04-26T11:21:54.689756+0000","last_undegraded":"2024-04-26T11:21:54.689756+0000","last_fullsized":"2024-04-26T11:21:54.689756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:54.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659565+0000","last_change":"2024-04-26T11:21:53.339171+0000","last_active":"2024-04-26T11:21:55.659565+0000","last_peered":"2024-04-26T11:21:55.659565+0000","last_clean":"2024-04-26T11:21:55.659565+0000","last_became_active":"2024-04-26T11:21:53.337433+0000","last_became_peered":"2024-04-26T11:21:53.337433+0000","last_unstale":"2024-04-26T11:21:55.659565+0000","last_undegraded":"2024-04-26T11:21:55.659565+0000","last_fullsized":"2024-04-26T11:21:55.659565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658299+0000","last_change":"2024-04-26T11:21:53.719666+0000","last_active":"2024-04-26T11:21:55.658299+0000","last_peered":"2024-04-26T11:21:55.658299+0000","last_clean":"2024-04-26T11:21:55.658299+0000","last_became_active":"2024-04-26T11:21:53.718871+0000","last_became_peered":"2024-04-26T11:21:53.718871+0000","last_unstale":"2024-04-26T11:21:55.658299+0000","last_undegraded":"2024-04-26T11:21:55.658299+0000","last_fullsized":"2024-04-26T11:21:55.658299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659351+0000","last_change":"2024-04-26T11:21:53.344744+0000","last_active":"2024-04-26T11:21:55.659351+0000","last_peered":"2024-04-26T11:21:55.659351+0000","last_clean":"2024-04-26T11:21:55.659351+0000","last_became_active":"2024-04-26T11:21:53.344055+0000","last_became_peered":"2024-04-26T11:21:53.344055+0000","last_unstale":"2024-04-26T11:21:55.659351+0000","last_undegraded":"2024-04-26T11:21:55.659351+0000","last_fullsized":"2024-04-26T11:21:55.659351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690681+0000","last_change":"2024-04-26T11:21:53.709563+0000","last_active":"2024-04-26T11:21:54.690681+0000","last_peered":"2024-04-26T11:21:54.690681+0000","last_clean":"2024-04-26T11:21:54.690681+0000","last_became_active":"2024-04-26T11:21:53.706598+0000","last_became_peered":"2024-04-26T11:21:53.706598+0000","last_unstale":"2024-04-26T11:21:54.690681+0000","last_undegraded":"2024-04-26T11:21:54.690681+0000","last_fullsized":"2024-04-26T11:21:54.690681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691180+0000","last_change":"2024-04-26T11:21:53.330145+0000","last_active":"2024-04-26T11:21:54.691180+0000","last_peered":"2024-04-26T11:21:54.691180+0000","last_clean":"2024-04-26T11:21:54.691180+0000","last_became_active":"2024-04-26T11:21:53.329256+0000","last_became_peered":"2024-04-26T11:21:53.329256+0000","last_unstale":"2024-04-26T11:21:54.691180+0000","last_undegraded":"2024-04-26T11:21:54.691180+0000","last_fullsized":"2024-04-26T11:21:54.691180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658841+0000","last_change":"2024-04-26T11:21:53.715233+0000","last_active":"2024-04-26T11:21:55.658841+0000","last_peered":"2024-04-26T11:21:55.658841+0000","last_clean":"2024-04-26T11:21:55.658841+0000","last_became_active":"2024-04-26T11:21:53.714405+0000","last_became_peered":"2024-04-26T11:21:53.714405+0000","last_unstale":"2024-04-26T11:21:55.658841+0000","last_undegraded":"2024-04-26T11:21:55.658841+0000","last_fullsized":"2024-04-26T11:21:55.658841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659404+0000","last_change":"2024-04-26T11:21:53.344659+0000","last_active":"2024-04-26T11:21:55.659404+0000","last_peered":"2024-04-26T11:21:55.659404+0000","last_clean":"2024-04-26T11:21:55.659404+0000","last_became_active":"2024-04-26T11:21:53.344024+0000","last_became_peered":"2024-04-26T11:21:53.344024+0000","last_unstale":"2024-04-26T11:21:55.659404+0000","last_undegraded":"2024-04-26T11:21:55.659404+0000","last_fullsized":"2024-04-26T11:21:55.659404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:53.053244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659429+0000","last_change":"2024-04-26T11:21:53.710093+0000","last_active":"2024-04-26T11:21:55.659429+0000","last_peered":"2024-04-26T11:21:55.659429+0000","last_clean":"2024-04-26T11:21:55.659429+0000","last_became_active":"2024-04-26T11:21:53.709020+0000","last_became_peered":"2024-04-26T11:21:53.709020+0000","last_unstale":"2024-04-26T11:21:55.659429+0000","last_undegraded":"2024-04-26T11:21:55.659429+0000","last_fullsized":"2024-04-26T11:21:55.659429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690297+0000","last_change":"2024-04-26T11:21:53.341961+0000","last_active":"2024-04-26T11:21:54.690297+0000","last_peered":"2024-04-26T11:21:54.690297+0000","last_clean":"2024-04-26T11:21:54.690297+0000","last_became_active":"2024-04-26T11:21:53.340768+0000","last_became_peered":"2024-04-26T11:21:53.340768+0000","last_unstale":"2024-04-26T11:21:54.690297+0000","last_undegraded":"2024-04-26T11:21:54.690297+0000","last_fullsized":"2024-04-26T11:21:54.690297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659841+0000","last_change":"2024-04-26T11:21:53.706161+0000","last_active":"2024-04-26T11:21:55.659841+0000","last_peered":"2024-04-26T11:21:55.659841+0000","last_clean":"2024-04-26T11:21:55.659841+0000","last_became_active":"2024-04-26T11:21:53.705388+0000","last_became_peered":"2024-04-26T11:21:53.705388+0000","last_unstale":"2024-04-26T11:21:55.659841+0000","last_undegraded":"2024-04-26T11:21:55.659841+0000","last_fullsized":"2024-04-26T11:21:55.659841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690017+0000","last_change":"2024-04-26T11:21:53.328489+0000","last_active":"2024-04-26T11:21:54.690017+0000","last_peered":"2024-04-26T11:21:54.690017+0000","last_clean":"2024-04-26T11:21:54.690017+0000","last_became_active":"2024-04-26T11:21:53.327836+0000","last_became_peered":"2024-04-26T11:21:53.327836+0000","last_unstale":"2024-04-26T11:21:54.690017+0000","last_undegraded":"2024-04-26T11:21:54.690017+0000","last_fullsized":"2024-04-26T11:21:54.690017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:32.644217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691473+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:21:54.691473+0000","last_peered":"2024-04-26T11:21:54.691473+0000","last_clean":"2024-04-26T11:21:54.691473+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:21:54.691473+0000","last_undegraded":"2024-04-26T11:21:54.691473+0000","last_fullsized":"2024-04-26T11:21:54.691473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693986+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:21:53.693986+0000","last_peered":"2024-04-26T11:21:53.693986+0000","last_clean":"2024-04-26T11:21:53.693986+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:21:53.693986+0000","last_undegraded":"2024-04-26T11:21:53.693986+0000","last_fullsized":"2024-04-26T11:21:53.693986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694913+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:21:53.694913+0000","last_peered":"2024-04-26T11:21:53.694913+0000","last_clean":"2024-04-26T11:21:53.694913+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:21:53.694913+0000","last_undegraded":"2024-04-26T11:21:53.694913+0000","last_fullsized":"2024-04-26T11:21:53.694913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690419+0000","last_change":"2024-04-26T11:21:53.326934+0000","last_active":"2024-04-26T11:21:54.690419+0000","last_peered":"2024-04-26T11:21:54.690419+0000","last_clean":"2024-04-26T11:21:54.690419+0000","last_became_active":"2024-04-26T11:21:53.325342+0000","last_became_peered":"2024-04-26T11:21:53.325342+0000","last_unstale":"2024-04-26T11:21:54.690419+0000","last_undegraded":"2024-04-26T11:21:54.690419+0000","last_fullsized":"2024-04-26T11:21:54.690419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659521+0000","last_change":"2024-04-26T11:21:53.709499+0000","last_active":"2024-04-26T11:21:55.659521+0000","last_peered":"2024-04-26T11:21:55.659521+0000","last_clean":"2024-04-26T11:21:55.659521+0000","last_became_active":"2024-04-26T11:21:53.707573+0000","last_became_peered":"2024-04-26T11:21:53.707573+0000","last_unstale":"2024-04-26T11:21:55.659521+0000","last_undegraded":"2024-04-26T11:21:55.659521+0000","last_fullsized":"2024-04-26T11:21:55.659521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693364+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:21:53.693364+0000","last_peered":"2024-04-26T11:21:53.693364+0000","last_clean":"2024-04-26T11:21:53.693364+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:21:53.693364+0000","last_undegraded":"2024-04-26T11:21:53.693364+0000","last_fullsized":"2024-04-26T11:21:53.693364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690244+0000","last_change":"2024-04-26T11:21:53.330362+0000","last_active":"2024-04-26T11:21:54.690244+0000","last_peered":"2024-04-26T11:21:54.690244+0000","last_clean":"2024-04-26T11:21:54.690244+0000","last_became_active":"2024-04-26T11:21:53.329383+0000","last_became_peered":"2024-04-26T11:21:53.329383+0000","last_unstale":"2024-04-26T11:21:54.690244+0000","last_undegraded":"2024-04-26T11:21:54.690244+0000","last_fullsized":"2024-04-26T11:21:54.690244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691659+0000","last_change":"2024-04-26T11:21:53.716469+0000","last_active":"2024-04-26T11:21:54.691659+0000","last_peered":"2024-04-26T11:21:54.691659+0000","last_clean":"2024-04-26T11:21:54.691659+0000","last_became_active":"2024-04-26T11:21:53.715684+0000","last_became_peered":"2024-04-26T11:21:53.715684+0000","last_unstale":"2024-04-26T11:21:54.691659+0000","last_undegraded":"2024-04-26T11:21:54.691659+0000","last_fullsized":"2024-04-26T11:21:54.691659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.683688+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:21:53.683688+0000","last_peered":"2024-04-26T11:21:53.683688+0000","last_clean":"2024-04-26T11:21:53.683688+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:21:53.683688+0000","last_undegraded":"2024-04-26T11:21:53.683688+0000","last_fullsized":"2024-04-26T11:21:53.683688+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689798+0000","last_change":"2024-04-26T11:21:53.345743+0000","last_active":"2024-04-26T11:21:54.689798+0000","last_peered":"2024-04-26T11:21:54.689798+0000","last_clean":"2024-04-26T11:21:54.689798+0000","last_became_active":"2024-04-26T11:21:53.344967+0000","last_became_peered":"2024-04-26T11:21:53.344967+0000","last_unstale":"2024-04-26T11:21:54.689798+0000","last_undegraded":"2024-04-26T11:21:54.689798+0000","last_fullsized":"2024-04-26T11:21:54.689798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:08.280572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691663+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:21:54.691663+0000","last_peered":"2024-04-26T11:21:54.691663+0000","last_clean":"2024-04-26T11:21:54.691663+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:21:54.691663+0000","last_undegraded":"2024-04-26T11:21:54.691663+0000","last_fullsized":"2024-04-26T11:21:54.691663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694282+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:21:53.694282+0000","last_peered":"2024-04-26T11:21:53.694282+0000","last_clean":"2024-04-26T11:21:53.694282+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:21:53.694282+0000","last_undegraded":"2024-04-26T11:21:53.694282+0000","last_fullsized":"2024-04-26T11:21:53.694282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658670+0000","last_change":"2024-04-26T11:21:53.338037+0000","last_active":"2024-04-26T11:21:55.658670+0000","last_peered":"2024-04-26T11:21:55.658670+0000","last_clean":"2024-04-26T11:21:55.658670+0000","last_became_active":"2024-04-26T11:21:53.337004+0000","last_became_peered":"2024-04-26T11:21:53.337004+0000","last_unstale":"2024-04-26T11:21:55.658670+0000","last_undegraded":"2024-04-26T11:21:55.658670+0000","last_fullsized":"2024-04-26T11:21:55.658670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691854+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:21:54.691854+0000","last_peered":"2024-04-26T11:21:54.691854+0000","last_clean":"2024-04-26T11:21:54.691854+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:21:54.691854+0000","last_undegraded":"2024-04-26T11:21:54.691854+0000","last_fullsized":"2024-04-26T11:21:54.691854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659642+0000","last_change":"2024-04-26T11:21:53.337312+0000","last_active":"2024-04-26T11:21:55.659642+0000","last_peered":"2024-04-26T11:21:55.659642+0000","last_clean":"2024-04-26T11:21:55.659642+0000","last_became_active":"2024-04-26T11:21:53.336587+0000","last_became_peered":"2024-04-26T11:21:53.336587+0000","last_unstale":"2024-04-26T11:21:55.659642+0000","last_undegraded":"2024-04-26T11:21:55.659642+0000","last_fullsized":"2024-04-26T11:21:55.659642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.681538+0000","last_change":"2024-04-26T11:21:49.292007+0000","last_active":"2024-04-26T11:21:53.681538+0000","last_peered":"2024-04-26T11:21:53.681538+0000","last_clean":"2024-04-26T11:21:53.681538+0000","last_became_active":"2024-04-26T11:21:49.291100+0000","last_became_peered":"2024-04-26T11:21:49.291100+0000","last_unstale":"2024-04-26T11:21:53.681538+0000","last_undegraded":"2024-04-26T11:21:53.681538+0000","last_fullsized":"2024-04-26T11:21:53.681538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.877516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690182+0000","last_change":"2024-04-26T11:21:53.697386+0000","last_active":"2024-04-26T11:21:54.690182+0000","last_peered":"2024-04-26T11:21:54.690182+0000","last_clean":"2024-04-26T11:21:54.690182+0000","last_became_active":"2024-04-26T11:21:53.695847+0000","last_became_peered":"2024-04-26T11:21:53.695847+0000","last_unstale":"2024-04-26T11:21:54.690182+0000","last_undegraded":"2024-04-26T11:21:54.690182+0000","last_fullsized":"2024-04-26T11:21:54.690182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691993+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:21:54.691993+0000","last_peered":"2024-04-26T11:21:54.691993+0000","last_clean":"2024-04-26T11:21:54.691993+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:21:54.691993+0000","last_undegraded":"2024-04-26T11:21:54.691993+0000","last_fullsized":"2024-04-26T11:21:54.691993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.688099+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:21:53.688099+0000","last_peered":"2024-04-26T11:21:53.688099+0000","last_clean":"2024-04-26T11:21:53.688099+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:21:53.688099+0000","last_undegraded":"2024-04-26T11:21:53.688099+0000","last_fullsized":"2024-04-26T11:21:53.688099+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690179+0000","last_change":"2024-04-26T11:21:53.696563+0000","last_active":"2024-04-26T11:21:54.690179+0000","last_peered":"2024-04-26T11:21:54.690179+0000","last_clean":"2024-04-26T11:21:54.690179+0000","last_became_active":"2024-04-26T11:21:53.695678+0000","last_became_peered":"2024-04-26T11:21:53.695678+0000","last_unstale":"2024-04-26T11:21:54.690179+0000","last_undegraded":"2024-04-26T11:21:54.690179+0000","last_fullsized":"2024-04-26T11:21:54.690179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.692075+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:21:54.692075+0000","last_peered":"2024-04-26T11:21:54.692075+0000","last_clean":"2024-04-26T11:21:54.692075+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:21:54.692075+0000","last_undegraded":"2024-04-26T11:21:54.692075+0000","last_fullsized":"2024-04-26T11:21:54.692075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.684028+0000","last_change":"2024-04-26T11:21:49.292644+0000","last_active":"2024-04-26T11:21:53.684028+0000","last_peered":"2024-04-26T11:21:53.684028+0000","last_clean":"2024-04-26T11:21:53.684028+0000","last_became_active":"2024-04-26T11:21:49.291499+0000","last_became_peered":"2024-04-26T11:21:49.291499+0000","last_unstale":"2024-04-26T11:21:53.684028+0000","last_undegraded":"2024-04-26T11:21:53.684028+0000","last_fullsized":"2024-04-26T11:21:53.684028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689637+0000","last_change":"2024-04-26T11:21:53.705104+0000","last_active":"2024-04-26T11:21:54.689637+0000","last_peered":"2024-04-26T11:21:54.689637+0000","last_clean":"2024-04-26T11:21:54.689637+0000","last_became_active":"2024-04-26T11:21:53.704282+0000","last_became_peered":"2024-04-26T11:21:53.704282+0000","last_unstale":"2024-04-26T11:21:54.689637+0000","last_undegraded":"2024-04-26T11:21:54.689637+0000","last_fullsized":"2024-04-26T11:21:54.689637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:56.396012+0000","last_change":"2024-04-26T11:21:53.332815+0000","last_active":"2024-04-26T11:21:56.396012+0000","last_peered":"2024-04-26T11:21:56.396012+0000","last_clean":"2024-04-26T11:21:56.396012+0000","last_became_active":"2024-04-26T11:21:53.332020+0000","last_became_peered":"2024-04-26T11:21:53.332020+0000","last_unstale":"2024-04-26T11:21:56.396012+0000","last_undegraded":"2024-04-26T11:21:56.396012+0000","last_fullsized":"2024-04-26T11:21:56.396012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.700312+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:21:53.700312+0000","last_peered":"2024-04-26T11:21:53.700312+0000","last_clean":"2024-04-26T11:21:53.700312+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:21:53.700312+0000","last_undegraded":"2024-04-26T11:21:53.700312+0000","last_fullsized":"2024-04-26T11:21:53.700312+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689824+0000","last_change":"2024-04-26T11:21:53.696546+0000","last_active":"2024-04-26T11:21:54.689824+0000","last_peered":"2024-04-26T11:21:54.689824+0000","last_clean":"2024-04-26T11:21:54.689824+0000","last_became_active":"2024-04-26T11:21:53.695670+0000","last_became_peered":"2024-04-26T11:21:53.695670+0000","last_unstale":"2024-04-26T11:21:54.689824+0000","last_undegraded":"2024-04-26T11:21:54.689824+0000","last_fullsized":"2024-04-26T11:21:54.689824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658127+0000","last_change":"2024-04-26T11:21:53.703599+0000","last_active":"2024-04-26T11:21:55.658127+0000","last_peered":"2024-04-26T11:21:55.658127+0000","last_clean":"2024-04-26T11:21:55.658127+0000","last_became_active":"2024-04-26T11:21:53.702893+0000","last_became_peered":"2024-04-26T11:21:53.702893+0000","last_unstale":"2024-04-26T11:21:55.658127+0000","last_undegraded":"2024-04-26T11:21:55.658127+0000","last_fullsized":"2024-04-26T11:21:55.658127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659192+0000","last_change":"2024-04-26T11:21:53.340288+0000","last_active":"2024-04-26T11:21:55.659192+0000","last_peered":"2024-04-26T11:21:55.659192+0000","last_clean":"2024-04-26T11:21:55.659192+0000","last_became_active":"2024-04-26T11:21:53.339414+0000","last_became_peered":"2024-04-26T11:21:53.339414+0000","last_unstale":"2024-04-26T11:21:55.659192+0000","last_undegraded":"2024-04-26T11:21:55.659192+0000","last_fullsized":"2024-04-26T11:21:55.659192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689909+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:21:54.689909+0000","last_peered":"2024-04-26T11:21:54.689909+0000","last_clean":"2024-04-26T11:21:54.689909+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:21:54.689909+0000","last_undegraded":"2024-04-26T11:21:54.689909+0000","last_fullsized":"2024-04-26T11:21:54.689909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691341+0000","last_change":"2024-04-26T11:21:53.343465+0000","last_active":"2024-04-26T11:21:54.691341+0000","last_peered":"2024-04-26T11:21:54.691341+0000","last_clean":"2024-04-26T11:21:54.691341+0000","last_became_active":"2024-04-26T11:21:53.342882+0000","last_became_peered":"2024-04-26T11:21:53.342882+0000","last_unstale":"2024-04-26T11:21:54.691341+0000","last_undegraded":"2024-04-26T11:21:54.691341+0000","last_fullsized":"2024-04-26T11:21:54.691341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:41.508747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.660158+0000","last_change":"2024-04-26T11:21:53.344846+0000","last_active":"2024-04-26T11:21:55.660158+0000","last_peered":"2024-04-26T11:21:55.660158+0000","last_clean":"2024-04-26T11:21:55.660158+0000","last_became_active":"2024-04-26T11:21:53.342981+0000","last_became_peered":"2024-04-26T11:21:53.342981+0000","last_unstale":"2024-04-26T11:21:55.660158+0000","last_undegraded":"2024-04-26T11:21:55.660158+0000","last_fullsized":"2024-04-26T11:21:55.660158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689736+0000","last_change":"2024-04-26T11:21:53.706890+0000","last_active":"2024-04-26T11:21:54.689736+0000","last_peered":"2024-04-26T11:21:54.689736+0000","last_clean":"2024-04-26T11:21:54.689736+0000","last_became_active":"2024-04-26T11:21:53.705229+0000","last_became_peered":"2024-04-26T11:21:53.705229+0000","last_unstale":"2024-04-26T11:21:54.689736+0000","last_undegraded":"2024-04-26T11:21:54.689736+0000","last_fullsized":"2024-04-26T11:21:54.689736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691905+0000","last_change":"2024-04-26T11:21:53.334527+0000","last_active":"2024-04-26T11:21:54.691905+0000","last_peered":"2024-04-26T11:21:54.691905+0000","last_clean":"2024-04-26T11:21:54.691905+0000","last_became_active":"2024-04-26T11:21:53.332325+0000","last_became_peered":"2024-04-26T11:21:53.332325+0000","last_unstale":"2024-04-26T11:21:54.691905+0000","last_undegraded":"2024-04-26T11:21:54.691905+0000","last_fullsized":"2024-04-26T11:21:54.691905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689613+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:21:54.689613+0000","last_peered":"2024-04-26T11:21:54.689613+0000","last_clean":"2024-04-26T11:21:54.689613+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:21:54.689613+0000","last_undegraded":"2024-04-26T11:21:54.689613+0000","last_fullsized":"2024-04-26T11:21:54.689613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691804+0000","last_change":"2024-04-26T11:21:53.696949+0000","last_active":"2024-04-26T11:21:54.691804+0000","last_peered":"2024-04-26T11:21:54.691804+0000","last_clean":"2024-04-26T11:21:54.691804+0000","last_became_active":"2024-04-26T11:21:53.696068+0000","last_became_peered":"2024-04-26T11:21:53.696068+0000","last_unstale":"2024-04-26T11:21:54.691804+0000","last_undegraded":"2024-04-26T11:21:54.691804+0000","last_fullsized":"2024-04-26T11:21:54.691804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689833+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:21:54.689833+0000","last_peered":"2024-04-26T11:21:54.689833+0000","last_clean":"2024-04-26T11:21:54.689833+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:21:54.689833+0000","last_undegraded":"2024-04-26T11:21:54.689833+0000","last_fullsized":"2024-04-26T11:21:54.689833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691375+0000","last_change":"2024-04-26T11:21:53.710749+0000","last_active":"2024-04-26T11:21:54.691375+0000","last_peered":"2024-04-26T11:21:54.691375+0000","last_clean":"2024-04-26T11:21:54.691375+0000","last_became_active":"2024-04-26T11:21:53.707330+0000","last_became_peered":"2024-04-26T11:21:53.707330+0000","last_unstale":"2024-04-26T11:21:54.691375+0000","last_undegraded":"2024-04-26T11:21:54.691375+0000","last_fullsized":"2024-04-26T11:21:54.691375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690082+0000","last_change":"2024-04-26T11:21:53.334972+0000","last_active":"2024-04-26T11:21:54.690082+0000","last_peered":"2024-04-26T11:21:54.690082+0000","last_clean":"2024-04-26T11:21:54.690082+0000","last_became_active":"2024-04-26T11:21:53.332642+0000","last_became_peered":"2024-04-26T11:21:53.332642+0000","last_unstale":"2024-04-26T11:21:54.690082+0000","last_undegraded":"2024-04-26T11:21:54.690082+0000","last_fullsized":"2024-04-26T11:21:54.690082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691006+0000","last_change":"2024-04-26T11:21:53.709701+0000","last_active":"2024-04-26T11:21:54.691006+0000","last_peered":"2024-04-26T11:21:54.691006+0000","last_clean":"2024-04-26T11:21:54.691006+0000","last_became_active":"2024-04-26T11:21:53.708905+0000","last_became_peered":"2024-04-26T11:21:53.708905+0000","last_unstale":"2024-04-26T11:21:54.691006+0000","last_undegraded":"2024-04-26T11:21:54.691006+0000","last_fullsized":"2024-04-26T11:21:54.691006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691004+0000","last_change":"2024-04-26T11:21:53.330226+0000","last_active":"2024-04-26T11:21:54.691004+0000","last_peered":"2024-04-26T11:21:54.691004+0000","last_clean":"2024-04-26T11:21:54.691004+0000","last_became_active":"2024-04-26T11:21:53.329446+0000","last_became_peered":"2024-04-26T11:21:53.329446+0000","last_unstale":"2024-04-26T11:21:54.691004+0000","last_undegraded":"2024-04-26T11:21:54.691004+0000","last_fullsized":"2024-04-26T11:21:54.691004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:52.599214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691125+0000","last_change":"2024-04-26T11:21:53.716629+0000","last_active":"2024-04-26T11:21:54.691125+0000","last_peered":"2024-04-26T11:21:54.691125+0000","last_clean":"2024-04-26T11:21:54.691125+0000","last_became_active":"2024-04-26T11:21:53.714799+0000","last_became_peered":"2024-04-26T11:21:53.714799+0000","last_unstale":"2024-04-26T11:21:54.691125+0000","last_undegraded":"2024-04-26T11:21:54.691125+0000","last_fullsized":"2024-04-26T11:21:54.691125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:54.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690731+0000","last_change":"2024-04-26T11:21:53.343318+0000","last_active":"2024-04-26T11:21:54.690731+0000","last_peered":"2024-04-26T11:21:54.690731+0000","last_clean":"2024-04-26T11:21:54.690731+0000","last_became_active":"2024-04-26T11:21:53.342789+0000","last_became_peered":"2024-04-26T11:21:53.342789+0000","last_unstale":"2024-04-26T11:21:54.690731+0000","last_undegraded":"2024-04-26T11:21:54.690731+0000","last_fullsized":"2024-04-26T11:21:54.690731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657848+0000","last_change":"2024-04-26T11:21:53.715726+0000","last_active":"2024-04-26T11:21:55.657848+0000","last_peered":"2024-04-26T11:21:55.657848+0000","last_clean":"2024-04-26T11:21:55.657848+0000","last_became_active":"2024-04-26T11:21:53.715126+0000","last_became_peered":"2024-04-26T11:21:53.715126+0000","last_unstale":"2024-04-26T11:21:55.657848+0000","last_undegraded":"2024-04-26T11:21:55.657848+0000","last_fullsized":"2024-04-26T11:21:55.657848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659105+0000","last_change":"2024-04-26T11:21:53.343934+0000","last_active":"2024-04-26T11:21:55.659105+0000","last_peered":"2024-04-26T11:21:55.659105+0000","last_clean":"2024-04-26T11:21:55.659105+0000","last_became_active":"2024-04-26T11:21:53.342401+0000","last_became_peered":"2024-04-26T11:21:53.342401+0000","last_unstale":"2024-04-26T11:21:55.659105+0000","last_undegraded":"2024-04-26T11:21:55.659105+0000","last_fullsized":"2024-04-26T11:21:55.659105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658676+0000","last_change":"2024-04-26T11:21:53.713092+0000","last_active":"2024-04-26T11:21:55.658676+0000","last_peered":"2024-04-26T11:21:55.658676+0000","last_clean":"2024-04-26T11:21:55.658676+0000","last_became_active":"2024-04-26T11:21:53.712207+0000","last_became_peered":"2024-04-26T11:21:53.712207+0000","last_unstale":"2024-04-26T11:21:55.658676+0000","last_undegraded":"2024-04-26T11:21:55.658676+0000","last_fullsized":"2024-04-26T11:21:55.658676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691034+0000","last_change":"2024-04-26T11:21:53.345453+0000","last_active":"2024-04-26T11:21:54.691034+0000","last_peered":"2024-04-26T11:21:54.691034+0000","last_clean":"2024-04-26T11:21:54.691034+0000","last_became_active":"2024-04-26T11:21:53.344468+0000","last_became_peered":"2024-04-26T11:21:53.344468+0000","last_unstale":"2024-04-26T11:21:54.691034+0000","last_undegraded":"2024-04-26T11:21:54.691034+0000","last_fullsized":"2024-04-26T11:21:54.691034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.295739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690674+0000","last_change":"2024-04-26T11:21:53.712311+0000","last_active":"2024-04-26T11:21:54.690674+0000","last_peered":"2024-04-26T11:21:54.690674+0000","last_clean":"2024-04-26T11:21:54.690674+0000","last_became_active":"2024-04-26T11:21:53.711195+0000","last_became_peered":"2024-04-26T11:21:53.711195+0000","last_unstale":"2024-04-26T11:21:54.690674+0000","last_undegraded":"2024-04-26T11:21:54.690674+0000","last_fullsized":"2024-04-26T11:21:54.690674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:50.973181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691630+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:21:54.691630+0000","last_peered":"2024-04-26T11:21:54.691630+0000","last_clean":"2024-04-26T11:21:54.691630+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:21:54.691630+0000","last_undegraded":"2024-04-26T11:21:54.691630+0000","last_fullsized":"2024-04-26T11:21:54.691630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657705+0000","last_change":"2024-04-26T11:21:53.713610+0000","last_active":"2024-04-26T11:21:55.657705+0000","last_peered":"2024-04-26T11:21:55.657705+0000","last_clean":"2024-04-26T11:21:55.657705+0000","last_became_active":"2024-04-26T11:21:53.712396+0000","last_became_peered":"2024-04-26T11:21:53.712396+0000","last_unstale":"2024-04-26T11:21:55.657705+0000","last_undegraded":"2024-04-26T11:21:55.657705+0000","last_fullsized":"2024-04-26T11:21:55.657705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691634+0000","last_change":"2024-04-26T11:21:53.334939+0000","last_active":"2024-04-26T11:21:54.691634+0000","last_peered":"2024-04-26T11:21:54.691634+0000","last_clean":"2024-04-26T11:21:54.691634+0000","last_became_active":"2024-04-26T11:21:53.332735+0000","last_became_peered":"2024-04-26T11:21:53.332735+0000","last_unstale":"2024-04-26T11:21:54.691634+0000","last_undegraded":"2024-04-26T11:21:54.691634+0000","last_fullsized":"2024-04-26T11:21:54.691634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738376,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":647190,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738376,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":249856,"data_stored":647806,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:22:04.934 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T11:22:04.934 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T11:22:04.934 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T11:22:04.934 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T11:22:05.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:05.273 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T11:22:05.290 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T11:22:05.291 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:22:05.585 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:05.585 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:54.674778+0000","last_up_change":"2024-04-26T11:21:41.209558+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:22:05.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:21:41.373843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:21:48.112664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:21:52.071918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:21:52.677679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:22:05.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:22:05.891 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-26T11:22:05.908 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:22:06.181 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-26T11:22:06.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T11:22:06.471 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-26T11:22:06.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T11:22:06.764 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-26T11:22:06.782 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:22:07.084 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:07.084 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:21:53.671194+0000","modified":"2024-04-26T11:21:55.684708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/3100108986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3100108986},{"type":"v1","addr":"172.21.15.73:6803","nonce":3100108986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:22:07.085 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-26T11:22:07.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:22:07.383 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:07.383 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:54.674778+0000","last_up_change":"2024-04-26T11:21:41.209558+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:22:07.400 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:21:41.373843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:21:48.112664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:21:52.071918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:21:52.677679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T11:22:07.401 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:22:07.682 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-26T11:22:07.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:22:07.990 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-26T11:22:08.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T11:22:08.281 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-26T11:22:08.299 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T11:22:08.578 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-26T11:22:08.596 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:22:08.919 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:08.919 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:21:53.671194+0000","modified":"2024-04-26T11:21:55.684708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/3100108986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3100108986},{"type":"v1","addr":"172.21.15.73:6803","nonce":3100108986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:22:08.919 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-26T11:22:08.939 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:22:09.218 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:09.218 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":18,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:21:54.674778+0000","last_up_change":"2024-04-26T11:21:41.209558+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:22:09.235 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:22:09.543 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:09.543 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:21:53.671194+0000","modified":"2024-04-26T11:21:55.684708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/3100108986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3100108986},{"type":"v1","addr":"172.21.15.73:6803","nonce":3100108986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:22:09.543 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-26T11:22:09.661 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T11:21:53.671194+0000', 'modified': '2024-04-26T11:21:55.684708+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4207': {'gid': 4207, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6803/3100108986', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6802', 'nonce': 3100108986}, {'type': 'v1', 'addr': '172.21.15.73:6803', 'nonce': 3100108986}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-26T11:22:09.662 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T11:22:09.662 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T11:22:09.801 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-26T11:22:09.800+0000 7faa677fe640 0 client.4472 ms_handle_reset on v2:172.21.15.73:6802/3100108986 2024-04-26T11:22:09.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-04-26T11:22:09.816+0000 7faa677fe640 0 client.4478 ms_handle_reset on v2:172.21.15.73:6802/3100108986 2024-04-26T11:22:09.821 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-26T11:22:09.821 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_fsid": "ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4", 2024-04-26T11:22:09.821 INFO:teuthology.orchestra.run.smithi073.stdout: "whoami": 0, 2024-04-26T11:22:09.821 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4207, 2024-04-26T11:22:09.821 INFO:teuthology.orchestra.run.smithi073.stdout: "want_state": "up:active", 2024-04-26T11:22:09.821 INFO:teuthology.orchestra.run.smithi073.stdout: "state": "up:active", 2024-04-26T11:22:09.821 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs", 2024-04-26T11:22:09.821 INFO:teuthology.orchestra.run.smithi073.stdout: "rank_uptime": 16.146231379, 2024-04-26T11:22:09.821 INFO:teuthology.orchestra.run.smithi073.stdout: "mdsmap_epoch": 5, 2024-04-26T11:22:09.822 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch": 18, 2024-04-26T11:22:09.822 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_epoch_barrier": 18, 2024-04-26T11:22:09.822 INFO:teuthology.orchestra.run.smithi073.stdout: "uptime": 20.430012093999999 2024-04-26T11:22:09.822 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-26T11:22:09.836 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T11:22:09.847 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T11:22:09.848 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}} 2024-04-26T11:22:09.848 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T11:22:09.848 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-26T11:22:09.848 DEBUG:teuthology.orchestra.run.smithi073:> sync 2024-04-26T11:22:10.087 DEBUG:teuthology.orchestra.run.smithi088:> sync 2024-04-26T11:22:10.342 DEBUG:teuthology.orchestra.run.smithi107:> sync 2024-04-26T11:22:10.485 DEBUG:teuthology.orchestra.run.smithi175:> sync 2024-04-26T11:22:10.681 DEBUG:tasks.thrashosds:checking console status of smithi073 2024-04-26T11:22:10.681 DEBUG:teuthology.orchestra.console.smithi073:Waiting for login prompt 2024-04-26T11:22:10.681 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi073 2024-04-26T11:22:10.770 DEBUG:teuthology.orchestra.console.smithi073:expect before: [Enter `^Ec?' for help] 2024-04-26T11:22:10.770 DEBUG:teuthology.orchestra.console.smithi073:expect after: smithi073 login: 2024-04-26T11:22:10.823 DEBUG:teuthology.orchestra.console.smithi073:console disconnect output: [Enter `^Ec?' for help] smithi073 login: [disconnect] 2024-04-26T11:22:10.924 DEBUG:tasks.thrashosds:checking console status of smithi088 2024-04-26T11:22:10.924 DEBUG:teuthology.orchestra.console.smithi088:Waiting for login prompt 2024-04-26T11:22:10.924 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi088 2024-04-26T11:22:11.062 DEBUG:teuthology.orchestra.console.smithi088:expect before: [Enter `^Ec?' for help] 2024-04-26T11:22:11.062 DEBUG:teuthology.orchestra.console.smithi088:expect after: smithi088 login: 2024-04-26T11:22:11.114 DEBUG:teuthology.orchestra.console.smithi088:console disconnect output: [Enter `^Ec?' for help] smithi088 login: [disconnect] 2024-04-26T11:22:11.215 DEBUG:tasks.thrashosds:checking console status of smithi107 2024-04-26T11:22:11.215 DEBUG:teuthology.orchestra.console.smithi107:Waiting for login prompt 2024-04-26T11:22:11.215 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi107 2024-04-26T11:22:11.326 DEBUG:teuthology.orchestra.console.smithi107:expect before: [Enter `^Ec?' for help] 2024-04-26T11:22:11.326 DEBUG:teuthology.orchestra.console.smithi107:expect after: smithi107 login: 2024-04-26T11:22:11.379 DEBUG:teuthology.orchestra.console.smithi107:console disconnect output: [Enter `^Ec?' for help] smithi107 login: [disconnect] 2024-04-26T11:22:11.479 DEBUG:tasks.thrashosds:checking console status of smithi175 2024-04-26T11:22:11.479 DEBUG:teuthology.orchestra.console.smithi175:Waiting for login prompt 2024-04-26T11:22:11.479 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi175 2024-04-26T11:22:11.637 DEBUG:teuthology.orchestra.console.smithi175:expect before: [Enter `^Ec?' for help] 2024-04-26T11:22:11.637 DEBUG:teuthology.orchestra.console.smithi175:expect after: smithi175 login: 2024-04-26T11:22:11.689 DEBUG:teuthology.orchestra.console.smithi175:console disconnect output: [Enter `^Ec?' for help] smithi175 login: [disconnect] 2024-04-26T11:22:11.791 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T11:22:12.123 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T11:22:12.123 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T11:22:12.124 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:22:12.425 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:12.427 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:22:12.441 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-26T11:22:11.326247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85824,"kb_used_data":640,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029696,"statfs":{"total":289910292480,"available":289822408704,"internally_reserved":0,"allocated":655360,"data_stored":1350688,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003746"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691482+0000","last_change":"2024-04-26T11:21:53.713298+0000","last_active":"2024-04-26T11:21:54.691482+0000","last_peered":"2024-04-26T11:21:54.691482+0000","last_clean":"2024-04-26T11:21:54.691482+0000","last_became_active":"2024-04-26T11:21:53.712481+0000","last_became_peered":"2024-04-26T11:21:53.712481+0000","last_unstale":"2024-04-26T11:21:54.691482+0000","last_undegraded":"2024-04-26T11:21:54.691482+0000","last_fullsized":"2024-04-26T11:21:54.691482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691323+0000","last_change":"2024-04-26T11:21:53.716754+0000","last_active":"2024-04-26T11:21:54.691323+0000","last_peered":"2024-04-26T11:21:54.691323+0000","last_clean":"2024-04-26T11:21:54.691323+0000","last_became_active":"2024-04-26T11:21:53.716109+0000","last_became_peered":"2024-04-26T11:21:53.716109+0000","last_unstale":"2024-04-26T11:21:54.691323+0000","last_undegraded":"2024-04-26T11:21:54.691323+0000","last_fullsized":"2024-04-26T11:21:54.691323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658980+0000","last_change":"2024-04-26T11:21:53.710480+0000","last_active":"2024-04-26T11:21:55.658980+0000","last_peered":"2024-04-26T11:21:55.658980+0000","last_clean":"2024-04-26T11:21:55.658980+0000","last_became_active":"2024-04-26T11:21:53.709433+0000","last_became_peered":"2024-04-26T11:21:53.709433+0000","last_unstale":"2024-04-26T11:21:55.658980+0000","last_undegraded":"2024-04-26T11:21:55.658980+0000","last_fullsized":"2024-04-26T11:21:55.658980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:11.687344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658399+0000","last_change":"2024-04-26T11:21:53.719849+0000","last_active":"2024-04-26T11:21:55.658399+0000","last_peered":"2024-04-26T11:21:55.658399+0000","last_clean":"2024-04-26T11:21:55.658399+0000","last_became_active":"2024-04-26T11:21:53.719152+0000","last_became_peered":"2024-04-26T11:21:53.719152+0000","last_unstale":"2024-04-26T11:21:55.658399+0000","last_undegraded":"2024-04-26T11:21:55.658399+0000","last_fullsized":"2024-04-26T11:21:55.658399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690467+0000","last_change":"2024-04-26T11:21:53.712493+0000","last_active":"2024-04-26T11:21:54.690467+0000","last_peered":"2024-04-26T11:21:54.690467+0000","last_clean":"2024-04-26T11:21:54.690467+0000","last_became_active":"2024-04-26T11:21:53.711704+0000","last_became_peered":"2024-04-26T11:21:53.711704+0000","last_unstale":"2024-04-26T11:21:54.690467+0000","last_undegraded":"2024-04-26T11:21:54.690467+0000","last_fullsized":"2024-04-26T11:21:54.690467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657707+0000","last_change":"2024-04-26T11:21:53.715149+0000","last_active":"2024-04-26T11:21:55.657707+0000","last_peered":"2024-04-26T11:21:55.657707+0000","last_clean":"2024-04-26T11:21:55.657707+0000","last_became_active":"2024-04-26T11:21:53.714125+0000","last_became_peered":"2024-04-26T11:21:53.714125+0000","last_unstale":"2024-04-26T11:21:55.657707+0000","last_undegraded":"2024-04-26T11:21:55.657707+0000","last_fullsized":"2024-04-26T11:21:55.657707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657112+0000","last_change":"2024-04-26T11:21:53.714653+0000","last_active":"2024-04-26T11:21:55.657112+0000","last_peered":"2024-04-26T11:21:55.657112+0000","last_clean":"2024-04-26T11:21:55.657112+0000","last_became_active":"2024-04-26T11:21:53.713586+0000","last_became_peered":"2024-04-26T11:21:53.713586+0000","last_unstale":"2024-04-26T11:21:55.657112+0000","last_undegraded":"2024-04-26T11:21:55.657112+0000","last_fullsized":"2024-04-26T11:21:55.657112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:01.563026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657099+0000","last_change":"2024-04-26T11:21:53.715422+0000","last_active":"2024-04-26T11:21:55.657099+0000","last_peered":"2024-04-26T11:21:55.657099+0000","last_clean":"2024-04-26T11:21:55.657099+0000","last_became_active":"2024-04-26T11:21:53.714329+0000","last_became_peered":"2024-04-26T11:21:53.714329+0000","last_unstale":"2024-04-26T11:21:55.657099+0000","last_undegraded":"2024-04-26T11:21:55.657099+0000","last_fullsized":"2024-04-26T11:21:55.657099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:06.981197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691270+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:21:54.691270+0000","last_peered":"2024-04-26T11:21:54.691270+0000","last_clean":"2024-04-26T11:21:54.691270+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:21:54.691270+0000","last_undegraded":"2024-04-26T11:21:54.691270+0000","last_fullsized":"2024-04-26T11:21:54.691270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691299+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:21:54.691299+0000","last_peered":"2024-04-26T11:21:54.691299+0000","last_clean":"2024-04-26T11:21:54.691299+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:21:54.691299+0000","last_undegraded":"2024-04-26T11:21:54.691299+0000","last_fullsized":"2024-04-26T11:21:54.691299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658964+0000","last_change":"2024-04-26T11:21:53.714245+0000","last_active":"2024-04-26T11:21:55.658964+0000","last_peered":"2024-04-26T11:21:55.658964+0000","last_clean":"2024-04-26T11:21:55.658964+0000","last_became_active":"2024-04-26T11:21:53.713331+0000","last_became_peered":"2024-04-26T11:21:53.713331+0000","last_unstale":"2024-04-26T11:21:55.658964+0000","last_undegraded":"2024-04-26T11:21:55.658964+0000","last_fullsized":"2024-04-26T11:21:55.658964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690847+0000","last_change":"2024-04-26T11:21:53.712269+0000","last_active":"2024-04-26T11:21:54.690847+0000","last_peered":"2024-04-26T11:21:54.690847+0000","last_clean":"2024-04-26T11:21:54.690847+0000","last_became_active":"2024-04-26T11:21:53.710740+0000","last_became_peered":"2024-04-26T11:21:53.710740+0000","last_unstale":"2024-04-26T11:21:54.690847+0000","last_undegraded":"2024-04-26T11:21:54.690847+0000","last_fullsized":"2024-04-26T11:21:54.690847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690903+0000","last_change":"2024-04-26T11:21:53.712552+0000","last_active":"2024-04-26T11:21:54.690903+0000","last_peered":"2024-04-26T11:21:54.690903+0000","last_clean":"2024-04-26T11:21:54.690903+0000","last_became_active":"2024-04-26T11:21:53.711470+0000","last_became_peered":"2024-04-26T11:21:53.711470+0000","last_unstale":"2024-04-26T11:21:54.690903+0000","last_undegraded":"2024-04-26T11:21:54.690903+0000","last_fullsized":"2024-04-26T11:21:54.690903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657972+0000","last_change":"2024-04-26T11:21:53.705872+0000","last_active":"2024-04-26T11:21:55.657972+0000","last_peered":"2024-04-26T11:21:55.657972+0000","last_clean":"2024-04-26T11:21:55.657972+0000","last_became_active":"2024-04-26T11:21:53.705040+0000","last_became_peered":"2024-04-26T11:21:53.705040+0000","last_unstale":"2024-04-26T11:21:55.657972+0000","last_undegraded":"2024-04-26T11:21:55.657972+0000","last_fullsized":"2024-04-26T11:21:55.657972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:02.015153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657316+0000","last_change":"2024-04-26T11:21:53.707324+0000","last_active":"2024-04-26T11:21:55.657316+0000","last_peered":"2024-04-26T11:21:55.657316+0000","last_clean":"2024-04-26T11:21:55.657316+0000","last_became_active":"2024-04-26T11:21:53.706602+0000","last_became_peered":"2024-04-26T11:21:53.706602+0000","last_unstale":"2024-04-26T11:21:55.657316+0000","last_undegraded":"2024-04-26T11:21:55.657316+0000","last_fullsized":"2024-04-26T11:21:55.657316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.907498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657115+0000","last_change":"2024-04-26T11:21:53.714327+0000","last_active":"2024-04-26T11:21:55.657115+0000","last_peered":"2024-04-26T11:21:55.657115+0000","last_clean":"2024-04-26T11:21:55.657115+0000","last_became_active":"2024-04-26T11:21:53.712908+0000","last_became_peered":"2024-04-26T11:21:53.712908+0000","last_unstale":"2024-04-26T11:21:55.657115+0000","last_undegraded":"2024-04-26T11:21:55.657115+0000","last_fullsized":"2024-04-26T11:21:55.657115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:31.158881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691927+0000","last_change":"2024-04-26T11:21:53.713524+0000","last_active":"2024-04-26T11:21:54.691927+0000","last_peered":"2024-04-26T11:21:54.691927+0000","last_clean":"2024-04-26T11:21:54.691927+0000","last_became_active":"2024-04-26T11:21:53.710675+0000","last_became_peered":"2024-04-26T11:21:53.710675+0000","last_unstale":"2024-04-26T11:21:54.691927+0000","last_undegraded":"2024-04-26T11:21:54.691927+0000","last_fullsized":"2024-04-26T11:21:54.691927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691739+0000","last_change":"2024-04-26T11:21:53.714983+0000","last_active":"2024-04-26T11:21:54.691739+0000","last_peered":"2024-04-26T11:21:54.691739+0000","last_clean":"2024-04-26T11:21:54.691739+0000","last_became_active":"2024-04-26T11:21:53.711987+0000","last_became_peered":"2024-04-26T11:21:53.711987+0000","last_unstale":"2024-04-26T11:21:54.691739+0000","last_undegraded":"2024-04-26T11:21:54.691739+0000","last_fullsized":"2024-04-26T11:21:54.691739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:49.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691059+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:21:54.691059+0000","last_peered":"2024-04-26T11:21:54.691059+0000","last_clean":"2024-04-26T11:21:54.691059+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:21:54.691059+0000","last_undegraded":"2024-04-26T11:21:54.691059+0000","last_fullsized":"2024-04-26T11:21:54.691059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658842+0000","last_change":"2024-04-26T11:21:53.715255+0000","last_active":"2024-04-26T11:21:55.658842+0000","last_peered":"2024-04-26T11:21:55.658842+0000","last_clean":"2024-04-26T11:21:55.658842+0000","last_became_active":"2024-04-26T11:21:53.714525+0000","last_became_peered":"2024-04-26T11:21:53.714525+0000","last_unstale":"2024-04-26T11:21:55.658842+0000","last_undegraded":"2024-04-26T11:21:55.658842+0000","last_fullsized":"2024-04-26T11:21:55.658842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658215+0000","last_change":"2024-04-26T11:21:53.714368+0000","last_active":"2024-04-26T11:21:55.658215+0000","last_peered":"2024-04-26T11:21:55.658215+0000","last_clean":"2024-04-26T11:21:55.658215+0000","last_became_active":"2024-04-26T11:21:53.713099+0000","last_became_peered":"2024-04-26T11:21:53.713099+0000","last_unstale":"2024-04-26T11:21:55.658215+0000","last_undegraded":"2024-04-26T11:21:55.658215+0000","last_fullsized":"2024-04-26T11:21:55.658215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689959+0000","last_change":"2024-04-26T11:21:53.709697+0000","last_active":"2024-04-26T11:21:54.689959+0000","last_peered":"2024-04-26T11:21:54.689959+0000","last_clean":"2024-04-26T11:21:54.689959+0000","last_became_active":"2024-04-26T11:21:53.708839+0000","last_became_peered":"2024-04-26T11:21:53.708839+0000","last_unstale":"2024-04-26T11:21:54.689959+0000","last_undegraded":"2024-04-26T11:21:54.689959+0000","last_fullsized":"2024-04-26T11:21:54.689959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689490+0000","last_change":"2024-04-26T11:21:53.705071+0000","last_active":"2024-04-26T11:21:54.689490+0000","last_peered":"2024-04-26T11:21:54.689490+0000","last_clean":"2024-04-26T11:21:54.689490+0000","last_became_active":"2024-04-26T11:21:53.704331+0000","last_became_peered":"2024-04-26T11:21:53.704331+0000","last_unstale":"2024-04-26T11:21:54.689490+0000","last_undegraded":"2024-04-26T11:21:54.689490+0000","last_fullsized":"2024-04-26T11:21:54.689490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689441+0000","last_change":"2024-04-26T11:21:53.692834+0000","last_active":"2024-04-26T11:21:54.689441+0000","last_peered":"2024-04-26T11:21:54.689441+0000","last_clean":"2024-04-26T11:21:54.689441+0000","last_became_active":"2024-04-26T11:21:53.690279+0000","last_became_peered":"2024-04-26T11:21:53.690279+0000","last_unstale":"2024-04-26T11:21:54.689441+0000","last_undegraded":"2024-04-26T11:21:54.689441+0000","last_fullsized":"2024-04-26T11:21:54.689441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691605+0000","last_change":"2024-04-26T11:21:53.698796+0000","last_active":"2024-04-26T11:21:54.691605+0000","last_peered":"2024-04-26T11:21:54.691605+0000","last_clean":"2024-04-26T11:21:54.691605+0000","last_became_active":"2024-04-26T11:21:53.697854+0000","last_became_peered":"2024-04-26T11:21:53.697854+0000","last_unstale":"2024-04-26T11:21:54.691605+0000","last_undegraded":"2024-04-26T11:21:54.691605+0000","last_fullsized":"2024-04-26T11:21:54.691605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691288+0000","last_change":"2024-04-26T11:21:53.706583+0000","last_active":"2024-04-26T11:21:54.691288+0000","last_peered":"2024-04-26T11:21:54.691288+0000","last_clean":"2024-04-26T11:21:54.691288+0000","last_became_active":"2024-04-26T11:21:53.704871+0000","last_became_peered":"2024-04-26T11:21:53.704871+0000","last_unstale":"2024-04-26T11:21:54.691288+0000","last_undegraded":"2024-04-26T11:21:54.691288+0000","last_fullsized":"2024-04-26T11:21:54.691288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659254+0000","last_change":"2024-04-26T11:21:53.709813+0000","last_active":"2024-04-26T11:21:55.659254+0000","last_peered":"2024-04-26T11:21:55.659254+0000","last_clean":"2024-04-26T11:21:55.659254+0000","last_became_active":"2024-04-26T11:21:53.708399+0000","last_became_peered":"2024-04-26T11:21:53.708399+0000","last_unstale":"2024-04-26T11:21:55.659254+0000","last_undegraded":"2024-04-26T11:21:55.659254+0000","last_fullsized":"2024-04-26T11:21:55.659254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:36.298230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691745+0000","last_change":"2024-04-26T11:21:53.710195+0000","last_active":"2024-04-26T11:21:54.691745+0000","last_peered":"2024-04-26T11:21:54.691745+0000","last_clean":"2024-04-26T11:21:54.691745+0000","last_became_active":"2024-04-26T11:21:53.709660+0000","last_became_peered":"2024-04-26T11:21:53.709660+0000","last_unstale":"2024-04-26T11:21:54.691745+0000","last_undegraded":"2024-04-26T11:21:54.691745+0000","last_fullsized":"2024-04-26T11:21:54.691745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691147+0000","last_change":"2024-04-26T11:21:53.703397+0000","last_active":"2024-04-26T11:21:54.691147+0000","last_peered":"2024-04-26T11:21:54.691147+0000","last_clean":"2024-04-26T11:21:54.691147+0000","last_became_active":"2024-04-26T11:21:53.701822+0000","last_became_peered":"2024-04-26T11:21:53.701822+0000","last_unstale":"2024-04-26T11:21:54.691147+0000","last_undegraded":"2024-04-26T11:21:54.691147+0000","last_fullsized":"2024-04-26T11:21:54.691147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690777+0000","last_change":"2024-04-26T11:21:53.709264+0000","last_active":"2024-04-26T11:21:54.690777+0000","last_peered":"2024-04-26T11:21:54.690777+0000","last_clean":"2024-04-26T11:21:54.690777+0000","last_became_active":"2024-04-26T11:21:53.708529+0000","last_became_peered":"2024-04-26T11:21:53.708529+0000","last_unstale":"2024-04-26T11:21:54.690777+0000","last_undegraded":"2024-04-26T11:21:54.690777+0000","last_fullsized":"2024-04-26T11:21:54.690777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689662+0000","last_change":"2024-04-26T11:21:53.710899+0000","last_active":"2024-04-26T11:21:54.689662+0000","last_peered":"2024-04-26T11:21:54.689662+0000","last_clean":"2024-04-26T11:21:54.689662+0000","last_became_active":"2024-04-26T11:21:53.710185+0000","last_became_peered":"2024-04-26T11:21:53.710185+0000","last_unstale":"2024-04-26T11:21:54.689662+0000","last_undegraded":"2024-04-26T11:21:54.689662+0000","last_fullsized":"2024-04-26T11:21:54.689662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657645+0000","last_change":"2024-04-26T11:21:53.708939+0000","last_active":"2024-04-26T11:21:55.657645+0000","last_peered":"2024-04-26T11:21:55.657645+0000","last_clean":"2024-04-26T11:21:55.657645+0000","last_became_active":"2024-04-26T11:21:53.708120+0000","last_became_peered":"2024-04-26T11:21:53.708120+0000","last_unstale":"2024-04-26T11:21:55.657645+0000","last_undegraded":"2024-04-26T11:21:55.657645+0000","last_fullsized":"2024-04-26T11:21:55.657645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691370+0000","last_change":"2024-04-26T11:21:53.712919+0000","last_active":"2024-04-26T11:21:54.691370+0000","last_peered":"2024-04-26T11:21:54.691370+0000","last_clean":"2024-04-26T11:21:54.691370+0000","last_became_active":"2024-04-26T11:21:53.710798+0000","last_became_peered":"2024-04-26T11:21:53.710798+0000","last_unstale":"2024-04-26T11:21:54.691370+0000","last_undegraded":"2024-04-26T11:21:54.691370+0000","last_fullsized":"2024-04-26T11:21:54.691370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658532+0000","last_change":"2024-04-26T11:21:53.343931+0000","last_active":"2024-04-26T11:21:55.658532+0000","last_peered":"2024-04-26T11:21:55.658532+0000","last_clean":"2024-04-26T11:21:55.658532+0000","last_became_active":"2024-04-26T11:21:53.342363+0000","last_became_peered":"2024-04-26T11:21:53.342363+0000","last_unstale":"2024-04-26T11:21:55.658532+0000","last_undegraded":"2024-04-26T11:21:55.658532+0000","last_fullsized":"2024-04-26T11:21:55.658532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690797+0000","last_change":"2024-04-26T11:21:53.712613+0000","last_active":"2024-04-26T11:21:54.690797+0000","last_peered":"2024-04-26T11:21:54.690797+0000","last_clean":"2024-04-26T11:21:54.690797+0000","last_became_active":"2024-04-26T11:21:53.711848+0000","last_became_peered":"2024-04-26T11:21:53.711848+0000","last_unstale":"2024-04-26T11:21:54.690797+0000","last_undegraded":"2024-04-26T11:21:54.690797+0000","last_fullsized":"2024-04-26T11:21:54.690797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:49.327612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690156+0000","last_change":"2024-04-26T11:21:53.333005+0000","last_active":"2024-04-26T11:21:54.690156+0000","last_peered":"2024-04-26T11:21:54.690156+0000","last_clean":"2024-04-26T11:21:54.690156+0000","last_became_active":"2024-04-26T11:21:53.332191+0000","last_became_peered":"2024-04-26T11:21:53.332191+0000","last_unstale":"2024-04-26T11:21:54.690156+0000","last_undegraded":"2024-04-26T11:21:54.690156+0000","last_fullsized":"2024-04-26T11:21:54.690156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691758+0000","last_change":"2024-04-26T11:21:53.707848+0000","last_active":"2024-04-26T11:21:54.691758+0000","last_peered":"2024-04-26T11:21:54.691758+0000","last_clean":"2024-04-26T11:21:54.691758+0000","last_became_active":"2024-04-26T11:21:53.706222+0000","last_became_peered":"2024-04-26T11:21:53.706222+0000","last_unstale":"2024-04-26T11:21:54.691758+0000","last_undegraded":"2024-04-26T11:21:54.691758+0000","last_fullsized":"2024-04-26T11:21:54.691758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691063+0000","last_change":"2024-04-26T11:21:53.341523+0000","last_active":"2024-04-26T11:21:54.691063+0000","last_peered":"2024-04-26T11:21:54.691063+0000","last_clean":"2024-04-26T11:21:54.691063+0000","last_became_active":"2024-04-26T11:21:53.340545+0000","last_became_peered":"2024-04-26T11:21:53.340545+0000","last_unstale":"2024-04-26T11:21:54.691063+0000","last_undegraded":"2024-04-26T11:21:54.691063+0000","last_fullsized":"2024-04-26T11:21:54.691063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.907675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691390+0000","last_change":"2024-04-26T11:21:53.706879+0000","last_active":"2024-04-26T11:21:54.691390+0000","last_peered":"2024-04-26T11:21:54.691390+0000","last_clean":"2024-04-26T11:21:54.691390+0000","last_became_active":"2024-04-26T11:21:53.705082+0000","last_became_peered":"2024-04-26T11:21:53.705082+0000","last_unstale":"2024-04-26T11:21:54.691390+0000","last_undegraded":"2024-04-26T11:21:54.691390+0000","last_fullsized":"2024-04-26T11:21:54.691390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657400+0000","last_change":"2024-04-26T11:21:53.341655+0000","last_active":"2024-04-26T11:21:55.657400+0000","last_peered":"2024-04-26T11:21:55.657400+0000","last_clean":"2024-04-26T11:21:55.657400+0000","last_became_active":"2024-04-26T11:21:53.340085+0000","last_became_peered":"2024-04-26T11:21:53.340085+0000","last_unstale":"2024-04-26T11:21:55.657400+0000","last_undegraded":"2024-04-26T11:21:55.657400+0000","last_fullsized":"2024-04-26T11:21:55.657400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659421+0000","last_change":"2024-04-26T11:21:53.340063+0000","last_active":"2024-04-26T11:21:55.659421+0000","last_peered":"2024-04-26T11:21:55.659421+0000","last_clean":"2024-04-26T11:21:55.659421+0000","last_became_active":"2024-04-26T11:21:53.339256+0000","last_became_peered":"2024-04-26T11:21:53.339256+0000","last_unstale":"2024-04-26T11:21:55.659421+0000","last_undegraded":"2024-04-26T11:21:55.659421+0000","last_fullsized":"2024-04-26T11:21:55.659421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689561+0000","last_change":"2024-04-26T11:21:53.697700+0000","last_active":"2024-04-26T11:21:54.689561+0000","last_peered":"2024-04-26T11:21:54.689561+0000","last_clean":"2024-04-26T11:21:54.689561+0000","last_became_active":"2024-04-26T11:21:53.696789+0000","last_became_peered":"2024-04-26T11:21:53.696789+0000","last_unstale":"2024-04-26T11:21:54.689561+0000","last_undegraded":"2024-04-26T11:21:54.689561+0000","last_fullsized":"2024-04-26T11:21:54.689561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691980+0000","last_change":"2024-04-26T11:21:53.341302+0000","last_active":"2024-04-26T11:21:54.691980+0000","last_peered":"2024-04-26T11:21:54.691980+0000","last_clean":"2024-04-26T11:21:54.691980+0000","last_became_active":"2024-04-26T11:21:53.340509+0000","last_became_peered":"2024-04-26T11:21:53.340509+0000","last_unstale":"2024-04-26T11:21:54.691980+0000","last_undegraded":"2024-04-26T11:21:54.691980+0000","last_fullsized":"2024-04-26T11:21:54.691980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:16.781849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689756+0000","last_change":"2024-04-26T11:21:53.716075+0000","last_active":"2024-04-26T11:21:54.689756+0000","last_peered":"2024-04-26T11:21:54.689756+0000","last_clean":"2024-04-26T11:21:54.689756+0000","last_became_active":"2024-04-26T11:21:53.714328+0000","last_became_peered":"2024-04-26T11:21:53.714328+0000","last_unstale":"2024-04-26T11:21:54.689756+0000","last_undegraded":"2024-04-26T11:21:54.689756+0000","last_fullsized":"2024-04-26T11:21:54.689756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:54.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659565+0000","last_change":"2024-04-26T11:21:53.339171+0000","last_active":"2024-04-26T11:21:55.659565+0000","last_peered":"2024-04-26T11:21:55.659565+0000","last_clean":"2024-04-26T11:21:55.659565+0000","last_became_active":"2024-04-26T11:21:53.337433+0000","last_became_peered":"2024-04-26T11:21:53.337433+0000","last_unstale":"2024-04-26T11:21:55.659565+0000","last_undegraded":"2024-04-26T11:21:55.659565+0000","last_fullsized":"2024-04-26T11:21:55.659565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658299+0000","last_change":"2024-04-26T11:21:53.719666+0000","last_active":"2024-04-26T11:21:55.658299+0000","last_peered":"2024-04-26T11:21:55.658299+0000","last_clean":"2024-04-26T11:21:55.658299+0000","last_became_active":"2024-04-26T11:21:53.718871+0000","last_became_peered":"2024-04-26T11:21:53.718871+0000","last_unstale":"2024-04-26T11:21:55.658299+0000","last_undegraded":"2024-04-26T11:21:55.658299+0000","last_fullsized":"2024-04-26T11:21:55.658299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659351+0000","last_change":"2024-04-26T11:21:53.344744+0000","last_active":"2024-04-26T11:21:55.659351+0000","last_peered":"2024-04-26T11:21:55.659351+0000","last_clean":"2024-04-26T11:21:55.659351+0000","last_became_active":"2024-04-26T11:21:53.344055+0000","last_became_peered":"2024-04-26T11:21:53.344055+0000","last_unstale":"2024-04-26T11:21:55.659351+0000","last_undegraded":"2024-04-26T11:21:55.659351+0000","last_fullsized":"2024-04-26T11:21:55.659351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690681+0000","last_change":"2024-04-26T11:21:53.709563+0000","last_active":"2024-04-26T11:21:54.690681+0000","last_peered":"2024-04-26T11:21:54.690681+0000","last_clean":"2024-04-26T11:21:54.690681+0000","last_became_active":"2024-04-26T11:21:53.706598+0000","last_became_peered":"2024-04-26T11:21:53.706598+0000","last_unstale":"2024-04-26T11:21:54.690681+0000","last_undegraded":"2024-04-26T11:21:54.690681+0000","last_fullsized":"2024-04-26T11:21:54.690681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691180+0000","last_change":"2024-04-26T11:21:53.330145+0000","last_active":"2024-04-26T11:21:54.691180+0000","last_peered":"2024-04-26T11:21:54.691180+0000","last_clean":"2024-04-26T11:21:54.691180+0000","last_became_active":"2024-04-26T11:21:53.329256+0000","last_became_peered":"2024-04-26T11:21:53.329256+0000","last_unstale":"2024-04-26T11:21:54.691180+0000","last_undegraded":"2024-04-26T11:21:54.691180+0000","last_fullsized":"2024-04-26T11:21:54.691180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658841+0000","last_change":"2024-04-26T11:21:53.715233+0000","last_active":"2024-04-26T11:21:55.658841+0000","last_peered":"2024-04-26T11:21:55.658841+0000","last_clean":"2024-04-26T11:21:55.658841+0000","last_became_active":"2024-04-26T11:21:53.714405+0000","last_became_peered":"2024-04-26T11:21:53.714405+0000","last_unstale":"2024-04-26T11:21:55.658841+0000","last_undegraded":"2024-04-26T11:21:55.658841+0000","last_fullsized":"2024-04-26T11:21:55.658841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659404+0000","last_change":"2024-04-26T11:21:53.344659+0000","last_active":"2024-04-26T11:21:55.659404+0000","last_peered":"2024-04-26T11:21:55.659404+0000","last_clean":"2024-04-26T11:21:55.659404+0000","last_became_active":"2024-04-26T11:21:53.344024+0000","last_became_peered":"2024-04-26T11:21:53.344024+0000","last_unstale":"2024-04-26T11:21:55.659404+0000","last_undegraded":"2024-04-26T11:21:55.659404+0000","last_fullsized":"2024-04-26T11:21:55.659404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:53.053244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659429+0000","last_change":"2024-04-26T11:21:53.710093+0000","last_active":"2024-04-26T11:21:55.659429+0000","last_peered":"2024-04-26T11:21:55.659429+0000","last_clean":"2024-04-26T11:21:55.659429+0000","last_became_active":"2024-04-26T11:21:53.709020+0000","last_became_peered":"2024-04-26T11:21:53.709020+0000","last_unstale":"2024-04-26T11:21:55.659429+0000","last_undegraded":"2024-04-26T11:21:55.659429+0000","last_fullsized":"2024-04-26T11:21:55.659429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690297+0000","last_change":"2024-04-26T11:21:53.341961+0000","last_active":"2024-04-26T11:21:54.690297+0000","last_peered":"2024-04-26T11:21:54.690297+0000","last_clean":"2024-04-26T11:21:54.690297+0000","last_became_active":"2024-04-26T11:21:53.340768+0000","last_became_peered":"2024-04-26T11:21:53.340768+0000","last_unstale":"2024-04-26T11:21:54.690297+0000","last_undegraded":"2024-04-26T11:21:54.690297+0000","last_fullsized":"2024-04-26T11:21:54.690297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659841+0000","last_change":"2024-04-26T11:21:53.706161+0000","last_active":"2024-04-26T11:21:55.659841+0000","last_peered":"2024-04-26T11:21:55.659841+0000","last_clean":"2024-04-26T11:21:55.659841+0000","last_became_active":"2024-04-26T11:21:53.705388+0000","last_became_peered":"2024-04-26T11:21:53.705388+0000","last_unstale":"2024-04-26T11:21:55.659841+0000","last_undegraded":"2024-04-26T11:21:55.659841+0000","last_fullsized":"2024-04-26T11:21:55.659841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690017+0000","last_change":"2024-04-26T11:21:53.328489+0000","last_active":"2024-04-26T11:21:54.690017+0000","last_peered":"2024-04-26T11:21:54.690017+0000","last_clean":"2024-04-26T11:21:54.690017+0000","last_became_active":"2024-04-26T11:21:53.327836+0000","last_became_peered":"2024-04-26T11:21:53.327836+0000","last_unstale":"2024-04-26T11:21:54.690017+0000","last_undegraded":"2024-04-26T11:21:54.690017+0000","last_fullsized":"2024-04-26T11:21:54.690017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:32.644217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691473+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:21:54.691473+0000","last_peered":"2024-04-26T11:21:54.691473+0000","last_clean":"2024-04-26T11:21:54.691473+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:21:54.691473+0000","last_undegraded":"2024-04-26T11:21:54.691473+0000","last_fullsized":"2024-04-26T11:21:54.691473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693986+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:21:53.693986+0000","last_peered":"2024-04-26T11:21:53.693986+0000","last_clean":"2024-04-26T11:21:53.693986+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:21:53.693986+0000","last_undegraded":"2024-04-26T11:21:53.693986+0000","last_fullsized":"2024-04-26T11:21:53.693986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694913+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:21:53.694913+0000","last_peered":"2024-04-26T11:21:53.694913+0000","last_clean":"2024-04-26T11:21:53.694913+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:21:53.694913+0000","last_undegraded":"2024-04-26T11:21:53.694913+0000","last_fullsized":"2024-04-26T11:21:53.694913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690419+0000","last_change":"2024-04-26T11:21:53.326934+0000","last_active":"2024-04-26T11:21:54.690419+0000","last_peered":"2024-04-26T11:21:54.690419+0000","last_clean":"2024-04-26T11:21:54.690419+0000","last_became_active":"2024-04-26T11:21:53.325342+0000","last_became_peered":"2024-04-26T11:21:53.325342+0000","last_unstale":"2024-04-26T11:21:54.690419+0000","last_undegraded":"2024-04-26T11:21:54.690419+0000","last_fullsized":"2024-04-26T11:21:54.690419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659521+0000","last_change":"2024-04-26T11:21:53.709499+0000","last_active":"2024-04-26T11:21:55.659521+0000","last_peered":"2024-04-26T11:21:55.659521+0000","last_clean":"2024-04-26T11:21:55.659521+0000","last_became_active":"2024-04-26T11:21:53.707573+0000","last_became_peered":"2024-04-26T11:21:53.707573+0000","last_unstale":"2024-04-26T11:21:55.659521+0000","last_undegraded":"2024-04-26T11:21:55.659521+0000","last_fullsized":"2024-04-26T11:21:55.659521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693364+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:21:53.693364+0000","last_peered":"2024-04-26T11:21:53.693364+0000","last_clean":"2024-04-26T11:21:53.693364+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:21:53.693364+0000","last_undegraded":"2024-04-26T11:21:53.693364+0000","last_fullsized":"2024-04-26T11:21:53.693364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690244+0000","last_change":"2024-04-26T11:21:53.330362+0000","last_active":"2024-04-26T11:21:54.690244+0000","last_peered":"2024-04-26T11:21:54.690244+0000","last_clean":"2024-04-26T11:21:54.690244+0000","last_became_active":"2024-04-26T11:21:53.329383+0000","last_became_peered":"2024-04-26T11:21:53.329383+0000","last_unstale":"2024-04-26T11:21:54.690244+0000","last_undegraded":"2024-04-26T11:21:54.690244+0000","last_fullsized":"2024-04-26T11:21:54.690244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691659+0000","last_change":"2024-04-26T11:21:53.716469+0000","last_active":"2024-04-26T11:21:54.691659+0000","last_peered":"2024-04-26T11:21:54.691659+0000","last_clean":"2024-04-26T11:21:54.691659+0000","last_became_active":"2024-04-26T11:21:53.715684+0000","last_became_peered":"2024-04-26T11:21:53.715684+0000","last_unstale":"2024-04-26T11:21:54.691659+0000","last_undegraded":"2024-04-26T11:21:54.691659+0000","last_fullsized":"2024-04-26T11:21:54.691659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.683688+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:21:53.683688+0000","last_peered":"2024-04-26T11:21:53.683688+0000","last_clean":"2024-04-26T11:21:53.683688+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:21:53.683688+0000","last_undegraded":"2024-04-26T11:21:53.683688+0000","last_fullsized":"2024-04-26T11:21:53.683688+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689798+0000","last_change":"2024-04-26T11:21:53.345743+0000","last_active":"2024-04-26T11:21:54.689798+0000","last_peered":"2024-04-26T11:21:54.689798+0000","last_clean":"2024-04-26T11:21:54.689798+0000","last_became_active":"2024-04-26T11:21:53.344967+0000","last_became_peered":"2024-04-26T11:21:53.344967+0000","last_unstale":"2024-04-26T11:21:54.689798+0000","last_undegraded":"2024-04-26T11:21:54.689798+0000","last_fullsized":"2024-04-26T11:21:54.689798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:08.280572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691663+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:21:54.691663+0000","last_peered":"2024-04-26T11:21:54.691663+0000","last_clean":"2024-04-26T11:21:54.691663+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:21:54.691663+0000","last_undegraded":"2024-04-26T11:21:54.691663+0000","last_fullsized":"2024-04-26T11:21:54.691663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694282+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:21:53.694282+0000","last_peered":"2024-04-26T11:21:53.694282+0000","last_clean":"2024-04-26T11:21:53.694282+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:21:53.694282+0000","last_undegraded":"2024-04-26T11:21:53.694282+0000","last_fullsized":"2024-04-26T11:21:53.694282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658670+0000","last_change":"2024-04-26T11:21:53.338037+0000","last_active":"2024-04-26T11:21:55.658670+0000","last_peered":"2024-04-26T11:21:55.658670+0000","last_clean":"2024-04-26T11:21:55.658670+0000","last_became_active":"2024-04-26T11:21:53.337004+0000","last_became_peered":"2024-04-26T11:21:53.337004+0000","last_unstale":"2024-04-26T11:21:55.658670+0000","last_undegraded":"2024-04-26T11:21:55.658670+0000","last_fullsized":"2024-04-26T11:21:55.658670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691854+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:21:54.691854+0000","last_peered":"2024-04-26T11:21:54.691854+0000","last_clean":"2024-04-26T11:21:54.691854+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:21:54.691854+0000","last_undegraded":"2024-04-26T11:21:54.691854+0000","last_fullsized":"2024-04-26T11:21:54.691854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659642+0000","last_change":"2024-04-26T11:21:53.337312+0000","last_active":"2024-04-26T11:21:55.659642+0000","last_peered":"2024-04-26T11:21:55.659642+0000","last_clean":"2024-04-26T11:21:55.659642+0000","last_became_active":"2024-04-26T11:21:53.336587+0000","last_became_peered":"2024-04-26T11:21:53.336587+0000","last_unstale":"2024-04-26T11:21:55.659642+0000","last_undegraded":"2024-04-26T11:21:55.659642+0000","last_fullsized":"2024-04-26T11:21:55.659642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.681538+0000","last_change":"2024-04-26T11:21:49.292007+0000","last_active":"2024-04-26T11:21:53.681538+0000","last_peered":"2024-04-26T11:21:53.681538+0000","last_clean":"2024-04-26T11:21:53.681538+0000","last_became_active":"2024-04-26T11:21:49.291100+0000","last_became_peered":"2024-04-26T11:21:49.291100+0000","last_unstale":"2024-04-26T11:21:53.681538+0000","last_undegraded":"2024-04-26T11:21:53.681538+0000","last_fullsized":"2024-04-26T11:21:53.681538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.877516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690182+0000","last_change":"2024-04-26T11:21:53.697386+0000","last_active":"2024-04-26T11:21:54.690182+0000","last_peered":"2024-04-26T11:21:54.690182+0000","last_clean":"2024-04-26T11:21:54.690182+0000","last_became_active":"2024-04-26T11:21:53.695847+0000","last_became_peered":"2024-04-26T11:21:53.695847+0000","last_unstale":"2024-04-26T11:21:54.690182+0000","last_undegraded":"2024-04-26T11:21:54.690182+0000","last_fullsized":"2024-04-26T11:21:54.690182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691993+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:21:54.691993+0000","last_peered":"2024-04-26T11:21:54.691993+0000","last_clean":"2024-04-26T11:21:54.691993+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:21:54.691993+0000","last_undegraded":"2024-04-26T11:21:54.691993+0000","last_fullsized":"2024-04-26T11:21:54.691993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.688099+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:21:53.688099+0000","last_peered":"2024-04-26T11:21:53.688099+0000","last_clean":"2024-04-26T11:21:53.688099+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:21:53.688099+0000","last_undegraded":"2024-04-26T11:21:53.688099+0000","last_fullsized":"2024-04-26T11:21:53.688099+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690179+0000","last_change":"2024-04-26T11:21:53.696563+0000","last_active":"2024-04-26T11:21:54.690179+0000","last_peered":"2024-04-26T11:21:54.690179+0000","last_clean":"2024-04-26T11:21:54.690179+0000","last_became_active":"2024-04-26T11:21:53.695678+0000","last_became_peered":"2024-04-26T11:21:53.695678+0000","last_unstale":"2024-04-26T11:21:54.690179+0000","last_undegraded":"2024-04-26T11:21:54.690179+0000","last_fullsized":"2024-04-26T11:21:54.690179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.692075+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:21:54.692075+0000","last_peered":"2024-04-26T11:21:54.692075+0000","last_clean":"2024-04-26T11:21:54.692075+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:21:54.692075+0000","last_undegraded":"2024-04-26T11:21:54.692075+0000","last_fullsized":"2024-04-26T11:21:54.692075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.684028+0000","last_change":"2024-04-26T11:21:49.292644+0000","last_active":"2024-04-26T11:21:53.684028+0000","last_peered":"2024-04-26T11:21:53.684028+0000","last_clean":"2024-04-26T11:21:53.684028+0000","last_became_active":"2024-04-26T11:21:49.291499+0000","last_became_peered":"2024-04-26T11:21:49.291499+0000","last_unstale":"2024-04-26T11:21:53.684028+0000","last_undegraded":"2024-04-26T11:21:53.684028+0000","last_fullsized":"2024-04-26T11:21:53.684028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689637+0000","last_change":"2024-04-26T11:21:53.705104+0000","last_active":"2024-04-26T11:21:54.689637+0000","last_peered":"2024-04-26T11:21:54.689637+0000","last_clean":"2024-04-26T11:21:54.689637+0000","last_became_active":"2024-04-26T11:21:53.704282+0000","last_became_peered":"2024-04-26T11:21:53.704282+0000","last_unstale":"2024-04-26T11:21:54.689637+0000","last_undegraded":"2024-04-26T11:21:54.689637+0000","last_fullsized":"2024-04-26T11:21:54.689637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:56.396012+0000","last_change":"2024-04-26T11:21:53.332815+0000","last_active":"2024-04-26T11:21:56.396012+0000","last_peered":"2024-04-26T11:21:56.396012+0000","last_clean":"2024-04-26T11:21:56.396012+0000","last_became_active":"2024-04-26T11:21:53.332020+0000","last_became_peered":"2024-04-26T11:21:53.332020+0000","last_unstale":"2024-04-26T11:21:56.396012+0000","last_undegraded":"2024-04-26T11:21:56.396012+0000","last_fullsized":"2024-04-26T11:21:56.396012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.700312+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:21:53.700312+0000","last_peered":"2024-04-26T11:21:53.700312+0000","last_clean":"2024-04-26T11:21:53.700312+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:21:53.700312+0000","last_undegraded":"2024-04-26T11:21:53.700312+0000","last_fullsized":"2024-04-26T11:21:53.700312+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689824+0000","last_change":"2024-04-26T11:21:53.696546+0000","last_active":"2024-04-26T11:21:54.689824+0000","last_peered":"2024-04-26T11:21:54.689824+0000","last_clean":"2024-04-26T11:21:54.689824+0000","last_became_active":"2024-04-26T11:21:53.695670+0000","last_became_peered":"2024-04-26T11:21:53.695670+0000","last_unstale":"2024-04-26T11:21:54.689824+0000","last_undegraded":"2024-04-26T11:21:54.689824+0000","last_fullsized":"2024-04-26T11:21:54.689824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658127+0000","last_change":"2024-04-26T11:21:53.703599+0000","last_active":"2024-04-26T11:21:55.658127+0000","last_peered":"2024-04-26T11:21:55.658127+0000","last_clean":"2024-04-26T11:21:55.658127+0000","last_became_active":"2024-04-26T11:21:53.702893+0000","last_became_peered":"2024-04-26T11:21:53.702893+0000","last_unstale":"2024-04-26T11:21:55.658127+0000","last_undegraded":"2024-04-26T11:21:55.658127+0000","last_fullsized":"2024-04-26T11:21:55.658127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659192+0000","last_change":"2024-04-26T11:21:53.340288+0000","last_active":"2024-04-26T11:21:55.659192+0000","last_peered":"2024-04-26T11:21:55.659192+0000","last_clean":"2024-04-26T11:21:55.659192+0000","last_became_active":"2024-04-26T11:21:53.339414+0000","last_became_peered":"2024-04-26T11:21:53.339414+0000","last_unstale":"2024-04-26T11:21:55.659192+0000","last_undegraded":"2024-04-26T11:21:55.659192+0000","last_fullsized":"2024-04-26T11:21:55.659192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689909+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:21:54.689909+0000","last_peered":"2024-04-26T11:21:54.689909+0000","last_clean":"2024-04-26T11:21:54.689909+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:21:54.689909+0000","last_undegraded":"2024-04-26T11:21:54.689909+0000","last_fullsized":"2024-04-26T11:21:54.689909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691341+0000","last_change":"2024-04-26T11:21:53.343465+0000","last_active":"2024-04-26T11:21:54.691341+0000","last_peered":"2024-04-26T11:21:54.691341+0000","last_clean":"2024-04-26T11:21:54.691341+0000","last_became_active":"2024-04-26T11:21:53.342882+0000","last_became_peered":"2024-04-26T11:21:53.342882+0000","last_unstale":"2024-04-26T11:21:54.691341+0000","last_undegraded":"2024-04-26T11:21:54.691341+0000","last_fullsized":"2024-04-26T11:21:54.691341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:41.508747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.660158+0000","last_change":"2024-04-26T11:21:53.344846+0000","last_active":"2024-04-26T11:21:55.660158+0000","last_peered":"2024-04-26T11:21:55.660158+0000","last_clean":"2024-04-26T11:21:55.660158+0000","last_became_active":"2024-04-26T11:21:53.342981+0000","last_became_peered":"2024-04-26T11:21:53.342981+0000","last_unstale":"2024-04-26T11:21:55.660158+0000","last_undegraded":"2024-04-26T11:21:55.660158+0000","last_fullsized":"2024-04-26T11:21:55.660158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689736+0000","last_change":"2024-04-26T11:21:53.706890+0000","last_active":"2024-04-26T11:21:54.689736+0000","last_peered":"2024-04-26T11:21:54.689736+0000","last_clean":"2024-04-26T11:21:54.689736+0000","last_became_active":"2024-04-26T11:21:53.705229+0000","last_became_peered":"2024-04-26T11:21:53.705229+0000","last_unstale":"2024-04-26T11:21:54.689736+0000","last_undegraded":"2024-04-26T11:21:54.689736+0000","last_fullsized":"2024-04-26T11:21:54.689736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691905+0000","last_change":"2024-04-26T11:21:53.334527+0000","last_active":"2024-04-26T11:21:54.691905+0000","last_peered":"2024-04-26T11:21:54.691905+0000","last_clean":"2024-04-26T11:21:54.691905+0000","last_became_active":"2024-04-26T11:21:53.332325+0000","last_became_peered":"2024-04-26T11:21:53.332325+0000","last_unstale":"2024-04-26T11:21:54.691905+0000","last_undegraded":"2024-04-26T11:21:54.691905+0000","last_fullsized":"2024-04-26T11:21:54.691905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689613+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:21:54.689613+0000","last_peered":"2024-04-26T11:21:54.689613+0000","last_clean":"2024-04-26T11:21:54.689613+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:21:54.689613+0000","last_undegraded":"2024-04-26T11:21:54.689613+0000","last_fullsized":"2024-04-26T11:21:54.689613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691804+0000","last_change":"2024-04-26T11:21:53.696949+0000","last_active":"2024-04-26T11:21:54.691804+0000","last_peered":"2024-04-26T11:21:54.691804+0000","last_clean":"2024-04-26T11:21:54.691804+0000","last_became_active":"2024-04-26T11:21:53.696068+0000","last_became_peered":"2024-04-26T11:21:53.696068+0000","last_unstale":"2024-04-26T11:21:54.691804+0000","last_undegraded":"2024-04-26T11:21:54.691804+0000","last_fullsized":"2024-04-26T11:21:54.691804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689833+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:21:54.689833+0000","last_peered":"2024-04-26T11:21:54.689833+0000","last_clean":"2024-04-26T11:21:54.689833+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:21:54.689833+0000","last_undegraded":"2024-04-26T11:21:54.689833+0000","last_fullsized":"2024-04-26T11:21:54.689833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691375+0000","last_change":"2024-04-26T11:21:53.710749+0000","last_active":"2024-04-26T11:21:54.691375+0000","last_peered":"2024-04-26T11:21:54.691375+0000","last_clean":"2024-04-26T11:21:54.691375+0000","last_became_active":"2024-04-26T11:21:53.707330+0000","last_became_peered":"2024-04-26T11:21:53.707330+0000","last_unstale":"2024-04-26T11:21:54.691375+0000","last_undegraded":"2024-04-26T11:21:54.691375+0000","last_fullsized":"2024-04-26T11:21:54.691375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690082+0000","last_change":"2024-04-26T11:21:53.334972+0000","last_active":"2024-04-26T11:21:54.690082+0000","last_peered":"2024-04-26T11:21:54.690082+0000","last_clean":"2024-04-26T11:21:54.690082+0000","last_became_active":"2024-04-26T11:21:53.332642+0000","last_became_peered":"2024-04-26T11:21:53.332642+0000","last_unstale":"2024-04-26T11:21:54.690082+0000","last_undegraded":"2024-04-26T11:21:54.690082+0000","last_fullsized":"2024-04-26T11:21:54.690082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691006+0000","last_change":"2024-04-26T11:21:53.709701+0000","last_active":"2024-04-26T11:21:54.691006+0000","last_peered":"2024-04-26T11:21:54.691006+0000","last_clean":"2024-04-26T11:21:54.691006+0000","last_became_active":"2024-04-26T11:21:53.708905+0000","last_became_peered":"2024-04-26T11:21:53.708905+0000","last_unstale":"2024-04-26T11:21:54.691006+0000","last_undegraded":"2024-04-26T11:21:54.691006+0000","last_fullsized":"2024-04-26T11:21:54.691006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691004+0000","last_change":"2024-04-26T11:21:53.330226+0000","last_active":"2024-04-26T11:21:54.691004+0000","last_peered":"2024-04-26T11:21:54.691004+0000","last_clean":"2024-04-26T11:21:54.691004+0000","last_became_active":"2024-04-26T11:21:53.329446+0000","last_became_peered":"2024-04-26T11:21:53.329446+0000","last_unstale":"2024-04-26T11:21:54.691004+0000","last_undegraded":"2024-04-26T11:21:54.691004+0000","last_fullsized":"2024-04-26T11:21:54.691004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:52.599214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691125+0000","last_change":"2024-04-26T11:21:53.716629+0000","last_active":"2024-04-26T11:21:54.691125+0000","last_peered":"2024-04-26T11:21:54.691125+0000","last_clean":"2024-04-26T11:21:54.691125+0000","last_became_active":"2024-04-26T11:21:53.714799+0000","last_became_peered":"2024-04-26T11:21:53.714799+0000","last_unstale":"2024-04-26T11:21:54.691125+0000","last_undegraded":"2024-04-26T11:21:54.691125+0000","last_fullsized":"2024-04-26T11:21:54.691125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:54.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690731+0000","last_change":"2024-04-26T11:21:53.343318+0000","last_active":"2024-04-26T11:21:54.690731+0000","last_peered":"2024-04-26T11:21:54.690731+0000","last_clean":"2024-04-26T11:21:54.690731+0000","last_became_active":"2024-04-26T11:21:53.342789+0000","last_became_peered":"2024-04-26T11:21:53.342789+0000","last_unstale":"2024-04-26T11:21:54.690731+0000","last_undegraded":"2024-04-26T11:21:54.690731+0000","last_fullsized":"2024-04-26T11:21:54.690731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657848+0000","last_change":"2024-04-26T11:21:53.715726+0000","last_active":"2024-04-26T11:21:55.657848+0000","last_peered":"2024-04-26T11:21:55.657848+0000","last_clean":"2024-04-26T11:21:55.657848+0000","last_became_active":"2024-04-26T11:21:53.715126+0000","last_became_peered":"2024-04-26T11:21:53.715126+0000","last_unstale":"2024-04-26T11:21:55.657848+0000","last_undegraded":"2024-04-26T11:21:55.657848+0000","last_fullsized":"2024-04-26T11:21:55.657848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659105+0000","last_change":"2024-04-26T11:21:53.343934+0000","last_active":"2024-04-26T11:21:55.659105+0000","last_peered":"2024-04-26T11:21:55.659105+0000","last_clean":"2024-04-26T11:21:55.659105+0000","last_became_active":"2024-04-26T11:21:53.342401+0000","last_became_peered":"2024-04-26T11:21:53.342401+0000","last_unstale":"2024-04-26T11:21:55.659105+0000","last_undegraded":"2024-04-26T11:21:55.659105+0000","last_fullsized":"2024-04-26T11:21:55.659105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658676+0000","last_change":"2024-04-26T11:21:53.713092+0000","last_active":"2024-04-26T11:21:55.658676+0000","last_peered":"2024-04-26T11:21:55.658676+0000","last_clean":"2024-04-26T11:21:55.658676+0000","last_became_active":"2024-04-26T11:21:53.712207+0000","last_became_peered":"2024-04-26T11:21:53.712207+0000","last_unstale":"2024-04-26T11:21:55.658676+0000","last_undegraded":"2024-04-26T11:21:55.658676+0000","last_fullsized":"2024-04-26T11:21:55.658676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691034+0000","last_change":"2024-04-26T11:21:53.345453+0000","last_active":"2024-04-26T11:21:54.691034+0000","last_peered":"2024-04-26T11:21:54.691034+0000","last_clean":"2024-04-26T11:21:54.691034+0000","last_became_active":"2024-04-26T11:21:53.344468+0000","last_became_peered":"2024-04-26T11:21:53.344468+0000","last_unstale":"2024-04-26T11:21:54.691034+0000","last_undegraded":"2024-04-26T11:21:54.691034+0000","last_fullsized":"2024-04-26T11:21:54.691034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.295739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690674+0000","last_change":"2024-04-26T11:21:53.712311+0000","last_active":"2024-04-26T11:21:54.690674+0000","last_peered":"2024-04-26T11:21:54.690674+0000","last_clean":"2024-04-26T11:21:54.690674+0000","last_became_active":"2024-04-26T11:21:53.711195+0000","last_became_peered":"2024-04-26T11:21:53.711195+0000","last_unstale":"2024-04-26T11:21:54.690674+0000","last_undegraded":"2024-04-26T11:21:54.690674+0000","last_fullsized":"2024-04-26T11:21:54.690674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:50.973181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691630+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:21:54.691630+0000","last_peered":"2024-04-26T11:21:54.691630+0000","last_clean":"2024-04-26T11:21:54.691630+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:21:54.691630+0000","last_undegraded":"2024-04-26T11:21:54.691630+0000","last_fullsized":"2024-04-26T11:21:54.691630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657705+0000","last_change":"2024-04-26T11:21:53.713610+0000","last_active":"2024-04-26T11:21:55.657705+0000","last_peered":"2024-04-26T11:21:55.657705+0000","last_clean":"2024-04-26T11:21:55.657705+0000","last_became_active":"2024-04-26T11:21:53.712396+0000","last_became_peered":"2024-04-26T11:21:53.712396+0000","last_unstale":"2024-04-26T11:21:55.657705+0000","last_undegraded":"2024-04-26T11:21:55.657705+0000","last_fullsized":"2024-04-26T11:21:55.657705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691634+0000","last_change":"2024-04-26T11:21:53.334939+0000","last_active":"2024-04-26T11:21:54.691634+0000","last_peered":"2024-04-26T11:21:54.691634+0000","last_clean":"2024-04-26T11:21:54.691634+0000","last_became_active":"2024-04-26T11:21:53.332735+0000","last_became_peered":"2024-04-26T11:21:53.332735+0000","last_unstale":"2024-04-26T11:21:54.691634+0000","last_undegraded":"2024-04-26T11:21:54.691634+0000","last_fullsized":"2024-04-26T11:21:54.691634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":647190,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":249856,"data_stored":647806,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:22:12.446 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:22:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:12.787 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:22:12.803 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-26T11:22:11.326247+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":85824,"kb_used_data":640,"kb_used_omap":4,"kb_used_meta":85115,"kb_avail":283029696,"statfs":{"total":289910292480,"available":289822408704,"internally_reserved":0,"allocated":655360,"data_stored":1350688,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":87158099},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003746"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691482+0000","last_change":"2024-04-26T11:21:53.713298+0000","last_active":"2024-04-26T11:21:54.691482+0000","last_peered":"2024-04-26T11:21:54.691482+0000","last_clean":"2024-04-26T11:21:54.691482+0000","last_became_active":"2024-04-26T11:21:53.712481+0000","last_became_peered":"2024-04-26T11:21:53.712481+0000","last_unstale":"2024-04-26T11:21:54.691482+0000","last_undegraded":"2024-04-26T11:21:54.691482+0000","last_fullsized":"2024-04-26T11:21:54.691482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691323+0000","last_change":"2024-04-26T11:21:53.716754+0000","last_active":"2024-04-26T11:21:54.691323+0000","last_peered":"2024-04-26T11:21:54.691323+0000","last_clean":"2024-04-26T11:21:54.691323+0000","last_became_active":"2024-04-26T11:21:53.716109+0000","last_became_peered":"2024-04-26T11:21:53.716109+0000","last_unstale":"2024-04-26T11:21:54.691323+0000","last_undegraded":"2024-04-26T11:21:54.691323+0000","last_fullsized":"2024-04-26T11:21:54.691323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658980+0000","last_change":"2024-04-26T11:21:53.710480+0000","last_active":"2024-04-26T11:21:55.658980+0000","last_peered":"2024-04-26T11:21:55.658980+0000","last_clean":"2024-04-26T11:21:55.658980+0000","last_became_active":"2024-04-26T11:21:53.709433+0000","last_became_peered":"2024-04-26T11:21:53.709433+0000","last_unstale":"2024-04-26T11:21:55.658980+0000","last_undegraded":"2024-04-26T11:21:55.658980+0000","last_fullsized":"2024-04-26T11:21:55.658980+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:11.687344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658399+0000","last_change":"2024-04-26T11:21:53.719849+0000","last_active":"2024-04-26T11:21:55.658399+0000","last_peered":"2024-04-26T11:21:55.658399+0000","last_clean":"2024-04-26T11:21:55.658399+0000","last_became_active":"2024-04-26T11:21:53.719152+0000","last_became_peered":"2024-04-26T11:21:53.719152+0000","last_unstale":"2024-04-26T11:21:55.658399+0000","last_undegraded":"2024-04-26T11:21:55.658399+0000","last_fullsized":"2024-04-26T11:21:55.658399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690467+0000","last_change":"2024-04-26T11:21:53.712493+0000","last_active":"2024-04-26T11:21:54.690467+0000","last_peered":"2024-04-26T11:21:54.690467+0000","last_clean":"2024-04-26T11:21:54.690467+0000","last_became_active":"2024-04-26T11:21:53.711704+0000","last_became_peered":"2024-04-26T11:21:53.711704+0000","last_unstale":"2024-04-26T11:21:54.690467+0000","last_undegraded":"2024-04-26T11:21:54.690467+0000","last_fullsized":"2024-04-26T11:21:54.690467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657707+0000","last_change":"2024-04-26T11:21:53.715149+0000","last_active":"2024-04-26T11:21:55.657707+0000","last_peered":"2024-04-26T11:21:55.657707+0000","last_clean":"2024-04-26T11:21:55.657707+0000","last_became_active":"2024-04-26T11:21:53.714125+0000","last_became_peered":"2024-04-26T11:21:53.714125+0000","last_unstale":"2024-04-26T11:21:55.657707+0000","last_undegraded":"2024-04-26T11:21:55.657707+0000","last_fullsized":"2024-04-26T11:21:55.657707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657112+0000","last_change":"2024-04-26T11:21:53.714653+0000","last_active":"2024-04-26T11:21:55.657112+0000","last_peered":"2024-04-26T11:21:55.657112+0000","last_clean":"2024-04-26T11:21:55.657112+0000","last_became_active":"2024-04-26T11:21:53.713586+0000","last_became_peered":"2024-04-26T11:21:53.713586+0000","last_unstale":"2024-04-26T11:21:55.657112+0000","last_undegraded":"2024-04-26T11:21:55.657112+0000","last_fullsized":"2024-04-26T11:21:55.657112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:01.563026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657099+0000","last_change":"2024-04-26T11:21:53.715422+0000","last_active":"2024-04-26T11:21:55.657099+0000","last_peered":"2024-04-26T11:21:55.657099+0000","last_clean":"2024-04-26T11:21:55.657099+0000","last_became_active":"2024-04-26T11:21:53.714329+0000","last_became_peered":"2024-04-26T11:21:53.714329+0000","last_unstale":"2024-04-26T11:21:55.657099+0000","last_undegraded":"2024-04-26T11:21:55.657099+0000","last_fullsized":"2024-04-26T11:21:55.657099+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:06.981197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691270+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:21:54.691270+0000","last_peered":"2024-04-26T11:21:54.691270+0000","last_clean":"2024-04-26T11:21:54.691270+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:21:54.691270+0000","last_undegraded":"2024-04-26T11:21:54.691270+0000","last_fullsized":"2024-04-26T11:21:54.691270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691299+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:21:54.691299+0000","last_peered":"2024-04-26T11:21:54.691299+0000","last_clean":"2024-04-26T11:21:54.691299+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:21:54.691299+0000","last_undegraded":"2024-04-26T11:21:54.691299+0000","last_fullsized":"2024-04-26T11:21:54.691299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658964+0000","last_change":"2024-04-26T11:21:53.714245+0000","last_active":"2024-04-26T11:21:55.658964+0000","last_peered":"2024-04-26T11:21:55.658964+0000","last_clean":"2024-04-26T11:21:55.658964+0000","last_became_active":"2024-04-26T11:21:53.713331+0000","last_became_peered":"2024-04-26T11:21:53.713331+0000","last_unstale":"2024-04-26T11:21:55.658964+0000","last_undegraded":"2024-04-26T11:21:55.658964+0000","last_fullsized":"2024-04-26T11:21:55.658964+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690847+0000","last_change":"2024-04-26T11:21:53.712269+0000","last_active":"2024-04-26T11:21:54.690847+0000","last_peered":"2024-04-26T11:21:54.690847+0000","last_clean":"2024-04-26T11:21:54.690847+0000","last_became_active":"2024-04-26T11:21:53.710740+0000","last_became_peered":"2024-04-26T11:21:53.710740+0000","last_unstale":"2024-04-26T11:21:54.690847+0000","last_undegraded":"2024-04-26T11:21:54.690847+0000","last_fullsized":"2024-04-26T11:21:54.690847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690903+0000","last_change":"2024-04-26T11:21:53.712552+0000","last_active":"2024-04-26T11:21:54.690903+0000","last_peered":"2024-04-26T11:21:54.690903+0000","last_clean":"2024-04-26T11:21:54.690903+0000","last_became_active":"2024-04-26T11:21:53.711470+0000","last_became_peered":"2024-04-26T11:21:53.711470+0000","last_unstale":"2024-04-26T11:21:54.690903+0000","last_undegraded":"2024-04-26T11:21:54.690903+0000","last_fullsized":"2024-04-26T11:21:54.690903+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657972+0000","last_change":"2024-04-26T11:21:53.705872+0000","last_active":"2024-04-26T11:21:55.657972+0000","last_peered":"2024-04-26T11:21:55.657972+0000","last_clean":"2024-04-26T11:21:55.657972+0000","last_became_active":"2024-04-26T11:21:53.705040+0000","last_became_peered":"2024-04-26T11:21:53.705040+0000","last_unstale":"2024-04-26T11:21:55.657972+0000","last_undegraded":"2024-04-26T11:21:55.657972+0000","last_fullsized":"2024-04-26T11:21:55.657972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:02.015153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657316+0000","last_change":"2024-04-26T11:21:53.707324+0000","last_active":"2024-04-26T11:21:55.657316+0000","last_peered":"2024-04-26T11:21:55.657316+0000","last_clean":"2024-04-26T11:21:55.657316+0000","last_became_active":"2024-04-26T11:21:53.706602+0000","last_became_peered":"2024-04-26T11:21:53.706602+0000","last_unstale":"2024-04-26T11:21:55.657316+0000","last_undegraded":"2024-04-26T11:21:55.657316+0000","last_fullsized":"2024-04-26T11:21:55.657316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.907498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657115+0000","last_change":"2024-04-26T11:21:53.714327+0000","last_active":"2024-04-26T11:21:55.657115+0000","last_peered":"2024-04-26T11:21:55.657115+0000","last_clean":"2024-04-26T11:21:55.657115+0000","last_became_active":"2024-04-26T11:21:53.712908+0000","last_became_peered":"2024-04-26T11:21:53.712908+0000","last_unstale":"2024-04-26T11:21:55.657115+0000","last_undegraded":"2024-04-26T11:21:55.657115+0000","last_fullsized":"2024-04-26T11:21:55.657115+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:31.158881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691927+0000","last_change":"2024-04-26T11:21:53.713524+0000","last_active":"2024-04-26T11:21:54.691927+0000","last_peered":"2024-04-26T11:21:54.691927+0000","last_clean":"2024-04-26T11:21:54.691927+0000","last_became_active":"2024-04-26T11:21:53.710675+0000","last_became_peered":"2024-04-26T11:21:53.710675+0000","last_unstale":"2024-04-26T11:21:54.691927+0000","last_undegraded":"2024-04-26T11:21:54.691927+0000","last_fullsized":"2024-04-26T11:21:54.691927+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691739+0000","last_change":"2024-04-26T11:21:53.714983+0000","last_active":"2024-04-26T11:21:54.691739+0000","last_peered":"2024-04-26T11:21:54.691739+0000","last_clean":"2024-04-26T11:21:54.691739+0000","last_became_active":"2024-04-26T11:21:53.711987+0000","last_became_peered":"2024-04-26T11:21:53.711987+0000","last_unstale":"2024-04-26T11:21:54.691739+0000","last_undegraded":"2024-04-26T11:21:54.691739+0000","last_fullsized":"2024-04-26T11:21:54.691739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:49.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691059+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:21:54.691059+0000","last_peered":"2024-04-26T11:21:54.691059+0000","last_clean":"2024-04-26T11:21:54.691059+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:21:54.691059+0000","last_undegraded":"2024-04-26T11:21:54.691059+0000","last_fullsized":"2024-04-26T11:21:54.691059+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658842+0000","last_change":"2024-04-26T11:21:53.715255+0000","last_active":"2024-04-26T11:21:55.658842+0000","last_peered":"2024-04-26T11:21:55.658842+0000","last_clean":"2024-04-26T11:21:55.658842+0000","last_became_active":"2024-04-26T11:21:53.714525+0000","last_became_peered":"2024-04-26T11:21:53.714525+0000","last_unstale":"2024-04-26T11:21:55.658842+0000","last_undegraded":"2024-04-26T11:21:55.658842+0000","last_fullsized":"2024-04-26T11:21:55.658842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658215+0000","last_change":"2024-04-26T11:21:53.714368+0000","last_active":"2024-04-26T11:21:55.658215+0000","last_peered":"2024-04-26T11:21:55.658215+0000","last_clean":"2024-04-26T11:21:55.658215+0000","last_became_active":"2024-04-26T11:21:53.713099+0000","last_became_peered":"2024-04-26T11:21:53.713099+0000","last_unstale":"2024-04-26T11:21:55.658215+0000","last_undegraded":"2024-04-26T11:21:55.658215+0000","last_fullsized":"2024-04-26T11:21:55.658215+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689959+0000","last_change":"2024-04-26T11:21:53.709697+0000","last_active":"2024-04-26T11:21:54.689959+0000","last_peered":"2024-04-26T11:21:54.689959+0000","last_clean":"2024-04-26T11:21:54.689959+0000","last_became_active":"2024-04-26T11:21:53.708839+0000","last_became_peered":"2024-04-26T11:21:53.708839+0000","last_unstale":"2024-04-26T11:21:54.689959+0000","last_undegraded":"2024-04-26T11:21:54.689959+0000","last_fullsized":"2024-04-26T11:21:54.689959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689490+0000","last_change":"2024-04-26T11:21:53.705071+0000","last_active":"2024-04-26T11:21:54.689490+0000","last_peered":"2024-04-26T11:21:54.689490+0000","last_clean":"2024-04-26T11:21:54.689490+0000","last_became_active":"2024-04-26T11:21:53.704331+0000","last_became_peered":"2024-04-26T11:21:53.704331+0000","last_unstale":"2024-04-26T11:21:54.689490+0000","last_undegraded":"2024-04-26T11:21:54.689490+0000","last_fullsized":"2024-04-26T11:21:54.689490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689441+0000","last_change":"2024-04-26T11:21:53.692834+0000","last_active":"2024-04-26T11:21:54.689441+0000","last_peered":"2024-04-26T11:21:54.689441+0000","last_clean":"2024-04-26T11:21:54.689441+0000","last_became_active":"2024-04-26T11:21:53.690279+0000","last_became_peered":"2024-04-26T11:21:53.690279+0000","last_unstale":"2024-04-26T11:21:54.689441+0000","last_undegraded":"2024-04-26T11:21:54.689441+0000","last_fullsized":"2024-04-26T11:21:54.689441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691605+0000","last_change":"2024-04-26T11:21:53.698796+0000","last_active":"2024-04-26T11:21:54.691605+0000","last_peered":"2024-04-26T11:21:54.691605+0000","last_clean":"2024-04-26T11:21:54.691605+0000","last_became_active":"2024-04-26T11:21:53.697854+0000","last_became_peered":"2024-04-26T11:21:53.697854+0000","last_unstale":"2024-04-26T11:21:54.691605+0000","last_undegraded":"2024-04-26T11:21:54.691605+0000","last_fullsized":"2024-04-26T11:21:54.691605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691288+0000","last_change":"2024-04-26T11:21:53.706583+0000","last_active":"2024-04-26T11:21:54.691288+0000","last_peered":"2024-04-26T11:21:54.691288+0000","last_clean":"2024-04-26T11:21:54.691288+0000","last_became_active":"2024-04-26T11:21:53.704871+0000","last_became_peered":"2024-04-26T11:21:53.704871+0000","last_unstale":"2024-04-26T11:21:54.691288+0000","last_undegraded":"2024-04-26T11:21:54.691288+0000","last_fullsized":"2024-04-26T11:21:54.691288+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659254+0000","last_change":"2024-04-26T11:21:53.709813+0000","last_active":"2024-04-26T11:21:55.659254+0000","last_peered":"2024-04-26T11:21:55.659254+0000","last_clean":"2024-04-26T11:21:55.659254+0000","last_became_active":"2024-04-26T11:21:53.708399+0000","last_became_peered":"2024-04-26T11:21:53.708399+0000","last_unstale":"2024-04-26T11:21:55.659254+0000","last_undegraded":"2024-04-26T11:21:55.659254+0000","last_fullsized":"2024-04-26T11:21:55.659254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:36.298230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691745+0000","last_change":"2024-04-26T11:21:53.710195+0000","last_active":"2024-04-26T11:21:54.691745+0000","last_peered":"2024-04-26T11:21:54.691745+0000","last_clean":"2024-04-26T11:21:54.691745+0000","last_became_active":"2024-04-26T11:21:53.709660+0000","last_became_peered":"2024-04-26T11:21:53.709660+0000","last_unstale":"2024-04-26T11:21:54.691745+0000","last_undegraded":"2024-04-26T11:21:54.691745+0000","last_fullsized":"2024-04-26T11:21:54.691745+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691147+0000","last_change":"2024-04-26T11:21:53.703397+0000","last_active":"2024-04-26T11:21:54.691147+0000","last_peered":"2024-04-26T11:21:54.691147+0000","last_clean":"2024-04-26T11:21:54.691147+0000","last_became_active":"2024-04-26T11:21:53.701822+0000","last_became_peered":"2024-04-26T11:21:53.701822+0000","last_unstale":"2024-04-26T11:21:54.691147+0000","last_undegraded":"2024-04-26T11:21:54.691147+0000","last_fullsized":"2024-04-26T11:21:54.691147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690777+0000","last_change":"2024-04-26T11:21:53.709264+0000","last_active":"2024-04-26T11:21:54.690777+0000","last_peered":"2024-04-26T11:21:54.690777+0000","last_clean":"2024-04-26T11:21:54.690777+0000","last_became_active":"2024-04-26T11:21:53.708529+0000","last_became_peered":"2024-04-26T11:21:53.708529+0000","last_unstale":"2024-04-26T11:21:54.690777+0000","last_undegraded":"2024-04-26T11:21:54.690777+0000","last_fullsized":"2024-04-26T11:21:54.690777+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689662+0000","last_change":"2024-04-26T11:21:53.710899+0000","last_active":"2024-04-26T11:21:54.689662+0000","last_peered":"2024-04-26T11:21:54.689662+0000","last_clean":"2024-04-26T11:21:54.689662+0000","last_became_active":"2024-04-26T11:21:53.710185+0000","last_became_peered":"2024-04-26T11:21:53.710185+0000","last_unstale":"2024-04-26T11:21:54.689662+0000","last_undegraded":"2024-04-26T11:21:54.689662+0000","last_fullsized":"2024-04-26T11:21:54.689662+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657645+0000","last_change":"2024-04-26T11:21:53.708939+0000","last_active":"2024-04-26T11:21:55.657645+0000","last_peered":"2024-04-26T11:21:55.657645+0000","last_clean":"2024-04-26T11:21:55.657645+0000","last_became_active":"2024-04-26T11:21:53.708120+0000","last_became_peered":"2024-04-26T11:21:53.708120+0000","last_unstale":"2024-04-26T11:21:55.657645+0000","last_undegraded":"2024-04-26T11:21:55.657645+0000","last_fullsized":"2024-04-26T11:21:55.657645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691370+0000","last_change":"2024-04-26T11:21:53.712919+0000","last_active":"2024-04-26T11:21:54.691370+0000","last_peered":"2024-04-26T11:21:54.691370+0000","last_clean":"2024-04-26T11:21:54.691370+0000","last_became_active":"2024-04-26T11:21:53.710798+0000","last_became_peered":"2024-04-26T11:21:53.710798+0000","last_unstale":"2024-04-26T11:21:54.691370+0000","last_undegraded":"2024-04-26T11:21:54.691370+0000","last_fullsized":"2024-04-26T11:21:54.691370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658532+0000","last_change":"2024-04-26T11:21:53.343931+0000","last_active":"2024-04-26T11:21:55.658532+0000","last_peered":"2024-04-26T11:21:55.658532+0000","last_clean":"2024-04-26T11:21:55.658532+0000","last_became_active":"2024-04-26T11:21:53.342363+0000","last_became_peered":"2024-04-26T11:21:53.342363+0000","last_unstale":"2024-04-26T11:21:55.658532+0000","last_undegraded":"2024-04-26T11:21:55.658532+0000","last_fullsized":"2024-04-26T11:21:55.658532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690797+0000","last_change":"2024-04-26T11:21:53.712613+0000","last_active":"2024-04-26T11:21:54.690797+0000","last_peered":"2024-04-26T11:21:54.690797+0000","last_clean":"2024-04-26T11:21:54.690797+0000","last_became_active":"2024-04-26T11:21:53.711848+0000","last_became_peered":"2024-04-26T11:21:53.711848+0000","last_unstale":"2024-04-26T11:21:54.690797+0000","last_undegraded":"2024-04-26T11:21:54.690797+0000","last_fullsized":"2024-04-26T11:21:54.690797+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:49.327612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690156+0000","last_change":"2024-04-26T11:21:53.333005+0000","last_active":"2024-04-26T11:21:54.690156+0000","last_peered":"2024-04-26T11:21:54.690156+0000","last_clean":"2024-04-26T11:21:54.690156+0000","last_became_active":"2024-04-26T11:21:53.332191+0000","last_became_peered":"2024-04-26T11:21:53.332191+0000","last_unstale":"2024-04-26T11:21:54.690156+0000","last_undegraded":"2024-04-26T11:21:54.690156+0000","last_fullsized":"2024-04-26T11:21:54.690156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691758+0000","last_change":"2024-04-26T11:21:53.707848+0000","last_active":"2024-04-26T11:21:54.691758+0000","last_peered":"2024-04-26T11:21:54.691758+0000","last_clean":"2024-04-26T11:21:54.691758+0000","last_became_active":"2024-04-26T11:21:53.706222+0000","last_became_peered":"2024-04-26T11:21:53.706222+0000","last_unstale":"2024-04-26T11:21:54.691758+0000","last_undegraded":"2024-04-26T11:21:54.691758+0000","last_fullsized":"2024-04-26T11:21:54.691758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691063+0000","last_change":"2024-04-26T11:21:53.341523+0000","last_active":"2024-04-26T11:21:54.691063+0000","last_peered":"2024-04-26T11:21:54.691063+0000","last_clean":"2024-04-26T11:21:54.691063+0000","last_became_active":"2024-04-26T11:21:53.340545+0000","last_became_peered":"2024-04-26T11:21:53.340545+0000","last_unstale":"2024-04-26T11:21:54.691063+0000","last_undegraded":"2024-04-26T11:21:54.691063+0000","last_fullsized":"2024-04-26T11:21:54.691063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.907675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691390+0000","last_change":"2024-04-26T11:21:53.706879+0000","last_active":"2024-04-26T11:21:54.691390+0000","last_peered":"2024-04-26T11:21:54.691390+0000","last_clean":"2024-04-26T11:21:54.691390+0000","last_became_active":"2024-04-26T11:21:53.705082+0000","last_became_peered":"2024-04-26T11:21:53.705082+0000","last_unstale":"2024-04-26T11:21:54.691390+0000","last_undegraded":"2024-04-26T11:21:54.691390+0000","last_fullsized":"2024-04-26T11:21:54.691390+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657400+0000","last_change":"2024-04-26T11:21:53.341655+0000","last_active":"2024-04-26T11:21:55.657400+0000","last_peered":"2024-04-26T11:21:55.657400+0000","last_clean":"2024-04-26T11:21:55.657400+0000","last_became_active":"2024-04-26T11:21:53.340085+0000","last_became_peered":"2024-04-26T11:21:53.340085+0000","last_unstale":"2024-04-26T11:21:55.657400+0000","last_undegraded":"2024-04-26T11:21:55.657400+0000","last_fullsized":"2024-04-26T11:21:55.657400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659421+0000","last_change":"2024-04-26T11:21:53.340063+0000","last_active":"2024-04-26T11:21:55.659421+0000","last_peered":"2024-04-26T11:21:55.659421+0000","last_clean":"2024-04-26T11:21:55.659421+0000","last_became_active":"2024-04-26T11:21:53.339256+0000","last_became_peered":"2024-04-26T11:21:53.339256+0000","last_unstale":"2024-04-26T11:21:55.659421+0000","last_undegraded":"2024-04-26T11:21:55.659421+0000","last_fullsized":"2024-04-26T11:21:55.659421+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689561+0000","last_change":"2024-04-26T11:21:53.697700+0000","last_active":"2024-04-26T11:21:54.689561+0000","last_peered":"2024-04-26T11:21:54.689561+0000","last_clean":"2024-04-26T11:21:54.689561+0000","last_became_active":"2024-04-26T11:21:53.696789+0000","last_became_peered":"2024-04-26T11:21:53.696789+0000","last_unstale":"2024-04-26T11:21:54.689561+0000","last_undegraded":"2024-04-26T11:21:54.689561+0000","last_fullsized":"2024-04-26T11:21:54.689561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691980+0000","last_change":"2024-04-26T11:21:53.341302+0000","last_active":"2024-04-26T11:21:54.691980+0000","last_peered":"2024-04-26T11:21:54.691980+0000","last_clean":"2024-04-26T11:21:54.691980+0000","last_became_active":"2024-04-26T11:21:53.340509+0000","last_became_peered":"2024-04-26T11:21:53.340509+0000","last_unstale":"2024-04-26T11:21:54.691980+0000","last_undegraded":"2024-04-26T11:21:54.691980+0000","last_fullsized":"2024-04-26T11:21:54.691980+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:16.781849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689756+0000","last_change":"2024-04-26T11:21:53.716075+0000","last_active":"2024-04-26T11:21:54.689756+0000","last_peered":"2024-04-26T11:21:54.689756+0000","last_clean":"2024-04-26T11:21:54.689756+0000","last_became_active":"2024-04-26T11:21:53.714328+0000","last_became_peered":"2024-04-26T11:21:53.714328+0000","last_unstale":"2024-04-26T11:21:54.689756+0000","last_undegraded":"2024-04-26T11:21:54.689756+0000","last_fullsized":"2024-04-26T11:21:54.689756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:54.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659565+0000","last_change":"2024-04-26T11:21:53.339171+0000","last_active":"2024-04-26T11:21:55.659565+0000","last_peered":"2024-04-26T11:21:55.659565+0000","last_clean":"2024-04-26T11:21:55.659565+0000","last_became_active":"2024-04-26T11:21:53.337433+0000","last_became_peered":"2024-04-26T11:21:53.337433+0000","last_unstale":"2024-04-26T11:21:55.659565+0000","last_undegraded":"2024-04-26T11:21:55.659565+0000","last_fullsized":"2024-04-26T11:21:55.659565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658299+0000","last_change":"2024-04-26T11:21:53.719666+0000","last_active":"2024-04-26T11:21:55.658299+0000","last_peered":"2024-04-26T11:21:55.658299+0000","last_clean":"2024-04-26T11:21:55.658299+0000","last_became_active":"2024-04-26T11:21:53.718871+0000","last_became_peered":"2024-04-26T11:21:53.718871+0000","last_unstale":"2024-04-26T11:21:55.658299+0000","last_undegraded":"2024-04-26T11:21:55.658299+0000","last_fullsized":"2024-04-26T11:21:55.658299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659351+0000","last_change":"2024-04-26T11:21:53.344744+0000","last_active":"2024-04-26T11:21:55.659351+0000","last_peered":"2024-04-26T11:21:55.659351+0000","last_clean":"2024-04-26T11:21:55.659351+0000","last_became_active":"2024-04-26T11:21:53.344055+0000","last_became_peered":"2024-04-26T11:21:53.344055+0000","last_unstale":"2024-04-26T11:21:55.659351+0000","last_undegraded":"2024-04-26T11:21:55.659351+0000","last_fullsized":"2024-04-26T11:21:55.659351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690681+0000","last_change":"2024-04-26T11:21:53.709563+0000","last_active":"2024-04-26T11:21:54.690681+0000","last_peered":"2024-04-26T11:21:54.690681+0000","last_clean":"2024-04-26T11:21:54.690681+0000","last_became_active":"2024-04-26T11:21:53.706598+0000","last_became_peered":"2024-04-26T11:21:53.706598+0000","last_unstale":"2024-04-26T11:21:54.690681+0000","last_undegraded":"2024-04-26T11:21:54.690681+0000","last_fullsized":"2024-04-26T11:21:54.690681+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691180+0000","last_change":"2024-04-26T11:21:53.330145+0000","last_active":"2024-04-26T11:21:54.691180+0000","last_peered":"2024-04-26T11:21:54.691180+0000","last_clean":"2024-04-26T11:21:54.691180+0000","last_became_active":"2024-04-26T11:21:53.329256+0000","last_became_peered":"2024-04-26T11:21:53.329256+0000","last_unstale":"2024-04-26T11:21:54.691180+0000","last_undegraded":"2024-04-26T11:21:54.691180+0000","last_fullsized":"2024-04-26T11:21:54.691180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658841+0000","last_change":"2024-04-26T11:21:53.715233+0000","last_active":"2024-04-26T11:21:55.658841+0000","last_peered":"2024-04-26T11:21:55.658841+0000","last_clean":"2024-04-26T11:21:55.658841+0000","last_became_active":"2024-04-26T11:21:53.714405+0000","last_became_peered":"2024-04-26T11:21:53.714405+0000","last_unstale":"2024-04-26T11:21:55.658841+0000","last_undegraded":"2024-04-26T11:21:55.658841+0000","last_fullsized":"2024-04-26T11:21:55.658841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659404+0000","last_change":"2024-04-26T11:21:53.344659+0000","last_active":"2024-04-26T11:21:55.659404+0000","last_peered":"2024-04-26T11:21:55.659404+0000","last_clean":"2024-04-26T11:21:55.659404+0000","last_became_active":"2024-04-26T11:21:53.344024+0000","last_became_peered":"2024-04-26T11:21:53.344024+0000","last_unstale":"2024-04-26T11:21:55.659404+0000","last_undegraded":"2024-04-26T11:21:55.659404+0000","last_fullsized":"2024-04-26T11:21:55.659404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:53.053244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659429+0000","last_change":"2024-04-26T11:21:53.710093+0000","last_active":"2024-04-26T11:21:55.659429+0000","last_peered":"2024-04-26T11:21:55.659429+0000","last_clean":"2024-04-26T11:21:55.659429+0000","last_became_active":"2024-04-26T11:21:53.709020+0000","last_became_peered":"2024-04-26T11:21:53.709020+0000","last_unstale":"2024-04-26T11:21:55.659429+0000","last_undegraded":"2024-04-26T11:21:55.659429+0000","last_fullsized":"2024-04-26T11:21:55.659429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690297+0000","last_change":"2024-04-26T11:21:53.341961+0000","last_active":"2024-04-26T11:21:54.690297+0000","last_peered":"2024-04-26T11:21:54.690297+0000","last_clean":"2024-04-26T11:21:54.690297+0000","last_became_active":"2024-04-26T11:21:53.340768+0000","last_became_peered":"2024-04-26T11:21:53.340768+0000","last_unstale":"2024-04-26T11:21:54.690297+0000","last_undegraded":"2024-04-26T11:21:54.690297+0000","last_fullsized":"2024-04-26T11:21:54.690297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659841+0000","last_change":"2024-04-26T11:21:53.706161+0000","last_active":"2024-04-26T11:21:55.659841+0000","last_peered":"2024-04-26T11:21:55.659841+0000","last_clean":"2024-04-26T11:21:55.659841+0000","last_became_active":"2024-04-26T11:21:53.705388+0000","last_became_peered":"2024-04-26T11:21:53.705388+0000","last_unstale":"2024-04-26T11:21:55.659841+0000","last_undegraded":"2024-04-26T11:21:55.659841+0000","last_fullsized":"2024-04-26T11:21:55.659841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690017+0000","last_change":"2024-04-26T11:21:53.328489+0000","last_active":"2024-04-26T11:21:54.690017+0000","last_peered":"2024-04-26T11:21:54.690017+0000","last_clean":"2024-04-26T11:21:54.690017+0000","last_became_active":"2024-04-26T11:21:53.327836+0000","last_became_peered":"2024-04-26T11:21:53.327836+0000","last_unstale":"2024-04-26T11:21:54.690017+0000","last_undegraded":"2024-04-26T11:21:54.690017+0000","last_fullsized":"2024-04-26T11:21:54.690017+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:32.644217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691473+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:21:54.691473+0000","last_peered":"2024-04-26T11:21:54.691473+0000","last_clean":"2024-04-26T11:21:54.691473+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:21:54.691473+0000","last_undegraded":"2024-04-26T11:21:54.691473+0000","last_fullsized":"2024-04-26T11:21:54.691473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693986+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:21:53.693986+0000","last_peered":"2024-04-26T11:21:53.693986+0000","last_clean":"2024-04-26T11:21:53.693986+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:21:53.693986+0000","last_undegraded":"2024-04-26T11:21:53.693986+0000","last_fullsized":"2024-04-26T11:21:53.693986+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694913+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:21:53.694913+0000","last_peered":"2024-04-26T11:21:53.694913+0000","last_clean":"2024-04-26T11:21:53.694913+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:21:53.694913+0000","last_undegraded":"2024-04-26T11:21:53.694913+0000","last_fullsized":"2024-04-26T11:21:53.694913+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690419+0000","last_change":"2024-04-26T11:21:53.326934+0000","last_active":"2024-04-26T11:21:54.690419+0000","last_peered":"2024-04-26T11:21:54.690419+0000","last_clean":"2024-04-26T11:21:54.690419+0000","last_became_active":"2024-04-26T11:21:53.325342+0000","last_became_peered":"2024-04-26T11:21:53.325342+0000","last_unstale":"2024-04-26T11:21:54.690419+0000","last_undegraded":"2024-04-26T11:21:54.690419+0000","last_fullsized":"2024-04-26T11:21:54.690419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659521+0000","last_change":"2024-04-26T11:21:53.709499+0000","last_active":"2024-04-26T11:21:55.659521+0000","last_peered":"2024-04-26T11:21:55.659521+0000","last_clean":"2024-04-26T11:21:55.659521+0000","last_became_active":"2024-04-26T11:21:53.707573+0000","last_became_peered":"2024-04-26T11:21:53.707573+0000","last_unstale":"2024-04-26T11:21:55.659521+0000","last_undegraded":"2024-04-26T11:21:55.659521+0000","last_fullsized":"2024-04-26T11:21:55.659521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.693364+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:21:53.693364+0000","last_peered":"2024-04-26T11:21:53.693364+0000","last_clean":"2024-04-26T11:21:53.693364+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:21:53.693364+0000","last_undegraded":"2024-04-26T11:21:53.693364+0000","last_fullsized":"2024-04-26T11:21:53.693364+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690244+0000","last_change":"2024-04-26T11:21:53.330362+0000","last_active":"2024-04-26T11:21:54.690244+0000","last_peered":"2024-04-26T11:21:54.690244+0000","last_clean":"2024-04-26T11:21:54.690244+0000","last_became_active":"2024-04-26T11:21:53.329383+0000","last_became_peered":"2024-04-26T11:21:53.329383+0000","last_unstale":"2024-04-26T11:21:54.690244+0000","last_undegraded":"2024-04-26T11:21:54.690244+0000","last_fullsized":"2024-04-26T11:21:54.690244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691659+0000","last_change":"2024-04-26T11:21:53.716469+0000","last_active":"2024-04-26T11:21:54.691659+0000","last_peered":"2024-04-26T11:21:54.691659+0000","last_clean":"2024-04-26T11:21:54.691659+0000","last_became_active":"2024-04-26T11:21:53.715684+0000","last_became_peered":"2024-04-26T11:21:53.715684+0000","last_unstale":"2024-04-26T11:21:54.691659+0000","last_undegraded":"2024-04-26T11:21:54.691659+0000","last_fullsized":"2024-04-26T11:21:54.691659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.683688+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:21:53.683688+0000","last_peered":"2024-04-26T11:21:53.683688+0000","last_clean":"2024-04-26T11:21:53.683688+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:21:53.683688+0000","last_undegraded":"2024-04-26T11:21:53.683688+0000","last_fullsized":"2024-04-26T11:21:53.683688+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689798+0000","last_change":"2024-04-26T11:21:53.345743+0000","last_active":"2024-04-26T11:21:54.689798+0000","last_peered":"2024-04-26T11:21:54.689798+0000","last_clean":"2024-04-26T11:21:54.689798+0000","last_became_active":"2024-04-26T11:21:53.344967+0000","last_became_peered":"2024-04-26T11:21:53.344967+0000","last_unstale":"2024-04-26T11:21:54.689798+0000","last_undegraded":"2024-04-26T11:21:54.689798+0000","last_fullsized":"2024-04-26T11:21:54.689798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:08.280572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691663+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:21:54.691663+0000","last_peered":"2024-04-26T11:21:54.691663+0000","last_clean":"2024-04-26T11:21:54.691663+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:21:54.691663+0000","last_undegraded":"2024-04-26T11:21:54.691663+0000","last_fullsized":"2024-04-26T11:21:54.691663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.694282+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:21:53.694282+0000","last_peered":"2024-04-26T11:21:53.694282+0000","last_clean":"2024-04-26T11:21:53.694282+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:21:53.694282+0000","last_undegraded":"2024-04-26T11:21:53.694282+0000","last_fullsized":"2024-04-26T11:21:53.694282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658670+0000","last_change":"2024-04-26T11:21:53.338037+0000","last_active":"2024-04-26T11:21:55.658670+0000","last_peered":"2024-04-26T11:21:55.658670+0000","last_clean":"2024-04-26T11:21:55.658670+0000","last_became_active":"2024-04-26T11:21:53.337004+0000","last_became_peered":"2024-04-26T11:21:53.337004+0000","last_unstale":"2024-04-26T11:21:55.658670+0000","last_undegraded":"2024-04-26T11:21:55.658670+0000","last_fullsized":"2024-04-26T11:21:55.658670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691854+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:21:54.691854+0000","last_peered":"2024-04-26T11:21:54.691854+0000","last_clean":"2024-04-26T11:21:54.691854+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:21:54.691854+0000","last_undegraded":"2024-04-26T11:21:54.691854+0000","last_fullsized":"2024-04-26T11:21:54.691854+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659642+0000","last_change":"2024-04-26T11:21:53.337312+0000","last_active":"2024-04-26T11:21:55.659642+0000","last_peered":"2024-04-26T11:21:55.659642+0000","last_clean":"2024-04-26T11:21:55.659642+0000","last_became_active":"2024-04-26T11:21:53.336587+0000","last_became_peered":"2024-04-26T11:21:53.336587+0000","last_unstale":"2024-04-26T11:21:55.659642+0000","last_undegraded":"2024-04-26T11:21:55.659642+0000","last_fullsized":"2024-04-26T11:21:55.659642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.681538+0000","last_change":"2024-04-26T11:21:49.292007+0000","last_active":"2024-04-26T11:21:53.681538+0000","last_peered":"2024-04-26T11:21:53.681538+0000","last_clean":"2024-04-26T11:21:53.681538+0000","last_became_active":"2024-04-26T11:21:49.291100+0000","last_became_peered":"2024-04-26T11:21:49.291100+0000","last_unstale":"2024-04-26T11:21:53.681538+0000","last_undegraded":"2024-04-26T11:21:53.681538+0000","last_fullsized":"2024-04-26T11:21:53.681538+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:43.877516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690182+0000","last_change":"2024-04-26T11:21:53.697386+0000","last_active":"2024-04-26T11:21:54.690182+0000","last_peered":"2024-04-26T11:21:54.690182+0000","last_clean":"2024-04-26T11:21:54.690182+0000","last_became_active":"2024-04-26T11:21:53.695847+0000","last_became_peered":"2024-04-26T11:21:53.695847+0000","last_unstale":"2024-04-26T11:21:54.690182+0000","last_undegraded":"2024-04-26T11:21:54.690182+0000","last_fullsized":"2024-04-26T11:21:54.690182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691993+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:21:54.691993+0000","last_peered":"2024-04-26T11:21:54.691993+0000","last_clean":"2024-04-26T11:21:54.691993+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:21:54.691993+0000","last_undegraded":"2024-04-26T11:21:54.691993+0000","last_fullsized":"2024-04-26T11:21:54.691993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.688099+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:21:53.688099+0000","last_peered":"2024-04-26T11:21:53.688099+0000","last_clean":"2024-04-26T11:21:53.688099+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:21:53.688099+0000","last_undegraded":"2024-04-26T11:21:53.688099+0000","last_fullsized":"2024-04-26T11:21:53.688099+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690179+0000","last_change":"2024-04-26T11:21:53.696563+0000","last_active":"2024-04-26T11:21:54.690179+0000","last_peered":"2024-04-26T11:21:54.690179+0000","last_clean":"2024-04-26T11:21:54.690179+0000","last_became_active":"2024-04-26T11:21:53.695678+0000","last_became_peered":"2024-04-26T11:21:53.695678+0000","last_unstale":"2024-04-26T11:21:54.690179+0000","last_undegraded":"2024-04-26T11:21:54.690179+0000","last_fullsized":"2024-04-26T11:21:54.690179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.692075+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:21:54.692075+0000","last_peered":"2024-04-26T11:21:54.692075+0000","last_clean":"2024-04-26T11:21:54.692075+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:21:54.692075+0000","last_undegraded":"2024-04-26T11:21:54.692075+0000","last_fullsized":"2024-04-26T11:21:54.692075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.684028+0000","last_change":"2024-04-26T11:21:49.292644+0000","last_active":"2024-04-26T11:21:53.684028+0000","last_peered":"2024-04-26T11:21:53.684028+0000","last_clean":"2024-04-26T11:21:53.684028+0000","last_became_active":"2024-04-26T11:21:49.291499+0000","last_became_peered":"2024-04-26T11:21:49.291499+0000","last_unstale":"2024-04-26T11:21:53.684028+0000","last_undegraded":"2024-04-26T11:21:53.684028+0000","last_fullsized":"2024-04-26T11:21:53.684028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689637+0000","last_change":"2024-04-26T11:21:53.705104+0000","last_active":"2024-04-26T11:21:54.689637+0000","last_peered":"2024-04-26T11:21:54.689637+0000","last_clean":"2024-04-26T11:21:54.689637+0000","last_became_active":"2024-04-26T11:21:53.704282+0000","last_became_peered":"2024-04-26T11:21:53.704282+0000","last_unstale":"2024-04-26T11:21:54.689637+0000","last_undegraded":"2024-04-26T11:21:54.689637+0000","last_fullsized":"2024-04-26T11:21:54.689637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:56.396012+0000","last_change":"2024-04-26T11:21:53.332815+0000","last_active":"2024-04-26T11:21:56.396012+0000","last_peered":"2024-04-26T11:21:56.396012+0000","last_clean":"2024-04-26T11:21:56.396012+0000","last_became_active":"2024-04-26T11:21:53.332020+0000","last_became_peered":"2024-04-26T11:21:53.332020+0000","last_unstale":"2024-04-26T11:21:56.396012+0000","last_undegraded":"2024-04-26T11:21:56.396012+0000","last_fullsized":"2024-04-26T11:21:56.396012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T11:21:53.700312+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:21:53.700312+0000","last_peered":"2024-04-26T11:21:53.700312+0000","last_clean":"2024-04-26T11:21:53.700312+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:21:53.700312+0000","last_undegraded":"2024-04-26T11:21:53.700312+0000","last_fullsized":"2024-04-26T11:21:53.700312+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689824+0000","last_change":"2024-04-26T11:21:53.696546+0000","last_active":"2024-04-26T11:21:54.689824+0000","last_peered":"2024-04-26T11:21:54.689824+0000","last_clean":"2024-04-26T11:21:54.689824+0000","last_became_active":"2024-04-26T11:21:53.695670+0000","last_became_peered":"2024-04-26T11:21:53.695670+0000","last_unstale":"2024-04-26T11:21:54.689824+0000","last_undegraded":"2024-04-26T11:21:54.689824+0000","last_fullsized":"2024-04-26T11:21:54.689824+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658127+0000","last_change":"2024-04-26T11:21:53.703599+0000","last_active":"2024-04-26T11:21:55.658127+0000","last_peered":"2024-04-26T11:21:55.658127+0000","last_clean":"2024-04-26T11:21:55.658127+0000","last_became_active":"2024-04-26T11:21:53.702893+0000","last_became_peered":"2024-04-26T11:21:53.702893+0000","last_unstale":"2024-04-26T11:21:55.658127+0000","last_undegraded":"2024-04-26T11:21:55.658127+0000","last_fullsized":"2024-04-26T11:21:55.658127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659192+0000","last_change":"2024-04-26T11:21:53.340288+0000","last_active":"2024-04-26T11:21:55.659192+0000","last_peered":"2024-04-26T11:21:55.659192+0000","last_clean":"2024-04-26T11:21:55.659192+0000","last_became_active":"2024-04-26T11:21:53.339414+0000","last_became_peered":"2024-04-26T11:21:53.339414+0000","last_unstale":"2024-04-26T11:21:55.659192+0000","last_undegraded":"2024-04-26T11:21:55.659192+0000","last_fullsized":"2024-04-26T11:21:55.659192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689909+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:21:54.689909+0000","last_peered":"2024-04-26T11:21:54.689909+0000","last_clean":"2024-04-26T11:21:54.689909+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:21:54.689909+0000","last_undegraded":"2024-04-26T11:21:54.689909+0000","last_fullsized":"2024-04-26T11:21:54.689909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691341+0000","last_change":"2024-04-26T11:21:53.343465+0000","last_active":"2024-04-26T11:21:54.691341+0000","last_peered":"2024-04-26T11:21:54.691341+0000","last_clean":"2024-04-26T11:21:54.691341+0000","last_became_active":"2024-04-26T11:21:53.342882+0000","last_became_peered":"2024-04-26T11:21:53.342882+0000","last_unstale":"2024-04-26T11:21:54.691341+0000","last_undegraded":"2024-04-26T11:21:54.691341+0000","last_fullsized":"2024-04-26T11:21:54.691341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:41.508747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.660158+0000","last_change":"2024-04-26T11:21:53.344846+0000","last_active":"2024-04-26T11:21:55.660158+0000","last_peered":"2024-04-26T11:21:55.660158+0000","last_clean":"2024-04-26T11:21:55.660158+0000","last_became_active":"2024-04-26T11:21:53.342981+0000","last_became_peered":"2024-04-26T11:21:53.342981+0000","last_unstale":"2024-04-26T11:21:55.660158+0000","last_undegraded":"2024-04-26T11:21:55.660158+0000","last_fullsized":"2024-04-26T11:21:55.660158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689736+0000","last_change":"2024-04-26T11:21:53.706890+0000","last_active":"2024-04-26T11:21:54.689736+0000","last_peered":"2024-04-26T11:21:54.689736+0000","last_clean":"2024-04-26T11:21:54.689736+0000","last_became_active":"2024-04-26T11:21:53.705229+0000","last_became_peered":"2024-04-26T11:21:53.705229+0000","last_unstale":"2024-04-26T11:21:54.689736+0000","last_undegraded":"2024-04-26T11:21:54.689736+0000","last_fullsized":"2024-04-26T11:21:54.689736+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691905+0000","last_change":"2024-04-26T11:21:53.334527+0000","last_active":"2024-04-26T11:21:54.691905+0000","last_peered":"2024-04-26T11:21:54.691905+0000","last_clean":"2024-04-26T11:21:54.691905+0000","last_became_active":"2024-04-26T11:21:53.332325+0000","last_became_peered":"2024-04-26T11:21:53.332325+0000","last_unstale":"2024-04-26T11:21:54.691905+0000","last_undegraded":"2024-04-26T11:21:54.691905+0000","last_fullsized":"2024-04-26T11:21:54.691905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689613+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:21:54.689613+0000","last_peered":"2024-04-26T11:21:54.689613+0000","last_clean":"2024-04-26T11:21:54.689613+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:21:54.689613+0000","last_undegraded":"2024-04-26T11:21:54.689613+0000","last_fullsized":"2024-04-26T11:21:54.689613+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691804+0000","last_change":"2024-04-26T11:21:53.696949+0000","last_active":"2024-04-26T11:21:54.691804+0000","last_peered":"2024-04-26T11:21:54.691804+0000","last_clean":"2024-04-26T11:21:54.691804+0000","last_became_active":"2024-04-26T11:21:53.696068+0000","last_became_peered":"2024-04-26T11:21:53.696068+0000","last_unstale":"2024-04-26T11:21:54.691804+0000","last_undegraded":"2024-04-26T11:21:54.691804+0000","last_fullsized":"2024-04-26T11:21:54.691804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.689833+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:21:54.689833+0000","last_peered":"2024-04-26T11:21:54.689833+0000","last_clean":"2024-04-26T11:21:54.689833+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:21:54.689833+0000","last_undegraded":"2024-04-26T11:21:54.689833+0000","last_fullsized":"2024-04-26T11:21:54.689833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691375+0000","last_change":"2024-04-26T11:21:53.710749+0000","last_active":"2024-04-26T11:21:54.691375+0000","last_peered":"2024-04-26T11:21:54.691375+0000","last_clean":"2024-04-26T11:21:54.691375+0000","last_became_active":"2024-04-26T11:21:53.707330+0000","last_became_peered":"2024-04-26T11:21:53.707330+0000","last_unstale":"2024-04-26T11:21:54.691375+0000","last_undegraded":"2024-04-26T11:21:54.691375+0000","last_fullsized":"2024-04-26T11:21:54.691375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690082+0000","last_change":"2024-04-26T11:21:53.334972+0000","last_active":"2024-04-26T11:21:54.690082+0000","last_peered":"2024-04-26T11:21:54.690082+0000","last_clean":"2024-04-26T11:21:54.690082+0000","last_became_active":"2024-04-26T11:21:53.332642+0000","last_became_peered":"2024-04-26T11:21:53.332642+0000","last_unstale":"2024-04-26T11:21:54.690082+0000","last_undegraded":"2024-04-26T11:21:54.690082+0000","last_fullsized":"2024-04-26T11:21:54.690082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691006+0000","last_change":"2024-04-26T11:21:53.709701+0000","last_active":"2024-04-26T11:21:54.691006+0000","last_peered":"2024-04-26T11:21:54.691006+0000","last_clean":"2024-04-26T11:21:54.691006+0000","last_became_active":"2024-04-26T11:21:53.708905+0000","last_became_peered":"2024-04-26T11:21:53.708905+0000","last_unstale":"2024-04-26T11:21:54.691006+0000","last_undegraded":"2024-04-26T11:21:54.691006+0000","last_fullsized":"2024-04-26T11:21:54.691006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691004+0000","last_change":"2024-04-26T11:21:53.330226+0000","last_active":"2024-04-26T11:21:54.691004+0000","last_peered":"2024-04-26T11:21:54.691004+0000","last_clean":"2024-04-26T11:21:54.691004+0000","last_became_active":"2024-04-26T11:21:53.329446+0000","last_became_peered":"2024-04-26T11:21:53.329446+0000","last_unstale":"2024-04-26T11:21:54.691004+0000","last_undegraded":"2024-04-26T11:21:54.691004+0000","last_fullsized":"2024-04-26T11:21:54.691004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:52.599214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691125+0000","last_change":"2024-04-26T11:21:53.716629+0000","last_active":"2024-04-26T11:21:54.691125+0000","last_peered":"2024-04-26T11:21:54.691125+0000","last_clean":"2024-04-26T11:21:54.691125+0000","last_became_active":"2024-04-26T11:21:53.714799+0000","last_became_peered":"2024-04-26T11:21:53.714799+0000","last_unstale":"2024-04-26T11:21:54.691125+0000","last_undegraded":"2024-04-26T11:21:54.691125+0000","last_fullsized":"2024-04-26T11:21:54.691125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:54.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690731+0000","last_change":"2024-04-26T11:21:53.343318+0000","last_active":"2024-04-26T11:21:54.690731+0000","last_peered":"2024-04-26T11:21:54.690731+0000","last_clean":"2024-04-26T11:21:54.690731+0000","last_became_active":"2024-04-26T11:21:53.342789+0000","last_became_peered":"2024-04-26T11:21:53.342789+0000","last_unstale":"2024-04-26T11:21:54.690731+0000","last_undegraded":"2024-04-26T11:21:54.690731+0000","last_fullsized":"2024-04-26T11:21:54.690731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657848+0000","last_change":"2024-04-26T11:21:53.715726+0000","last_active":"2024-04-26T11:21:55.657848+0000","last_peered":"2024-04-26T11:21:55.657848+0000","last_clean":"2024-04-26T11:21:55.657848+0000","last_became_active":"2024-04-26T11:21:53.715126+0000","last_became_peered":"2024-04-26T11:21:53.715126+0000","last_unstale":"2024-04-26T11:21:55.657848+0000","last_undegraded":"2024-04-26T11:21:55.657848+0000","last_fullsized":"2024-04-26T11:21:55.657848+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.659105+0000","last_change":"2024-04-26T11:21:53.343934+0000","last_active":"2024-04-26T11:21:55.659105+0000","last_peered":"2024-04-26T11:21:55.659105+0000","last_clean":"2024-04-26T11:21:55.659105+0000","last_became_active":"2024-04-26T11:21:53.342401+0000","last_became_peered":"2024-04-26T11:21:53.342401+0000","last_unstale":"2024-04-26T11:21:55.659105+0000","last_undegraded":"2024-04-26T11:21:55.659105+0000","last_fullsized":"2024-04-26T11:21:55.659105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.658676+0000","last_change":"2024-04-26T11:21:53.713092+0000","last_active":"2024-04-26T11:21:55.658676+0000","last_peered":"2024-04-26T11:21:55.658676+0000","last_clean":"2024-04-26T11:21:55.658676+0000","last_became_active":"2024-04-26T11:21:53.712207+0000","last_became_peered":"2024-04-26T11:21:53.712207+0000","last_unstale":"2024-04-26T11:21:55.658676+0000","last_undegraded":"2024-04-26T11:21:55.658676+0000","last_fullsized":"2024-04-26T11:21:55.658676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691034+0000","last_change":"2024-04-26T11:21:53.345453+0000","last_active":"2024-04-26T11:21:54.691034+0000","last_peered":"2024-04-26T11:21:54.691034+0000","last_clean":"2024-04-26T11:21:54.691034+0000","last_became_active":"2024-04-26T11:21:53.344468+0000","last_became_peered":"2024-04-26T11:21:53.344468+0000","last_unstale":"2024-04-26T11:21:54.691034+0000","last_undegraded":"2024-04-26T11:21:54.691034+0000","last_fullsized":"2024-04-26T11:21:54.691034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.295739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.690674+0000","last_change":"2024-04-26T11:21:53.712311+0000","last_active":"2024-04-26T11:21:54.690674+0000","last_peered":"2024-04-26T11:21:54.690674+0000","last_clean":"2024-04-26T11:21:54.690674+0000","last_became_active":"2024-04-26T11:21:53.711195+0000","last_became_peered":"2024-04-26T11:21:53.711195+0000","last_unstale":"2024-04-26T11:21:54.690674+0000","last_undegraded":"2024-04-26T11:21:54.690674+0000","last_fullsized":"2024-04-26T11:21:54.690674+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:50.973181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691630+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:21:54.691630+0000","last_peered":"2024-04-26T11:21:54.691630+0000","last_clean":"2024-04-26T11:21:54.691630+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:21:54.691630+0000","last_undegraded":"2024-04-26T11:21:54.691630+0000","last_fullsized":"2024-04-26T11:21:54.691630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:55.657705+0000","last_change":"2024-04-26T11:21:53.713610+0000","last_active":"2024-04-26T11:21:55.657705+0000","last_peered":"2024-04-26T11:21:55.657705+0000","last_clean":"2024-04-26T11:21:55.657705+0000","last_became_active":"2024-04-26T11:21:53.712396+0000","last_became_peered":"2024-04-26T11:21:53.712396+0000","last_unstale":"2024-04-26T11:21:55.657705+0000","last_undegraded":"2024-04-26T11:21:55.657705+0000","last_fullsized":"2024-04-26T11:21:55.657705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T11:21:54.691634+0000","last_change":"2024-04-26T11:21:53.334939+0000","last_active":"2024-04-26T11:21:54.691634+0000","last_peered":"2024-04-26T11:21:54.691634+0000","last_clean":"2024-04-26T11:21:54.691634+0000","last_became_active":"2024-04-26T11:21:53.332735+0000","last_became_peered":"2024-04-26T11:21:53.332735+0000","last_unstale":"2024-04-26T11:21:54.691634+0000","last_undegraded":"2024-04-26T11:21:54.691634+0000","last_fullsized":"2024-04-26T11:21:54.691634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":163840,"data_stored":55692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":647190,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":249856,"data_stored":647806,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:22:12.807 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T11:22:12.808 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T11:22:13.145 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 18 2024-04-26T11:22:13.145 INFO:teuthology.orchestra.run.smithi073.stdout:fsid ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4 2024-04-26T11:22:13.145 INFO:teuthology.orchestra.run.smithi073.stdout:created 2024-04-26T11:21:32.561072+0000 2024-04-26T11:22:13.145 INFO:teuthology.orchestra.run.smithi073.stdout:modified 2024-04-26T11:21:54.674778+0000 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:crush_version 4 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:full_ratio 0.95 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:backfillfull_ratio 0.9 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:nearfull_ratio 0.85 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:require_min_compat_client luminous 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:min_compat_client jewel 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:require_osd_release reef 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:stretch_mode_enabled false 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 11 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-26T11:22:13.146 INFO:teuthology.orchestra.run.smithi073.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-26T11:22:13.147 INFO:teuthology.orchestra.run.smithi073.stdout:max_osd 3 2024-04-26T11:22:13.147 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6800/21480,v1:172.21.15.88:6801/21480] [v2:172.21.15.88:6802/21480,v1:172.21.15.88:6803/21480] exists,up 8b4f67c6-5cab-46bf-b296-34fcc29c7766 2024-04-26T11:22:13.147 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6800/21474,v1:172.21.15.107:6801/21474] [v2:172.21.15.107:6802/21474,v1:172.21.15.107:6803/21474] exists,up d465bcda-9e32-469e-82f3-077db852411e 2024-04-26T11:22:13.147 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/21537,v1:172.21.15.175:6801/21537] [v2:172.21.15.175:6802/21537,v1:172.21.15.175:6803/21537] exists,up 61e99173-e480-4da1-a95b-d98715c3e713 2024-04-26T11:22:13.164 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.88:6800/21480,v1:172.21.15.88:6801/21480] [v2:172.21.15.88:6802/21480,v1:172.21.15.88:6803/21480] exists,up 8b4f67c6-5cab-46bf-b296-34fcc29c7766', 'osd.1 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.107:6800/21474,v1:172.21.15.107:6801/21474] [v2:172.21.15.107:6802/21474,v1:172.21.15.107:6803/21474] exists,up d465bcda-9e32-469e-82f3-077db852411e', 'osd.2 up in weight 1 up_from 8 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/21537,v1:172.21.15.175:6801/21537] [v2:172.21.15.175:6802/21537,v1:172.21.15.175:6803/21537] exists,up 61e99173-e480-4da1-a95b-d98715c3e713'] 2024-04-26T11:22:13.165 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T11:22:13.277 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-26T11:22:13.277 INFO:teuthology.orchestra.run.smithi073.stdout: "name": "mon.a", 2024-04-26T11:22:13.277 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster": "ceph", 2024-04-26T11:22:13.277 INFO:teuthology.orchestra.run.smithi073.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "admin_socket_mode": "", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_client_required": "cephx, none", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_cluster_required": "cephx", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_debug": "true", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_service_required": "cephx", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "auth_supported": "cephx", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio": "true", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T11:22:13.278 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_aio_reap_max": "16", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_async_discard": "false", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_block_size": "4096", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio": "false", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_enable_discard": "false", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_flock_retry": "3", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_inject_crash": "0", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring": "false", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring_hipri": "false", 2024-04-26T11:22:13.279 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bdev_type": "", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_allocator": "hybrid", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_buffered_io": "true", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T11:22:13.280 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_replay_recovery": "false", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_sync_write": "false", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_allocator": "hybrid", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T11:22:13.281 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_create": "true", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_create": "false", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_path": "", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_db_size": "0", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_path": "", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_size": "107374182400", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_create": "false", 2024-04-26T11:22:13.282 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_path": "", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs": "true", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_autotune": "true", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T11:22:13.283 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size": "0", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_type": "2q", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_clone_cow": "true", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T11:22:13.284 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_mode": "none", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_freelist": "false", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T11:22:13.285 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T11:22:13.286 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fail_eio": "false", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T11:22:13.287 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size": "0", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T11:22:13.288 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T11:22:13.289 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_spdk_mem": "512", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_tracing": "false", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T11:22:13.290 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T11:22:13.291 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_cluster_require_version": "2", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_require_signatures": "false", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_require_version": "2", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_service_require_signatures": "false", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_service_require_version": "2", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "cephx_sign_messages": "true", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "chdir": "", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "client_acl_type": "", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "client_asio_thread_count": "2", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "client_cache_mid": "0.750000", 2024-04-26T11:22:13.292 INFO:teuthology.orchestra.run.smithi073.stdout: "client_cache_size": "16384", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_caps_release_delay": "5", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_check_pool_perm": "true", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_force_sync_read": "false", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_getattr_caps": "false", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_die_on_failed_remount": "false", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_dirsize_rbytes": "true", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_force_lazyio": "false", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_fs": "", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_inject_release_failure": "false", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_max_inline_size": "4096", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T11:22:13.293 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mds_namespace": "", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_metadata": "", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_gid": "-1", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_timeout": "300", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mount_uid": "-1", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_mountpoint": "/", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_notify_timeout": "10", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc": "true", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_max_objects": "1000", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_size": "209715200", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_permissions": "true", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_quota": "true", 2024-04-26T11:22:13.294 INFO:teuthology.orchestra.run.smithi073.stdout: "client_quota_df": "true", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_max_bytes": "0", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_max_periods": "4", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "client_readahead_min": "131072", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "client_reconnect_stale": "false", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "client_shutdown_timeout": "30", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "client_snapdir": ".snap", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "client_tick_interval": "1", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "client_trace": "", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "client_use_faked_inos": "false", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "client_use_random_mds": "false", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog": "false", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_graylog_port": "12201", 2024-04-26T11:22:13.295 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_monitors": "default=true", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog": "false", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "clog_to_syslog_level": "info", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "-", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_network": "", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_network_interface": "", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_isal": "false", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_level": "5", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "compressor_zstd_level": "1", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T11:22:13.296 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "crimson_seastar_smp": "1", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location": "", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location_hook": "", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_location_hook_timeout": "10", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "daemonize": "false", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "daos_pool": "tank", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_alienstore": "0/5", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asok": "1/5", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asok_assert_abort": "false", 2024-04-26T11:22:13.297 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_auth": "20/20", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bdev": "1/3", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bluefs": "1/5", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_bluestore": "1/5", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_buffer": "0/1", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cephsqlite": "0/5", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_client": "0/5", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_compressor": "1/5", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_context": "0/1", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_crush": "1/1", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_crypto": "1/5", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_cyanstore": "0/5", 2024-04-26T11:22:13.298 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_dpdk": "1/5", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_eventtrace": "1/5", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_filer": "0/1", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_filestore": "1/3", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_finisher": "1/1", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_fuse": "1/5", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_javaclient": "1/5", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_journal": "1/3", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_journaler": "0/5", 2024-04-26T11:22:13.299 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_kstore": "1/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_leveldb": "4/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_lockdep": "0/1", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mclock": "1/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds": "1/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_balancer": "1/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_locker": "1/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_log": "1/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mds_migrator": "1/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_memstore": "1/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mgr": "2/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mgrc": "1/5", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_mon": "20/20", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_monc": "0/10", 2024-04-26T11:22:13.300 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_ms": "1/1", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_none": "0/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objclass": "0/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objectcacher": "0/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_objecter": "0/1", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_optracker": "0/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_osd": "1/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_paxos": "20/20", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_perfcounter": "1/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_prioritycache": "1/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rados": "0/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd": "0/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rbd_replay": "0/5", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_refs": "0/0", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_reserver": "1/1", 2024-04-26T11:22:13.301 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw": "1/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_access": "1/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_flight": "1/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rgw_sync": "1/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_rocksdb": "4/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore": "0/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_backref": "0/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_cache": "0/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_device": "0/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_epm": "0/5", 2024-04-26T11:22:13.302 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_journal": "0/5", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_lba": "0/5", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_odata": "0/5", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_omap": "0/5", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_onode": "0/5", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_t": "0/5", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_seastore_tm": "0/5", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_striper": "0/1", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_test": "0/5", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_throttle": "1/1", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_timer": "0/1", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "debug_tp": "0/5", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T11:22:13.303 INFO:teuthology.orchestra.run.smithi073.stdout: "device_failure_prediction_mode": "none", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_graylog": "false", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_journald": "false", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_stderr": "true", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "err_to_syslog": "false", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "event_tracing": "false", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_http_port": "9926", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_prio_limit": "5", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_sort_metrics": "true", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "exporter_stats_period": "5", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "fake_statfs_for_testing": "0", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "fatal_signal_handlers": "true", 2024-04-26T11:22:13.304 INFO:teuthology.orchestra.run.smithi073.stdout: "filer_max_purge_ops": "10", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filer_max_truncate_ops": "128", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_blackhole": "false", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_btrfs_snap": "true", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_caller_concurrency": "10", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_omap_check": "false", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_debug_verify_split": "false", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_dump_file": "", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T11:22:13.305 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fadvise": "true", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fail_eio": "true", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fd_cache_size": "128", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fiemap": "false", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_inject_stall": "0", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_parallel": "false", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_trailing": "false", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_journal_writeahead": "false", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_kill_at": "0", 2024-04-26T11:22:13.306 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T11:22:13.307 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_merge_threshold": "-10", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_odsync_write": "false", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_backend_path": "", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_op_threads": "2", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_punch_hole": "false", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T11:22:13.308 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_queue_max_ops": "50", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_seek_data_hole": "false", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_sloppy_crc": "false", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_splice": "false", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_split_multiple": "2", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_split_rand_factor": "20", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_update_to": "1000", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T11:22:13.309 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_xfs_extsize": "false", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "filestore_zfs_snap": "false", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "fio_dir": "/tmp/fio", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4", 2024-04-26T11:22:13.310 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_allow_other": "true", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_big_writes": "true", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_debug": "false", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_default_permissions": "false", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_disable_pagecache": "false", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_max_write": "0", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_multithreaded": "true", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_require_active_mds": "true", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_set_user_groups": "true", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_move": "true", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_read": "true", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_splice_write": "true", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T11:22:13.311 INFO:teuthology.orchestra.run.smithi073.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "gss_target_name": "ceph", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_file": "", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_inject_failure": "0", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_interval": "5", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "host": "smithi073", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T11:22:13.312 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "inject_early_sigterm": "false", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "jaeger_agent_port": "6799", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "jaeger_tracing_enable": "false", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_aio": "true", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_align_min_size": "65536", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_block_align": "true", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_block_size": "4096", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_dio": "true", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_discard": "false", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_force_aio": "false", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_ignore_corruption": "false", 2024-04-26T11:22:13.313 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_max_write_entries": "100", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_replay_from": "0", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_write_header_frequency": "0", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "journal_zero_on_create": "false", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_prefetch_periods": "10", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_prezero_periods": "5", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "journaler_write_head_interval": "15", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "key": "", 2024-04-26T11:22:13.314 INFO:teuthology.orchestra.run.smithi073.stdout: "keyfile": "", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_backend": "rocksdb", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_max_bytes": "67108864", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_max_ops": "512", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_onode_map_size": "1024", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "kstore_sync_transaction": "false", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_block_size": "65536", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_bloom_size": "0", 2024-04-26T11:22:13.315 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_cache_size": "536870912", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_compact_on_mount": "false", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_compression": "false", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_log": "", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_max_open_files": "0", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_paranoid": "false", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "librados_thread_count": "2", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "lockdep": "false", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "lockdep_force_backtrace": "false", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "log_coarse_timestamps": "true", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "log_flush_on_exit": "false", 2024-04-26T11:22:13.316 INFO:teuthology.orchestra.run.smithi073.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_graylog_port": "12201", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_max_new": "1000", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_max_recent": "10000", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_stderr_prefix": "", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_file": "true", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_graylog": "false", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_journald": "false", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_stderr": "false", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "log_to_syslog": "false", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_action_on_write_error": "1", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_alternate_name_max": "8192", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_asio_thread_count": "2", 2024-04-26T11:22:13.317 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_export_pin": "true", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_interval": "10", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_max": "-1", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_max_until": "-1", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_merge_size": "50", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T11:22:13.318 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_mode": "0", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_bits": "3", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_size": "10000", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T11:22:13.319 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_mid": "0.700000", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_interval": "1", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T11:22:13.320 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_auth_pins": "false", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_frag": "false", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_scatterstat": "false", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_debug_subtrees": "false", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_default_dir_hash": "2", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_defer_session_stale": "true", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_max_entries": "0", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dir_prefetch": "true", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T11:22:13.321 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_early_reply": "true", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_enable_op_tracker": "true", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_enforce_unique_name": "true", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T11:22:13.322 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_health_dummy": "false", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_join_fs": "", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_journal_format": "1", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_create_at": "0", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_export_at": "0", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_import_at": "0", 2024-04-26T11:22:13.323 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_at": "0", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_link_at": "0", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_openc_at": "0", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_rename_at": "0", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_max_events": "-1", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_max_segments": "128", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_pause": "false", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_segment_size": "0", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T11:22:13.324 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_completed_requests": "100000", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_export_size": "20971520", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_file_recover": "32", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_files": "64", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_ops": "8192", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_metrics_update_interval": "2", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_min_caps_per_client": "100", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_numa_node": "-1", 2024-04-26T11:22:13.325 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_duration": "600", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_size": "20", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_op_log_threshold": "5", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_ping_grace": "15", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_ping_interval": "5", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_caps": "30000", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T11:22:13.326 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_replay_interval": "1.000000", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_root_ino_gid": "0", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_root_ino_uid": "0", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T11:22:13.327 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_shutdown_check": "0", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_skip_ino": "0", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_min_uid": "0", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_snap_rstat": "false", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_symlink_recovery": "true", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_thrash_exports": "0", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_thrash_fragments": "0", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_tick_interval": "5.000000", 2024-04-26T11:22:13.328 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_valgrind_exit": "false", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_verify_backtrace": "1", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_verify_scatter": "false", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_wipe_sessions": "false", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool_debug": "false", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_page_set": "false", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "memstore_page_size": "65536", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_bytes": "134217728", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_messages": "512", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T11:22:13.329 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_disabled_modules": "", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mds_messages": "128", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_mon_messages": "128", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_osd_messages": "8192", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_pool": "true", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_standby_modules": "true", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_stats_period": "5", 2024-04-26T11:22:13.330 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_stats_threshold": "5", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_tick_period": "2", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_allow_pool_delete": "true", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_bytes": "104857600", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T11:22:13.331 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T11:22:13.332 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_start": "false", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_compact_on_trim": "true", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_cpu_threads": "4", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_avail_crit": "5", 2024-04-26T11:22:13.333 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_avail_warn": "5", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_json": "false", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_extra_checks": "false", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_quincy": "false", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T11:22:13.334 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_election_default_strategy": "1", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_election_timeout": "5.000000", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_enable_op_tracker": "true", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_fake_pool_delete": "false", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_force_quorum_join": "false", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_log_update_period": "5", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_max_detail": "50", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog": "true", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T11:22:13.335 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_host": "172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790],[v2:172.21.15.73:3302,v1:172.21.15.73:6791]", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_host_override": "", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_initial_members": "", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease": "5.000000", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_full_interval": "50", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_max": "10000", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_log_max_summary": "50", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_log_epochs": "500", 2024-04-26T11:22:13.336 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_osd": "10000", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_memory_autotune": "true", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_memory_target": "2147483648", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_digest_period": "5", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T11:22:13.337 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_complaint_time": "30", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_duration": "600", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_size": "20", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_op_log_threshold": "5", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T11:22:13.338 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_cache_size": "500", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T11:22:13.339 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_report_timeout": "900", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T11:22:13.340 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_max_osds": "4", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T11:22:13.341 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_interval": "86400", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_max_keys": "100", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_scrub_timeout": "300", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_session_timeout": "300", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_smart_report_timeout": "5", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_pool_size": "4", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T11:22:13.342 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_debug": "false", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_tick_interval": "5", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T11:22:13.343 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_older_version": "true", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T11:22:13.344 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "monmap": "", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "motr_tracing_enabled": "false", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_op_threads": "3", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_cm": "false", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_device_name": "", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T11:22:13.345 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_sl": "3", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_rdma_type": "ib", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_async_reap_threshold": "5", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_before_connect": "false", 2024-04-26T11:22:13.346 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_ipv4": "true", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_ipv6": "false", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_msgr1": "true", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_msgr2": "true", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_port_max": "7568", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_port_min": "6800", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_retry_count": "3", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_bind_retry_delay": "5", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_client": "false", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mds": "false", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mgr": "false", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_mon": "false", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_blackhole_osd": "false", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_client_mode": "crc secure", 2024-04-26T11:22:13.347 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_cluster_type": "", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_compress_secure": "false", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_crc_data": "true", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_crc_header": "true", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_bug": "true", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_old_message": "true", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T11:22:13.348 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hugepages": "", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_lro": "true", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_pmd": "", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_port_id": "0", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_dump_on_send": "false", 2024-04-26T11:22:13.349 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_delay_type": "", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_network_congestion": "0", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_inject_socket_failures": "0", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_max_accept_failures": "4", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_max_backoff": "15.000000", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T11:22:13.350 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compress_mode": "none", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_pq_min_cost": "65536", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_public_type": "", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_service_mode": "crc secure", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_nodelay": "true", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "ms_type": "async+posix", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "no_config_file": "false", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T11:22:13.351 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inflight_ops": "1024", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter_timeout": "10.000000", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "objectstore_blackhole": "false", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "openssl_engine_opts": "", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_max_ops": "4", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_agent_slop": "0.020000", 2024-04-26T11:22:13.352 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_asio_thread_count": "2", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_scan_max": "512", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backfill_scan_min": "64", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_peering": "false", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_beacon_report_interval": "300", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_duration": "30", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T11:22:13.353 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_blkin_trace_all": "false", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_class_update_on_start": "true", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_message_cap": "256", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_op_priority": "63", 2024-04-26T11:22:13.354 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_client_watch_timeout": "30", 2024-04-26T11:22:13.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_command_max_records": "256", 2024-04-26T11:22:13.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_compact_on_start": "false", 2024-04-26T11:22:13.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T11:22:13.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T11:22:13.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T11:22:13.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_update_on_start": "true", 2024-04-26T11:22:13.355 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T11:22:13.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T11:22:13.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T11:22:13.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T11:22:13.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T11:22:13.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T11:22:13.358 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_op_order": "false", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_shutdown": "false", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T11:22:13.359 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_default_notify_timeout": "30", 2024-04-26T11:22:13.360 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_enable_op_tracker": "true", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_info": "true", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown": "true", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T11:22:13.361 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_function_tracing": "false", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_grace": "20", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_interval": "6", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_stale": "600", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T11:22:13.362 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_journal_size": "5120", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_kill_backfill_at": "0", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_cache_size": "50", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_dedup": "true", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_message_max": "40", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_attr_name_len": "100", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_attr_size": "0", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_backfills": "1", 2024-04-26T11:22:13.363 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_markdown_count": "5", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_markdown_period": "600", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_name_len": "2048", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_object_size": "134217728", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_pgls": "1024", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_push_cost": "8388608", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_push_objects": "10", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_scrubs": "3", 2024-04-26T11:22:13.364 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_max_write_size": "90", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_profile": "balanced", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T11:22:13.365 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_base": "805306368", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target": "4294967296", 2024-04-26T11:22:13.366 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target_autotune": "false", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_min_recovery_priority": "0", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_report_interval": "5", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_num_cache_shards": "32", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_node": "-1", 2024-04-26T11:22:13.367 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objecter_finishers": "1", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore": "bluestore", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore_fuse": "false", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_objectstore_tracing": "false", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_duration": "600", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_size": "20", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_log_threshold": "5", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards": "0", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T11:22:13.368 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_op_thread_timeout": "15", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_open_classes_on_start": "true", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_os_flags": "0", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_peering_op_priority": "255", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_delete_priority": "5", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T11:22:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_crimson": "false", 2024-04-26T11:22:13.370 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_flags": "0", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_min_size": "0", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T11:22:13.371 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_size": "2", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_default_type": "replicated", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_cost": "20971520", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active": "0", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T11:22:13.372 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_op_priority": "3", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_priority": "5", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_repair_during_recovery": "false", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T11:22:13.373 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_cost": "52428800", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_end_hour": "0", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T11:22:13.374 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_priority": "5", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_skip_data_digest": "false", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_smart_report_timeout": "5", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_priority": "5", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T11:22:13.375 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_target_transaction_size": "30", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T11:22:13.376 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_tracing": "false", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_use_stale_snap": "false", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_kill_at": "0", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_max_join_drift": "10", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_min": "500", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_min_wait": "0.050000", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_max": "500", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_service_trim_min": "250", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_stash_full_interval": "25", 2024-04-26T11:22:13.377 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_trim_max": "500", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "paxos_trim_min": "250", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "perf": "true", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "-", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrv": "", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "public_bind_addr": "-", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "public_network": "", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "public_network_interface": "", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "qat_compressor_enabled": "false", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_mon_op_timeout": "0", 2024-04-26T11:22:13.378 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_osd_op_timeout": "0", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rados_tracing": "false", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_atime_update_interval": "60", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache": "true", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T11:22:13.379 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_policy": "writearound", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_size": "33554432", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_compression_hint": "none", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_clone_format": "auto", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_data_pool": "", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_features": "61", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_format": "2", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_map_options": "", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_order": "22", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_pool": "rbd", 2024-04-26T11:22:13.380 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_stripe_count": "0", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_io_scheduler": "simple", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T11:22:13.381 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_order": "24", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_pool": "", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_journal_splay_width": "4", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T11:22:13.382 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T11:22:13.383 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_op_threads": "1", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T11:22:13.384 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_plugins": "", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T11:22:13.385 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T11:22:13.386 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_tracing": "false", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_validate_names": "true", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd_validate_pool": "true", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "restapi_base_url": "", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "restapi_log_level": "", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_admin_entry": "admin", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_backend_store": "rados", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_barbican_url": "", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_beast_enable_async": "true", 2024-04-26T11:22:13.387 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_enabled": "true", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_config_store": "rados", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_content_length_compat": "false", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T11:22:13.388 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_cross_domain_policy": "", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T11:22:13.389 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T11:22:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T11:22:13.391 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_log_window": "30", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T11:22:13.392 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T11:22:13.393 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dns_name": "", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dns_s3website_name": "", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_ops_log": "false", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T11:22:13.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_static_website": "false", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enable_usage_log": "false", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_expose_bucket": "false", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_extended_http_attrs": "", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_filter": "none", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_objs": "32", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T11:22:13.395 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_init_timeout": "300", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_password": "", 2024-04-26T11:22:13.396 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_project": "", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_token": "", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_admin_user": "", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_api_version": "2", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T11:22:13.397 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_url": "", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_objs": "32", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_worker": "3", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T11:22:13.398 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_http_headers": "", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attr_size": "0", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T11:22:13.399 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_listing_results": "1000", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_notify_retries": "10", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T11:22:13.400 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T11:22:13.401 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_num_control_oids": "8", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_numa_node": "-1", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_op_tracing": "false", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_token": "", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_url": "", 2024-04-26T11:22:13.402 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_rados": "false", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_print_continue": "true", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T11:22:13.403 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rados_tracing": "false", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm": "", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm_id": "", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_region": "", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_request_uri": "", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T11:22:13.404 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_resolve_cname": "false", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_run_sync_thread": "true", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T11:22:13.405 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_script_uri": "", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_service_provider_name": "", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_client_id": "", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_client_secret": "", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_entry": "sts", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_key": "sts", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T11:22:13.406 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_auth_url": "", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_custom_header": "", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_need_stats": "true", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_tenant_name": "", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_url": "", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_lease_period": "120", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T11:22:13.407 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_thread_pool_size": "512", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_comment": "", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_createby": "", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_encoding": "", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_flag": "false", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_origin": "", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_torrent_tracker": "", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T11:22:13.408 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_max_shards": "32", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_use_opa_authz": "false", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_user_unique_email": "true", 2024-04-26T11:22:13.409 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_verify_ssl": "true", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone": "", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone_id": "", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup": "", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup_id": "", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_block_size": "4096", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T11:22:13.410 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_partition_filters": "false", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_perf": "false", 2024-04-26T11:22:13.411 INFO:teuthology.orchestra.run.smithi073.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "run_dir": "/var/run/ceph", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_block_create": "true", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_device_size": "53687091200", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_main_device_type": "SSD", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T11:22:13.412 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "seastore_segment_size": "67108864", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "set_keepcaps": "false", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "setgroup": "", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "setuser": "", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "setuser_match_path": "", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "thp": "false", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "threadpool_default_timeout": "60", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout: "throttler_perf_counter": "true" 2024-04-26T11:22:13.413 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-26T11:22:13.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T11:22:13.552 INFO:teuthology.orchestra.run.smithi073.stdout:mon.a: {} 2024-04-26T11:22:13.552 INFO:teuthology.orchestra.run.smithi073.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:22:13.560 INFO:teuthology.orchestra.run.smithi073.stdout:mon.b: {} 2024-04-26T11:22:13.560 INFO:teuthology.orchestra.run.smithi073.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:22:13.569 INFO:teuthology.orchestra.run.smithi073.stdout:mon.c: {} 2024-04-26T11:22:13.569 INFO:teuthology.orchestra.run.smithi073.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:22:13.586 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-26T11:22:13.586 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-26T11:22:13.610 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-26T11:22:13.610 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-26T11:22:13.610 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-26T11:22:13.610 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T11:22:13.611 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T11:22:13.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:13.611 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-26T11:22:13.611 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T11:22:13.611 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:22:13.611 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:22:13.612 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-04-26T11:22:13.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-04-26T11:22:13.612 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T11:22:13.613 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T11:22:13.613 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:22:13.613 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T11:22:13.613 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:13.614 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T11:22:13.614 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:22:13.615 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:13.610+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:13.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:13.619 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-04-26T11:22:13.672 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2024-04-26T11:22:13.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:22:13.673 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-26T11:22:13.673 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T11:22:13.715 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:13.714+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:13.744 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:13.744 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:13.744 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:13.744 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:13.759 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:13.762 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:13.762 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:13.783 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:13.783 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:13.816 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:13.814+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:13.817 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:13.817 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:13.882 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:13.882 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:13.896 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:13.900 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 210 (0%) 2024-04-26T11:22:13.900 INFO:teuthology.orchestra.run.smithi073.stdout:avg 70 2024-04-26T11:22:13.900 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-26T11:22:13.900 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-26T11:22:13.900 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-26T11:22:13.900 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:13.900 INFO:teuthology.orchestra.run.smithi073.stdout:oload 110 2024-04-26T11:22:13.900 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 0.05 2024-04-26T11:22:13.900 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-04-26T11:22:13.900 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0003 2024-04-26T11:22:13.900 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0003 2024-04-26T11:22:13.901 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-04-26T11:22:13.916 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-04-26T11:22:13.917 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-04-26T11:22:13.917 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:13.916+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:14.015 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:14.015 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:14.018 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:14.016+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:14.029 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:14.071 INFO:teuthology.orchestra.run.smithi073.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-26T11:22:14.088 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T11:22:14.088 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T11:22:14.088 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2024-04-26T11:22:14.088 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T11:22:14.088 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T11:22:14.088 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T11:22:14.088 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T11:22:14.088 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T11:22:14.089 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T11:22:14.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:14.089 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2024-04-26T11:22:14.093 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T11:22:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T11:22:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T11:22:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-26T11:22:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2024-04-26T11:22:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-26T11:22:14.094 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T11:22:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2024-04-26T11:22:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2024-04-26T11:22:14.094 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T11:22:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2024-04-26T11:22:14.094 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42539sec preferred_lft 42539sec 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:44:14:b8:9e brd ff:ff:ff:ff:ff:ff 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-26T11:22:14.095 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2024-04-26T11:22:14.096 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T11:22:14.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:14.096 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-04-26T11:22:14.096 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-26T11:22:14.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2024-04-26T11:22:14.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2024-04-26T11:22:14.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2024-04-26T11:22:14.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T11:22:14.096 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-26T11:22:14.118 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:14.117+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:14.162 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:14.163 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:14.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:14.172 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T11:22:14.178 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:14.188 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 210 (0%) 2024-04-26T11:22:14.189 INFO:teuthology.orchestra.run.smithi073.stdout:avg 70 2024-04-26T11:22:14.189 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-26T11:22:14.189 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-26T11:22:14.189 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-26T11:22:14.189 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:14.189 INFO:teuthology.orchestra.run.smithi073.stdout:oload 110 2024-04-26T11:22:14.189 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 3 2024-04-26T11:22:14.189 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-04-26T11:22:14.189 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0003 2024-04-26T11:22:14.189 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0003 2024-04-26T11:22:14.189 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-04-26T11:22:14.198 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-04-26T11:22:14.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:14.199 DEBUG:teuthology.orchestra.run.smithi073:> route 2024-04-26T11:22:14.206 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-04-26T11:22:14.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-04-26T11:22:14.222 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:14.222+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:14.276 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2024-04-26T11:22:14.277 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T11:22:14.277 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-26T11:22:14.277 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-26T11:22:14.277 INFO:teuthology.orchestra.run.smithi073.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-26T11:22:14.277 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-26T11:22:14.277 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-26T11:22:14.277 INFO:teuthology.orchestra.run.smithi073.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T11:22:14.277 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T11:22:14.277 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-26T11:22:14.277 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T11:22:14.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:14.278 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-04-26T11:22:14.278 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-26T11:22:14.278 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-26T11:22:14.278 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-26T11:22:14.278 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-26T11:22:14.278 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-26T11:22:14.298 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:14.298 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:14.313 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:14.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:14.350 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-26T11:22:14.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:14.354+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:14.402 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-26T11:22:14.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:14.403 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2024-04-26T11:22:14.420 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:14.417+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:14.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:14.469 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-04-26T11:22:14.470 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-26T11:22:14.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T11:22:14.470 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T11:22:14.470 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-26T11:22:14.478 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:14.478 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:14.494 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:14.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:14.518+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:14.522 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 210 (0%) 2024-04-26T11:22:14.522 INFO:teuthology.orchestra.run.smithi073.stdout:avg 70 2024-04-26T11:22:14.522 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-26T11:22:14.522 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-26T11:22:14.522 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-26T11:22:14.522 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:14.522 INFO:teuthology.orchestra.run.smithi073.stdout:oload 1000 2024-04-26T11:22:14.522 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 3 2024-04-26T11:22:14.522 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-04-26T11:22:14.522 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0003 2024-04-26T11:22:14.523 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0030 2024-04-26T11:22:14.523 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-04-26T11:22:14.532 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T11:22:14.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:14.533 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-04-26T11:22:14.533 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-26T11:22:14.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T11:22:14.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T11:22:14.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T11:22:14.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T11:22:14.533 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T11:22:14.533 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-26T11:22:14.540 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-04-26T11:22:14.540 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 0.05 2024-04-26T11:22:14.622 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:14.621+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:14.623 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:14.623 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:14.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:14.627 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2024-04-26T11:22:14.627 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2024-04-26T11:22:14.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2024-04-26T11:22:14.627 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T11:22:14.627 DEBUG:teuthology.orchestra.run.smithi073:> ') 2024-04-26T11:22:14.637 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:14.690 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-26T11:22:14.690 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T11:22:14.690 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T11:22:14.722 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:14.720+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:14.737 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T11:22:14.737 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T11:22:14.737 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T11:22:14.760 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:14.760 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:14.773 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:14.784 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-04-26T11:22:14.823 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:14.821+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:14.834 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T11:22:14.834 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T11:22:14.847 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 210 (0%) 2024-04-26T11:22:14.847 INFO:teuthology.orchestra.run.smithi073.stdout:avg 70 2024-04-26T11:22:14.847 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-26T11:22:14.847 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-26T11:22:14.847 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-26T11:22:14.847 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:14.847 INFO:teuthology.orchestra.run.smithi073.stdout:oload 1000 2024-04-26T11:22:14.847 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 0.05 2024-04-26T11:22:14.847 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-04-26T11:22:14.848 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0003 2024-04-26T11:22:14.848 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0030 2024-04-26T11:22:14.848 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-04-26T11:22:14.856 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T11:22:14.857 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T11:22:14.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:14.857 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-04-26T11:22:14.865 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-04-26T11:22:14.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2024-04-26T11:22:14.915 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T11:22:14.915 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-26T11:22:14.923 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:14.920+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:14.939 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:14.940 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:14.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:14.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-04-26T11:22:14.968 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T11:22:14.968 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T11:22:15.022 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T11:22:15.022 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T11:22:15.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:15.023 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-04-26T11:22:15.024 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:15.021+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:15.038 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:2024-04-26T11:22:15.036+0000 7f82aba0a580 -1 init, newargv = 0x55a849558b80 newargc=15 2024-04-26T11:22:15.038 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[22838]: starting ceph client 2024-04-26T11:22:15.050 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[22838]: starting fuse 2024-04-26T11:22:15.089 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:15.090 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:15.103 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:15.125 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:15.126+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:15.195 INFO:teuthology.orchestra.run.smithi073.stdout:moved 0 / 210 (0%) 2024-04-26T11:22:15.195 INFO:teuthology.orchestra.run.smithi073.stdout:avg 70 2024-04-26T11:22:15.196 INFO:teuthology.orchestra.run.smithi073.stdout:stddev 2.16025 -> 2.16025 (expected baseline 6.8313) 2024-04-26T11:22:15.196 INFO:teuthology.orchestra.run.smithi073.stdout:min osd.1 with 67 -> 67 pgs (0.957143 -> 0.957143 * mean) 2024-04-26T11:22:15.196 INFO:teuthology.orchestra.run.smithi073.stdout:max osd.2 with 72 -> 72 pgs (1.02857 -> 1.02857 * mean) 2024-04-26T11:22:15.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:15.196 INFO:teuthology.orchestra.run.smithi073.stdout:oload 110 2024-04-26T11:22:15.196 INFO:teuthology.orchestra.run.smithi073.stdout:max_change 3 2024-04-26T11:22:15.196 INFO:teuthology.orchestra.run.smithi073.stdout:max_change_osds 4 2024-04-26T11:22:15.196 INFO:teuthology.orchestra.run.smithi073.stdout:average_utilization 0.0003 2024-04-26T11:22:15.196 INFO:teuthology.orchestra.run.smithi073.stdout:overload_utilization 0.0003 2024-04-26T11:22:15.196 INFO:teuthology.orchestra.run.smithi073.stderr:no change 2024-04-26T11:22:15.226 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:15.228+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:15.265 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:15.265 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:15.279 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:15.327 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:15.328+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:15.402 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:15.405 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:15.416 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:15.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:15.462+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:15.529 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:15.526+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:15.546 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:15.547 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:15.560 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:15.629 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:15.628+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:15.719 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:15.719 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:15.731 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:15.729+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:15.732 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:15.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:15.830+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:15.836 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:22:15.852 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:15.853 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:15.867 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:15.932 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:15.928+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:15.991 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:15.991 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:15.999 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:15.999 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:16.010 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:16.010 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:16.014 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:16.028 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:16.029 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:16.057 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:16.056+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:16.135 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:16.133+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:16.143 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2024-04-26T11:22:16.157 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-26T11:22:16.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-26T11:22:16.171 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:16.171 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:16.171 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:16.171 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:16.171 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:16.185 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:16.208 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-26T11:22:16.209 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-26T11:22:16.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:16.209 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2024-04-26T11:22:16.236 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:16.234+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:16.258 INFO:teuthology.orchestra.run.smithi073.stdout:45 2024-04-26T11:22:16.258 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> import re 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> import os 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2024-04-26T11:22:16.259 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> return f 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.0")) 2024-04-26T11:22:16.260 DEBUG:teuthology.orchestra.run.smithi073:> ' 2024-04-26T11:22:16.310 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.627363746, 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:16.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:16.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:16.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:16.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:16.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:16.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:16.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:16.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:16.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:16.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:16.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:16.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:16.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.627237351000002, 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.317 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:16.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:16.321 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.627148558000002, 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:16.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:16.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.627043745000002, 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:16.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:16.333 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.626993088999999, 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:16.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:16.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:16.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:16.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:16.338 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.338 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.338 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.338 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.626936136000001, 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:16.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:16.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:16.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:16.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.626877144000002, 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.347 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.626774138000002, 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:16.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.626698298000001, 2024-04-26T11:22:16.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:16.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:16.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.611480736000001, 2024-04-26T11:22:16.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.358 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.607093290000002, 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:16.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:16.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:16.362 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.606081474, 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:16.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:16.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:16.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.60575781, 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:16.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:16.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.605701533000001, 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:16.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.374 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.605650103999999, 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.378 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.605585313999999, 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:16.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:16.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.381 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.601100966000001, 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:16.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.385 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.386 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.386 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:16.386 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:16.386 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.595890516000001, 2024-04-26T11:22:16.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:16.386 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.386 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.386 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:16.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.390 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.595807004000001, 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:16.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:16.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.394 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.915117465000002, 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:16.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:16.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:16.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:16.399 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:16.400 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.0.22838.asok 2024-04-26T11:22:16.401 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:16.402 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:16.402+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:16.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:22:16.502 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:16.498+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:16.529 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:16.529 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:16.530 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:16.530 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:16.543 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:16.558 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.22838.asok 2024-04-26T11:22:16.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:16.558 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.22838.asok status 2024-04-26T11:22:16.603 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:16.601+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:16.662 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-26T11:22:16.662 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2024-04-26T11:22:16.662 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "dc093b5e41f728edab6e0330295fdf9156d31664", 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 18.2.2-1256-gdc093b5e (dc093b5e41f728edab6e0330295fdf9156d31664) reef (stable)", 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "0", 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "22838", 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4728, 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4728 2024-04-26T11:22:16.663 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 298198185 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 298198185 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4728 192.168.0.1:0/298198185", 2024-04-26T11:22:16.664 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/298198185", 2024-04-26T11:22:16.665 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2024-04-26T11:22:16.665 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 5, 2024-04-26T11:22:16.665 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 19, 2024-04-26T11:22:16.665 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2024-04-26T11:22:16.665 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2024-04-26T11:22:16.665 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2024-04-26T11:22:16.665 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-26T11:22:16.665 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:16.666 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:16.666 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:16.666 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:16.666 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:16.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:16.676 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2024-04-26T11:22:16.676 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-26T11:22:16.678 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:16.682 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2024-04-26T11:22:16.682 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-26T11:22:16.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:22:16.682 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T11:22:16.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:16.702+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:16.736 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T11:22:16.749 INFO:tasks.workunit:Pulling workunits from ref 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T11:22:16.750 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T11:22:16.750 INFO:tasks.workunit:timeout=3h 2024-04-26T11:22:16.750 INFO:tasks.workunit:cleanup=True 2024-04-26T11:22:16.750 DEBUG:teuthology.orchestra.run.smithi073:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T11:22:16.782 INFO:teuthology.orchestra.run.smithi073.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T11:22:16.782 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-26T11:22:16.782 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-26T11:22:16.783 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T11:22:16.783 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T11:22:16.783 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-04-26 11:21:53.677352391 +0000 2024-04-26T11:22:16.783 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-04-26 11:22:16.736660998 +0000 2024-04-26T11:22:16.783 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2024-04-26T11:22:16.783 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T11:22:16.783 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T11:22:16.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:16.802+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:16.844 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7d2137f0a666c92a9411c1af5c33e4968be54da6 2024-04-26T11:22:16.847 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:16.847 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:16.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:16.847 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:16.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.847 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 33.077801684999997, 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:16.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:16.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.163972174000001, 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.859 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.163886437999999, 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:16.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.865 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.163827264999998, 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:16.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:16.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.871 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.163741799, 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:16.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:16.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:16.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.163682362999999, 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:16.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:16.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:16.884 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.163601746000001, 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:16.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:16.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.163400541000001, 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:16.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.896 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.163277562000001, 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:16.902 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.163222166000001, 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:16.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:16.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:16.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:16.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.163078354, 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:16.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:16.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:16.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.163013660000001, 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.915 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:16.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:16.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.162921221000001, 2024-04-26T11:22:16.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:16.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:16.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:16.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.927 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.162843130999999, 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:16.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:16.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:16.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:16.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.934 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.162797636000001, 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:16.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:16.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:16.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:16.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.940 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.162766429000001, 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:16.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:16.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.946 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.162725982000001, 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:16.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:16.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:16.953 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.162687778999999, 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:16.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:16.959 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.162637586999999, 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:16.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:16.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:16.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 23.162549070000001, 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:16.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:16.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:16.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:16.970 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:16.972 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:16.973 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:16.973+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:16.978 INFO:tasks.workunit.client.0.smithi073.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T11:22:17.073 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:17.073+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:17.107 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:17.107 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:17.108 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:17.108 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:17.123 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:17.173 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:17.172+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:17.242 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:17.243 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:17.243 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:17.243 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:17.243 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:17.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:17.274 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:17.272+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:17.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:17.374+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:17.378 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 33.772694199, 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.694093765000002, 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:17.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:17.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.390 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.693159091999998, 2024-04-26T11:22:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.391 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.693085975999999, 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.693034636, 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.692984367000001, 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.692932067000001, 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.692882530999999, 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.692816001000001, 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.692530126000001, 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.690994451999998, 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.689124262, 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.689028149999999, 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.666993099999999, 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.666912027999999, 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.666859114000001, 2024-04-26T11:22:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.666751879, 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.666697319000001, 2024-04-26T11:22:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.665982018000001, 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 23.664088592999999, 2024-04-26T11:22:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:17.481 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:17.483 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-26T11:22:17.484 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:17.484 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:17.480+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:17.584 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:17.580+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:17.613 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:17.614 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:17.614 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:22:17.614 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:17.627 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:17.716 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:17.716+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:17.786 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:17.784+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:17.790 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:17.790 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:17.790 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:17.790 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:17.790 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:17.804 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:17.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:17.886+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:17.976 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:17.976 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:17.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:17.976 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:17.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.976 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.976 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.291983981000001, 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:17.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:17.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:17.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:17.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:17.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.291857585999999, 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:17.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:17.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:17.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:17.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.291768792999999, 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:17.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:17.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:17.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:17.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.291663979999999, 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:17.992 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:17.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.291613324, 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:17.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:17.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.002 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.291556370999999, 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:18.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:18.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:18.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:18.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.291497378999999, 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.011 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.291394372999999, 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:18.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:18.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.291318532999998, 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:18.019 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.276100970999998, 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:18.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.271713524999999, 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:18.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.270701709000001, 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:18.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:18.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:18.031 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.270378045000001, 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.270321767999999, 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.270270339, 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.270205549, 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.265721201000002, 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.260510750999998, 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.260427238999998, 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.579737699999999, 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:18.064 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:18.064 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:22:18.066 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:18.065+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:18.066 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:18.166 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:18.165+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:18.199 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:18.199 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:18.200 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:18.200 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:18.214 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:18.221 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:18.221 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:18.241 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:18.242 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:18.261 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:18.261 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:18.267 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:18.264+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:18.368 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:18.370+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:18.379 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:18.379 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:18.393 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:18.469 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:18.470+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:18.515 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:18.515 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:18.529 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:18.569 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:18.568+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:18.661 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:18.662 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:18.670 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:18.668+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:18.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:18.771 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:18.768+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:18.801 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:18.801 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:18.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:18.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:18.870+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:18.941 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:18.941 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:18.956 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:19.002 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:19.002+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:19.074 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:19.072+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:19.085 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:19.085 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:19.099 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:19.174 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:19.172+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:19.215 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:19.215 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:19.229 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:19.275 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:19.272+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:19.346 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:19.346 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:19.360 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:19.375 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:19.374+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:19.477 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:19.472+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:19.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:22:19.489 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:19.489 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:19.504 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:19.577 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:19.578+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:19.661 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:19.662 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:19.675 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:19.678 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:19.678+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:19.778 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:19.776+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:19.797 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:19.797 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:19.811 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:19.879 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:19.878+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:19.939 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:19.940 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:19.955 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:19.998 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:19.998+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:20.081 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:20.080+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:20.121 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:20.121 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:20.136 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:20.181 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:20.180+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:20.215 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:22:20.215 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:22:20.215 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T11:22:20.215 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.699132 2024-04-26T11:22:20.215 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.6991318698183931 2024-04-26T11:22:20.256 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:20.256 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:20.270 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:20.280 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:22:20.281 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:20.278+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:20.382 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:20.380+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:20.401 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:20.401 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:20.416 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:20.426 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:20.426 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:20.429 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:22:20.447 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:20.448 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:20.465 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:20.465 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:20.483 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:20.480+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:20.536 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:20.536 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:20.536 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:20.536 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:20.536 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:20.550 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:20.596 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:20.596+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:20.667 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:20.667 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:20.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:20.667 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:20.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.667 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:20.667 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:20.667 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.984014085999998, 2024-04-26T11:22:20.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:20.667 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.667 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:20.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:20.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:20.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:20.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.983887691, 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:20.672 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:20.677 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.983798898, 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:20.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:20.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.682 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.983694085, 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:20.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:20.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:20.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.983643429000001, 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:20.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:20.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:20.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:20.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.692 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.983586475999999, 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:20.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:20.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.697 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.983527484, 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:20.701 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.983424478, 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:20.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:20.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.983348637999999, 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.705 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:20.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:20.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:20.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.968131075999999, 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:20.712 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.96374363, 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:20.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:20.716 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.962731814000001, 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:20.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.962408150000002, 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.720 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:20.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:20.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.962351872999999, 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.962300444, 2024-04-26T11:22:20.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:20.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:20.731 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.731 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.731 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.731 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:20.731 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:20.731 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.962235654000001, 2024-04-26T11:22:20.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:20.733 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.733 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.957751305999999, 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.952540855999999, 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:20.740 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:20.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:20.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.952457343999999, 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.271767805, 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:20.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:20.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:20.752 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.753 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.753 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.753 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:20.753 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:20.753 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:20.754 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:20.755 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:20.752+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:20.885 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:20.854+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:20.885 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:20.885 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:20.885 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:20.885 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:20.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:20.956 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:20.952+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:21.021 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:21.021 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:21.021 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:21.021 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:21.021 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:21.037 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:21.081 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:21.080+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:21.158 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:21.156+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:21.206 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.437525710000003, 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:21.207 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.212 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.523696199, 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:21.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:21.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:21.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:21.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:21.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:21.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:21.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:21.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.523610463000001, 2024-04-26T11:22:21.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:21.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:21.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:21.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:21.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.52355129, 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.227 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:21.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.523465823999999, 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.233 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:21.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:21.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:21.239 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.523406388000001, 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:21.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.523325771, 2024-04-26T11:22:21.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:21.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:21.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.251 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.523124566, 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:21.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.253 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:21.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.523001587, 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:21.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:21.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:21.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.263 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.522946190999999, 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.264 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.265 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.266 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.267 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:21.268 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:21.269 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.522802379000002, 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.270 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.271 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.272 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:21.273 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:21.274 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:21.275 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.522737684999999, 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.276 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:21.277 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:21.278 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:21.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:21.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:21.279 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.279 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.279 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:21.279 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:21.279 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:21.280 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.281 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.282 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.522645246, 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.283 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.284 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.285 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:21.286 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:21.287 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.288 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.522567156000001, 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.289 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:21.290 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:21.291 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:21.292 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.293 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.294 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.522521660999999, 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:21.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:21.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.300 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.522490454, 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:21.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:21.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:21.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.522450007, 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:21.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:21.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.522411804000001, 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.522361612000001, 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 27.522273094999999, 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:21.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:21.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:21.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:21.330 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:21.330 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:21.331 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:21.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:21.330+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:21.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:21.430+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:21.436 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.2 primary-affinity to 0.699132 (8458182) 2024-04-26T11:22:21.464 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:21.465 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:21.465 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:21.465 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:21.479 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:21.534 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:21.532+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:21.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:21.634+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:21.646 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:21.646 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:21.646 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:21.646 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:21.646 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:21.660 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:21.736 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:21.732+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:21.826 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 38.220749984999998, 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:21.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:21.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:21.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.142149550999999, 2024-04-26T11:22:21.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:21.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:21.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.836 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.141214878, 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:21.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.141141762, 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.141090422000001, 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:21.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:21.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:21.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.141040152999999, 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:21.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:21.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.857 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.140987852999999, 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:21.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:21.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:21.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:21.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.140938317, 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:21.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.140871786999998, 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.868 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:21.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.140585911999999, 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.872 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:21.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.139050237999999, 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:21.879 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.137180048000001, 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:21.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.883 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.137083936, 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:21.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:21.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:21.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.115048886, 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:21.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:21.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.114967814, 2024-04-26T11:22:21.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.114914899999999, 2024-04-26T11:22:21.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:21.900 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.114807665000001, 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:21.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:21.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:21.904 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.114753104999998, 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:21.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:21.908 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.114037803999999, 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:21.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:21.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.912 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 28.112144379, 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:21.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:21.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:21.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:21.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:21.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:21.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:21.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:21.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:21.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:21.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:21.917 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.917 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.917 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.917 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:21.917 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:21.917 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:21.919 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:21.919 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:21.918+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:22.019 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:22.016+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:22.049 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:22:22.050 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:22.063 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:22.120 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:22.116+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:22.179 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:22.180 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:22.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:22.237 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:22.236+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:22.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:22.322+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:22.361 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:22.361 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:22.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:22.361 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:22.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.361 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:22.361 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:22.361 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.677628855000002, 2024-04-26T11:22:22.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:22.361 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.361 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:22.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:22.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:22.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:22.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:22.367 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.677502459999999, 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.372 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.677413667, 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:22.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:22.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.677308854, 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:22.378 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:22.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:22.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.383 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.677258198000001, 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.388 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.677201244999999, 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:22.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.677142253, 2024-04-26T11:22:22.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:22.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:22.398 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.677039247, 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:22.402 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.676963406999999, 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:22.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:22.406 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.661745844999999, 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:22.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:22.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.657358399, 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:22.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.656346583000001, 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.414 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:22.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:22.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:22.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:22.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:22.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:22.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.418 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.656022919000002, 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:22.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:22.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.655966641999999, 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:22.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:22.426 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.655915213, 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:22.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:22.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.430 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.655850423, 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:22.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:22.434 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.651366074999999, 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:22.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.438 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.646155624999999, 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.442 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.646072112999999, 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.446 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.965382573999999, 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:22.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:22.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:22.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:22.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:22.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:22.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:22.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.452 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:22.452 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:22.452 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:22.452 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:22:22.454 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:22.452+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:22.454 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:22.480 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:22:22.554 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:22.556+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:22.583 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:22.583 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:22.583 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:22.584 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:22.599 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:22.641 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:22.641 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:22.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:22.654+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:22.675 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:22.675 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:22.696 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:22.697 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:22.721 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:22.721 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:22.736 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:22.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:22.754+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:22.857 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:22.856+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:22.857 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:22.858 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:22.871 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:22.961 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:22.956+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:23.004 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:23.004 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:23.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:23.067 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:23.066+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:23.142 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:23.142 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:23.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:23.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:23.198+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:23.261 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:23.260+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:23.321 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:23.321 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:23.335 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:23.361 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:23.360+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:23.459 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:22:23.462 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:23.460+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:23.466 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:23.467 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:23.482 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:23.563 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:23.560+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:23.597 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:23.597 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:23.611 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:23.664 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:23.660+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:23.765 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:23.764+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:23.775 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:23.776 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:23.790 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:23.867 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:23.866+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:23.935 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:23.967 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:23.964+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:24.056 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:24.056 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:24.068 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:24.064+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:24.070 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:24.168 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:24.164+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:24.239 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:24.240 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:24.255 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:24.269 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:24.268+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:24.370 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:24.368+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:24.384 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:24.384 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:24.399 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:24.471 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:24.472+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:24.516 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:24.516 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:24.531 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:24.579 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:24.578+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:24.653 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:24.654 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:24.667 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:24.711 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:24.710+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:24.714 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:22:24.775 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:24.772+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:24.797 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:24.797 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:24.812 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:24.867 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:24.868 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:24.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:24.874+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:24.887 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:24.888 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:24.907 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:24.908 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:24.936 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:24.936 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:24.936 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:24.950 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:24.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:24.978+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:25.069 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:25.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.384375309999999, 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:25.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:25.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.384248915000001, 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.384160122000001, 2024-04-26T11:22:25.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.085 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.384055309000001, 2024-04-26T11:22:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:25.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:25.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.384004653000002, 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:25.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:25.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:25.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.3839477, 2024-04-26T11:22:25.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:25.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:25.102 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.383888708000001, 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.106 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.383785702000001, 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:25.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:25.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.383709862, 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:25.114 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.3684923, 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.364104854000001, 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.118 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:25.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:25.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.363093037999999, 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:25.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:25.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:25.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.362769373999999, 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:25.130 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.362713097, 2024-04-26T11:22:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:25.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:25.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:25.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.362661668000001, 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:25.139 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.362596878000002, 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:25.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:25.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.35811253, 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:25.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:25.147 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.35290208, 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:25.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.151 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.352818568, 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:25.156 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.672129029000001, 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:25.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:25.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:25.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:25.161 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:25.162 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:25.163 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:25.164 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:25.162+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:25.264 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:25.264+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:25.293 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:25.293 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:25.293 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:25.293 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:25.308 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:25.365 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:25.364+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:25.430 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:25.430 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:25.430 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:25.430 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:25.430 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:25.444 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:25.482 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:22:25.489 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:25.488+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:25.564 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:25.564 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:25.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:25.565 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:25.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.565 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:25.565 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:25.565 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 41.794656795000002, 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:25.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:25.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:25.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.880827283999999, 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:25.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.577 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.880741548, 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:25.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:25.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:25.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.583 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.880682374999999, 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:25.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:25.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:25.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:25.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.880596909000001, 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:25.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:25.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.595 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.880537473, 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:25.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:25.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:25.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:25.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.880456855999999, 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:25.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:25.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.880255650999999, 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:25.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:25.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.880132671999998, 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:25.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:25.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:25.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:25.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:25.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:25.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.880077276000002, 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:25.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:25.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:25.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.625 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.879933464, 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:25.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:25.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:25.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.879868770000002, 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:25.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:25.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:25.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:25.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:25.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:25.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:25.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:25.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:25.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:25.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.879776330999999, 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:25.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:25.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.645 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.879698241, 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:25.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:25.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.879652746000001, 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:25.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:25.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:25.657 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.879621538999999, 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:25.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:25.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:25.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.663 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.879581091999999, 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:25.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:25.669 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.879542889, 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:25.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:25.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:25.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.879492697, 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:25.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:25.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:25.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 31.879404180000002, 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:25.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:25.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:25.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:25.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:25.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:25.686 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:25.686 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:25.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:25.686 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.686 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.686 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.686 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:25.686 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:25.686 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:25.688 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:25.688 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:25.688+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:25.789 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:25.788+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:25.818 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:25.819 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:25.819 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:25.833 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:25.890 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:25.885+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:25.955 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:25.955 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:25.955 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:25.955 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:25.955 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:25.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:26.011 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:26.009+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:26.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:26.089+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:26.137 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:26.137 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:26.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:26.137 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 42.531830534000001, 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:26.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.453230099999999, 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.452295427000003, 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:26.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.452222311, 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:26.152 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:26.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.452170971000001, 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.157 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:26.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:26.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.452120702000002, 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:26.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:26.166 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.452068402000002, 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:26.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:26.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:26.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:26.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.452018866000003, 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:26.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:26.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:26.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.451952335999998, 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:26.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.451666461000002, 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:26.180 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.183 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.450130786999999, 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:26.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.448260597000001, 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:26.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:26.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:26.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:26.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.448164485, 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:26.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.426129435, 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.195 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:26.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.426048363, 2024-04-26T11:22:26.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.425995448999998, 2024-04-26T11:22:26.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:26.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:26.207 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.425888213999997, 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:26.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:26.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.425833654000002, 2024-04-26T11:22:26.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.215 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.425118353000002, 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:26.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 32.423224928000003, 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:26.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:26.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:26.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.223 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:26.224 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:26.224 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:26.225 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:26.226 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:26.224+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:26.326 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:26.325+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:26.354 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:26.354 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:26.354 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:22:26.354 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:26.368 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:26.427 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:26.424+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:26.459 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:22:26.459 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:22:26.459 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T11:22:26.459 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T11:22:26.459 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T11:22:26.459 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T11:22:26.475 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-26T11:22:26.489 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:26.490 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:26.490 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:26.490 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:26.490 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:26.504 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:26.528 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:26.528+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:26.581 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:26.581 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T11:22:26.581 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:26.627 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.943137426, 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.943011030999998, 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.942922238000001, 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.942817425000001, 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.942766769000002, 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.942709815999997, 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.942650823999998, 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.942547818000001, 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.942471978, 2024-04-26T11:22:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.927254415999997, 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.922866970000001, 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.921855153999999, 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.92153149, 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.921475213000001, 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.921423783999998, 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.921358994000002, 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.916874645999997, 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.911664195999997, 2024-04-26T11:22:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:26.704 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.911580684, 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:26.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:26.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.708 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 27.230891145000001, 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:26.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:26.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:26.713 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.714 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.714 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.714 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:26.714 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:26.714 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:26.715 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:26.712+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:26.716 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:26.816 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:26.812+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:26.849 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:26.849 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:26.849 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:26.849 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:26.864 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:26.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:26.913+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:26.926 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:22:27.018 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:27.016+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:27.029 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:27.029 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:27.029 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:27.029 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:27.029 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:27.043 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:27.076 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:27.077 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:27.095 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:27.096 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:27.115 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:27.115 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:27.118 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:27.116+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:27.164 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:27.165 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:27.178 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:27.219 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:27.220+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:27.308 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:27.308 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:27.321 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:27.316+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:27.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:27.422 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:27.420+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:27.443 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:27.443 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:27.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:27.523 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:27.521+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:27.574 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:27.574 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:27.588 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:27.635 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:27.633+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:27.721 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:27.721 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:27.724 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:27.721+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:27.736 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:27.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:27.825+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:27.858 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:27.858 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:27.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:27.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:27.925+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:27.990 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:27.990 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:28.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:28.050 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:28.048+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:28.128 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:28.124+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:28.135 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:28.135 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:28.149 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:28.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:28.229+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:28.316 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:28.316 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:28.330 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:28.331 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:28.331+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:28.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:28.429+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:28.452 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:28.452 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:28.466 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:28.499 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:22:28.532 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:28.532+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:28.594 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:28.594 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:28.609 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:28.633 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:28.631+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:28.717 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:28.718 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:28.731 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:28.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:28.733+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:28.836 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:28.832+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:28.836 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:28.836 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:28.849 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:28.936 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:28.931+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:28.978 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:28.978 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:28.994 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:29.037 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:29.037+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:29.132 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:22:29.138 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:29.135+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:29.159 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:29.159 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:29.173 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:29.239 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:29.240+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:29.289 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:29.289 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:29.309 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:29.309 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:29.330 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:29.330 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:29.340 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:29.335+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:29.342 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.658063828000003, 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.657937433000001, 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.348 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:29.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:29.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:29.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:29.353 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.657848639999997, 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:29.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:29.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:29.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.657743826999997, 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:29.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.657693170999998, 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.657636218, 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.657577226000001, 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:29.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:29.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.377 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.657474219999997, 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:29.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.657398379999997, 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:29.381 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.642180818, 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:29.388 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.637793371999997, 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.636781556000003, 2024-04-26T11:22:29.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:29.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.636457892000003, 2024-04-26T11:22:29.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.636401614999997, 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.403 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.636350186000001, 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:29.407 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.636285395999998, 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.631801048, 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.414 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.626590598, 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:29.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.418 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.626507085999997, 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:29.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:29.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:29.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.945817547000001, 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:29.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.428 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:29.428 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:29.428 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:29.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:29.441 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:29.437+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:29.492 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-26T11:22:29.541 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:29.541+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:29.558 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:29.558 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:29.558 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:29.558 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:29.572 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:29.642 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:29.641+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:29.687 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:29.687 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:29.687 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:29.687 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:29.688 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:29.701 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:29.743 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:29.739+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:29.820 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:29.820 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.050926058999998, 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:29.821 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:29.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:29.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.826 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.827 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.827 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:29.827 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.137096548000002, 2024-04-26T11:22:29.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:29.827 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.827 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.827 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:29.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:29.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:29.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:29.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:29.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:29.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:29.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.833 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.137010812, 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:29.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:29.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:29.839 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.136951639000003, 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:29.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.136866173000001, 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:29.846 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:29.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:29.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:29.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:29.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:29.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.852 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.136806737000001, 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:29.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:29.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:29.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:29.858 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.136726119999999, 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:29.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.864 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.136524915000003, 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:29.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.870 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.136401935999999, 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.136346539999998, 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:29.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:29.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:29.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:29.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:29.881 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.136202728000001, 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:29.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:29.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:29.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:29.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:29.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.887 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.136138033999998, 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:29.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:29.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:29.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:29.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.136045594999999, 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.893 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:29.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:29.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:29.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:29.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:29.898 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.135967504999996, 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:29.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:29.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:29.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:29.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:29.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.904 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.135922010000002, 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:29.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:29.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:29.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.135890803000002, 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.910 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.915 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.135850355999999, 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:29.921 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.135812153000003, 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:29.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:29.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:29.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:29.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:29.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:29.927 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.135761961, 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 36.135673443999998, 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:29.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:29.937 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:29.939 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:29.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:29.937+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:30.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:30.037+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:30.067 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:30.068 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:30.068 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:30.082 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:30.141 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:30.139+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:30.242 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:30.243+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:30.244 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:30.244 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:30.244 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:30.244 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:30.258 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:30.343 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:30.343+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:30.379 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:30.379 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:30.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:30.379 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:30.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.379 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:30.379 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 46.775202237000002, 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:30.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:30.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.696601803, 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.695667129999997, 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:30.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:30.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:30.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:30.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.695594014000001, 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.695542674000002, 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.399 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:30.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:30.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.695492405000003, 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.404 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:30.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:30.409 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.695440105000003, 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:30.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:30.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:30.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:30.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.695390568999997, 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.419 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.695324038999999, 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:30.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:30.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.695038164000003, 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.69350249, 2024-04-26T11:22:30.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.691632300000002, 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:30.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:30.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:30.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.691536188000001, 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:30.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:30.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:30.438 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.669501138000001, 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:30.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:30.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:30.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:30.442 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.669420066000001, 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:30.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.669367152, 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.447 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:30.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:30.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.669259916999998, 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:30.451 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.669205357000003, 2024-04-26T11:22:30.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:30.459 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.668490056000003, 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.463 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 36.666596630999997, 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:30.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:30.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:30.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:30.467 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:30.469 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:30.469 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:30.467+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:30.570 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:30.565+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:30.601 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:30.601 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:30.601 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:22:30.601 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:30.615 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:30.670 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:30.667+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:30.730 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:30.730 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:30.730 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:30.730 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:30.730 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:30.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:30.772 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:30.769+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:30.866 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:30.866 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:30.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:30.866 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:30.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.866 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.866 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:30.866 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.182588656, 2024-04-26T11:22:30.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:30.866 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:30.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.871 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.182462260999998, 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:30.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:30.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:30.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:30.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.182373468000002, 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.182268655000001, 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:30.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:30.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:30.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.182217999000002, 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.182161045999997, 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.892 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.182102053999998, 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:30.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:30.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.181999048000002, 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:30.901 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.181923208000001, 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.908 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.166705645999997, 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:30.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:30.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.162318200000001, 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.912 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:30.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:30.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:30.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.161306384, 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.916 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:30.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:30.920 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.16098272, 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.160926443000001, 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:30.924 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:30.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:30.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:30.927 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.160875013999998, 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:30.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:30.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:30.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.160810224000002, 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.156325875999997, 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:30.935 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:30.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:30.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:30.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.151115425999997, 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.151031914000001, 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.470342375000001, 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:30.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:30.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:30.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:30.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:30.953 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.953 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.953 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.953 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:30.953 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:30.953 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:30.955 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:30.956 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:30.951+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:31.056 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:31.057+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:31.085 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:31.085 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:31.085 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:31.086 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:31.099 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:31.157 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:31.151+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:31.216 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:31.216 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:31.216 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:31.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:31.274 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:31.271+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:31.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:31.357+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 47.621242645999999, 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.391 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:31.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:31.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.707413135000003, 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.402 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.707327399, 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:31.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:31.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:31.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:31.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.707268225999997, 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:31.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:31.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.707182760000002, 2024-04-26T11:22:31.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.707123324000001, 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.420 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:31.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:31.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:31.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:31.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:31.425 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.707042706999999, 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:31.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:31.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:31.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.431 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706841502000003, 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.437 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706718522999999, 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:31.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.443 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706663126999999, 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:31.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:31.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:31.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:31.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:31.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:31.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:31.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.449 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706519315000001, 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:31.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:31.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706454620999999, 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.455 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:31.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:31.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706362181999999, 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.466 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706284091999997, 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:31.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:31.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:31.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706238597000002, 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:31.478 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706207390000003, 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:31.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:31.484 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706166942999999, 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:31.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:31.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:31.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:31.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706128739999997, 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:31.490 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.706078548000001, 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.496 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:31.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:31.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:31.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:31.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:31.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 37.705990030999999, 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:31.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:31.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:31.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:31.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:31.506 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:31.506 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:31.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:22:31.508 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:31.509 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:31.507+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:31.518 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:22:31.597 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:22:31.597 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:22:31.597 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-26T11:22:31.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T11:22:31.609 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:31.607+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:31.639 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:31.639 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:31.639 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:31.640 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:31.653 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:31.679 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:31.679 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:31.701 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:31.701 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:31.710 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:31.707+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:31.721 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:31.721 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:31.773 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:31.773 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:31.787 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:31.811 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:31.811+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:31.902 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:31.902 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-26T11:22:31.902 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 26, 2024-04-26T11:22:31.902 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4", 2024-04-26T11:22:31.902 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-04-26T11:21:32.561072+0000", 2024-04-26T11:22:31.902 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-04-26T11:22:29.474897+0000", 2024-04-26T11:22:31.902 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-04-26T11:21:41.209558+0000", 2024-04-26T11:22:31.902 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-04-26T11:21:33.824306+0000", 2024-04-26T11:22:31.902 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T11:22:31.902 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5806080, 2024-04-26T11:22:31.902 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "nodeep-scrub", 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "noscrub", 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 4, 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-04-26T11:22:31.903 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "reef", 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:41.373843+0000", 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:22:31.904 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:22:31.905 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:22:31.906 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:22:31.907 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:22:31.908 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.89970910549163818, 2024-04-26T11:22:31.909 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:48.112664+0000", 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:22:31.910 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:22:31.911 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "14", 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:22:31.912 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:22:31.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:22:31.914 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.89970910549163818, 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-04-26T11:22:31.915 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:52.071918+0000", 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-04-26T11:22:31.916 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "17", 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:22:31.917 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:22:31.918 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:22:31.919 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-04-26T11:22:31.920 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.89970910549163818, 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-04-26T11:22:31.921 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:52.677679+0000", 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-04-26T11:22:31.922 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:22:31.923 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:22:31.924 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:22:31.925 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.2699999809265137, 2024-04-26T11:22:31.926 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.2699999809265137, 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.2699999809265137, 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.2699999809265137, 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.89970910549163818, 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.89999997615814209, 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.89999997615814209 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "8b4f67c6-5cab-46bf-b296-34fcc29c7766", 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-26T11:22:31.927 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 22, 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6800", 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.928 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6801", 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6802", 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6803", 2024-04-26T11:22:31.929 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6806", 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6807", 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:31.930 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6804", 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6805", 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.931 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.88:6801/21480", 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.88:6803/21480", 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.88:6807/21480", 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.88:6805/21480", 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "d465bcda-9e32-469e-82f3-077db852411e", 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-26T11:22:31.932 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 22, 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6800", 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:31.933 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6801", 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6802", 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:31.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6803", 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6806", 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:31.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6807", 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6804", 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:31.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6805", 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.107:6801/21474", 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.107:6803/21474", 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.107:6807/21474", 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.107:6805/21474", 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-26T11:22:31.937 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "61e99173-e480-4da1-a95b-d98715c3e713", 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 0.699127197265625, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 16, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:22:31.938 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6800", 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6801", 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.939 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6802", 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6803", 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.940 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6806", 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6807", 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6804", 2024-04-26T11:22:31.941 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6805", 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.175:6801/21537", 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.175:6803/21537", 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.175:6807/21537", 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.175:6805/21537", 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:22:31.942 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.131929+0000", 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.943 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.107573+0000", 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:22:31.944 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.162743+0000", 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-04-26T11:22:31.945 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-04-26T11:22:31.946 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-04-26T11:22:31.947 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-04-26T11:22:31.947 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-04-26T11:22:31.947 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-04-26T11:22:31.947 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:31.947 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-26T11:22:31.949 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:31.949 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:31.949 INFO:tasks.thrashosds.thrasher:j is {'epoch': 26, 'fsid': 'ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4', 'created': '2024-04-26T11:21:32.561072+0000', 'modified': '2024-04-26T11:22:29.474897+0000', 'last_up_change': '2024-04-26T11:21:41.209558+0000', 'last_in_change': '2024-04-26T11:21:33.824306+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:21:41.373843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8997091054916382, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:21:48.112664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.8997091054916382, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:21:52.071918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 0.8997091054916382, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:21:52.677679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.2699999809265137, 'score_stable': 1.2699999809265137, 'optimal_score': 1, 'raw_score_acting': 1.2699999809265137, 'raw_score_stable': 1.2699999809265137, 'primary_affinity_weighted': 0.8997091054916382, 'average_primary_affinity': 0.8999999761581421, 'average_primary_affinity_weighted': 0.8999999761581421}}], 'osds': [{'osd': 0, 'uuid': '8b4f67c6-5cab-46bf-b296-34fcc29c7766', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6800', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6801', 'nonce': 21480}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6802', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6803', 'nonce': 21480}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6806', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6807', 'nonce': 21480}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6804', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6805', 'nonce': 21480}]}, 'public_addr': '172.21.15.88:6801/21480', 'cluster_addr': '172.21.15.88:6803/21480', 'heartbeat_back_addr': '172.21.15.88:6807/21480', 'heartbeat_front_addr': '172.21.15.88:6805/21480', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'd465bcda-9e32-469e-82f3-077db852411e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 21474}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 21474}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 21474}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 21474}]}, 'public_addr': '172.21.15.107:6801/21474', 'cluster_addr': '172.21.15.107:6803/21474', 'heartbeat_back_addr': '172.21.15.107:6807/21474', 'heartbeat_front_addr': '172.21.15.107:6805/21474', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '61e99173-e480-4da1-a95b-d98715c3e713', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.699127197265625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6800', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6801', 'nonce': 21537}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6802', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6803', 'nonce': 21537}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6806', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6807', 'nonce': 21537}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6804', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6805', 'nonce': 21537}]}, 'public_addr': '172.21.15.175:6801/21537', 'cluster_addr': '172.21.15.175:6803/21537', 'heartbeat_back_addr': '172.21.15.175:6807/21537', 'heartbeat_front_addr': '172.21.15.175:6805/21537', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.131929+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.107573+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.162743+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T11:22:31.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:22:31.950 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:31.951 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:31.945+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:32.050 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:32.049+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:32.081 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:32.082 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:32.096 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:32.150 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:32.149+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:32.212 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:32.212 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:32.226 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:32.234 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:32.235 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:22:32.251 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-04-26T11:22:31.332396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90048,"kb_used_data":792,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025472,"statfs":{"total":289910292480,"available":289818083328,"internally_reserved":0,"allocated":811008,"data_stored":1436570,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":91352403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1669,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.876684"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.441775+0000","last_change":"2024-04-26T11:21:53.713298+0000","last_active":"2024-04-26T11:22:22.441775+0000","last_peered":"2024-04-26T11:22:22.441775+0000","last_clean":"2024-04-26T11:22:22.441775+0000","last_became_active":"2024-04-26T11:21:53.712481+0000","last_became_peered":"2024-04-26T11:21:53.712481+0000","last_unstale":"2024-04-26T11:22:22.441775+0000","last_undegraded":"2024-04-26T11:22:22.441775+0000","last_fullsized":"2024-04-26T11:22:22.441775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440394+0000","last_change":"2024-04-26T11:21:53.716754+0000","last_active":"2024-04-26T11:22:22.440394+0000","last_peered":"2024-04-26T11:22:22.440394+0000","last_clean":"2024-04-26T11:22:22.440394+0000","last_became_active":"2024-04-26T11:21:53.716109+0000","last_became_peered":"2024-04-26T11:21:53.716109+0000","last_unstale":"2024-04-26T11:22:22.440394+0000","last_undegraded":"2024-04-26T11:22:22.440394+0000","last_fullsized":"2024-04-26T11:22:22.440394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438763+0000","last_change":"2024-04-26T11:21:53.710480+0000","last_active":"2024-04-26T11:22:22.438763+0000","last_peered":"2024-04-26T11:22:22.438763+0000","last_clean":"2024-04-26T11:22:22.438763+0000","last_became_active":"2024-04-26T11:21:53.709433+0000","last_became_peered":"2024-04-26T11:21:53.709433+0000","last_unstale":"2024-04-26T11:22:22.438763+0000","last_undegraded":"2024-04-26T11:22:22.438763+0000","last_fullsized":"2024-04-26T11:22:22.438763+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:11.687344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437881+0000","last_change":"2024-04-26T11:21:53.719849+0000","last_active":"2024-04-26T11:22:22.437881+0000","last_peered":"2024-04-26T11:22:22.437881+0000","last_clean":"2024-04-26T11:22:22.437881+0000","last_became_active":"2024-04-26T11:21:53.719152+0000","last_became_peered":"2024-04-26T11:21:53.719152+0000","last_unstale":"2024-04-26T11:22:22.437881+0000","last_undegraded":"2024-04-26T11:22:22.437881+0000","last_fullsized":"2024-04-26T11:22:22.437881+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440441+0000","last_change":"2024-04-26T11:21:53.712493+0000","last_active":"2024-04-26T11:22:22.440441+0000","last_peered":"2024-04-26T11:22:22.440441+0000","last_clean":"2024-04-26T11:22:22.440441+0000","last_became_active":"2024-04-26T11:21:53.711704+0000","last_became_peered":"2024-04-26T11:21:53.711704+0000","last_unstale":"2024-04-26T11:22:22.440441+0000","last_undegraded":"2024-04-26T11:22:22.440441+0000","last_fullsized":"2024-04-26T11:22:22.440441+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437157+0000","last_change":"2024-04-26T11:21:53.715149+0000","last_active":"2024-04-26T11:22:22.437157+0000","last_peered":"2024-04-26T11:22:22.437157+0000","last_clean":"2024-04-26T11:22:22.437157+0000","last_became_active":"2024-04-26T11:21:53.714125+0000","last_became_peered":"2024-04-26T11:21:53.714125+0000","last_unstale":"2024-04-26T11:22:22.437157+0000","last_undegraded":"2024-04-26T11:22:22.437157+0000","last_fullsized":"2024-04-26T11:22:22.437157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.436814+0000","last_change":"2024-04-26T11:21:53.714653+0000","last_active":"2024-04-26T11:22:22.436814+0000","last_peered":"2024-04-26T11:22:22.436814+0000","last_clean":"2024-04-26T11:22:22.436814+0000","last_became_active":"2024-04-26T11:21:53.713586+0000","last_became_peered":"2024-04-26T11:21:53.713586+0000","last_unstale":"2024-04-26T11:22:22.436814+0000","last_undegraded":"2024-04-26T11:22:22.436814+0000","last_fullsized":"2024-04-26T11:22:22.436814+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:01.563026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.436581+0000","last_change":"2024-04-26T11:21:53.715422+0000","last_active":"2024-04-26T11:22:22.436581+0000","last_peered":"2024-04-26T11:22:22.436581+0000","last_clean":"2024-04-26T11:22:22.436581+0000","last_became_active":"2024-04-26T11:21:53.714329+0000","last_became_peered":"2024-04-26T11:21:53.714329+0000","last_unstale":"2024-04-26T11:22:22.436581+0000","last_undegraded":"2024-04-26T11:22:22.436581+0000","last_fullsized":"2024-04-26T11:22:22.436581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:06.981197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.962862+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:22:22.962862+0000","last_peered":"2024-04-26T11:22:22.962862+0000","last_clean":"2024-04-26T11:22:22.962862+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:22:22.962862+0000","last_undegraded":"2024-04-26T11:22:22.962862+0000","last_fullsized":"2024-04-26T11:22:22.962862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440808+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:22:22.440808+0000","last_peered":"2024-04-26T11:22:22.440808+0000","last_clean":"2024-04-26T11:22:22.440808+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:22:22.440808+0000","last_undegraded":"2024-04-26T11:22:22.440808+0000","last_fullsized":"2024-04-26T11:22:22.440808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438831+0000","last_change":"2024-04-26T11:21:53.714245+0000","last_active":"2024-04-26T11:22:22.438831+0000","last_peered":"2024-04-26T11:22:22.438831+0000","last_clean":"2024-04-26T11:22:22.438831+0000","last_became_active":"2024-04-26T11:21:53.713331+0000","last_became_peered":"2024-04-26T11:21:53.713331+0000","last_unstale":"2024-04-26T11:22:22.438831+0000","last_undegraded":"2024-04-26T11:22:22.438831+0000","last_fullsized":"2024-04-26T11:22:22.438831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439776+0000","last_change":"2024-04-26T11:21:53.712269+0000","last_active":"2024-04-26T11:22:22.439776+0000","last_peered":"2024-04-26T11:22:22.439776+0000","last_clean":"2024-04-26T11:22:22.439776+0000","last_became_active":"2024-04-26T11:21:53.710740+0000","last_became_peered":"2024-04-26T11:21:53.710740+0000","last_unstale":"2024-04-26T11:22:22.439776+0000","last_undegraded":"2024-04-26T11:22:22.439776+0000","last_fullsized":"2024-04-26T11:22:22.439776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439757+0000","last_change":"2024-04-26T11:21:53.712552+0000","last_active":"2024-04-26T11:22:22.439757+0000","last_peered":"2024-04-26T11:22:22.439757+0000","last_clean":"2024-04-26T11:22:22.439757+0000","last_became_active":"2024-04-26T11:21:53.711470+0000","last_became_peered":"2024-04-26T11:21:53.711470+0000","last_unstale":"2024-04-26T11:22:22.439757+0000","last_undegraded":"2024-04-26T11:22:22.439757+0000","last_fullsized":"2024-04-26T11:22:22.439757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437207+0000","last_change":"2024-04-26T11:21:53.705872+0000","last_active":"2024-04-26T11:22:22.437207+0000","last_peered":"2024-04-26T11:22:22.437207+0000","last_clean":"2024-04-26T11:22:22.437207+0000","last_became_active":"2024-04-26T11:21:53.705040+0000","last_became_peered":"2024-04-26T11:21:53.705040+0000","last_unstale":"2024-04-26T11:22:22.437207+0000","last_undegraded":"2024-04-26T11:22:22.437207+0000","last_fullsized":"2024-04-26T11:22:22.437207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:02.015153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437275+0000","last_change":"2024-04-26T11:21:53.707324+0000","last_active":"2024-04-26T11:22:22.437275+0000","last_peered":"2024-04-26T11:22:22.437275+0000","last_clean":"2024-04-26T11:22:22.437275+0000","last_became_active":"2024-04-26T11:21:53.706602+0000","last_became_peered":"2024-04-26T11:21:53.706602+0000","last_unstale":"2024-04-26T11:22:22.437275+0000","last_undegraded":"2024-04-26T11:22:22.437275+0000","last_fullsized":"2024-04-26T11:22:22.437275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.907498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.436811+0000","last_change":"2024-04-26T11:21:53.714327+0000","last_active":"2024-04-26T11:22:22.436811+0000","last_peered":"2024-04-26T11:22:22.436811+0000","last_clean":"2024-04-26T11:22:22.436811+0000","last_became_active":"2024-04-26T11:21:53.712908+0000","last_became_peered":"2024-04-26T11:21:53.712908+0000","last_unstale":"2024-04-26T11:22:22.436811+0000","last_undegraded":"2024-04-26T11:22:22.436811+0000","last_fullsized":"2024-04-26T11:22:22.436811+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:31.158881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.458928+0000","last_change":"2024-04-26T11:22:22.966385+0000","last_active":"2024-04-26T11:22:23.458928+0000","last_peered":"2024-04-26T11:22:23.458928+0000","last_clean":"2024-04-26T11:22:23.458928+0000","last_became_active":"2024-04-26T11:22:22.965634+0000","last_became_peered":"2024-04-26T11:22:22.965634+0000","last_unstale":"2024-04-26T11:22:23.458928+0000","last_undegraded":"2024-04-26T11:22:23.458928+0000","last_fullsized":"2024-04-26T11:22:23.458928+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:00:05.693062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.441323+0000","last_change":"2024-04-26T11:21:53.714983+0000","last_active":"2024-04-26T11:22:22.441323+0000","last_peered":"2024-04-26T11:22:22.441323+0000","last_clean":"2024-04-26T11:22:22.441323+0000","last_became_active":"2024-04-26T11:21:53.711987+0000","last_became_peered":"2024-04-26T11:21:53.711987+0000","last_unstale":"2024-04-26T11:22:22.441323+0000","last_undegraded":"2024-04-26T11:22:22.441323+0000","last_fullsized":"2024-04-26T11:22:22.441323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:49.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.963047+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:22:22.963047+0000","last_peered":"2024-04-26T11:22:22.963047+0000","last_clean":"2024-04-26T11:22:22.963047+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:22:22.963047+0000","last_undegraded":"2024-04-26T11:22:22.963047+0000","last_fullsized":"2024-04-26T11:22:22.963047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438105+0000","last_change":"2024-04-26T11:21:53.715255+0000","last_active":"2024-04-26T11:22:22.438105+0000","last_peered":"2024-04-26T11:22:22.438105+0000","last_clean":"2024-04-26T11:22:22.438105+0000","last_became_active":"2024-04-26T11:21:53.714525+0000","last_became_peered":"2024-04-26T11:21:53.714525+0000","last_unstale":"2024-04-26T11:22:22.438105+0000","last_undegraded":"2024-04-26T11:22:22.438105+0000","last_fullsized":"2024-04-26T11:22:22.438105+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437842+0000","last_change":"2024-04-26T11:21:53.714368+0000","last_active":"2024-04-26T11:22:22.437842+0000","last_peered":"2024-04-26T11:22:22.437842+0000","last_clean":"2024-04-26T11:22:22.437842+0000","last_became_active":"2024-04-26T11:21:53.713099+0000","last_became_peered":"2024-04-26T11:21:53.713099+0000","last_unstale":"2024-04-26T11:22:22.437842+0000","last_undegraded":"2024-04-26T11:22:22.437842+0000","last_fullsized":"2024-04-26T11:22:22.437842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438931+0000","last_change":"2024-04-26T11:21:53.709697+0000","last_active":"2024-04-26T11:22:22.438931+0000","last_peered":"2024-04-26T11:22:22.438931+0000","last_clean":"2024-04-26T11:22:22.438931+0000","last_became_active":"2024-04-26T11:21:53.708839+0000","last_became_peered":"2024-04-26T11:21:53.708839+0000","last_unstale":"2024-04-26T11:22:22.438931+0000","last_undegraded":"2024-04-26T11:22:22.438931+0000","last_fullsized":"2024-04-26T11:22:22.438931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.454826+0000","last_change":"2024-04-26T11:22:22.965573+0000","last_active":"2024-04-26T11:22:23.454826+0000","last_peered":"2024-04-26T11:22:23.454826+0000","last_clean":"2024-04-26T11:22:23.454826+0000","last_became_active":"2024-04-26T11:22:22.964803+0000","last_became_peered":"2024-04-26T11:22:22.964803+0000","last_unstale":"2024-04-26T11:22:23.454826+0000","last_undegraded":"2024-04-26T11:22:23.454826+0000","last_fullsized":"2024-04-26T11:22:23.454826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:49.016909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438513+0000","last_change":"2024-04-26T11:21:53.692834+0000","last_active":"2024-04-26T11:22:22.438513+0000","last_peered":"2024-04-26T11:22:22.438513+0000","last_clean":"2024-04-26T11:22:22.438513+0000","last_became_active":"2024-04-26T11:21:53.690279+0000","last_became_peered":"2024-04-26T11:21:53.690279+0000","last_unstale":"2024-04-26T11:22:22.438513+0000","last_undegraded":"2024-04-26T11:22:22.438513+0000","last_fullsized":"2024-04-26T11:22:22.438513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.441819+0000","last_change":"2024-04-26T11:21:53.698796+0000","last_active":"2024-04-26T11:22:22.441819+0000","last_peered":"2024-04-26T11:22:22.441819+0000","last_clean":"2024-04-26T11:22:22.441819+0000","last_became_active":"2024-04-26T11:21:53.697854+0000","last_became_peered":"2024-04-26T11:21:53.697854+0000","last_unstale":"2024-04-26T11:22:22.441819+0000","last_undegraded":"2024-04-26T11:22:22.441819+0000","last_fullsized":"2024-04-26T11:22:22.441819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.963715+0000","last_change":"2024-04-26T11:21:53.706583+0000","last_active":"2024-04-26T11:22:22.963715+0000","last_peered":"2024-04-26T11:22:22.963715+0000","last_clean":"2024-04-26T11:22:22.963715+0000","last_became_active":"2024-04-26T11:21:53.704871+0000","last_became_peered":"2024-04-26T11:21:53.704871+0000","last_unstale":"2024-04-26T11:22:22.963715+0000","last_undegraded":"2024-04-26T11:22:22.963715+0000","last_fullsized":"2024-04-26T11:22:22.963715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439395+0000","last_change":"2024-04-26T11:21:53.709813+0000","last_active":"2024-04-26T11:22:22.439395+0000","last_peered":"2024-04-26T11:22:22.439395+0000","last_clean":"2024-04-26T11:22:22.439395+0000","last_became_active":"2024-04-26T11:21:53.708399+0000","last_became_peered":"2024-04-26T11:21:53.708399+0000","last_unstale":"2024-04-26T11:22:22.439395+0000","last_undegraded":"2024-04-26T11:22:22.439395+0000","last_fullsized":"2024-04-26T11:22:22.439395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:36.298230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440932+0000","last_change":"2024-04-26T11:21:53.710195+0000","last_active":"2024-04-26T11:22:22.440932+0000","last_peered":"2024-04-26T11:22:22.440932+0000","last_clean":"2024-04-26T11:22:22.440932+0000","last_became_active":"2024-04-26T11:21:53.709660+0000","last_became_peered":"2024-04-26T11:21:53.709660+0000","last_unstale":"2024-04-26T11:22:22.440932+0000","last_undegraded":"2024-04-26T11:22:22.440932+0000","last_fullsized":"2024-04-26T11:22:22.440932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.457449+0000","last_change":"2024-04-26T11:22:22.966443+0000","last_active":"2024-04-26T11:22:23.457449+0000","last_peered":"2024-04-26T11:22:23.457449+0000","last_clean":"2024-04-26T11:22:23.457449+0000","last_became_active":"2024-04-26T11:22:22.965560+0000","last_became_peered":"2024-04-26T11:22:22.965560+0000","last_unstale":"2024-04-26T11:22:23.457449+0000","last_undegraded":"2024-04-26T11:22:23.457449+0000","last_fullsized":"2024-04-26T11:22:23.457449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:16.351173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439193+0000","last_change":"2024-04-26T11:21:53.709264+0000","last_active":"2024-04-26T11:22:22.439193+0000","last_peered":"2024-04-26T11:22:22.439193+0000","last_clean":"2024-04-26T11:22:22.439193+0000","last_became_active":"2024-04-26T11:21:53.708529+0000","last_became_peered":"2024-04-26T11:21:53.708529+0000","last_unstale":"2024-04-26T11:22:22.439193+0000","last_undegraded":"2024-04-26T11:22:22.439193+0000","last_fullsized":"2024-04-26T11:22:22.439193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.456776+0000","last_change":"2024-04-26T11:22:22.966512+0000","last_active":"2024-04-26T11:22:23.456776+0000","last_peered":"2024-04-26T11:22:23.456776+0000","last_clean":"2024-04-26T11:22:23.456776+0000","last_became_active":"2024-04-26T11:22:22.965738+0000","last_became_peered":"2024-04-26T11:22:22.965738+0000","last_unstale":"2024-04-26T11:22:23.456776+0000","last_undegraded":"2024-04-26T11:22:23.456776+0000","last_fullsized":"2024-04-26T11:22:23.456776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:04.294421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437028+0000","last_change":"2024-04-26T11:21:53.708939+0000","last_active":"2024-04-26T11:22:22.437028+0000","last_peered":"2024-04-26T11:22:22.437028+0000","last_clean":"2024-04-26T11:22:22.437028+0000","last_became_active":"2024-04-26T11:21:53.708120+0000","last_became_peered":"2024-04-26T11:21:53.708120+0000","last_unstale":"2024-04-26T11:22:22.437028+0000","last_undegraded":"2024-04-26T11:22:22.437028+0000","last_fullsized":"2024-04-26T11:22:22.437028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440270+0000","last_change":"2024-04-26T11:21:53.712919+0000","last_active":"2024-04-26T11:22:22.440270+0000","last_peered":"2024-04-26T11:22:22.440270+0000","last_clean":"2024-04-26T11:22:22.440270+0000","last_became_active":"2024-04-26T11:21:53.710798+0000","last_became_peered":"2024-04-26T11:21:53.710798+0000","last_unstale":"2024-04-26T11:22:22.440270+0000","last_undegraded":"2024-04-26T11:22:22.440270+0000","last_fullsized":"2024-04-26T11:22:22.440270+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438106+0000","last_change":"2024-04-26T11:21:53.343931+0000","last_active":"2024-04-26T11:22:22.438106+0000","last_peered":"2024-04-26T11:22:22.438106+0000","last_clean":"2024-04-26T11:22:22.438106+0000","last_became_active":"2024-04-26T11:21:53.342363+0000","last_became_peered":"2024-04-26T11:21:53.342363+0000","last_unstale":"2024-04-26T11:22:22.438106+0000","last_undegraded":"2024-04-26T11:22:22.438106+0000","last_fullsized":"2024-04-26T11:22:22.438106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440310+0000","last_change":"2024-04-26T11:21:53.712613+0000","last_active":"2024-04-26T11:22:22.440310+0000","last_peered":"2024-04-26T11:22:22.440310+0000","last_clean":"2024-04-26T11:22:22.440310+0000","last_became_active":"2024-04-26T11:21:53.711848+0000","last_became_peered":"2024-04-26T11:21:53.711848+0000","last_unstale":"2024-04-26T11:22:22.440310+0000","last_undegraded":"2024-04-26T11:22:22.440310+0000","last_fullsized":"2024-04-26T11:22:22.440310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:49.327612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.962288+0000","last_change":"2024-04-26T11:21:53.333005+0000","last_active":"2024-04-26T11:22:22.962288+0000","last_peered":"2024-04-26T11:22:22.962288+0000","last_clean":"2024-04-26T11:22:22.962288+0000","last_became_active":"2024-04-26T11:21:53.332191+0000","last_became_peered":"2024-04-26T11:21:53.332191+0000","last_unstale":"2024-04-26T11:22:22.962288+0000","last_undegraded":"2024-04-26T11:22:22.962288+0000","last_fullsized":"2024-04-26T11:22:22.962288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.456426+0000","last_change":"2024-04-26T11:22:22.965614+0000","last_active":"2024-04-26T11:22:23.456426+0000","last_peered":"2024-04-26T11:22:23.456426+0000","last_clean":"2024-04-26T11:22:23.456426+0000","last_became_active":"2024-04-26T11:22:22.964902+0000","last_became_peered":"2024-04-26T11:22:22.964902+0000","last_unstale":"2024-04-26T11:22:23.456426+0000","last_undegraded":"2024-04-26T11:22:23.456426+0000","last_fullsized":"2024-04-26T11:22:23.456426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:10:27.248495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439149+0000","last_change":"2024-04-26T11:21:53.341523+0000","last_active":"2024-04-26T11:22:22.439149+0000","last_peered":"2024-04-26T11:22:22.439149+0000","last_clean":"2024-04-26T11:22:22.439149+0000","last_became_active":"2024-04-26T11:21:53.340545+0000","last_became_peered":"2024-04-26T11:21:53.340545+0000","last_unstale":"2024-04-26T11:22:22.439149+0000","last_undegraded":"2024-04-26T11:22:22.439149+0000","last_fullsized":"2024-04-26T11:22:22.439149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.907675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.963249+0000","last_change":"2024-04-26T11:21:53.706879+0000","last_active":"2024-04-26T11:22:22.963249+0000","last_peered":"2024-04-26T11:22:22.963249+0000","last_clean":"2024-04-26T11:22:22.963249+0000","last_became_active":"2024-04-26T11:21:53.705082+0000","last_became_peered":"2024-04-26T11:21:53.705082+0000","last_unstale":"2024-04-26T11:22:22.963249+0000","last_undegraded":"2024-04-26T11:22:22.963249+0000","last_fullsized":"2024-04-26T11:22:22.963249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":24,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437275+0000","last_change":"2024-04-26T11:21:53.341655+0000","last_active":"2024-04-26T11:22:22.437275+0000","last_peered":"2024-04-26T11:22:22.437275+0000","last_clean":"2024-04-26T11:22:22.437275+0000","last_became_active":"2024-04-26T11:21:53.340085+0000","last_became_peered":"2024-04-26T11:21:53.340085+0000","last_unstale":"2024-04-26T11:22:22.437275+0000","last_undegraded":"2024-04-26T11:22:22.437275+0000","last_fullsized":"2024-04-26T11:22:22.437275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439795+0000","last_change":"2024-04-26T11:21:53.340063+0000","last_active":"2024-04-26T11:22:22.439795+0000","last_peered":"2024-04-26T11:22:22.439795+0000","last_clean":"2024-04-26T11:22:22.439795+0000","last_became_active":"2024-04-26T11:21:53.339256+0000","last_became_peered":"2024-04-26T11:21:53.339256+0000","last_unstale":"2024-04-26T11:22:22.439795+0000","last_undegraded":"2024-04-26T11:22:22.439795+0000","last_fullsized":"2024-04-26T11:22:22.439795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438628+0000","last_change":"2024-04-26T11:21:53.697700+0000","last_active":"2024-04-26T11:22:22.438628+0000","last_peered":"2024-04-26T11:22:22.438628+0000","last_clean":"2024-04-26T11:22:22.438628+0000","last_became_active":"2024-04-26T11:21:53.696789+0000","last_became_peered":"2024-04-26T11:21:53.696789+0000","last_unstale":"2024-04-26T11:22:22.438628+0000","last_undegraded":"2024-04-26T11:22:22.438628+0000","last_fullsized":"2024-04-26T11:22:22.438628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.441605+0000","last_change":"2024-04-26T11:21:53.341302+0000","last_active":"2024-04-26T11:22:22.441605+0000","last_peered":"2024-04-26T11:22:22.441605+0000","last_clean":"2024-04-26T11:22:22.441605+0000","last_became_active":"2024-04-26T11:21:53.340509+0000","last_became_peered":"2024-04-26T11:21:53.340509+0000","last_unstale":"2024-04-26T11:22:22.441605+0000","last_undegraded":"2024-04-26T11:22:22.441605+0000","last_fullsized":"2024-04-26T11:22:22.441605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:16.781849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438701+0000","last_change":"2024-04-26T11:21:53.716075+0000","last_active":"2024-04-26T11:22:22.438701+0000","last_peered":"2024-04-26T11:22:22.438701+0000","last_clean":"2024-04-26T11:22:22.438701+0000","last_became_active":"2024-04-26T11:21:53.714328+0000","last_became_peered":"2024-04-26T11:21:53.714328+0000","last_unstale":"2024-04-26T11:22:22.438701+0000","last_undegraded":"2024-04-26T11:22:22.438701+0000","last_fullsized":"2024-04-26T11:22:22.438701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:54.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439986+0000","last_change":"2024-04-26T11:21:53.339171+0000","last_active":"2024-04-26T11:22:22.439986+0000","last_peered":"2024-04-26T11:22:22.439986+0000","last_clean":"2024-04-26T11:22:22.439986+0000","last_became_active":"2024-04-26T11:21:53.337433+0000","last_became_peered":"2024-04-26T11:21:53.337433+0000","last_unstale":"2024-04-26T11:22:22.439986+0000","last_undegraded":"2024-04-26T11:22:22.439986+0000","last_fullsized":"2024-04-26T11:22:22.439986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438252+0000","last_change":"2024-04-26T11:21:53.719666+0000","last_active":"2024-04-26T11:22:22.438252+0000","last_peered":"2024-04-26T11:22:22.438252+0000","last_clean":"2024-04-26T11:22:22.438252+0000","last_became_active":"2024-04-26T11:21:53.718871+0000","last_became_peered":"2024-04-26T11:21:53.718871+0000","last_unstale":"2024-04-26T11:22:22.438252+0000","last_undegraded":"2024-04-26T11:22:22.438252+0000","last_fullsized":"2024-04-26T11:22:22.438252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439007+0000","last_change":"2024-04-26T11:21:53.344744+0000","last_active":"2024-04-26T11:22:22.439007+0000","last_peered":"2024-04-26T11:22:22.439007+0000","last_clean":"2024-04-26T11:22:22.439007+0000","last_became_active":"2024-04-26T11:21:53.344055+0000","last_became_peered":"2024-04-26T11:21:53.344055+0000","last_unstale":"2024-04-26T11:22:22.439007+0000","last_undegraded":"2024-04-26T11:22:22.439007+0000","last_fullsized":"2024-04-26T11:22:22.439007+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.963199+0000","last_change":"2024-04-26T11:21:53.709563+0000","last_active":"2024-04-26T11:22:22.963199+0000","last_peered":"2024-04-26T11:22:22.963199+0000","last_clean":"2024-04-26T11:22:22.963199+0000","last_became_active":"2024-04-26T11:21:53.706598+0000","last_became_peered":"2024-04-26T11:21:53.706598+0000","last_unstale":"2024-04-26T11:22:22.963199+0000","last_undegraded":"2024-04-26T11:22:22.963199+0000","last_fullsized":"2024-04-26T11:22:22.963199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.963788+0000","last_change":"2024-04-26T11:21:53.330145+0000","last_active":"2024-04-26T11:22:22.963788+0000","last_peered":"2024-04-26T11:22:22.963788+0000","last_clean":"2024-04-26T11:22:22.963788+0000","last_became_active":"2024-04-26T11:21:53.329256+0000","last_became_peered":"2024-04-26T11:21:53.329256+0000","last_unstale":"2024-04-26T11:22:22.963788+0000","last_undegraded":"2024-04-26T11:22:22.963788+0000","last_fullsized":"2024-04-26T11:22:22.963788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438231+0000","last_change":"2024-04-26T11:21:53.715233+0000","last_active":"2024-04-26T11:22:22.438231+0000","last_peered":"2024-04-26T11:22:22.438231+0000","last_clean":"2024-04-26T11:22:22.438231+0000","last_became_active":"2024-04-26T11:21:53.714405+0000","last_became_peered":"2024-04-26T11:21:53.714405+0000","last_unstale":"2024-04-26T11:22:22.438231+0000","last_undegraded":"2024-04-26T11:22:22.438231+0000","last_fullsized":"2024-04-26T11:22:22.438231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438484+0000","last_change":"2024-04-26T11:21:53.344659+0000","last_active":"2024-04-26T11:22:22.438484+0000","last_peered":"2024-04-26T11:22:22.438484+0000","last_clean":"2024-04-26T11:22:22.438484+0000","last_became_active":"2024-04-26T11:21:53.344024+0000","last_became_peered":"2024-04-26T11:21:53.344024+0000","last_unstale":"2024-04-26T11:22:22.438484+0000","last_undegraded":"2024-04-26T11:22:22.438484+0000","last_fullsized":"2024-04-26T11:22:22.438484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:53.053244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439233+0000","last_change":"2024-04-26T11:21:53.710093+0000","last_active":"2024-04-26T11:22:22.439233+0000","last_peered":"2024-04-26T11:22:22.439233+0000","last_clean":"2024-04-26T11:22:22.439233+0000","last_became_active":"2024-04-26T11:21:53.709020+0000","last_became_peered":"2024-04-26T11:21:53.709020+0000","last_unstale":"2024-04-26T11:22:22.439233+0000","last_undegraded":"2024-04-26T11:22:22.439233+0000","last_fullsized":"2024-04-26T11:22:22.439233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439535+0000","last_change":"2024-04-26T11:21:53.341961+0000","last_active":"2024-04-26T11:22:22.439535+0000","last_peered":"2024-04-26T11:22:22.439535+0000","last_clean":"2024-04-26T11:22:22.439535+0000","last_became_active":"2024-04-26T11:21:53.340768+0000","last_became_peered":"2024-04-26T11:21:53.340768+0000","last_unstale":"2024-04-26T11:22:22.439535+0000","last_undegraded":"2024-04-26T11:22:22.439535+0000","last_fullsized":"2024-04-26T11:22:22.439535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439258+0000","last_change":"2024-04-26T11:21:53.706161+0000","last_active":"2024-04-26T11:22:22.439258+0000","last_peered":"2024-04-26T11:22:22.439258+0000","last_clean":"2024-04-26T11:22:22.439258+0000","last_became_active":"2024-04-26T11:21:53.705388+0000","last_became_peered":"2024-04-26T11:21:53.705388+0000","last_unstale":"2024-04-26T11:22:22.439258+0000","last_undegraded":"2024-04-26T11:22:22.439258+0000","last_fullsized":"2024-04-26T11:22:22.439258+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439741+0000","last_change":"2024-04-26T11:21:53.328489+0000","last_active":"2024-04-26T11:22:22.439741+0000","last_peered":"2024-04-26T11:22:22.439741+0000","last_clean":"2024-04-26T11:22:22.439741+0000","last_became_active":"2024-04-26T11:21:53.327836+0000","last_became_peered":"2024-04-26T11:21:53.327836+0000","last_unstale":"2024-04-26T11:22:22.439741+0000","last_undegraded":"2024-04-26T11:22:22.439741+0000","last_fullsized":"2024-04-26T11:22:22.439741+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:32.644217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.963936+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:22:22.963936+0000","last_peered":"2024-04-26T11:22:22.963936+0000","last_clean":"2024-04-26T11:22:22.963936+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:22:22.963936+0000","last_undegraded":"2024-04-26T11:22:22.963936+0000","last_fullsized":"2024-04-26T11:22:22.963936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":218,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438072+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:22:22.438072+0000","last_peered":"2024-04-26T11:22:22.438072+0000","last_clean":"2024-04-26T11:22:22.438072+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:22:22.438072+0000","last_undegraded":"2024-04-26T11:22:22.438072+0000","last_fullsized":"2024-04-26T11:22:22.438072+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438323+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:22:22.438323+0000","last_peered":"2024-04-26T11:22:22.438323+0000","last_clean":"2024-04-26T11:22:22.438323+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:22:22.438323+0000","last_undegraded":"2024-04-26T11:22:22.438323+0000","last_fullsized":"2024-04-26T11:22:22.438323+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.457362+0000","last_change":"2024-04-26T11:22:22.966306+0000","last_active":"2024-04-26T11:22:23.457362+0000","last_peered":"2024-04-26T11:22:23.457362+0000","last_clean":"2024-04-26T11:22:23.457362+0000","last_became_active":"2024-04-26T11:22:22.965291+0000","last_became_peered":"2024-04-26T11:22:22.965291+0000","last_unstale":"2024-04-26T11:22:23.457362+0000","last_undegraded":"2024-04-26T11:22:23.457362+0000","last_fullsized":"2024-04-26T11:22:23.457362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:48.605392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439445+0000","last_change":"2024-04-26T11:21:53.709499+0000","last_active":"2024-04-26T11:22:22.439445+0000","last_peered":"2024-04-26T11:22:22.439445+0000","last_clean":"2024-04-26T11:22:22.439445+0000","last_became_active":"2024-04-26T11:21:53.707573+0000","last_became_peered":"2024-04-26T11:21:53.707573+0000","last_unstale":"2024-04-26T11:22:22.439445+0000","last_undegraded":"2024-04-26T11:22:22.439445+0000","last_fullsized":"2024-04-26T11:22:22.439445+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437676+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:22:22.437676+0000","last_peered":"2024-04-26T11:22:22.437676+0000","last_clean":"2024-04-26T11:22:22.437676+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:22:22.437676+0000","last_undegraded":"2024-04-26T11:22:22.437676+0000","last_fullsized":"2024-04-26T11:22:22.437676+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.456005+0000","last_change":"2024-04-26T11:22:22.966993+0000","last_active":"2024-04-26T11:22:23.456005+0000","last_peered":"2024-04-26T11:22:23.456005+0000","last_clean":"2024-04-26T11:22:23.456005+0000","last_became_active":"2024-04-26T11:22:22.966452+0000","last_became_peered":"2024-04-26T11:22:22.966452+0000","last_unstale":"2024-04-26T11:22:23.456005+0000","last_undegraded":"2024-04-26T11:22:23.456005+0000","last_fullsized":"2024-04-26T11:22:23.456005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:01.979942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440977+0000","last_change":"2024-04-26T11:21:53.716469+0000","last_active":"2024-04-26T11:22:22.440977+0000","last_peered":"2024-04-26T11:22:22.440977+0000","last_clean":"2024-04-26T11:22:22.440977+0000","last_became_active":"2024-04-26T11:21:53.715684+0000","last_became_peered":"2024-04-26T11:21:53.715684+0000","last_unstale":"2024-04-26T11:22:22.440977+0000","last_undegraded":"2024-04-26T11:22:22.440977+0000","last_fullsized":"2024-04-26T11:22:22.440977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.964313+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:22:22.964313+0000","last_peered":"2024-04-26T11:22:22.964313+0000","last_clean":"2024-04-26T11:22:22.964313+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:22:22.964313+0000","last_undegraded":"2024-04-26T11:22:22.964313+0000","last_fullsized":"2024-04-26T11:22:22.964313+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438863+0000","last_change":"2024-04-26T11:21:53.345743+0000","last_active":"2024-04-26T11:22:22.438863+0000","last_peered":"2024-04-26T11:22:22.438863+0000","last_clean":"2024-04-26T11:22:22.438863+0000","last_became_active":"2024-04-26T11:21:53.344967+0000","last_became_peered":"2024-04-26T11:21:53.344967+0000","last_unstale":"2024-04-26T11:22:22.438863+0000","last_undegraded":"2024-04-26T11:22:22.438863+0000","last_fullsized":"2024-04-26T11:22:22.438863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:08.280572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.963582+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:22:22.963582+0000","last_peered":"2024-04-26T11:22:22.963582+0000","last_clean":"2024-04-26T11:22:22.963582+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:22:22.963582+0000","last_undegraded":"2024-04-26T11:22:22.963582+0000","last_fullsized":"2024-04-26T11:22:22.963582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438595+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:22:22.438595+0000","last_peered":"2024-04-26T11:22:22.438595+0000","last_clean":"2024-04-26T11:22:22.438595+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:22:22.438595+0000","last_undegraded":"2024-04-26T11:22:22.438595+0000","last_fullsized":"2024-04-26T11:22:22.438595+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438134+0000","last_change":"2024-04-26T11:21:53.338037+0000","last_active":"2024-04-26T11:22:22.438134+0000","last_peered":"2024-04-26T11:22:22.438134+0000","last_clean":"2024-04-26T11:22:22.438134+0000","last_became_active":"2024-04-26T11:21:53.337004+0000","last_became_peered":"2024-04-26T11:21:53.337004+0000","last_unstale":"2024-04-26T11:22:22.438134+0000","last_undegraded":"2024-04-26T11:22:22.438134+0000","last_fullsized":"2024-04-26T11:22:22.438134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.963246+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:22:22.963246+0000","last_peered":"2024-04-26T11:22:22.963246+0000","last_clean":"2024-04-26T11:22:22.963246+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:22:22.963246+0000","last_undegraded":"2024-04-26T11:22:22.963246+0000","last_fullsized":"2024-04-26T11:22:22.963246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439716+0000","last_change":"2024-04-26T11:21:53.337312+0000","last_active":"2024-04-26T11:22:22.439716+0000","last_peered":"2024-04-26T11:22:22.439716+0000","last_clean":"2024-04-26T11:22:22.439716+0000","last_became_active":"2024-04-26T11:21:53.336587+0000","last_became_peered":"2024-04-26T11:21:53.336587+0000","last_unstale":"2024-04-26T11:22:22.439716+0000","last_undegraded":"2024-04-26T11:22:22.439716+0000","last_fullsized":"2024-04-26T11:22:22.439716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.458074+0000","last_change":"2024-04-26T11:22:22.965829+0000","last_active":"2024-04-26T11:22:23.458074+0000","last_peered":"2024-04-26T11:22:23.458074+0000","last_clean":"2024-04-26T11:22:23.458074+0000","last_became_active":"2024-04-26T11:22:22.965420+0000","last_became_peered":"2024-04-26T11:22:22.965420+0000","last_unstale":"2024-04-26T11:22:23.458074+0000","last_undegraded":"2024-04-26T11:22:23.458074+0000","last_fullsized":"2024-04-26T11:22:23.458074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:59.139551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439032+0000","last_change":"2024-04-26T11:21:53.697386+0000","last_active":"2024-04-26T11:22:22.439032+0000","last_peered":"2024-04-26T11:22:22.439032+0000","last_clean":"2024-04-26T11:22:22.439032+0000","last_became_active":"2024-04-26T11:21:53.695847+0000","last_became_peered":"2024-04-26T11:21:53.695847+0000","last_unstale":"2024-04-26T11:22:22.439032+0000","last_undegraded":"2024-04-26T11:22:22.439032+0000","last_fullsized":"2024-04-26T11:22:22.439032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.963553+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:22:22.963553+0000","last_peered":"2024-04-26T11:22:22.963553+0000","last_clean":"2024-04-26T11:22:22.963553+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:22:22.963553+0000","last_undegraded":"2024-04-26T11:22:22.963553+0000","last_fullsized":"2024-04-26T11:22:22.963553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.441010+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:22:22.441010+0000","last_peered":"2024-04-26T11:22:22.441010+0000","last_clean":"2024-04-26T11:22:22.441010+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:22:22.441010+0000","last_undegraded":"2024-04-26T11:22:22.441010+0000","last_fullsized":"2024-04-26T11:22:22.441010+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440437+0000","last_change":"2024-04-26T11:21:53.696563+0000","last_active":"2024-04-26T11:22:22.440437+0000","last_peered":"2024-04-26T11:22:22.440437+0000","last_clean":"2024-04-26T11:22:22.440437+0000","last_became_active":"2024-04-26T11:21:53.695678+0000","last_became_peered":"2024-04-26T11:21:53.695678+0000","last_unstale":"2024-04-26T11:22:22.440437+0000","last_undegraded":"2024-04-26T11:22:22.440437+0000","last_fullsized":"2024-04-26T11:22:22.440437+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.964312+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:22:22.964312+0000","last_peered":"2024-04-26T11:22:22.964312+0000","last_clean":"2024-04-26T11:22:22.964312+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:22:22.964312+0000","last_undegraded":"2024-04-26T11:22:22.964312+0000","last_fullsized":"2024-04-26T11:22:22.964312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.458809+0000","last_change":"2024-04-26T11:22:22.966484+0000","last_active":"2024-04-26T11:22:23.458809+0000","last_peered":"2024-04-26T11:22:23.458809+0000","last_clean":"2024-04-26T11:22:23.458809+0000","last_became_active":"2024-04-26T11:22:22.965800+0000","last_became_peered":"2024-04-26T11:22:22.965800+0000","last_unstale":"2024-04-26T11:22:23.458809+0000","last_undegraded":"2024-04-26T11:22:23.458809+0000","last_fullsized":"2024-04-26T11:22:23.458809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:57.952871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.454623+0000","last_change":"2024-04-26T11:22:22.965305+0000","last_active":"2024-04-26T11:22:23.454623+0000","last_peered":"2024-04-26T11:22:23.454623+0000","last_clean":"2024-04-26T11:22:23.454623+0000","last_became_active":"2024-04-26T11:22:22.964810+0000","last_became_peered":"2024-04-26T11:22:22.964810+0000","last_unstale":"2024-04-26T11:22:23.454623+0000","last_undegraded":"2024-04-26T11:22:23.454623+0000","last_fullsized":"2024-04-26T11:22:23.454623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:02:04.175000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.678083+0000","last_change":"2024-04-26T11:21:53.332815+0000","last_active":"2024-04-26T11:22:23.678083+0000","last_peered":"2024-04-26T11:22:23.678083+0000","last_clean":"2024-04-26T11:22:23.678083+0000","last_became_active":"2024-04-26T11:21:53.332020+0000","last_became_peered":"2024-04-26T11:21:53.332020+0000","last_unstale":"2024-04-26T11:22:23.678083+0000","last_undegraded":"2024-04-26T11:22:23.678083+0000","last_fullsized":"2024-04-26T11:22:23.678083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439898+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:22:22.439898+0000","last_peered":"2024-04-26T11:22:22.439898+0000","last_clean":"2024-04-26T11:22:22.439898+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:22:22.439898+0000","last_undegraded":"2024-04-26T11:22:22.439898+0000","last_fullsized":"2024-04-26T11:22:22.439898+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438924+0000","last_change":"2024-04-26T11:21:53.696546+0000","last_active":"2024-04-26T11:22:22.438924+0000","last_peered":"2024-04-26T11:22:22.438924+0000","last_clean":"2024-04-26T11:22:22.438924+0000","last_became_active":"2024-04-26T11:21:53.695670+0000","last_became_peered":"2024-04-26T11:21:53.695670+0000","last_unstale":"2024-04-26T11:22:22.438924+0000","last_undegraded":"2024-04-26T11:22:22.438924+0000","last_fullsized":"2024-04-26T11:22:22.438924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437721+0000","last_change":"2024-04-26T11:21:53.703599+0000","last_active":"2024-04-26T11:22:22.437721+0000","last_peered":"2024-04-26T11:22:22.437721+0000","last_clean":"2024-04-26T11:22:22.437721+0000","last_became_active":"2024-04-26T11:21:53.702893+0000","last_became_peered":"2024-04-26T11:21:53.702893+0000","last_unstale":"2024-04-26T11:22:22.437721+0000","last_undegraded":"2024-04-26T11:22:22.437721+0000","last_fullsized":"2024-04-26T11:22:22.437721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.456891+0000","last_change":"2024-04-26T11:21:53.340288+0000","last_active":"2024-04-26T11:22:23.456891+0000","last_peered":"2024-04-26T11:22:23.456891+0000","last_clean":"2024-04-26T11:22:23.456891+0000","last_became_active":"2024-04-26T11:21:53.339414+0000","last_became_peered":"2024-04-26T11:21:53.339414+0000","last_unstale":"2024-04-26T11:22:23.456891+0000","last_undegraded":"2024-04-26T11:22:23.456891+0000","last_fullsized":"2024-04-26T11:22:23.456891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.962754+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:22:22.962754+0000","last_peered":"2024-04-26T11:22:22.962754+0000","last_clean":"2024-04-26T11:22:22.962754+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:22:22.962754+0000","last_undegraded":"2024-04-26T11:22:22.962754+0000","last_fullsized":"2024-04-26T11:22:22.962754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440858+0000","last_change":"2024-04-26T11:21:53.343465+0000","last_active":"2024-04-26T11:22:22.440858+0000","last_peered":"2024-04-26T11:22:22.440858+0000","last_clean":"2024-04-26T11:22:22.440858+0000","last_became_active":"2024-04-26T11:21:53.342882+0000","last_became_peered":"2024-04-26T11:21:53.342882+0000","last_unstale":"2024-04-26T11:22:22.440858+0000","last_undegraded":"2024-04-26T11:22:22.440858+0000","last_fullsized":"2024-04-26T11:22:22.440858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:41.508747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440140+0000","last_change":"2024-04-26T11:21:53.344846+0000","last_active":"2024-04-26T11:22:22.440140+0000","last_peered":"2024-04-26T11:22:22.440140+0000","last_clean":"2024-04-26T11:22:22.440140+0000","last_became_active":"2024-04-26T11:21:53.342981+0000","last_became_peered":"2024-04-26T11:21:53.342981+0000","last_unstale":"2024-04-26T11:22:22.440140+0000","last_undegraded":"2024-04-26T11:22:22.440140+0000","last_fullsized":"2024-04-26T11:22:22.440140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.962843+0000","last_change":"2024-04-26T11:21:53.706890+0000","last_active":"2024-04-26T11:22:22.962843+0000","last_peered":"2024-04-26T11:22:22.962843+0000","last_clean":"2024-04-26T11:22:22.962843+0000","last_became_active":"2024-04-26T11:21:53.705229+0000","last_became_peered":"2024-04-26T11:21:53.705229+0000","last_unstale":"2024-04-26T11:22:22.962843+0000","last_undegraded":"2024-04-26T11:22:22.962843+0000","last_fullsized":"2024-04-26T11:22:22.962843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.964335+0000","last_change":"2024-04-26T11:21:53.334527+0000","last_active":"2024-04-26T11:22:22.964335+0000","last_peered":"2024-04-26T11:22:22.964335+0000","last_clean":"2024-04-26T11:22:22.964335+0000","last_became_active":"2024-04-26T11:21:53.332325+0000","last_became_peered":"2024-04-26T11:21:53.332325+0000","last_unstale":"2024-04-26T11:22:22.964335+0000","last_undegraded":"2024-04-26T11:22:22.964335+0000","last_fullsized":"2024-04-26T11:22:22.964335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.964599+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:22:22.964599+0000","last_peered":"2024-04-26T11:22:22.964599+0000","last_clean":"2024-04-26T11:22:22.964599+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:22:22.964599+0000","last_undegraded":"2024-04-26T11:22:22.964599+0000","last_fullsized":"2024-04-26T11:22:22.964599+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.441889+0000","last_change":"2024-04-26T11:21:53.696949+0000","last_active":"2024-04-26T11:22:22.441889+0000","last_peered":"2024-04-26T11:22:22.441889+0000","last_clean":"2024-04-26T11:22:22.441889+0000","last_became_active":"2024-04-26T11:21:53.696068+0000","last_became_peered":"2024-04-26T11:21:53.696068+0000","last_unstale":"2024-04-26T11:22:22.441889+0000","last_undegraded":"2024-04-26T11:22:22.441889+0000","last_fullsized":"2024-04-26T11:22:22.441889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.964850+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:22:22.964850+0000","last_peered":"2024-04-26T11:22:22.964850+0000","last_clean":"2024-04-26T11:22:22.964850+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:22:22.964850+0000","last_undegraded":"2024-04-26T11:22:22.964850+0000","last_fullsized":"2024-04-26T11:22:22.964850+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T11:22:23.456096+0000","last_change":"2024-04-26T11:22:22.966645+0000","last_active":"2024-04-26T11:22:23.456096+0000","last_peered":"2024-04-26T11:22:23.456096+0000","last_clean":"2024-04-26T11:22:23.456096+0000","last_became_active":"2024-04-26T11:22:22.966217+0000","last_became_peered":"2024-04-26T11:22:22.966217+0000","last_unstale":"2024-04-26T11:22:23.456096+0000","last_undegraded":"2024-04-26T11:22:23.456096+0000","last_fullsized":"2024-04-26T11:22:23.456096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:14:22.853058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.963789+0000","last_change":"2024-04-26T11:21:53.334972+0000","last_active":"2024-04-26T11:22:22.963789+0000","last_peered":"2024-04-26T11:22:22.963789+0000","last_clean":"2024-04-26T11:22:22.963789+0000","last_became_active":"2024-04-26T11:21:53.332642+0000","last_became_peered":"2024-04-26T11:21:53.332642+0000","last_unstale":"2024-04-26T11:22:22.963789+0000","last_undegraded":"2024-04-26T11:22:22.963789+0000","last_fullsized":"2024-04-26T11:22:22.963789+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440314+0000","last_change":"2024-04-26T11:21:53.709701+0000","last_active":"2024-04-26T11:22:22.440314+0000","last_peered":"2024-04-26T11:22:22.440314+0000","last_clean":"2024-04-26T11:22:22.440314+0000","last_became_active":"2024-04-26T11:21:53.708905+0000","last_became_peered":"2024-04-26T11:21:53.708905+0000","last_unstale":"2024-04-26T11:22:22.440314+0000","last_undegraded":"2024-04-26T11:22:22.440314+0000","last_fullsized":"2024-04-26T11:22:22.440314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439420+0000","last_change":"2024-04-26T11:21:53.330226+0000","last_active":"2024-04-26T11:22:22.439420+0000","last_peered":"2024-04-26T11:22:22.439420+0000","last_clean":"2024-04-26T11:22:22.439420+0000","last_became_active":"2024-04-26T11:21:53.329446+0000","last_became_peered":"2024-04-26T11:21:53.329446+0000","last_unstale":"2024-04-26T11:22:22.439420+0000","last_undegraded":"2024-04-26T11:22:22.439420+0000","last_fullsized":"2024-04-26T11:22:22.439420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:52.599214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440000+0000","last_change":"2024-04-26T11:21:53.716629+0000","last_active":"2024-04-26T11:22:22.440000+0000","last_peered":"2024-04-26T11:22:22.440000+0000","last_clean":"2024-04-26T11:22:22.440000+0000","last_became_active":"2024-04-26T11:21:53.714799+0000","last_became_peered":"2024-04-26T11:21:53.714799+0000","last_unstale":"2024-04-26T11:22:22.440000+0000","last_undegraded":"2024-04-26T11:22:22.440000+0000","last_fullsized":"2024-04-26T11:22:22.440000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:54.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440671+0000","last_change":"2024-04-26T11:21:53.343318+0000","last_active":"2024-04-26T11:22:22.440671+0000","last_peered":"2024-04-26T11:22:22.440671+0000","last_clean":"2024-04-26T11:22:22.440671+0000","last_became_active":"2024-04-26T11:21:53.342789+0000","last_became_peered":"2024-04-26T11:21:53.342789+0000","last_unstale":"2024-04-26T11:22:22.440671+0000","last_undegraded":"2024-04-26T11:22:22.440671+0000","last_fullsized":"2024-04-26T11:22:22.440671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437601+0000","last_change":"2024-04-26T11:21:53.715726+0000","last_active":"2024-04-26T11:22:22.437601+0000","last_peered":"2024-04-26T11:22:22.437601+0000","last_clean":"2024-04-26T11:22:22.437601+0000","last_became_active":"2024-04-26T11:21:53.715126+0000","last_became_peered":"2024-04-26T11:21:53.715126+0000","last_unstale":"2024-04-26T11:22:22.437601+0000","last_undegraded":"2024-04-26T11:22:22.437601+0000","last_fullsized":"2024-04-26T11:22:22.437601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.438473+0000","last_change":"2024-04-26T11:21:53.343934+0000","last_active":"2024-04-26T11:22:22.438473+0000","last_peered":"2024-04-26T11:22:22.438473+0000","last_clean":"2024-04-26T11:22:22.438473+0000","last_became_active":"2024-04-26T11:21:53.342401+0000","last_became_peered":"2024-04-26T11:21:53.342401+0000","last_unstale":"2024-04-26T11:22:22.438473+0000","last_undegraded":"2024-04-26T11:22:22.438473+0000","last_fullsized":"2024-04-26T11:22:22.438473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437432+0000","last_change":"2024-04-26T11:21:53.713092+0000","last_active":"2024-04-26T11:22:22.437432+0000","last_peered":"2024-04-26T11:22:22.437432+0000","last_clean":"2024-04-26T11:22:22.437432+0000","last_became_active":"2024-04-26T11:21:53.712207+0000","last_became_peered":"2024-04-26T11:21:53.712207+0000","last_unstale":"2024-04-26T11:22:22.437432+0000","last_undegraded":"2024-04-26T11:22:22.437432+0000","last_fullsized":"2024-04-26T11:22:22.437432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.440668+0000","last_change":"2024-04-26T11:21:53.345453+0000","last_active":"2024-04-26T11:22:22.440668+0000","last_peered":"2024-04-26T11:22:22.440668+0000","last_clean":"2024-04-26T11:22:22.440668+0000","last_became_active":"2024-04-26T11:21:53.344468+0000","last_became_peered":"2024-04-26T11:21:53.344468+0000","last_unstale":"2024-04-26T11:22:22.440668+0000","last_undegraded":"2024-04-26T11:22:22.440668+0000","last_fullsized":"2024-04-26T11:22:22.440668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.295739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.439605+0000","last_change":"2024-04-26T11:21:53.712311+0000","last_active":"2024-04-26T11:22:22.439605+0000","last_peered":"2024-04-26T11:22:22.439605+0000","last_clean":"2024-04-26T11:22:22.439605+0000","last_became_active":"2024-04-26T11:21:53.711195+0000","last_became_peered":"2024-04-26T11:21:53.711195+0000","last_unstale":"2024-04-26T11:22:22.439605+0000","last_undegraded":"2024-04-26T11:22:22.439605+0000","last_fullsized":"2024-04-26T11:22:22.439605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:50.973181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.964349+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:22:22.964349+0000","last_peered":"2024-04-26T11:22:22.964349+0000","last_clean":"2024-04-26T11:22:22.964349+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:22:22.964349+0000","last_undegraded":"2024-04-26T11:22:22.964349+0000","last_fullsized":"2024-04-26T11:22:22.964349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.437746+0000","last_change":"2024-04-26T11:21:53.713610+0000","last_active":"2024-04-26T11:22:22.437746+0000","last_peered":"2024-04-26T11:22:22.437746+0000","last_clean":"2024-04-26T11:22:22.437746+0000","last_became_active":"2024-04-26T11:21:53.712396+0000","last_became_peered":"2024-04-26T11:21:53.712396+0000","last_unstale":"2024-04-26T11:22:22.437746+0000","last_undegraded":"2024-04-26T11:22:22.437746+0000","last_fullsized":"2024-04-26T11:22:22.437746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T11:22:22.963830+0000","last_change":"2024-04-26T11:21:53.334939+0000","last_active":"2024-04-26T11:22:22.963830+0000","last_peered":"2024-04-26T11:22:22.963830+0000","last_clean":"2024-04-26T11:22:22.963830+0000","last_became_active":"2024-04-26T11:21:53.332735+0000","last_became_peered":"2024-04-26T11:21:53.332735+0000","last_unstale":"2024-04-26T11:22:22.963830+0000","last_undegraded":"2024-04-26T11:22:22.963830+0000","last_fullsized":"2024-04-26T11:22:22.963830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738381,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":81024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738381,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":294912,"data_stored":677465,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":303104,"data_stored":678081,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:22:32.255 INFO:tasks.thrashosds.thrasher:Setting 4.8 to [2, 1] 2024-04-26T11:22:32.255 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.8', '2', '1'] 2024-04-26T11:22:32.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.8 2 1 2024-04-26T11:22:32.255 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:32.249+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:32.342 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:32.342 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:32.352 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:32.351+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:32.356 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:32.453 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:32.447+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:32.484 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:32.484 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:32.494 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:22:32.497 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:32.554 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:32.551+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:32.655 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:32.653+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:32.658 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:32.658 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:32.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:32.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:32.757+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:32.789 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:32.789 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:32.801 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:32.857 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:32.851+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:32.932 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:32.932 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:32.946 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:32.958 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:32.959+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:33.059 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:33.055+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:33.065 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:33.065 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:33.079 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:33.161 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:33.157+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:33.201 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:33.202 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:33.214 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:33.262 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:33.259+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:33.349 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:33.349 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:33.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:33.364 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:33.359+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:33.463 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:33.459+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:33.505 INFO:teuthology.orchestra.run.smithi073.stderr:set 4.8 pg_upmap mapping to [2,1] 2024-04-26T11:22:33.524 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:33.524 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:33.539 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:33.564 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:33.559+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:33.665 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:33.663+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:33.702 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:33.703 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:33.717 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:33.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:22:33.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:33.765+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:33.849 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:33.849 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:33.864 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:33.868 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:33.863+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:33.893 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:33.893 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:33.913 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:33.913 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:33.932 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:33.933 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:33.970 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:33.969+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:33.980 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:33.980 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:33.980 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:33.980 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:33.981 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:33.992 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:34.069 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:34.067+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:34.115 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:34.115 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:34.115 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:34.115 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:34.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.115 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:34.115 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:34.115 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.347328218999998, 2024-04-26T11:22:34.115 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:34.115 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.116 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.117 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:34.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:34.120 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.433498708000002, 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.121 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:34.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:34.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.433412971999999, 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.128 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.129 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:34.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:34.131 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.433353799000002, 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:34.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:34.135 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:34.136 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:34.137 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.433268333000001, 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.139 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:34.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:34.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.144 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.433208897, 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.145 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:34.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:34.150 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.433128279999998, 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:34.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:34.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432927075000002, 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:34.162 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432804095999998, 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:34.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432748699999998, 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:34.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:34.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.174 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432604888, 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:34.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:34.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:34.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:34.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.180 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432540193999998, 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:34.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432447754999998, 2024-04-26T11:22:34.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432369665000003, 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.192 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:34.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:34.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432324170000001, 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.198 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:34.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:34.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432292963000002, 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.204 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:34.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432252515999998, 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.210 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:34.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:34.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:34.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:34.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:34.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432214313000003, 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.218 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:34.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:34.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:34.221 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:34.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:34.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.221 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432164121, 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:34.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:34.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 40.432075603999998, 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:34.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:34.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:34.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:34.233 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:34.235 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:34.235 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:34.229+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:34.337 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:34.331+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:34.367 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:34.368 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:34.368 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:34.368 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:34.381 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:34.437 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:34.431+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:34.504 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:34.504 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:34.504 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:34.504 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:34.504 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:34.514 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:22:34.518 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:34.563 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:34.561+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:34.636 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.030199402000001, 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.637 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:34.638 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.639 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.640 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.951598967999999, 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.641 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.642 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:34.643 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:34.644 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.645 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.646 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.950664295000003, 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.647 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:34.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.652 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.950591179, 2024-04-26T11:22:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:34.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:34.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:34.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:34.658 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.950539839000001, 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:34.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:34.664 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.950489570000002, 2024-04-26T11:22:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.665 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:34.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:34.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.950437270000002, 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.672 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:34.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:34.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.950387734000003, 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:34.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:34.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.950321203999998, 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:34.683 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:34.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:34.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.950035329000002, 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:34.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.948499654999999, 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:34.691 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:34.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:34.695 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.946629465000001, 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:34.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.946533353, 2024-04-26T11:22:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:34.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.924498303, 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:34.706 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:34.710 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.924417231, 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:34.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:34.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.924364316999998, 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:34.715 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:34.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.924257081999997, 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.924202522000002, 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.724 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:34.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:34.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.728 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.923487221000002, 2024-04-26T11:22:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:34.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:34.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 40.921593796000003, 2024-04-26T11:22:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:34.734 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:34.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:34.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:34.738 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:34.739 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:34.740 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:34.741 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:34.739+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:34.841 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:34.841+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:34.871 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:34.871 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:34.871 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:22:34.871 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:34.885 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:34.942 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:34.941+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:35.008 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:35.008 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:35.009 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:35.009 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:35.009 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:35.022 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:35.069 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:35.067+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:35.144 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:35.143+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.463863955000001, 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.149 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:35.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:35.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:35.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:35.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:35.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.155 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.463737559999998, 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:35.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:35.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:35.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.463648767000002, 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:35.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:35.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:35.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:35.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:35.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:35.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:35.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.166 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.463543954000002, 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:35.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:35.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:35.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:35.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:35.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:35.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.463493298000003, 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:35.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:35.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:35.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:35.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:35.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.177 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.463436344999998, 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:35.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:35.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:35.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:35.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:35.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:35.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:35.183 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.183 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.183 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.184 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.184 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:35.184 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.463377352999998, 2024-04-26T11:22:35.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:35.184 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.185 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:35.185 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:35.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:35.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:35.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:35.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:35.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:35.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:35.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:35.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:35.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:35.192 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.193 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.193 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.193 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:35.194 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.463274347000002, 2024-04-26T11:22:35.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:35.194 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.194 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:35.194 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:35.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:35.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:35.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:35.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:35.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:35.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:35.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:35.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:35.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:35.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:35.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:35.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:35.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.463198507000001, 2024-04-26T11:22:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:35.203 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:35.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:35.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:35.212 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.212 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.212 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.212 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:35.213 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:35.213 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.447980944999998, 2024-04-26T11:22:35.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:35.213 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.213 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:35.213 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:35.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:35.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:35.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:35.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:35.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:35.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:35.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:35.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:35.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:35.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:35.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:35.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:35.220 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.221 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.221 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.221 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:35.221 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:35.222 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.443593499000002, 2024-04-26T11:22:35.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:35.222 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.222 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.222 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:35.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:35.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:35.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:35.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:35.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:35.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:35.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:35.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:35.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:35.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:35.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:35.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:35.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:35.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:35.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:35.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:35.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:35.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:35.231 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.231 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.231 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.232 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:35.232 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:35.232 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.442581683, 2024-04-26T11:22:35.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:35.233 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.233 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.233 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:35.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:35.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:35.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:35.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:35.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:35.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:35.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:35.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:35.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:35.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:35.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:35.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:35.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:35.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:35.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:35.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:35.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:35.241 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.242 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.242 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.242 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:35.242 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:35.243 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.442258019000001, 2024-04-26T11:22:35.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:35.243 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.243 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:35.243 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:35.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:35.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:35.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.247 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.442201742000002, 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:35.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:35.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.251 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.442150312999999, 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:35.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:35.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:35.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.442085523000003, 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:35.255 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.258 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.437601174999998, 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:35.262 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.432390724999998, 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:35.266 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.432307213000001, 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:35.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:35.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.270 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 35.751617674000002, 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:35.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:35.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:35.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:35.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:35.275 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:35.277 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:35.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:35.277+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:35.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:35.377+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:35.403 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:35.403 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:35.403 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:35.404 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:35.418 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:35.479 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:35.475+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:35.533 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:35.534 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:35.534 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:35.534 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:35.534 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:35.538 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:22:35.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:35.580 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:35.579+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:35.681 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:35.675+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:35.714 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 51.944859352000002, 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:35.715 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:35.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:35.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.031029840999999, 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:35.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:35.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:35.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.030944105000003, 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:35.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:35.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.030884931999999, 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:35.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:35.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:35.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.030799465999998, 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:35.739 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:35.742 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.745 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.030740029999997, 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:35.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.747 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:35.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.030659413000002, 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.752 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:35.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.757 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.030458207999999, 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:35.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:35.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.763 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.030335229000002, 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:35.766 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.767 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.768 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:35.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.030279833000002, 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:35.770 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.771 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:35.773 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.774 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.775 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:35.776 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.030136020999997, 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.777 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:35.778 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:35.779 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.780 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.781 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.782 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.030071327000002, 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.783 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.784 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.785 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:35.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.029978888000002, 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:35.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.794 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.029900798, 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:35.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:35.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.800 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.029855302999998, 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:35.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:35.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:35.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:35.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:35.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.029824095999999, 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:35.807 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:35.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:35.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:35.813 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.029783649000002, 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:35.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:35.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.029745446, 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:35.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:35.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.825 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.029695254000004, 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:35.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:35.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:35.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 42.029606737000002, 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:35.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:35.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:35.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:35.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.836 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.837 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:35.837 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:35.837 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:35.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:35.839 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:35.839+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:35.939 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:35.935+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:35.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:22:35.968 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:35.968 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:35.968 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:35.968 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:35.982 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:36.040 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:36.039+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:36.097 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:36.097 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:36.098 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:36.098 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:36.098 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:36.108 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:36.108 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:36.111 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:36.126 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:36.127 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:36.141 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:36.135+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:36.146 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:36.147 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:36.235 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:36.235 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:36.242 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:36.239+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:36.249 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:36.343 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:36.343+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:36.380 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:36.380 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:36.394 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:36.444 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:36.445+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:36.510 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:36.510 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:36.524 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:36.544 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:36.543+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:36.639 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:36.639 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:36.645 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:36.639+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:36.653 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:36.745 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:36.743+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:36.783 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:36.783 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:36.797 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:36.846 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:36.847+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:36.919 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:36.920 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:36.935 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:36.982 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:36.979+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:37.048 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:37.047+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:37.055 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:37.055 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:37.070 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:37.149 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:37.147+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:37.202 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:37.202 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:37.217 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:37.249 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:37.247+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:37.338 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:37.339 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:37.350 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:37.347+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:37.352 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:37.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:37.445+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:37.474 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:37.474 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:37.488 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:37.551 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:37.547+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:37.561 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:22:37.618 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:37.618 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:37.632 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:37.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:37.649+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:37.754 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:37.751+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:37.791 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:37.791 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:37.805 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:37.855 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:37.851+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:37.921 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:37.921 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:37.935 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:37.982 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:37.979+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:38.056 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:38.051+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:38.067 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:38.067 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:38.082 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:38.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:38.157+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:38.165 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:22:38.245 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:38.245 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:38.257 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:38.251+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:38.259 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:38.320 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:38.320 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:38.340 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:38.340 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:38.358 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:38.357+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:38.360 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:38.360 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:38.428 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:38.428 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:38.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:38.428 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 54.658246431000002, 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:38.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:38.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:38.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.744416919999999, 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.434 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.435 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:38.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:38.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.744331184000004, 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.441 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:38.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.744272011, 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.447 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:38.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.744186544999998, 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:38.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.744127108999997, 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.459 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:38.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:38.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:38.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.744046492000003, 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.465 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.466 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743845286999999, 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.471 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:38.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:38.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743722308000002, 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:38.482 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743666912000002, 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.488 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743523099999997, 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:38.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.494 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743458406000002, 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.500 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743365967000003, 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:38.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743287877, 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.507 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:38.510 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.511 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.512 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743242381999998, 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.513 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:38.514 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.515 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:38.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:38.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.517 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:38.517 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:38.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.517 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.517 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.518 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.519 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.520 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743211174999999, 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:38.522 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:38.523 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.524 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:38.525 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.526 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743170728000003, 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.527 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:38.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:38.531 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743132525, 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.533 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:38.534 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:38.535 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.536 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.537 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.538 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.743082332999997, 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.539 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.540 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.541 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.542 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:38.544 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 44.742993816000002, 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:38.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:38.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:38.549 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:38.550 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:22:38.550 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:22:38.550 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T11:22:38.550 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 1.000000 2024-04-26T11:22:38.550 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T11:22:38.552 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:38.553 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:38.547+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:38.555 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-26T11:22:38.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:38.649+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:38.685 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:38.686 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:38.686 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:38.686 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:38.700 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:38.752 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:38.751+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:38.853 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:38.847+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:38.865 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:38.865 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:38.879 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:38.954 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:38.951+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:39.004 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.398182767999998, 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.319582334000003, 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:39.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:39.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:39.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:39.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:39.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:39.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.015 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.318647661, 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:39.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:39.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:39.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.020 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.318574544999997, 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:39.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.318523204999998, 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:39.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.318472935999999, 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:39.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:39.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:39.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:39.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:39.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:39.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.036 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.318420635999999, 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:39.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:39.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:39.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:39.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:39.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:39.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:39.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:39.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.3183711, 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:39.043 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.044 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:39.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.048 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.318304570000002, 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:39.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:39.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:39.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:39.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:39.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.053 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.318018694999999, 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:39.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:39.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:39.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.316483021000003, 2024-04-26T11:22:39.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.060 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.314612830999998, 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:39.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:39.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:39.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:39.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:39.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:39.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:39.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:39.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:39.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:39.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:39.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:39.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:39.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.314516718999997, 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:39.066 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:39.070 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.292481668999997, 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:39.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:39.075 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.292400596999997, 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:39.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.292347683000003, 2024-04-26T11:22:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.082 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:39.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:39.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:39.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.292240448000001, 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:39.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:39.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.292185887999999, 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:39.091 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:39.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:39.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.291470586999999, 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:39.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:39.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:39.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:39.100 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 45.289577162, 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:39.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:39.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:39.108 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:39.110 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:39.111 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:39.111+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:39.211 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:39.209+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:39.242 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:39.242 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:39.242 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:22:39.242 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:39.256 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:39.312 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:39.311+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:39.371 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:39.371 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:39.371 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:39.372 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:39.372 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:39.385 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:39.413 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:39.411+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:39.504 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:39.504 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:39.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:39.504 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:39.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.504 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.504 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:39.504 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.818570864999998, 2024-04-26T11:22:39.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:39.504 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:39.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:39.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:39.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:39.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:39.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:39.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:39.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:39.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.818444470000003, 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:39.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:39.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.818355677, 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:39.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:39.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:39.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:39.520 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.818250863999999, 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:39.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:39.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.818200208, 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:39.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:39.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:39.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:39.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:39.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:39.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:39.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.818143255000003, 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:39.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:39.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:39.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:39.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:39.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:39.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.818084263000003, 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.542 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.817981257, 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:39.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.817905416999999, 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:39.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:39.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.802687855000002, 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.798300408999999, 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.554 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:39.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:39.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:39.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.797288592999998, 2024-04-26T11:22:39.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:39.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.796964928999998, 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.566 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.796908651999999, 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:39.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:39.570 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.796857223000004, 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.796792433, 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.792308085000002, 2024-04-26T11:22:39.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:39.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.787097635000002, 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 45.787014122999999, 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:39.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.106324583999999, 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:39.589 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:39.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:39.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:39.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:39.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:39.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:39.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:39.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:39.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:39.594 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.594 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.594 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.594 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:39.594 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:39.594 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:39.596 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T11:22:39.596 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:39.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:39.597+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:39.697 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:39.691+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:39.725 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:39.725 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:39.726 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:39.726 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:39.739 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:39.826 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:39.823+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:39.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:39.897+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:39.905 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:39.905 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:39.905 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:39.905 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:39.905 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:39.919 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:39.999 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:39.997+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:40.090 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 56.320383780999997, 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:40.091 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.092 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.093 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.094 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.094 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:40.094 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:40.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.094 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.094 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.094 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:40.094 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:40.094 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.094 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.094 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.095 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:40.095 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:40.095 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.095 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.095 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.095 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:40.095 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:40.095 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.095 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.096 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.096 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:40.096 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:40.096 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.096 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.096 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.096 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.097 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.406554270000001, 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.098 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.099 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.100 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.101 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.102 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.103 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.406468533999998, 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.104 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.105 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.106 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.107 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.108 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.109 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.406409361000001, 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.110 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.111 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.112 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.113 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:40.114 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.115 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:40.116 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.406323895, 2024-04-26T11:22:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.117 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:40.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.120 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.121 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:40.122 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.406264458999999, 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.124 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.125 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:40.126 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:40.127 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.128 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.129 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.131 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:40.131 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:40.131 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.131 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.131 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.131 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.132 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.406183841999997, 2024-04-26T11:22:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:40.133 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.134 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.134 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.134 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.134 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.134 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:40.134 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.134 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.135 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.135 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:40.135 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.135 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.135 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.135 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.136 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:40.136 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:40.136 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.136 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.136 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.136 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:40.137 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:40.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.137 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.137 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.137 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:40.137 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:40.137 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.138 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.139 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.140 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:40.141 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405982637000001, 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:40.142 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.143 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:40.144 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.146 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405859657999997, 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:40.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:40.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:40.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:40.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:40.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:40.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.153 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405804261999997, 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:40.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:40.159 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405660449999999, 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:40.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:40.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:40.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.165 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405595755999997, 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:40.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:40.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:40.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405503316999997, 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:40.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:40.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.177 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405425227000002, 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:40.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:40.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:40.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405379732, 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.189 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405348525000001, 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:40.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:40.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405308077999997, 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.195 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:40.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405269875000002, 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:40.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:40.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405219682999999, 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.211 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.212 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:40.212 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:40.212 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 46.405131165999997, 2024-04-26T11:22:40.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:40.212 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:40.212 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:40.212 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:40.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:40.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:40.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:40.216 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:40.217 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:40.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:40.219 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:40.219+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:40.319 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:40.319+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:40.350 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:40.351 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:40.351 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:40.351 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:40.364 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:40.377 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:22:40.421 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:40.415+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:40.485 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:40.485 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:40.485 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:40.485 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:40.485 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:40.499 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:40.535 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:40.536 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:40.547 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:40.549+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:40.552 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:40.553 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:40.574 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:40.575 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:40.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:22:40.622 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:40.623+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:40.625 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:40.625 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:40.639 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:40.723 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:40.723+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:40.771 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:40.771 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:40.784 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:40.823 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:40.823+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:40.903 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:40.903 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:40.917 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:40.961 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:40.959+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:41.025 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:41.023+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:41.035 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:41.035 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:41.049 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:41.126 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:41.119+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:41.180 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:41.181 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:41.195 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:41.242 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:41.239+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:41.328 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:41.327+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:41.362 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:41.362 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:41.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:41.428 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:41.423+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:41.498 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:41.498 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:41.512 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:41.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:41.561+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:41.586 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-26T11:22:41.630 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:41.629+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:41.643 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:41.643 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:41.658 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:41.731 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:41.731+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:41.824 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:41.825 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:41.832 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:41.831+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:41.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:41.933 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:41.933+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:41.960 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:41.961 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:41.975 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:42.033 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:42.031+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:42.102 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:42.102 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:42.117 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:42.134 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:42.133+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:42.235 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:42.231+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:42.235 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:42.236 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:42.249 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:42.335 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:42.335+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:42.370 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:42.370 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:42.384 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:42.437 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:42.431+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:42.517 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:42.517 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:42.531 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:42.538 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:42.539+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:42.591 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:22:42.638 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:42.637+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:42.650 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:42.650 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:42.664 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:42.739 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:42.741+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:42.747 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:42.747 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:42.767 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:42.767 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:42.787 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:42.787 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:42.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:42.787 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:42.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.787 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:42.787 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:42.787 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.018651959000003, 2024-04-26T11:22:42.787 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:42.787 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:42.789 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.790 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:42.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.792 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.104822448, 2024-04-26T11:22:42.793 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.794 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:42.795 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.796 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.797 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.798 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.104736711999998, 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.799 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.800 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.801 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:42.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.104677539000001, 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:42.805 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.806 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:42.807 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:42.808 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:42.809 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.810 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:42.811 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.104592072999999, 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:42.812 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:42.813 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.814 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.815 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.816 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:42.817 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.104532636999998, 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:42.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:42.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.822 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:42.823 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.104452019999997, 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.825 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:42.826 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:42.827 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.104250815, 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:42.831 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:42.832 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:42.833 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.834 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.835 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.104127836000004, 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:42.836 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.837 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.838 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.839 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.840 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.841 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.104072440000003, 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.842 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.843 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:42.844 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:42.845 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:42.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:42.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:42.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.846 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.846 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.846 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:42.846 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:42.846 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.847 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.103928627999998, 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:42.848 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:42.849 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.850 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:42.851 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:42.852 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.853 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.103863934000003, 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.854 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:42.855 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:42.856 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:42.857 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.858 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.859 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.103771494999997, 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:42.860 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:42.861 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.862 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:42.863 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.864 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.103693405000001, 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.866 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:42.867 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:42.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.103647909999999, 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.872 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:42.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:42.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:42.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.103616703, 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:42.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:42.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:42.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:42.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:42.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.884 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.103576255999997, 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:42.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:42.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.103538053000001, 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:42.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:42.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:42.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:42.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.103487860999998, 2024-04-26T11:22:42.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:42.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 49.103399344000003, 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:42.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:42.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:42.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:42.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:42.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:42.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:42.908 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.908 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.908 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.908 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:42.908 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:42.908 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:42.909 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:42.911 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:42.911 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:42.912 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:42.909+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:43.013 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:43.007+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:43.043 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:43.043 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:43.043 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:43.043 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:43.057 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:43.111 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:43.111+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:43.179 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:43.179 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:43.179 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:43.179 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:43.179 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:43.193 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:43.213 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:43.211+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:43.314 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:43.313+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 59.710941945999998, 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.316 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:43.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:43.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.320 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.632341511999996, 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:43.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:43.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:43.325 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.631406839, 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:43.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:43.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.631333722999997, 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:43.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:43.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:43.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:43.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:43.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:43.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:43.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:43.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:43.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.631282382999999, 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:43.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:43.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.631232113999999, 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:43.342 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:43.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:43.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.631179813999999, 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:43.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.631130278000001, 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:43.353 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:43.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:43.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.631063748000003, 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.358 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:43.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:43.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.630777873, 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:43.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.629242198999997, 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:43.366 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:43.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:43.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:43.369 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.627372008999998, 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:43.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:43.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.627275896999997, 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:43.377 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.605240846999997, 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:43.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:43.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:43.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:43.381 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.605159774999997, 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:43.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:43.385 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.605106861000003, 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:43.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.604999626000001, 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:43.390 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:43.394 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.604945065999999, 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:43.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:43.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.604229764999999, 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:43.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:43.402 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 49.602336340000001, 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:43.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:43.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:43.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:43.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:43.407 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.407 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.407 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.407 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:43.407 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:43.407 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:43.408 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:43.414 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:43.411+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:43.516 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:43.515+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:43.537 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:43.537 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:43.538 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:22:43.538 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:43.552 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:43.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:22:43.616 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:43.616+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:43.667 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:43.667 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:43.667 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:43.667 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:43.667 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:43.681 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:43.717 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:43.716+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:43.805 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.120392486999997, 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:43.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.811 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.120266092000001, 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:43.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:43.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:43.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.120177298999998, 2024-04-26T11:22:43.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:43.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.822 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.120072485999998, 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:43.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:43.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:43.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:43.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:43.828 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.828 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.828 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.120021829999999, 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.834 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.119964877000001, 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:43.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:43.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.119905885000001, 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:43.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:43.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.843 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.119802878999998, 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:43.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.119727038999997, 2024-04-26T11:22:43.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.104509477000001, 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:43.851 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.100122030999998, 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:43.854 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:43.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.099110215000003, 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.858 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:43.862 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.098786551000003, 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:43.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.098730273999998, 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:43.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.098678845000002, 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:43.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.098614054999999, 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:43.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.094129707, 2024-04-26T11:22:43.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.088919257000001, 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.882 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 50.088835744999997, 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.408146205999998, 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:43.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:43.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:43.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:43.895 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.896 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.896 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.896 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:43.896 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:43.896 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:43.897 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:43.898 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:43.896+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:43.998 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:43.991+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:44.029 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:44.029 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:44.029 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:44.029 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:44.043 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:44.130 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:44.127+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:44.199 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:44.196+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:44.207 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:44.207 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:44.208 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:44.221 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:44.306 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:44.303+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:44.389 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:44.389 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:44.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:44.389 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 60.619044613, 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.705215101999997, 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.395 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.705129366000001, 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.401 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:44.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.705070192999997, 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.407 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:44.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:44.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:44.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.412 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.704984727000003, 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:44.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:44.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:44.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:44.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.704925291000002, 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:44.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.704844674, 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.424 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:44.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:44.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:44.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:44.430 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.704643468999997, 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:44.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:44.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:44.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:44.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:44.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:44.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.435 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.435 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.435 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:44.435 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:44.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.70452049, 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.437 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.438 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:44.439 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:44.440 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.441 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.442 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.704465094, 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:44.443 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.444 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.445 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.446 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.447 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.448 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.704321282000002, 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.449 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.450 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.451 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.452 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.453 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.454 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.704256588, 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.455 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.456 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.457 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.458 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.459 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:44.460 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.704164149, 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.461 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:44.462 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:44.463 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.464 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.465 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.704086058999998, 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.466 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:44.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.467 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.467 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:44.467 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.467 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.467 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:44.469 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:44.470 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.471 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.704040564000003, 2024-04-26T11:22:44.472 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.473 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.474 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:44.475 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:44.476 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.477 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.478 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.704009356999997, 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.479 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:44.480 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:44.481 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:44.482 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.70396891, 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.484 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:44.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.485 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.485 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:44.485 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:44.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.487 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:44.488 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:44.489 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.703930706999998, 2024-04-26T11:22:44.490 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:44.491 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.492 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:44.493 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.494 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.495 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.703880515000002, 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.496 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:44.497 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:44.498 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.499 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.500 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 50.703791998, 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.502 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:44.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:44.504 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:44.505 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:44.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:44.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:44.506 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:44.506 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:44.506 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:44.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.506 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:44.506 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:44.506 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:44.508 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:44.508 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:44.507+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:44.597 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:22:44.597 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:22:44.597 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-26T11:22:44.597 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T11:22:44.597 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T11:22:44.598 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-26T11:22:44.605 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:22:44.641 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:44.641 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:44.641 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:44.641 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:44.641 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:44.640+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:44.655 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:44.709 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:44.703+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:44.729 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:44.729 INFO:teuthology.orchestra.run.smithi107.stdout: "success": "" 2024-04-26T11:22:44.729 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:44.810 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:44.811+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:44.823 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:44.823 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:44.824 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:44.824 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:44.824 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:44.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:44.911 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:44.907+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:44.912 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:22:44.960 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:44.960 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:44.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:44.960 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:44.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.961 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:44.961 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:44.961 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 61.353809282999997, 2024-04-26T11:22:44.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:44.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:44.961 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.961 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:44.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:44.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:44.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:44.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:44.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:44.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:44.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:44.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:44.965 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.966 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:44.966 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.966 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.966 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:44.966 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.275208849000002, 2024-04-26T11:22:44.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:44.966 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:44.966 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.966 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:44.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:44.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:44.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:44.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:44.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:44.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:44.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:44.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:44.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:44.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:44.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:44.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:44.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:44.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:44.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:44.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:44.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:44.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:44.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:44.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.972 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.274274175999999, 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:44.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:44.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:44.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:44.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:44.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:44.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:44.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.979 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.274201060000003, 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:44.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:44.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:44.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:44.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:44.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:44.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:44.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:44.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:44.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:44.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:44.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.985 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.274149719999997, 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:44.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:44.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:44.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:44.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:44.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:44.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:44.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:44.992 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.274099450999998, 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:44.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:44.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:44.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:44.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:44.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:44.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:44.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:44.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:44.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:44.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:44.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:44.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:44.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:44.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:44.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:44.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.274047150999998, 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:44.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:45.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:45.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:45.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:45.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:45.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:45.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:45.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:45.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:45.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:45.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.273997614999999, 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:45.005 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:45.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:45.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:45.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:45.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:45.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:45.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:45.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:45.011 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.273931085000001, 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:45.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:45.015 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.273645209999998, 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:45.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:45.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:45.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:45.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:45.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:45.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.272109536000002, 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:45.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:45.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.270239345999997, 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:45.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:45.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:45.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:45.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:45.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:45.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:45.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.270143234000003, 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:45.029 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:45.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:45.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:45.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:45.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:45.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:45.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.032 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:45.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.248108184000003, 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:45.034 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.038 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.248027112000003, 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:45.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:45.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:45.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:45.041 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:45.042 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.043 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.247974198000001, 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:45.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:45.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:45.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:45.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:45.048 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.247866963, 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:45.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:45.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.053 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:45.054 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:45.054 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.247812402999998, 2024-04-26T11:22:45.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:45.054 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.054 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:45.054 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:45.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:45.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:45.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:45.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:45.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:45.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:45.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:45.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:45.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.058 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.247097101999998, 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:45.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:45.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 51.245203676999999, 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:45.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:45.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:45.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:45.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:45.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:45.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:45.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:45.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:45.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:45.069 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:45.069 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:45.070 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:45.070 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:45.071 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:45.072 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:45.067+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:45.089 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:45.089 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:45.107 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:45.107 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:45.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:45.168+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:45.204 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:45.204 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:45.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:45.272 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:45.267+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:45.335 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:45.335 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:45.349 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:45.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:45.372+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:45.466 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:45.466 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:45.475 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:45.471+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:45.480 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:45.576 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:45.576+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:45.610 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:45.611 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:45.626 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:45.678 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:45.671+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:45.746 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:45.746 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:45.760 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:45.802 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:45.799+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:45.880 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:45.879+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:45.917 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:45.917 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:45.931 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:45.981 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:45.975+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:46.061 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:46.061 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:46.075 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:46.120 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:46.120+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:46.183 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:46.182+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:46.193 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:46.193 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:46.207 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:46.296 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:46.296+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:46.373 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:46.373 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:46.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:46.384+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:46.387 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:46.486 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:46.482+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:46.518 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:46.518 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:46.534 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:46.587 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:46.583+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:46.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:22:46.650 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:46.651 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:46.664 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:46.706 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:46.703+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:46.789 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:46.786+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:46.828 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:46.828 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:46.842 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:46.890 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:46.887+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:46.973 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:46.974 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:46.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:46.991 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:46.988+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:47.091 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:47.086+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:47.108 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:47.108 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:47.123 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:47.126 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:22:47.192 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:47.191+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:47.282 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:47.283 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 63.524169514999997, 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.294 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.295 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:47.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:47.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.298 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.299 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.610340004000001, 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.300 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.301 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.302 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.303 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.304 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.305 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.610254267999998, 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:47.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:47.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.311 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.610195095000002, 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.312 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:47.313 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:47.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:47.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.317 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.610109629, 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:47.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:47.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.610050192999999, 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.327 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.328 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:47.329 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609969575999997, 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:47.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609768371000001, 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:47.335 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609645391999997, 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:47.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:47.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:47.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:47.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:47.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.347 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:47.347 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:47.286+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:47.347 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:47.348 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:47.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:47.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609589995999997, 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:47.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:47.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609446183999999, 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:47.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:47.361 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609381489999997, 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.367 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609289050999998, 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:47.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.373 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609210961000002, 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:47.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:47.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:47.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:47.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609165466, 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:47.385 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609134259000001, 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:47.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:47.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:47.391 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609093811999998, 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609055609000002, 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:47.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:47.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.609005416999999, 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.403 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 53.608916899999997, 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:47.409 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:47.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.413 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.414 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.414 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:47.414 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:47.414 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:47.414 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:47.415 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:47.416 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:47.416+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:47.517 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:47.515+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:47.545 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:47.546 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:47.559 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:47.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:47.616+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:47.636 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:22:47.681 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:47.681 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:47.681 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:47.681 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:47.681 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:47.695 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:47.740 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:47.740+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:47.820 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:47.819+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:47.864 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:47.864 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:47.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:47.864 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:47.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.864 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:47.864 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:47.864 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 64.257450680000005, 2024-04-26T11:22:47.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:47.868 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.178850246000003, 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:47.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:47.874 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.177915573, 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:47.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:47.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.880 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.177842456999997, 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:47.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:47.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:47.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.177791116999998, 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.886 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:47.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.177740847999999, 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.892 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:47.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:47.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:47.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:47.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:47.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:47.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.177688547999999, 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:47.898 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:47.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:47.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.903 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.177639012, 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:47.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.909 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.177572482000002, 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.913 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.177286606999999, 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.175750933000003, 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:47.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:47.921 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.173880742999998, 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:47.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.173784630999997, 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.926 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:47.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:47.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:47.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:47.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:47.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:47.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:47.933 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.151749580999997, 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:47.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:47.938 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.151668508999997, 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:47.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:47.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.151615595000003, 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:47.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.151508360000001, 2024-04-26T11:22:47.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:47.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.151453799999999, 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.952 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:47.956 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.150738498999999, 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:47.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:47.960 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 54.148845074, 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:47.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:47.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:47.965 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:47.967 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:47.968 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:47.964+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:48.068 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:48.066+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:48.098 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:48.098 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:48.099 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:22:48.099 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:48.114 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:48.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:48.168+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:48.231 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:48.231 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:48.231 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:48.231 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:48.231 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:48.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:48.290 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:48.287+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:48.371 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:48.371 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:48.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:48.371 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:48.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.371 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.371 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:48.371 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.685008893000003, 2024-04-26T11:22:48.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:48.371 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.371 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:48.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.684882498, 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.381 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.684793704999997, 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:48.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:48.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:48.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.684688891999997, 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:48.387 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:48.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:48.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:48.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.684638235999998, 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.397 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.684581283, 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:48.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:48.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:48.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:48.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:48.402 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.684522291, 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:48.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:48.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.406 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.684419284999997, 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:48.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:48.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.684343445000003, 2024-04-26T11:22:48.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:48.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.669125883, 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:48.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.664738436999997, 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:48.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.420 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.663726621000002, 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.663402957000002, 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:48.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:48.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.663346679999997, 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:48.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.663295251000001, 2024-04-26T11:22:48.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:48.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:48.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:48.434 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.663230460999998, 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:48.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.658746112999999, 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:48.438 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:48.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:48.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.441 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.653535663, 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:48.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.653452151000003, 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:48.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:48.449 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 48.972762611999997, 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:48.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:48.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:48.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:48.454 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:48.454 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:48.454 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:48.368+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:48.455 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:48.471 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:48.472+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:48.572 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:48.566+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:48.585 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:48.585 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:48.585 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:48.586 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:48.599 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:48.673 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:48.670+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:48.766 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:48.766 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:48.766 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:48.766 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:48.766 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:48.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:48.772+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:48.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:48.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:48.872+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 65.136751805000003, 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.907 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:48.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:48.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.912 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.222922294, 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:48.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:48.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.222836557999997, 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.924 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.222777385000001, 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:48.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.927 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:48.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:48.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.222691918999999, 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:48.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.222632482999998, 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:48.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:48.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.941 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.222551866000003, 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:48.947 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.222350661, 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:48.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:48.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:48.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:48.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:48.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:48.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:48.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.222227682000003, 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:48.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:48.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:48.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:48.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.222172286000003, 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.967 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.222028473999998, 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:48.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:48.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:48.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.973 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.221963780000003, 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:48.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:48.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:48.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:48.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.221871341000003, 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:48.979 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:48.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:48.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.221793251000001, 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:48.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:48.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:48.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.221747755999999, 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:48.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:48.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:48.996 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.221716549, 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:48.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:48.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.221676102000004, 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:49.002 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:49.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:49.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:49.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:49.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:49.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.221637899000001, 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:49.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:49.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:49.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:49.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.221587706999998, 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:49.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:49.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:49.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:49.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:49.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 55.221499190000003, 2024-04-26T11:22:49.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:49.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:49.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:49.023 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:49.024 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:49.024 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:49.024 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:49.025 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:49.026 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:49.018+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:49.126 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:49.122+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:49.157 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:49.157 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:49.157 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:49.158 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:49.171 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:49.227 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:49.226+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:49.292 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:49.293 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:49.293 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:49.293 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:49.293 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:49.307 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:49.327 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:49.326+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:49.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:22:49.428 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:49.422+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:49.431 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 65.825255831999996, 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:49.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:49.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:49.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.436 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.746655398000001, 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:49.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.745720724999998, 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:49.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:49.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.745647609000002, 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:49.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.745596269000004, 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.452 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:49.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:49.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:49.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.745545999999997, 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:49.457 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:49.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.745493699999997, 2024-04-26T11:22:49.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:49.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.467 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.745444163999998, 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.745377634, 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:49.472 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.745091758999997, 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.743556085000002, 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:49.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:49.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:49.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:49.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:49.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.741685895000003, 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.483 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.741589783000002, 2024-04-26T11:22:49.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:49.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:49.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.719554733000002, 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.491 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:49.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.719473661000002, 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.495 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.496 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:49.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:49.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:49.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:49.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:49.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:49.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:49.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:49.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:49.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:49.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:49.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:49.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:49.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:49.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:49.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:49.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:49.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:49.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.503 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.503 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:49.503 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:49.504 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.719420747000001, 2024-04-26T11:22:49.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:49.504 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.504 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.504 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:49.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:49.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:49.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:49.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:49.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:49.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:49.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:49.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:49.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:49.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:49.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:49.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:49.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:49.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:49.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:49.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:49.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:49.511 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.512 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.512 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.512 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:49.512 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:49.512 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.719313511999999, 2024-04-26T11:22:49.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:49.513 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.513 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.513 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:49.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:49.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:49.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:49.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:49.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:49.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:49.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:49.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:49.520 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.520 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.520 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.520 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:49.521 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:49.521 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.719258951999997, 2024-04-26T11:22:49.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:49.521 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.521 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.521 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:49.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:49.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:49.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.525 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.718543650999997, 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:49.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:49.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 55.716650225999999, 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:49.530 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:49.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:49.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:49.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:49.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:49.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:49.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:49.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:49.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.534 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.534 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:49.534 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:49.534 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:49.536 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:49.536 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:49.534+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:49.558 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:49.559 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:49.578 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:49.579 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:49.595 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:49.596 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:49.636 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:49.636+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:49.659 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:22:49.665 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:49.665 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:49.679 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:49.736 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:49.734+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:49.745 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:22:49.745 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:22:49.745 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-04-26T11:22:49.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-04-26T11:22:49.802 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:49.802 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:49.816 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:49.858 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:49.858+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:49.914 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-04-26T11:22:49.937 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:49.938+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:49.977 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:49.977 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:49.992 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:50.039 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:50.036+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:50.067 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-04-26T11:22:50.122 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:50.122 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:50.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:50.140 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:50.138+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:50.241 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:50.238+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:50.252 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:50.252 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:50.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:50.342 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:50.334+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:50.389 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:50.389 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:50.405 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:50.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:50.452+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:50.536 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:50.536 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:50.543 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:50.542+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:50.550 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:50.644 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:50.642+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:50.644 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-26T11:22:50.716 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:50.716 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:50.730 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:50.776 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:50.776+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:50.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:50.844+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:50.850 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:50.851 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:50.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:50.946 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:50.946+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:50.995 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:50.996 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:51.010 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:51.047 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:51.044+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:51.179 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:51.176+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:51.280 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:51.278+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:51.304 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:51.304 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:51.320 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:51.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:51.380+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:51.435 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:51.435 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:51.449 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:51.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:51.480+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:51.578 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:51.578 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:51.582 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:51.582+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:51.593 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:51.612 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:22:51.684 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:51.682+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:51.751 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:51.751 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:51.765 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:51.766 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:51.766 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:51.785 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:51.782+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:51.786 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:51.786 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:51.805 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:51.806 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:51.886 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:51.884+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:51.932 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:51.932 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:51.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:51.932 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.161858530000003, 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.933 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:51.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:51.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.938 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.248029019000001, 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:51.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:51.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.944 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.247943282999998, 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:51.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:51.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.247884110000001, 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:51.951 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:51.952 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.953 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:51.956 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.247798644, 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:51.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:51.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:51.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.247739207999999, 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:51.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:51.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:51.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.247658590999997, 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:51.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:51.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:51.974 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.247457386000001, 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:51.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:51.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:51.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:51.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:51.980 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.247334406999997, 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:51.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:51.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:51.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:51.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.247279011000003, 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:51.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:51.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:51.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.247135198999999, 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:51.993 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:51.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:51.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:51.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.247070505000003, 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:51.999 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:52.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:52.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:52.005 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.246978065999997, 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:52.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:52.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:52.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:52.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.246899976000002, 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:52.011 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:52.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:52.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:52.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.246854481, 2024-04-26T11:22:52.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:52.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:52.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:52.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:52.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:52.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:52.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:52.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:52.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:52.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:52.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:52.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:52.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:52.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.246823274, 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:52.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:52.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:52.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.246782826999997, 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:52.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:52.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:52.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:52.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.246744624000002, 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.037 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:52.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:52.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.040 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.041 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.042 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.246694431999998, 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.043 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:52.044 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.045 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.046 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.047 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:52.048 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 58.246605915000004, 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:52.049 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.050 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.051 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:52.053 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:52.054 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:52.054 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:52.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:52.056 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:52.054+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:52.157 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:52.154+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:52.184 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:52.184 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:52.184 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:52.184 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:52.198 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:52.257 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:52.256+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:52.315 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:52.315 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:52.315 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:52.315 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:52.315 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:52.329 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:52.358 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:52.358+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:52.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:52.456+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:52.499 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:52.499 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:52.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:52.499 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:52.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.499 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:52.499 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:52.499 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.892535745000004, 2024-04-26T11:22:52.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:52.499 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.499 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:52.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.813935311000002, 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.508 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.813000637999998, 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:52.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.812927522000003, 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:52.514 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.519 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.812876181999997, 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:52.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.524 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.812825912999998, 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:52.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:52.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.812773612999997, 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.530 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:52.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.535 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.812724076999999, 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:52.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:52.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:52.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.812657547000001, 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.544 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.812371671999998, 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:52.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:52.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:52.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.810835998000002, 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:52.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.808965807999996, 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.552 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:52.556 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.808869696000002, 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:52.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.560 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.786834646000003, 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:52.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.786753574000002, 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:52.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.786700660000001, 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:52.569 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:52.573 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.786593425, 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:52.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.786538864999997, 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:52.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:52.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:52.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.785823563999998, 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 58.783930138999999, 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.586 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:52.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:52.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:52.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:52.590 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:52.590 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:52.592 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:52.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:52.592+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:52.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:22:52.693 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:52.690+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:52.724 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:52.724 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:52.725 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:22:52.725 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:52.738 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:52.793 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:52.792+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:52.859 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:52.859 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:52.859 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:52.860 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:52.860 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:52.873 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:52.894 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:52.894+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:52.992 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:52.992 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:52.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:52.992 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.306547033000001, 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:52.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:52.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:52.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:52.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:52.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:52.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:52.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:52.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:52.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:52.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:52.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:52.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:52.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.306420637999999, 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:52.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:53.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.306331845000003, 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.004 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:53.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:53.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:53.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:53.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:53.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:53.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:53.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:53.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:53.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:53.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:53.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.010 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.306227032000002, 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:53.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:53.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:53.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:53.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:53.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:53.016 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.016 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.016 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.017 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.017 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:53.017 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.306176376000003, 2024-04-26T11:22:53.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:53.017 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.017 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.017 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:53.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:53.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:53.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:53.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:53.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.306119422999998, 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:53.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:53.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:53.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:53.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:53.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:53.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:53.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:53.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:53.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:53.028 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.028 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.028 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.029 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.029 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:53.029 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.306060430999999, 2024-04-26T11:22:53.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:53.029 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.305957425000003, 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.036 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.305881585000002, 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:53.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:53.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:53.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:53.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:53.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:53.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.290664022999998, 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:53.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:53.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.286276577000002, 2024-04-26T11:22:53.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:53.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:53.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:53.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:53.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:53.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:53.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:53.049 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.050 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.050 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.050 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:53.050 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:53.050 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.285264761000001, 2024-04-26T11:22:53.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:53.050 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.050 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.050 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:53.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:53.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:53.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.284941097000001, 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:53.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:53.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:53.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:53.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:53.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:53.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:53.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:53.059 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.059 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.059 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.284884820000002, 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:53.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:53.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:53.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:53.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:53.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:53.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.284833390999999, 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:53.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.067 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.284768601000003, 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:53.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.072 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:53.072 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:53.072 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.280284252999998, 2024-04-26T11:22:53.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:53.072 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.072 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:53.072 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.275073802999998, 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:53.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:53.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:53.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:53.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:53.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.274990291000002, 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:53.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:53.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:53.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:53.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:53.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 53.594300752000002, 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:53.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:53.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:53.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:53.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:53.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:53.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:53.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:53.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.091 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:53.091 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:53.091 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:53.093 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:53.093 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:53.090+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:53.194 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:53.192+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:53.223 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:53.223 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:53.223 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:53.223 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:53.237 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:53.295 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:53.294+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:53.359 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:53.359 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:53.359 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:53.359 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:53.359 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:53.373 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:53.396 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:53.396+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:53.498 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:53.496+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:53.542 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:53.542 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 69.771988836999995, 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:53.543 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.544 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.545 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.546 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.858159325999999, 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.549 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.550 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.554 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.858073590000004, 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:53.555 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.556 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.557 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.559 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.560 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.858014417, 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:53.561 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:53.562 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:53.563 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.564 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.565 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.566 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.857928950999998, 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.567 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.568 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.569 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.570 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.572 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.857869514999997, 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:53.573 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.574 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:53.576 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:53.577 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.857788898000003, 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:53.578 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:53.579 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:53.580 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.581 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:53.582 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:53.583 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.857587692999999, 2024-04-26T11:22:53.584 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.585 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.586 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.587 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:53.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:53.589 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.857464714000002, 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:53.590 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.591 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.592 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.593 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.594 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.595 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.857409318000002, 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:53.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:53.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:53.601 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.857265505999997, 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.602 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.603 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.604 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.605 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.606 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.607 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.857200812000002, 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.608 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:53.609 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.610 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.611 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.612 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.613 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.857108373000003, 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.614 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:53.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:53.616 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:53.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:53.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.619 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.857030283, 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:53.620 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:53.621 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:53.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:53.623 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.856984787999998, 2024-04-26T11:22:53.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:53.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:53.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:53.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.856953580999999, 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:53.631 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:53.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:53.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:53.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.856913134000003, 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:53.637 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:53.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:53.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:53.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.856874931, 2024-04-26T11:22:53.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:53.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:53.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.856824738999997, 2024-04-26T11:22:53.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.657 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 59.856736222000002, 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:53.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:53.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:53.662 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:53.663 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-26T11:22:53.664 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:53.665 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:53.662+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:53.765 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:53.764+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:53.793 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:53.794 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:53.794 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:53.794 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:53.810 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:53.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:22:53.865 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:53.862+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:53.965 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:53.965 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:53.966 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:53.966+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:53.971 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:53.972 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:53.972 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:53.972 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:53.972 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:53.987 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:53.987 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:53.988 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:54.006 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:54.007 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:54.067 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:54.066+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:54.109 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:54.109 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:54.125 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:54.168 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:54.168+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:54.254 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:54.254 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:54.268 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:54.269 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:54.266+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:54.370 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:54.370+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:54.384 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:54.384 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:54.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:54.486 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:54.486+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:54.562 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:54.562 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:54.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:54.572+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:54.576 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:54.673 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:54.670+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:54.706 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:54.706 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:54.720 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:54.774 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:54.774+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:54.842 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:54.842 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:54.856 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:54.874 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:54.872+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:54.973 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:54.973 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:54.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:54.972+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:54.987 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:55.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:55.076+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:55.117 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:55.117 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:55.131 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:55.176 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:55.174+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:55.217 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:22:55.217 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:22:55.218 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T11:22:55.218 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T11:22:55.277 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:55.274+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:55.299 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:55.299 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:55.313 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:55.378 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:55.376+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:55.430 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:55.430 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:55.444 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:55.479 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:55.478+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:55.533 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:55.533 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-26T11:22:55.533 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 38, 2024-04-26T11:22:55.533 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4", 2024-04-26T11:22:55.533 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-04-26T11:21:32.561072+0000", 2024-04-26T11:22:55.533 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-04-26T11:22:53.641278+0000", 2024-04-26T11:22:55.533 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-04-26T11:21:41.209558+0000", 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-04-26T11:21:33.824306+0000", 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5806080, 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "nodeep-scrub", 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "noscrub", 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T11:22:55.534 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 4, 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "luminous", 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "reef", 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:41.373843+0000", 2024-04-26T11:22:55.535 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-04-26T11:22:55.536 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:22:55.537 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:22:55.538 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:22:55.539 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:22:55.539 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:22:55.539 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:22:55.539 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:22:55.539 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:22:55.539 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:22:55.539 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:22:55.539 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:22:55.540 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-26T11:22:55.541 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:48.112664+0000", 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:22:55.542 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:22:55.543 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "14", 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:22:55.544 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:22:55.545 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.546 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-04-26T11:22:55.547 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:52.071918+0000", 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-04-26T11:22:55.548 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "17", 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:22:55.549 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:22:55.550 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:22:55.551 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-26T11:22:55.552 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.1299999952316284, 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.1299999952316284, 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.553 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:52.677679+0000", 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:22:55.554 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.555 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:22:55.556 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.557 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-04-26T11:22:55.558 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.0800000429153442, 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.0800000429153442, 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.0800000429153442, 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.0800000429153442, 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 1, 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 1, 2024-04-26T11:22:55.559 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 1 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "8b4f67c6-5cab-46bf-b296-34fcc29c7766", 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:22:55.560 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 22, 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6800", 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6801", 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.561 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6802", 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6803", 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.562 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6806", 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6807", 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.563 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6804", 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6805", 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.564 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.88:6801/21480", 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.88:6803/21480", 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.88:6807/21480", 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.88:6805/21480", 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-26T11:22:55.565 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "d465bcda-9e32-469e-82f3-077db852411e", 2024-04-26T11:22:55.566 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-26T11:22:55.566 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:22:55.566 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:22:55.566 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-26T11:22:55.566 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:22:55.566 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:22:55.566 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:22:55.566 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 28, 2024-04-26T11:22:55.566 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-26T11:22:55.566 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:22:55.566 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6800", 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6801", 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:22:55.567 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6802", 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6803", 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.568 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.569 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.569 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6806", 2024-04-26T11:22:55.570 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:55.570 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.571 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.571 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.571 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6807", 2024-04-26T11:22:55.571 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:55.571 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.571 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.571 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.571 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:22:55.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6804", 2024-04-26T11:22:55.572 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:55.572 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.572 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.572 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.572 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6805", 2024-04-26T11:22:55.572 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.107:6801/21474", 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.107:6803/21474", 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.107:6807/21474", 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.107:6805/21474", 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.573 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "61e99173-e480-4da1-a95b-d98715c3e713", 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 32, 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:22:55.574 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6800", 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6801", 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.575 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6802", 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6803", 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.576 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6806", 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6807", 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.577 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6804", 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6805", 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.578 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.175:6801/21537", 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.175:6803/21537", 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.175:6807/21537", 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.175:6805/21537", 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:22:55.579 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.131929+0000", 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.107573+0000", 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-26T11:22:55.580 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.162743+0000", 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [ 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "4.8", 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-26T11:22:55.581 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: 1 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-04-26T11:22:55.582 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-04-26T11:22:55.583 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-04-26T11:22:55.584 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:22:55.584 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-26T11:22:55.585 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:55.585 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:55.586 INFO:tasks.thrashosds.thrasher:j is {'epoch': 38, 'fsid': 'ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4', 'created': '2024-04-26T11:21:32.561072+0000', 'modified': '2024-04-26T11:22:53.641278+0000', 'last_up_change': '2024-04-26T11:21:41.209558+0000', 'last_in_change': '2024-04-26T11:21:33.824306+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:21:41.373843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:21:48.112664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:21:52.071918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:21:52.677679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.0800000429153442, 'score_stable': 1.0800000429153442, 'optimal_score': 1, 'raw_score_acting': 1.0800000429153442, 'raw_score_stable': 1.0800000429153442, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '8b4f67c6-5cab-46bf-b296-34fcc29c7766', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6800', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6801', 'nonce': 21480}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6802', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6803', 'nonce': 21480}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6806', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6807', 'nonce': 21480}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6804', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6805', 'nonce': 21480}]}, 'public_addr': '172.21.15.88:6801/21480', 'cluster_addr': '172.21.15.88:6803/21480', 'heartbeat_back_addr': '172.21.15.88:6807/21480', 'heartbeat_front_addr': '172.21.15.88:6805/21480', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'd465bcda-9e32-469e-82f3-077db852411e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 28, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 21474}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 21474}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 21474}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 21474}]}, 'public_addr': '172.21.15.107:6801/21474', 'cluster_addr': '172.21.15.107:6803/21474', 'heartbeat_back_addr': '172.21.15.107:6807/21474', 'heartbeat_front_addr': '172.21.15.107:6805/21474', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '61e99173-e480-4da1-a95b-d98715c3e713', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 32, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6800', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6801', 'nonce': 21537}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6802', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6803', 'nonce': 21537}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6806', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6807', 'nonce': 21537}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6804', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6805', 'nonce': 21537}]}, 'public_addr': '172.21.15.175:6801/21537', 'cluster_addr': '172.21.15.175:6803/21537', 'heartbeat_back_addr': '172.21.15.175:6807/21537', 'heartbeat_front_addr': '172.21.15.175:6805/21537', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.131929+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.107573+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.162743+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.8', 'osds': [2, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T11:22:55.586 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:22:55.587 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:55.584+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:55.589 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:55.672 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:22:55.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:55.684+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:55.705 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:55.705 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:55.719 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:55.787 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:55.786+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:55.842 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:55.842 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:55.857 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:55.883 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:22:55.885 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:22:55.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:55.888+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:55.900 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-26T11:22:55.340377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90348,"kb_used_data":1096,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025172,"statfs":{"total":289910292480,"available":289817776128,"internally_reserved":0,"allocated":1122304,"data_stored":1598082,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":91352403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.706889"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637069+0000","last_change":"2024-04-26T11:21:53.713298+0000","last_active":"2024-04-26T11:22:47.637069+0000","last_peered":"2024-04-26T11:22:47.637069+0000","last_clean":"2024-04-26T11:22:47.637069+0000","last_became_active":"2024-04-26T11:21:53.712481+0000","last_became_peered":"2024-04-26T11:21:53.712481+0000","last_unstale":"2024-04-26T11:22:47.637069+0000","last_undegraded":"2024-04-26T11:22:47.637069+0000","last_fullsized":"2024-04-26T11:22:47.637069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636322+0000","last_change":"2024-04-26T11:21:53.716754+0000","last_active":"2024-04-26T11:22:47.636322+0000","last_peered":"2024-04-26T11:22:47.636322+0000","last_clean":"2024-04-26T11:22:47.636322+0000","last_became_active":"2024-04-26T11:21:53.716109+0000","last_became_peered":"2024-04-26T11:21:53.716109+0000","last_unstale":"2024-04-26T11:22:47.636322+0000","last_undegraded":"2024-04-26T11:22:47.636322+0000","last_fullsized":"2024-04-26T11:22:47.636322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837094+0000","last_change":"2024-04-26T11:21:53.710480+0000","last_active":"2024-04-26T11:22:48.837094+0000","last_peered":"2024-04-26T11:22:48.837094+0000","last_clean":"2024-04-26T11:22:48.837094+0000","last_became_active":"2024-04-26T11:21:53.709433+0000","last_became_peered":"2024-04-26T11:21:53.709433+0000","last_unstale":"2024-04-26T11:22:48.837094+0000","last_undegraded":"2024-04-26T11:22:48.837094+0000","last_fullsized":"2024-04-26T11:22:48.837094+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:11.687344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836569+0000","last_change":"2024-04-26T11:21:53.719849+0000","last_active":"2024-04-26T11:22:48.836569+0000","last_peered":"2024-04-26T11:22:48.836569+0000","last_clean":"2024-04-26T11:22:48.836569+0000","last_became_active":"2024-04-26T11:21:53.719152+0000","last_became_peered":"2024-04-26T11:21:53.719152+0000","last_unstale":"2024-04-26T11:22:48.836569+0000","last_undegraded":"2024-04-26T11:22:48.836569+0000","last_fullsized":"2024-04-26T11:22:48.836569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637066+0000","last_change":"2024-04-26T11:21:53.712493+0000","last_active":"2024-04-26T11:22:47.637066+0000","last_peered":"2024-04-26T11:22:47.637066+0000","last_clean":"2024-04-26T11:22:47.637066+0000","last_became_active":"2024-04-26T11:21:53.711704+0000","last_became_peered":"2024-04-26T11:21:53.711704+0000","last_unstale":"2024-04-26T11:22:47.637066+0000","last_undegraded":"2024-04-26T11:22:47.637066+0000","last_fullsized":"2024-04-26T11:22:47.637066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836414+0000","last_change":"2024-04-26T11:21:53.715149+0000","last_active":"2024-04-26T11:22:48.836414+0000","last_peered":"2024-04-26T11:22:48.836414+0000","last_clean":"2024-04-26T11:22:48.836414+0000","last_became_active":"2024-04-26T11:21:53.714125+0000","last_became_peered":"2024-04-26T11:21:53.714125+0000","last_unstale":"2024-04-26T11:22:48.836414+0000","last_undegraded":"2024-04-26T11:22:48.836414+0000","last_fullsized":"2024-04-26T11:22:48.836414+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836226+0000","last_change":"2024-04-26T11:21:53.714653+0000","last_active":"2024-04-26T11:22:48.836226+0000","last_peered":"2024-04-26T11:22:48.836226+0000","last_clean":"2024-04-26T11:22:48.836226+0000","last_became_active":"2024-04-26T11:21:53.713586+0000","last_became_peered":"2024-04-26T11:21:53.713586+0000","last_unstale":"2024-04-26T11:22:48.836226+0000","last_undegraded":"2024-04-26T11:22:48.836226+0000","last_fullsized":"2024-04-26T11:22:48.836226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:01.563026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836053+0000","last_change":"2024-04-26T11:21:53.715422+0000","last_active":"2024-04-26T11:22:48.836053+0000","last_peered":"2024-04-26T11:22:48.836053+0000","last_clean":"2024-04-26T11:22:48.836053+0000","last_became_active":"2024-04-26T11:21:53.714329+0000","last_became_peered":"2024-04-26T11:21:53.714329+0000","last_unstale":"2024-04-26T11:22:48.836053+0000","last_undegraded":"2024-04-26T11:22:48.836053+0000","last_fullsized":"2024-04-26T11:22:48.836053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:06.981197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637134+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:22:47.637134+0000","last_peered":"2024-04-26T11:22:47.637134+0000","last_clean":"2024-04-26T11:22:47.637134+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:22:47.637134+0000","last_undegraded":"2024-04-26T11:22:47.637134+0000","last_fullsized":"2024-04-26T11:22:47.637134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636407+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:22:47.636407+0000","last_peered":"2024-04-26T11:22:47.636407+0000","last_clean":"2024-04-26T11:22:47.636407+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:22:47.636407+0000","last_undegraded":"2024-04-26T11:22:47.636407+0000","last_fullsized":"2024-04-26T11:22:47.636407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836820+0000","last_change":"2024-04-26T11:21:53.714245+0000","last_active":"2024-04-26T11:22:48.836820+0000","last_peered":"2024-04-26T11:22:48.836820+0000","last_clean":"2024-04-26T11:22:48.836820+0000","last_became_active":"2024-04-26T11:21:53.713331+0000","last_became_peered":"2024-04-26T11:21:53.713331+0000","last_unstale":"2024-04-26T11:22:48.836820+0000","last_undegraded":"2024-04-26T11:22:48.836820+0000","last_fullsized":"2024-04-26T11:22:48.836820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636818+0000","last_change":"2024-04-26T11:21:53.712269+0000","last_active":"2024-04-26T11:22:47.636818+0000","last_peered":"2024-04-26T11:22:47.636818+0000","last_clean":"2024-04-26T11:22:47.636818+0000","last_became_active":"2024-04-26T11:21:53.710740+0000","last_became_peered":"2024-04-26T11:21:53.710740+0000","last_unstale":"2024-04-26T11:22:47.636818+0000","last_undegraded":"2024-04-26T11:22:47.636818+0000","last_fullsized":"2024-04-26T11:22:47.636818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636454+0000","last_change":"2024-04-26T11:21:53.712552+0000","last_active":"2024-04-26T11:22:47.636454+0000","last_peered":"2024-04-26T11:22:47.636454+0000","last_clean":"2024-04-26T11:22:47.636454+0000","last_became_active":"2024-04-26T11:21:53.711470+0000","last_became_peered":"2024-04-26T11:21:53.711470+0000","last_unstale":"2024-04-26T11:22:47.636454+0000","last_undegraded":"2024-04-26T11:22:47.636454+0000","last_fullsized":"2024-04-26T11:22:47.636454+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836533+0000","last_change":"2024-04-26T11:21:53.705872+0000","last_active":"2024-04-26T11:22:48.836533+0000","last_peered":"2024-04-26T11:22:48.836533+0000","last_clean":"2024-04-26T11:22:48.836533+0000","last_became_active":"2024-04-26T11:21:53.705040+0000","last_became_peered":"2024-04-26T11:21:53.705040+0000","last_unstale":"2024-04-26T11:22:48.836533+0000","last_undegraded":"2024-04-26T11:22:48.836533+0000","last_fullsized":"2024-04-26T11:22:48.836533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:02.015153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836280+0000","last_change":"2024-04-26T11:21:53.707324+0000","last_active":"2024-04-26T11:22:48.836280+0000","last_peered":"2024-04-26T11:22:48.836280+0000","last_clean":"2024-04-26T11:22:48.836280+0000","last_became_active":"2024-04-26T11:21:53.706602+0000","last_became_peered":"2024-04-26T11:21:53.706602+0000","last_unstale":"2024-04-26T11:22:48.836280+0000","last_undegraded":"2024-04-26T11:22:48.836280+0000","last_fullsized":"2024-04-26T11:22:48.836280+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.907498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836101+0000","last_change":"2024-04-26T11:21:53.714327+0000","last_active":"2024-04-26T11:22:48.836101+0000","last_peered":"2024-04-26T11:22:48.836101+0000","last_clean":"2024-04-26T11:22:48.836101+0000","last_became_active":"2024-04-26T11:21:53.712908+0000","last_became_peered":"2024-04-26T11:21:53.712908+0000","last_unstale":"2024-04-26T11:22:48.836101+0000","last_undegraded":"2024-04-26T11:22:48.836101+0000","last_fullsized":"2024-04-26T11:22:48.836101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:31.158881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637976+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:22:47.637976+0000","last_peered":"2024-04-26T11:22:47.637976+0000","last_clean":"2024-04-26T11:22:47.637976+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:22:47.637976+0000","last_undegraded":"2024-04-26T11:22:47.637976+0000","last_fullsized":"2024-04-26T11:22:47.637976+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636710+0000","last_change":"2024-04-26T11:21:53.714983+0000","last_active":"2024-04-26T11:22:47.636710+0000","last_peered":"2024-04-26T11:22:47.636710+0000","last_clean":"2024-04-26T11:22:47.636710+0000","last_became_active":"2024-04-26T11:21:53.711987+0000","last_became_peered":"2024-04-26T11:21:53.711987+0000","last_unstale":"2024-04-26T11:22:47.636710+0000","last_undegraded":"2024-04-26T11:22:47.636710+0000","last_fullsized":"2024-04-26T11:22:47.636710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:49.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637243+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:22:47.637243+0000","last_peered":"2024-04-26T11:22:47.637243+0000","last_clean":"2024-04-26T11:22:47.637243+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:22:47.637243+0000","last_undegraded":"2024-04-26T11:22:47.637243+0000","last_fullsized":"2024-04-26T11:22:47.637243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836751+0000","last_change":"2024-04-26T11:21:53.715255+0000","last_active":"2024-04-26T11:22:48.836751+0000","last_peered":"2024-04-26T11:22:48.836751+0000","last_clean":"2024-04-26T11:22:48.836751+0000","last_became_active":"2024-04-26T11:21:53.714525+0000","last_became_peered":"2024-04-26T11:21:53.714525+0000","last_unstale":"2024-04-26T11:22:48.836751+0000","last_undegraded":"2024-04-26T11:22:48.836751+0000","last_fullsized":"2024-04-26T11:22:48.836751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836899+0000","last_change":"2024-04-26T11:21:53.714368+0000","last_active":"2024-04-26T11:22:48.836899+0000","last_peered":"2024-04-26T11:22:48.836899+0000","last_clean":"2024-04-26T11:22:48.836899+0000","last_became_active":"2024-04-26T11:21:53.713099+0000","last_became_peered":"2024-04-26T11:21:53.713099+0000","last_unstale":"2024-04-26T11:22:48.836899+0000","last_undegraded":"2024-04-26T11:22:48.836899+0000","last_fullsized":"2024-04-26T11:22:48.836899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636406+0000","last_change":"2024-04-26T11:21:53.709697+0000","last_active":"2024-04-26T11:22:47.636406+0000","last_peered":"2024-04-26T11:22:47.636406+0000","last_clean":"2024-04-26T11:22:47.636406+0000","last_became_active":"2024-04-26T11:21:53.708839+0000","last_became_peered":"2024-04-26T11:21:53.708839+0000","last_unstale":"2024-04-26T11:22:47.636406+0000","last_undegraded":"2024-04-26T11:22:47.636406+0000","last_fullsized":"2024-04-26T11:22:47.636406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.635512+0000","last_change":"2024-04-26T11:22:40.788692+0000","last_active":"2024-04-26T11:22:47.635512+0000","last_peered":"2024-04-26T11:22:47.635512+0000","last_clean":"2024-04-26T11:22:47.635512+0000","last_became_active":"2024-04-26T11:22:40.788099+0000","last_became_peered":"2024-04-26T11:22:40.788099+0000","last_unstale":"2024-04-26T11:22:47.635512+0000","last_undegraded":"2024-04-26T11:22:47.635512+0000","last_fullsized":"2024-04-26T11:22:47.635512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:49.604299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.635804+0000","last_change":"2024-04-26T11:21:53.692834+0000","last_active":"2024-04-26T11:22:47.635804+0000","last_peered":"2024-04-26T11:22:47.635804+0000","last_clean":"2024-04-26T11:22:47.635804+0000","last_became_active":"2024-04-26T11:21:53.690279+0000","last_became_peered":"2024-04-26T11:21:53.690279+0000","last_unstale":"2024-04-26T11:22:47.635804+0000","last_undegraded":"2024-04-26T11:22:47.635804+0000","last_fullsized":"2024-04-26T11:22:47.635804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637193+0000","last_change":"2024-04-26T11:21:53.698796+0000","last_active":"2024-04-26T11:22:47.637193+0000","last_peered":"2024-04-26T11:22:47.637193+0000","last_clean":"2024-04-26T11:22:47.637193+0000","last_became_active":"2024-04-26T11:21:53.697854+0000","last_became_peered":"2024-04-26T11:21:53.697854+0000","last_unstale":"2024-04-26T11:22:47.637193+0000","last_undegraded":"2024-04-26T11:22:47.637193+0000","last_fullsized":"2024-04-26T11:22:47.637193+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637381+0000","last_change":"2024-04-26T11:21:53.706583+0000","last_active":"2024-04-26T11:22:47.637381+0000","last_peered":"2024-04-26T11:22:47.637381+0000","last_clean":"2024-04-26T11:22:47.637381+0000","last_became_active":"2024-04-26T11:21:53.704871+0000","last_became_peered":"2024-04-26T11:21:53.704871+0000","last_unstale":"2024-04-26T11:22:47.637381+0000","last_undegraded":"2024-04-26T11:22:47.637381+0000","last_fullsized":"2024-04-26T11:22:47.637381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836901+0000","last_change":"2024-04-26T11:21:53.709813+0000","last_active":"2024-04-26T11:22:48.836901+0000","last_peered":"2024-04-26T11:22:48.836901+0000","last_clean":"2024-04-26T11:22:48.836901+0000","last_became_active":"2024-04-26T11:21:53.708399+0000","last_became_peered":"2024-04-26T11:21:53.708399+0000","last_unstale":"2024-04-26T11:22:48.836901+0000","last_undegraded":"2024-04-26T11:22:48.836901+0000","last_fullsized":"2024-04-26T11:22:48.836901+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:36.298230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637165+0000","last_change":"2024-04-26T11:21:53.710195+0000","last_active":"2024-04-26T11:22:47.637165+0000","last_peered":"2024-04-26T11:22:47.637165+0000","last_clean":"2024-04-26T11:22:47.637165+0000","last_became_active":"2024-04-26T11:21:53.709660+0000","last_became_peered":"2024-04-26T11:21:53.709660+0000","last_unstale":"2024-04-26T11:22:47.637165+0000","last_undegraded":"2024-04-26T11:22:47.637165+0000","last_fullsized":"2024-04-26T11:22:47.637165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636514+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:22:47.636514+0000","last_peered":"2024-04-26T11:22:47.636514+0000","last_clean":"2024-04-26T11:22:47.636514+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:22:47.636514+0000","last_undegraded":"2024-04-26T11:22:47.636514+0000","last_fullsized":"2024-04-26T11:22:47.636514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636652+0000","last_change":"2024-04-26T11:21:53.709264+0000","last_active":"2024-04-26T11:22:47.636652+0000","last_peered":"2024-04-26T11:22:47.636652+0000","last_clean":"2024-04-26T11:22:47.636652+0000","last_became_active":"2024-04-26T11:21:53.708529+0000","last_became_peered":"2024-04-26T11:21:53.708529+0000","last_unstale":"2024-04-26T11:22:47.636652+0000","last_undegraded":"2024-04-26T11:22:47.636652+0000","last_fullsized":"2024-04-26T11:22:47.636652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.635706+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:22:47.635706+0000","last_peered":"2024-04-26T11:22:47.635706+0000","last_clean":"2024-04-26T11:22:47.635706+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:22:47.635706+0000","last_undegraded":"2024-04-26T11:22:47.635706+0000","last_fullsized":"2024-04-26T11:22:47.635706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836175+0000","last_change":"2024-04-26T11:21:53.708939+0000","last_active":"2024-04-26T11:22:48.836175+0000","last_peered":"2024-04-26T11:22:48.836175+0000","last_clean":"2024-04-26T11:22:48.836175+0000","last_became_active":"2024-04-26T11:21:53.708120+0000","last_became_peered":"2024-04-26T11:21:53.708120+0000","last_unstale":"2024-04-26T11:22:48.836175+0000","last_undegraded":"2024-04-26T11:22:48.836175+0000","last_fullsized":"2024-04-26T11:22:48.836175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637006+0000","last_change":"2024-04-26T11:21:53.712919+0000","last_active":"2024-04-26T11:22:47.637006+0000","last_peered":"2024-04-26T11:22:47.637006+0000","last_clean":"2024-04-26T11:22:47.637006+0000","last_became_active":"2024-04-26T11:21:53.710798+0000","last_became_peered":"2024-04-26T11:21:53.710798+0000","last_unstale":"2024-04-26T11:22:47.637006+0000","last_undegraded":"2024-04-26T11:22:47.637006+0000","last_fullsized":"2024-04-26T11:22:47.637006+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836981+0000","last_change":"2024-04-26T11:21:53.343931+0000","last_active":"2024-04-26T11:22:48.836981+0000","last_peered":"2024-04-26T11:22:48.836981+0000","last_clean":"2024-04-26T11:22:48.836981+0000","last_became_active":"2024-04-26T11:21:53.342363+0000","last_became_peered":"2024-04-26T11:21:53.342363+0000","last_unstale":"2024-04-26T11:22:48.836981+0000","last_undegraded":"2024-04-26T11:22:48.836981+0000","last_fullsized":"2024-04-26T11:22:48.836981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636568+0000","last_change":"2024-04-26T11:21:53.712613+0000","last_active":"2024-04-26T11:22:47.636568+0000","last_peered":"2024-04-26T11:22:47.636568+0000","last_clean":"2024-04-26T11:22:47.636568+0000","last_became_active":"2024-04-26T11:21:53.711848+0000","last_became_peered":"2024-04-26T11:21:53.711848+0000","last_unstale":"2024-04-26T11:22:47.636568+0000","last_undegraded":"2024-04-26T11:22:47.636568+0000","last_fullsized":"2024-04-26T11:22:47.636568+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:49.327612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636263+0000","last_change":"2024-04-26T11:21:53.333005+0000","last_active":"2024-04-26T11:22:47.636263+0000","last_peered":"2024-04-26T11:22:47.636263+0000","last_clean":"2024-04-26T11:22:47.636263+0000","last_became_active":"2024-04-26T11:21:53.332191+0000","last_became_peered":"2024-04-26T11:21:53.332191+0000","last_unstale":"2024-04-26T11:22:47.636263+0000","last_undegraded":"2024-04-26T11:22:47.636263+0000","last_fullsized":"2024-04-26T11:22:47.636263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637647+0000","last_change":"2024-04-26T11:22:40.788833+0000","last_active":"2024-04-26T11:22:47.637647+0000","last_peered":"2024-04-26T11:22:47.637647+0000","last_clean":"2024-04-26T11:22:47.637647+0000","last_became_active":"2024-04-26T11:22:40.788294+0000","last_became_peered":"2024-04-26T11:22:40.788294+0000","last_unstale":"2024-04-26T11:22:47.637647+0000","last_undegraded":"2024-04-26T11:22:47.637647+0000","last_fullsized":"2024-04-26T11:22:47.637647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:08.719453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636358+0000","last_change":"2024-04-26T11:21:53.341523+0000","last_active":"2024-04-26T11:22:47.636358+0000","last_peered":"2024-04-26T11:22:47.636358+0000","last_clean":"2024-04-26T11:22:47.636358+0000","last_became_active":"2024-04-26T11:21:53.340545+0000","last_became_peered":"2024-04-26T11:21:53.340545+0000","last_unstale":"2024-04-26T11:22:47.636358+0000","last_undegraded":"2024-04-26T11:22:47.636358+0000","last_fullsized":"2024-04-26T11:22:47.636358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.907675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637336+0000","last_change":"2024-04-26T11:21:53.706879+0000","last_active":"2024-04-26T11:22:47.637336+0000","last_peered":"2024-04-26T11:22:47.637336+0000","last_clean":"2024-04-26T11:22:47.637336+0000","last_became_active":"2024-04-26T11:21:53.705082+0000","last_became_peered":"2024-04-26T11:21:53.705082+0000","last_unstale":"2024-04-26T11:22:47.637336+0000","last_undegraded":"2024-04-26T11:22:47.637336+0000","last_fullsized":"2024-04-26T11:22:47.637336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836189+0000","last_change":"2024-04-26T11:21:53.341655+0000","last_active":"2024-04-26T11:22:48.836189+0000","last_peered":"2024-04-26T11:22:48.836189+0000","last_clean":"2024-04-26T11:22:48.836189+0000","last_became_active":"2024-04-26T11:21:53.340085+0000","last_became_peered":"2024-04-26T11:21:53.340085+0000","last_unstale":"2024-04-26T11:22:48.836189+0000","last_undegraded":"2024-04-26T11:22:48.836189+0000","last_fullsized":"2024-04-26T11:22:48.836189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837456+0000","last_change":"2024-04-26T11:21:53.340063+0000","last_active":"2024-04-26T11:22:48.837456+0000","last_peered":"2024-04-26T11:22:48.837456+0000","last_clean":"2024-04-26T11:22:48.837456+0000","last_became_active":"2024-04-26T11:21:53.339256+0000","last_became_peered":"2024-04-26T11:21:53.339256+0000","last_unstale":"2024-04-26T11:22:48.837456+0000","last_undegraded":"2024-04-26T11:22:48.837456+0000","last_fullsized":"2024-04-26T11:22:48.837456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.635269+0000","last_change":"2024-04-26T11:22:40.571973+0000","last_active":"2024-04-26T11:22:47.635269+0000","last_peered":"2024-04-26T11:22:47.635269+0000","last_clean":"2024-04-26T11:22:47.635269+0000","last_became_active":"2024-04-26T11:22:40.571207+0000","last_became_peered":"2024-04-26T11:22:40.571207+0000","last_unstale":"2024-04-26T11:22:47.635269+0000","last_undegraded":"2024-04-26T11:22:47.635269+0000","last_fullsized":"2024-04-26T11:22:47.635269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:31.334310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637332+0000","last_change":"2024-04-26T11:21:53.341302+0000","last_active":"2024-04-26T11:22:47.637332+0000","last_peered":"2024-04-26T11:22:47.637332+0000","last_clean":"2024-04-26T11:22:47.637332+0000","last_became_active":"2024-04-26T11:21:53.340509+0000","last_became_peered":"2024-04-26T11:21:53.340509+0000","last_unstale":"2024-04-26T11:22:47.637332+0000","last_undegraded":"2024-04-26T11:22:47.637332+0000","last_fullsized":"2024-04-26T11:22:47.637332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:16.781849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636136+0000","last_change":"2024-04-26T11:21:53.716075+0000","last_active":"2024-04-26T11:22:47.636136+0000","last_peered":"2024-04-26T11:22:47.636136+0000","last_clean":"2024-04-26T11:22:47.636136+0000","last_became_active":"2024-04-26T11:21:53.714328+0000","last_became_peered":"2024-04-26T11:21:53.714328+0000","last_unstale":"2024-04-26T11:22:47.636136+0000","last_undegraded":"2024-04-26T11:22:47.636136+0000","last_fullsized":"2024-04-26T11:22:47.636136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:54.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837181+0000","last_change":"2024-04-26T11:21:53.339171+0000","last_active":"2024-04-26T11:22:48.837181+0000","last_peered":"2024-04-26T11:22:48.837181+0000","last_clean":"2024-04-26T11:22:48.837181+0000","last_became_active":"2024-04-26T11:21:53.337433+0000","last_became_peered":"2024-04-26T11:21:53.337433+0000","last_unstale":"2024-04-26T11:22:48.837181+0000","last_undegraded":"2024-04-26T11:22:48.837181+0000","last_fullsized":"2024-04-26T11:22:48.837181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836646+0000","last_change":"2024-04-26T11:21:53.719666+0000","last_active":"2024-04-26T11:22:48.836646+0000","last_peered":"2024-04-26T11:22:48.836646+0000","last_clean":"2024-04-26T11:22:48.836646+0000","last_became_active":"2024-04-26T11:21:53.718871+0000","last_became_peered":"2024-04-26T11:21:53.718871+0000","last_unstale":"2024-04-26T11:22:48.836646+0000","last_undegraded":"2024-04-26T11:22:48.836646+0000","last_fullsized":"2024-04-26T11:22:48.836646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837034+0000","last_change":"2024-04-26T11:21:53.344744+0000","last_active":"2024-04-26T11:22:48.837034+0000","last_peered":"2024-04-26T11:22:48.837034+0000","last_clean":"2024-04-26T11:22:48.837034+0000","last_became_active":"2024-04-26T11:21:53.344055+0000","last_became_peered":"2024-04-26T11:21:53.344055+0000","last_unstale":"2024-04-26T11:22:48.837034+0000","last_undegraded":"2024-04-26T11:22:48.837034+0000","last_fullsized":"2024-04-26T11:22:48.837034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636595+0000","last_change":"2024-04-26T11:21:53.709563+0000","last_active":"2024-04-26T11:22:47.636595+0000","last_peered":"2024-04-26T11:22:47.636595+0000","last_clean":"2024-04-26T11:22:47.636595+0000","last_became_active":"2024-04-26T11:21:53.706598+0000","last_became_peered":"2024-04-26T11:21:53.706598+0000","last_unstale":"2024-04-26T11:22:47.636595+0000","last_undegraded":"2024-04-26T11:22:47.636595+0000","last_fullsized":"2024-04-26T11:22:47.636595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637059+0000","last_change":"2024-04-26T11:21:53.330145+0000","last_active":"2024-04-26T11:22:47.637059+0000","last_peered":"2024-04-26T11:22:47.637059+0000","last_clean":"2024-04-26T11:22:47.637059+0000","last_became_active":"2024-04-26T11:21:53.329256+0000","last_became_peered":"2024-04-26T11:21:53.329256+0000","last_unstale":"2024-04-26T11:22:47.637059+0000","last_undegraded":"2024-04-26T11:22:47.637059+0000","last_fullsized":"2024-04-26T11:22:47.637059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836699+0000","last_change":"2024-04-26T11:21:53.715233+0000","last_active":"2024-04-26T11:22:48.836699+0000","last_peered":"2024-04-26T11:22:48.836699+0000","last_clean":"2024-04-26T11:22:48.836699+0000","last_became_active":"2024-04-26T11:21:53.714405+0000","last_became_peered":"2024-04-26T11:21:53.714405+0000","last_unstale":"2024-04-26T11:22:48.836699+0000","last_undegraded":"2024-04-26T11:22:48.836699+0000","last_fullsized":"2024-04-26T11:22:48.836699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836857+0000","last_change":"2024-04-26T11:21:53.344659+0000","last_active":"2024-04-26T11:22:48.836857+0000","last_peered":"2024-04-26T11:22:48.836857+0000","last_clean":"2024-04-26T11:22:48.836857+0000","last_became_active":"2024-04-26T11:21:53.344024+0000","last_became_peered":"2024-04-26T11:21:53.344024+0000","last_unstale":"2024-04-26T11:22:48.836857+0000","last_undegraded":"2024-04-26T11:22:48.836857+0000","last_fullsized":"2024-04-26T11:22:48.836857+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:53.053244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837042+0000","last_change":"2024-04-26T11:21:53.710093+0000","last_active":"2024-04-26T11:22:48.837042+0000","last_peered":"2024-04-26T11:22:48.837042+0000","last_clean":"2024-04-26T11:22:48.837042+0000","last_became_active":"2024-04-26T11:21:53.709020+0000","last_became_peered":"2024-04-26T11:21:53.709020+0000","last_unstale":"2024-04-26T11:22:48.837042+0000","last_undegraded":"2024-04-26T11:22:48.837042+0000","last_fullsized":"2024-04-26T11:22:48.837042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636452+0000","last_change":"2024-04-26T11:21:53.341961+0000","last_active":"2024-04-26T11:22:47.636452+0000","last_peered":"2024-04-26T11:22:47.636452+0000","last_clean":"2024-04-26T11:22:47.636452+0000","last_became_active":"2024-04-26T11:21:53.340768+0000","last_became_peered":"2024-04-26T11:21:53.340768+0000","last_unstale":"2024-04-26T11:22:47.636452+0000","last_undegraded":"2024-04-26T11:22:47.636452+0000","last_fullsized":"2024-04-26T11:22:47.636452+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837141+0000","last_change":"2024-04-26T11:21:53.706161+0000","last_active":"2024-04-26T11:22:48.837141+0000","last_peered":"2024-04-26T11:22:48.837141+0000","last_clean":"2024-04-26T11:22:48.837141+0000","last_became_active":"2024-04-26T11:21:53.705388+0000","last_became_peered":"2024-04-26T11:21:53.705388+0000","last_unstale":"2024-04-26T11:22:48.837141+0000","last_undegraded":"2024-04-26T11:22:48.837141+0000","last_fullsized":"2024-04-26T11:22:48.837141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.635870+0000","last_change":"2024-04-26T11:21:53.328489+0000","last_active":"2024-04-26T11:22:47.635870+0000","last_peered":"2024-04-26T11:22:47.635870+0000","last_clean":"2024-04-26T11:22:47.635870+0000","last_became_active":"2024-04-26T11:21:53.327836+0000","last_became_peered":"2024-04-26T11:21:53.327836+0000","last_unstale":"2024-04-26T11:22:47.635870+0000","last_undegraded":"2024-04-26T11:22:47.635870+0000","last_fullsized":"2024-04-26T11:22:47.635870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:32.644217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637395+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:22:47.637395+0000","last_peered":"2024-04-26T11:22:47.637395+0000","last_clean":"2024-04-26T11:22:47.637395+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:22:47.637395+0000","last_undegraded":"2024-04-26T11:22:47.637395+0000","last_fullsized":"2024-04-26T11:22:47.637395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":229,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836411+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:22:48.836411+0000","last_peered":"2024-04-26T11:22:48.836411+0000","last_clean":"2024-04-26T11:22:48.836411+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:22:48.836411+0000","last_undegraded":"2024-04-26T11:22:48.836411+0000","last_fullsized":"2024-04-26T11:22:48.836411+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837096+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:22:48.837096+0000","last_peered":"2024-04-26T11:22:48.837096+0000","last_clean":"2024-04-26T11:22:48.837096+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:22:48.837096+0000","last_undegraded":"2024-04-26T11:22:48.837096+0000","last_fullsized":"2024-04-26T11:22:48.837096+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636540+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:22:47.636540+0000","last_peered":"2024-04-26T11:22:47.636540+0000","last_clean":"2024-04-26T11:22:47.636540+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:22:47.636540+0000","last_undegraded":"2024-04-26T11:22:47.636540+0000","last_fullsized":"2024-04-26T11:22:47.636540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837138+0000","last_change":"2024-04-26T11:21:53.709499+0000","last_active":"2024-04-26T11:22:48.837138+0000","last_peered":"2024-04-26T11:22:48.837138+0000","last_clean":"2024-04-26T11:22:48.837138+0000","last_became_active":"2024-04-26T11:21:53.707573+0000","last_became_peered":"2024-04-26T11:21:53.707573+0000","last_unstale":"2024-04-26T11:22:48.837138+0000","last_undegraded":"2024-04-26T11:22:48.837138+0000","last_fullsized":"2024-04-26T11:22:48.837138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836298+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:22:48.836298+0000","last_peered":"2024-04-26T11:22:48.836298+0000","last_clean":"2024-04-26T11:22:48.836298+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:22:48.836298+0000","last_undegraded":"2024-04-26T11:22:48.836298+0000","last_fullsized":"2024-04-26T11:22:48.836298+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636355+0000","last_change":"2024-04-26T11:22:40.788935+0000","last_active":"2024-04-26T11:22:47.636355+0000","last_peered":"2024-04-26T11:22:47.636355+0000","last_clean":"2024-04-26T11:22:47.636355+0000","last_became_active":"2024-04-26T11:22:40.788573+0000","last_became_peered":"2024-04-26T11:22:40.788573+0000","last_unstale":"2024-04-26T11:22:47.636355+0000","last_undegraded":"2024-04-26T11:22:47.636355+0000","last_fullsized":"2024-04-26T11:22:47.636355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:33.615604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636496+0000","last_change":"2024-04-26T11:21:53.716469+0000","last_active":"2024-04-26T11:22:47.636496+0000","last_peered":"2024-04-26T11:22:47.636496+0000","last_clean":"2024-04-26T11:22:47.636496+0000","last_became_active":"2024-04-26T11:21:53.715684+0000","last_became_peered":"2024-04-26T11:21:53.715684+0000","last_unstale":"2024-04-26T11:22:47.636496+0000","last_undegraded":"2024-04-26T11:22:47.636496+0000","last_fullsized":"2024-04-26T11:22:47.636496+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636613+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:22:47.636613+0000","last_peered":"2024-04-26T11:22:47.636613+0000","last_clean":"2024-04-26T11:22:47.636613+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:22:47.636613+0000","last_undegraded":"2024-04-26T11:22:47.636613+0000","last_fullsized":"2024-04-26T11:22:47.636613+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.635969+0000","last_change":"2024-04-26T11:21:53.345743+0000","last_active":"2024-04-26T11:22:47.635969+0000","last_peered":"2024-04-26T11:22:47.635969+0000","last_clean":"2024-04-26T11:22:47.635969+0000","last_became_active":"2024-04-26T11:21:53.344967+0000","last_became_peered":"2024-04-26T11:21:53.344967+0000","last_unstale":"2024-04-26T11:22:47.635969+0000","last_undegraded":"2024-04-26T11:22:47.635969+0000","last_fullsized":"2024-04-26T11:22:47.635969+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:08.280572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637582+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:22:47.637582+0000","last_peered":"2024-04-26T11:22:47.637582+0000","last_clean":"2024-04-26T11:22:47.637582+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:22:47.637582+0000","last_undegraded":"2024-04-26T11:22:47.637582+0000","last_fullsized":"2024-04-26T11:22:47.637582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837022+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:22:48.837022+0000","last_peered":"2024-04-26T11:22:48.837022+0000","last_clean":"2024-04-26T11:22:48.837022+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:22:48.837022+0000","last_undegraded":"2024-04-26T11:22:48.837022+0000","last_fullsized":"2024-04-26T11:22:48.837022+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837018+0000","last_change":"2024-04-26T11:21:53.338037+0000","last_active":"2024-04-26T11:22:48.837018+0000","last_peered":"2024-04-26T11:22:48.837018+0000","last_clean":"2024-04-26T11:22:48.837018+0000","last_became_active":"2024-04-26T11:21:53.337004+0000","last_became_peered":"2024-04-26T11:21:53.337004+0000","last_unstale":"2024-04-26T11:22:48.837018+0000","last_undegraded":"2024-04-26T11:22:48.837018+0000","last_fullsized":"2024-04-26T11:22:48.837018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637540+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:22:47.637540+0000","last_peered":"2024-04-26T11:22:47.637540+0000","last_clean":"2024-04-26T11:22:47.637540+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:22:47.637540+0000","last_undegraded":"2024-04-26T11:22:47.637540+0000","last_fullsized":"2024-04-26T11:22:47.637540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837217+0000","last_change":"2024-04-26T11:21:53.337312+0000","last_active":"2024-04-26T11:22:48.837217+0000","last_peered":"2024-04-26T11:22:48.837217+0000","last_clean":"2024-04-26T11:22:48.837217+0000","last_became_active":"2024-04-26T11:21:53.336587+0000","last_became_peered":"2024-04-26T11:21:53.336587+0000","last_unstale":"2024-04-26T11:22:48.837217+0000","last_undegraded":"2024-04-26T11:22:48.837217+0000","last_fullsized":"2024-04-26T11:22:48.837217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637757+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:22:47.637757+0000","last_peered":"2024-04-26T11:22:47.637757+0000","last_clean":"2024-04-26T11:22:47.637757+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:22:47.637757+0000","last_undegraded":"2024-04-26T11:22:47.637757+0000","last_fullsized":"2024-04-26T11:22:47.637757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636249+0000","last_change":"2024-04-26T11:21:53.697386+0000","last_active":"2024-04-26T11:22:47.636249+0000","last_peered":"2024-04-26T11:22:47.636249+0000","last_clean":"2024-04-26T11:22:47.636249+0000","last_became_active":"2024-04-26T11:21:53.695847+0000","last_became_peered":"2024-04-26T11:21:53.695847+0000","last_unstale":"2024-04-26T11:22:47.636249+0000","last_undegraded":"2024-04-26T11:22:47.636249+0000","last_fullsized":"2024-04-26T11:22:47.636249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637564+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:22:47.637564+0000","last_peered":"2024-04-26T11:22:47.637564+0000","last_clean":"2024-04-26T11:22:47.637564+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:22:47.637564+0000","last_undegraded":"2024-04-26T11:22:47.637564+0000","last_fullsized":"2024-04-26T11:22:47.637564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636919+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:22:47.636919+0000","last_peered":"2024-04-26T11:22:47.636919+0000","last_clean":"2024-04-26T11:22:47.636919+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:22:47.636919+0000","last_undegraded":"2024-04-26T11:22:47.636919+0000","last_fullsized":"2024-04-26T11:22:47.636919+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636705+0000","last_change":"2024-04-26T11:21:53.696563+0000","last_active":"2024-04-26T11:22:47.636705+0000","last_peered":"2024-04-26T11:22:47.636705+0000","last_clean":"2024-04-26T11:22:47.636705+0000","last_became_active":"2024-04-26T11:21:53.695678+0000","last_became_peered":"2024-04-26T11:21:53.695678+0000","last_unstale":"2024-04-26T11:22:47.636705+0000","last_undegraded":"2024-04-26T11:22:47.636705+0000","last_fullsized":"2024-04-26T11:22:47.636705+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637972+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:22:47.637972+0000","last_peered":"2024-04-26T11:22:47.637972+0000","last_clean":"2024-04-26T11:22:47.637972+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:22:47.637972+0000","last_undegraded":"2024-04-26T11:22:47.637972+0000","last_fullsized":"2024-04-26T11:22:47.637972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637796+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:22:47.637796+0000","last_peered":"2024-04-26T11:22:47.637796+0000","last_clean":"2024-04-26T11:22:47.637796+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:22:47.637796+0000","last_undegraded":"2024-04-26T11:22:47.637796+0000","last_fullsized":"2024-04-26T11:22:47.637796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.635904+0000","last_change":"2024-04-26T11:22:40.787812+0000","last_active":"2024-04-26T11:22:47.635904+0000","last_peered":"2024-04-26T11:22:47.635904+0000","last_clean":"2024-04-26T11:22:47.635904+0000","last_became_active":"2024-04-26T11:22:40.787235+0000","last_became_peered":"2024-04-26T11:22:40.787235+0000","last_unstale":"2024-04-26T11:22:47.635904+0000","last_undegraded":"2024-04-26T11:22:47.635904+0000","last_fullsized":"2024-04-26T11:22:47.635904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:13.809010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637793+0000","last_change":"2024-04-26T11:21:53.332815+0000","last_active":"2024-04-26T11:22:47.637793+0000","last_peered":"2024-04-26T11:22:47.637793+0000","last_clean":"2024-04-26T11:22:47.637793+0000","last_became_active":"2024-04-26T11:21:53.332020+0000","last_became_peered":"2024-04-26T11:21:53.332020+0000","last_unstale":"2024-04-26T11:22:47.637793+0000","last_undegraded":"2024-04-26T11:22:47.637793+0000","last_fullsized":"2024-04-26T11:22:47.637793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837438+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:22:48.837438+0000","last_peered":"2024-04-26T11:22:48.837438+0000","last_clean":"2024-04-26T11:22:48.837438+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:22:48.837438+0000","last_undegraded":"2024-04-26T11:22:48.837438+0000","last_fullsized":"2024-04-26T11:22:48.837438+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636554+0000","last_change":"2024-04-26T11:21:53.696546+0000","last_active":"2024-04-26T11:22:47.636554+0000","last_peered":"2024-04-26T11:22:47.636554+0000","last_clean":"2024-04-26T11:22:47.636554+0000","last_became_active":"2024-04-26T11:21:53.695670+0000","last_became_peered":"2024-04-26T11:21:53.695670+0000","last_unstale":"2024-04-26T11:22:47.636554+0000","last_undegraded":"2024-04-26T11:22:47.636554+0000","last_fullsized":"2024-04-26T11:22:47.636554+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836870+0000","last_change":"2024-04-26T11:21:53.703599+0000","last_active":"2024-04-26T11:22:48.836870+0000","last_peered":"2024-04-26T11:22:48.836870+0000","last_clean":"2024-04-26T11:22:48.836870+0000","last_became_active":"2024-04-26T11:21:53.702893+0000","last_became_peered":"2024-04-26T11:21:53.702893+0000","last_unstale":"2024-04-26T11:22:48.836870+0000","last_undegraded":"2024-04-26T11:22:48.836870+0000","last_fullsized":"2024-04-26T11:22:48.836870+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836908+0000","last_change":"2024-04-26T11:21:53.340288+0000","last_active":"2024-04-26T11:22:48.836908+0000","last_peered":"2024-04-26T11:22:48.836908+0000","last_clean":"2024-04-26T11:22:48.836908+0000","last_became_active":"2024-04-26T11:21:53.339414+0000","last_became_peered":"2024-04-26T11:21:53.339414+0000","last_unstale":"2024-04-26T11:22:48.836908+0000","last_undegraded":"2024-04-26T11:22:48.836908+0000","last_fullsized":"2024-04-26T11:22:48.836908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636000+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:22:47.636000+0000","last_peered":"2024-04-26T11:22:47.636000+0000","last_clean":"2024-04-26T11:22:47.636000+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:22:47.636000+0000","last_undegraded":"2024-04-26T11:22:47.636000+0000","last_fullsized":"2024-04-26T11:22:47.636000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636781+0000","last_change":"2024-04-26T11:21:53.343465+0000","last_active":"2024-04-26T11:22:47.636781+0000","last_peered":"2024-04-26T11:22:47.636781+0000","last_clean":"2024-04-26T11:22:47.636781+0000","last_became_active":"2024-04-26T11:21:53.342882+0000","last_became_peered":"2024-04-26T11:21:53.342882+0000","last_unstale":"2024-04-26T11:22:47.636781+0000","last_undegraded":"2024-04-26T11:22:47.636781+0000","last_fullsized":"2024-04-26T11:22:47.636781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:41.508747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.837317+0000","last_change":"2024-04-26T11:21:53.344846+0000","last_active":"2024-04-26T11:22:48.837317+0000","last_peered":"2024-04-26T11:22:48.837317+0000","last_clean":"2024-04-26T11:22:48.837317+0000","last_became_active":"2024-04-26T11:21:53.342981+0000","last_became_peered":"2024-04-26T11:21:53.342981+0000","last_unstale":"2024-04-26T11:22:48.837317+0000","last_undegraded":"2024-04-26T11:22:48.837317+0000","last_fullsized":"2024-04-26T11:22:48.837317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.635749+0000","last_change":"2024-04-26T11:21:53.706890+0000","last_active":"2024-04-26T11:22:47.635749+0000","last_peered":"2024-04-26T11:22:47.635749+0000","last_clean":"2024-04-26T11:22:47.635749+0000","last_became_active":"2024-04-26T11:21:53.705229+0000","last_became_peered":"2024-04-26T11:21:53.705229+0000","last_unstale":"2024-04-26T11:22:47.635749+0000","last_undegraded":"2024-04-26T11:22:47.635749+0000","last_fullsized":"2024-04-26T11:22:47.635749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637859+0000","last_change":"2024-04-26T11:21:53.334527+0000","last_active":"2024-04-26T11:22:47.637859+0000","last_peered":"2024-04-26T11:22:47.637859+0000","last_clean":"2024-04-26T11:22:47.637859+0000","last_became_active":"2024-04-26T11:21:53.332325+0000","last_became_peered":"2024-04-26T11:21:53.332325+0000","last_unstale":"2024-04-26T11:22:47.637859+0000","last_undegraded":"2024-04-26T11:22:47.637859+0000","last_fullsized":"2024-04-26T11:22:47.637859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.635725+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:22:47.635725+0000","last_peered":"2024-04-26T11:22:47.635725+0000","last_clean":"2024-04-26T11:22:47.635725+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:22:47.635725+0000","last_undegraded":"2024-04-26T11:22:47.635725+0000","last_fullsized":"2024-04-26T11:22:47.635725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637294+0000","last_change":"2024-04-26T11:21:53.696949+0000","last_active":"2024-04-26T11:22:47.637294+0000","last_peered":"2024-04-26T11:22:47.637294+0000","last_clean":"2024-04-26T11:22:47.637294+0000","last_became_active":"2024-04-26T11:21:53.696068+0000","last_became_peered":"2024-04-26T11:21:53.696068+0000","last_unstale":"2024-04-26T11:22:47.637294+0000","last_undegraded":"2024-04-26T11:22:47.637294+0000","last_fullsized":"2024-04-26T11:22:47.637294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636138+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:22:47.636138+0000","last_peered":"2024-04-26T11:22:47.636138+0000","last_clean":"2024-04-26T11:22:47.636138+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:22:47.636138+0000","last_undegraded":"2024-04-26T11:22:47.636138+0000","last_fullsized":"2024-04-26T11:22:47.636138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637402+0000","last_change":"2024-04-26T11:22:40.788324+0000","last_active":"2024-04-26T11:22:47.637402+0000","last_peered":"2024-04-26T11:22:47.637402+0000","last_clean":"2024-04-26T11:22:47.637402+0000","last_became_active":"2024-04-26T11:22:40.788127+0000","last_became_peered":"2024-04-26T11:22:40.788127+0000","last_unstale":"2024-04-26T11:22:47.637402+0000","last_undegraded":"2024-04-26T11:22:47.637402+0000","last_fullsized":"2024-04-26T11:22:47.637402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:13.953872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636185+0000","last_change":"2024-04-26T11:21:53.334972+0000","last_active":"2024-04-26T11:22:47.636185+0000","last_peered":"2024-04-26T11:22:47.636185+0000","last_clean":"2024-04-26T11:22:47.636185+0000","last_became_active":"2024-04-26T11:21:53.332642+0000","last_became_peered":"2024-04-26T11:21:53.332642+0000","last_unstale":"2024-04-26T11:22:47.636185+0000","last_undegraded":"2024-04-26T11:22:47.636185+0000","last_fullsized":"2024-04-26T11:22:47.636185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636482+0000","last_change":"2024-04-26T11:21:53.709701+0000","last_active":"2024-04-26T11:22:47.636482+0000","last_peered":"2024-04-26T11:22:47.636482+0000","last_clean":"2024-04-26T11:22:47.636482+0000","last_became_active":"2024-04-26T11:21:53.708905+0000","last_became_peered":"2024-04-26T11:21:53.708905+0000","last_unstale":"2024-04-26T11:22:47.636482+0000","last_undegraded":"2024-04-26T11:22:47.636482+0000","last_fullsized":"2024-04-26T11:22:47.636482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636938+0000","last_change":"2024-04-26T11:21:53.330226+0000","last_active":"2024-04-26T11:22:47.636938+0000","last_peered":"2024-04-26T11:22:47.636938+0000","last_clean":"2024-04-26T11:22:47.636938+0000","last_became_active":"2024-04-26T11:21:53.329446+0000","last_became_peered":"2024-04-26T11:21:53.329446+0000","last_unstale":"2024-04-26T11:22:47.636938+0000","last_undegraded":"2024-04-26T11:22:47.636938+0000","last_fullsized":"2024-04-26T11:22:47.636938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:52.599214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636911+0000","last_change":"2024-04-26T11:21:53.716629+0000","last_active":"2024-04-26T11:22:47.636911+0000","last_peered":"2024-04-26T11:22:47.636911+0000","last_clean":"2024-04-26T11:22:47.636911+0000","last_became_active":"2024-04-26T11:21:53.714799+0000","last_became_peered":"2024-04-26T11:21:53.714799+0000","last_unstale":"2024-04-26T11:22:47.636911+0000","last_undegraded":"2024-04-26T11:22:47.636911+0000","last_fullsized":"2024-04-26T11:22:47.636911+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:54.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636981+0000","last_change":"2024-04-26T11:21:53.343318+0000","last_active":"2024-04-26T11:22:47.636981+0000","last_peered":"2024-04-26T11:22:47.636981+0000","last_clean":"2024-04-26T11:22:47.636981+0000","last_became_active":"2024-04-26T11:21:53.342789+0000","last_became_peered":"2024-04-26T11:21:53.342789+0000","last_unstale":"2024-04-26T11:22:47.636981+0000","last_undegraded":"2024-04-26T11:22:47.636981+0000","last_fullsized":"2024-04-26T11:22:47.636981+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836728+0000","last_change":"2024-04-26T11:21:53.715726+0000","last_active":"2024-04-26T11:22:48.836728+0000","last_peered":"2024-04-26T11:22:48.836728+0000","last_clean":"2024-04-26T11:22:48.836728+0000","last_became_active":"2024-04-26T11:21:53.715126+0000","last_became_peered":"2024-04-26T11:21:53.715126+0000","last_unstale":"2024-04-26T11:22:48.836728+0000","last_undegraded":"2024-04-26T11:22:48.836728+0000","last_fullsized":"2024-04-26T11:22:48.836728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836918+0000","last_change":"2024-04-26T11:21:53.343934+0000","last_active":"2024-04-26T11:22:48.836918+0000","last_peered":"2024-04-26T11:22:48.836918+0000","last_clean":"2024-04-26T11:22:48.836918+0000","last_became_active":"2024-04-26T11:21:53.342401+0000","last_became_peered":"2024-04-26T11:21:53.342401+0000","last_unstale":"2024-04-26T11:22:48.836918+0000","last_undegraded":"2024-04-26T11:22:48.836918+0000","last_fullsized":"2024-04-26T11:22:48.836918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836802+0000","last_change":"2024-04-26T11:21:53.713092+0000","last_active":"2024-04-26T11:22:48.836802+0000","last_peered":"2024-04-26T11:22:48.836802+0000","last_clean":"2024-04-26T11:22:48.836802+0000","last_became_active":"2024-04-26T11:21:53.712207+0000","last_became_peered":"2024-04-26T11:21:53.712207+0000","last_unstale":"2024-04-26T11:22:48.836802+0000","last_undegraded":"2024-04-26T11:22:48.836802+0000","last_fullsized":"2024-04-26T11:22:48.836802+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636652+0000","last_change":"2024-04-26T11:21:53.345453+0000","last_active":"2024-04-26T11:22:47.636652+0000","last_peered":"2024-04-26T11:22:47.636652+0000","last_clean":"2024-04-26T11:22:47.636652+0000","last_became_active":"2024-04-26T11:21:53.344468+0000","last_became_peered":"2024-04-26T11:21:53.344468+0000","last_unstale":"2024-04-26T11:22:47.636652+0000","last_undegraded":"2024-04-26T11:22:47.636652+0000","last_fullsized":"2024-04-26T11:22:47.636652+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.295739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.636535+0000","last_change":"2024-04-26T11:21:53.712311+0000","last_active":"2024-04-26T11:22:47.636535+0000","last_peered":"2024-04-26T11:22:47.636535+0000","last_clean":"2024-04-26T11:22:47.636535+0000","last_became_active":"2024-04-26T11:21:53.711195+0000","last_became_peered":"2024-04-26T11:21:53.711195+0000","last_unstale":"2024-04-26T11:22:47.636535+0000","last_undegraded":"2024-04-26T11:22:47.636535+0000","last_fullsized":"2024-04-26T11:22:47.636535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:50.973181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637645+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:22:47.637645+0000","last_peered":"2024-04-26T11:22:47.637645+0000","last_clean":"2024-04-26T11:22:47.637645+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:22:47.637645+0000","last_undegraded":"2024-04-26T11:22:47.637645+0000","last_fullsized":"2024-04-26T11:22:47.637645+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:48.836311+0000","last_change":"2024-04-26T11:21:53.713610+0000","last_active":"2024-04-26T11:22:48.836311+0000","last_peered":"2024-04-26T11:22:48.836311+0000","last_clean":"2024-04-26T11:22:48.836311+0000","last_became_active":"2024-04-26T11:21:53.712396+0000","last_became_peered":"2024-04-26T11:21:53.712396+0000","last_unstale":"2024-04-26T11:22:48.836311+0000","last_undegraded":"2024-04-26T11:22:48.836311+0000","last_fullsized":"2024-04-26T11:22:48.836311+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T11:22:47.637661+0000","last_change":"2024-04-26T11:21:53.334939+0000","last_active":"2024-04-26T11:22:47.637661+0000","last_peered":"2024-04-26T11:22:47.637661+0000","last_clean":"2024-04-26T11:22:47.637661+0000","last_became_active":"2024-04-26T11:21:53.332735+0000","last_became_peered":"2024-04-26T11:21:53.332735+0000","last_unstale":"2024-04-26T11:22:47.637661+0000","last_undegraded":"2024-04-26T11:22:47.637661+0000","last_fullsized":"2024-04-26T11:22:47.637661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738386,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":136279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.93000000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738386,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":401408,"data_stored":732720,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66300000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738386,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":401408,"data_stored":729083,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:22:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":1.0249999999999999}]},{"osd":2,"last update":"Fri Apr 26 11:22:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.87}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:22:55.904 INFO:tasks.thrashosds.thrasher:Setting 4.39 to [2, 0, 1] 2024-04-26T11:22:55.904 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.39', '2', '0', '1'] 2024-04-26T11:22:55.904 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.39 2 0 1 2024-04-26T11:22:55.989 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:55.986+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:55.992 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:55.992 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:56.007 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:56.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:22:56.090 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:56.088+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:56.163 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:56.164 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:56.173 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:56.173 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:56.173 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:56.174 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:56.174 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:56.187 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:56.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:56.188+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:56.198 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:56.198 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:56.221 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:56.221 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:56.269 INFO:teuthology.orchestra.run.smithi073.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-26T11:22:56.273 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T11:22:56.274 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-26T11:22:56.292 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:56.290+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:56.305 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:56.305 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:56.305 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:56.305 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:56.305 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.305 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:56.305 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.536985951999995, 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:56.306 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:56.307 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.308 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.309 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:56.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:56.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.310 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.310 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.310 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:56.310 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:56.310 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.313 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.313 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.313 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.314 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.623156440999999, 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:56.315 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:56.316 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:56.317 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.320 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.623070705000003, 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.322 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.323 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:56.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:56.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:56.324 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:56.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.324 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.324 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:56.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:56.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:56.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:56.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.325 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.325 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:56.325 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.326 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.327 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:56.327 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:56.327 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.327 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.327 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.328 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.328 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.623011532, 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.329 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:56.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:56.331 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.332 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.333 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.334 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.622926065999998, 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:56.335 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.336 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.337 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:56.338 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:56.339 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:56.340 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.622866629999997, 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.341 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.342 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:56.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:56.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.345 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:56.345 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:56.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.345 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:56.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.622786013000002, 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:56.347 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.348 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.349 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:56.350 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.351 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:56.352 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.353 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.622584807999999, 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.354 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:56.355 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.356 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:56.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:56.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.358 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.358 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:56.358 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:56.358 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.358 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:56.359 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.622461829000002, 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.360 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:56.361 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.362 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:56.363 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.364 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.365 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.366 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.622406433000002, 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.367 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.368 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.369 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.370 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:56.371 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:56.372 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.373 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.622262620999997, 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.374 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.375 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.376 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.377 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:56.378 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.379 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.622197927000002, 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.380 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:56.381 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:56.382 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.383 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.384 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.385 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.622105488000003, 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.386 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.387 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:56.388 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:56.389 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.390 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.391 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.622027398, 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.392 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.393 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.394 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.398 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.621981902999998, 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:56.399 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:56.400 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.401 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:56.402 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:56.403 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.404 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.621950695999999, 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.405 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.406 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.407 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:56.408 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:56.409 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.410 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.621910249000003, 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.411 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.412 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:56.413 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.414 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.415 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:56.416 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.621872046, 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.417 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.418 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.419 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.420 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:56.421 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:56.422 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.423 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.621821853999997, 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.424 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.425 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.426 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:56.427 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:56.428 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.429 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 62.621733337000002, 2024-04-26T11:22:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:56.430 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.431 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.432 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:56.433 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:56.434 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:56.435 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:56.436 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:56.437 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:56.434+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:56.536 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:56.536+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:56.567 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:56.567 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:56.568 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:56.568 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:56.582 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:56.637 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:56.634+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:56.671 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:22:56.738 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:56.738+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:56.747 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:56.747 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:56.747 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:56.747 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:56.747 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:56.761 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:56.840 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:56.838+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:56.879 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:22:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:22:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:22:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.879 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.272299199000003, 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:22:56.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:22:56.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.193698765000001, 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:22:56.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.192764091999997, 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:56.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.192690976000002, 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:56.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:22:56.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:22:56.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.192639636000003, 2024-04-26T11:22:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:22:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:22:56.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.192589366999997, 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:22:56.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:22:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:22:56.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.192537067000004, 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:22:56.909 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:22:56.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:22:56.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:22:56.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.192487530999998, 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:22:56.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.192421001, 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:22:56.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:22:56.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.924 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.192135125999997, 2024-04-26T11:22:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:22:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:22:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.928 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.190599452000001, 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:22:56.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:22:56.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.188729262000003, 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:22:56.932 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:22:56.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:22:56.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.936 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.188633150000001, 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:22:56.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:22:56.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.166598100000002, 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.166517028000001, 2024-04-26T11:22:56.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:22:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.166464114, 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:22:56.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.166356878999999, 2024-04-26T11:22:56.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:22:56.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:22:56.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.958 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.166302319000003, 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:22:56.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:22:56.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.165587017999997, 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:22:56.963 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:22:56.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 63.163693592999998, 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:22:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:22:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:22:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:22:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:22:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:22:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:22:56.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:22:56.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:22:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:22:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:22:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:22:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:22:56.972 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:22:56.972 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:56.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:56.974 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:56.974+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:57.075 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:57.072+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:57.103 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:57.103 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:57.103 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:22:57.104 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:57.117 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:57.176 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:57.176+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:57.234 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:57.234 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:22:57.234 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:22:57.234 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:22:57.234 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:57.248 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:57.298 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:57.298+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:57.371 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.687025458999997, 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:22:57.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:22:57.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:22:57.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.686899064000002, 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:22:57.377 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.382 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.686810270999999, 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:22:57.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:22:57.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:22:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.686705457999999, 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.393 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.686654802, 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:22:57.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:22:57.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.398 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.686597849000002, 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:22:57.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.686538857000002, 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.407 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.686435850999999, 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:57.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.686360010999998, 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.415 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.671142449000001, 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:57.419 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.666755002999999, 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:22:57.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.665743186999997, 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:22:57.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:22:57.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.665419522999997, 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.428 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.665363245999998, 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:22:57.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:22:57.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:57.435 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.665311817000003, 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.665247026999999, 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:22:57.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.660762679000001, 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.446 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.655552229000001, 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:22:57.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:22:57.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.450 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 63.655468716999998, 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:22:57.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 57.974779177999999, 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:22:57.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:22:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:22:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:22:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:22:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:22:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:22:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:22:57.460 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:22:57.460 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:22:57.462 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:57.462+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:57.462 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:57.562 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:57.562+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:57.596 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:57.596 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:57.596 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:22:57.596 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:57.610 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:57.663 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:57.662+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:57.733 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:22:57.733 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:22:57.733 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:22:57.733 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:57.747 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:57.791 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:57.790+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:57.864 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:57.862+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:57.868 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:22:57.868 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:22:57.868 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:22:57.868 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:22:57.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.868 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:22:57.868 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:57.868 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 74.097415936999994, 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:57.869 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.870 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:22:57.870 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.870 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.870 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.870 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:22:57.871 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:22:57.872 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:22:57.873 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.183586426000005, 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.875 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.876 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.877 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:22:57.878 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:22:57.879 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.880 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.183500690000002, 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.881 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.882 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.883 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.884 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.885 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.886 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.183441517000006, 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:22:57.887 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:22:57.888 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:22:57.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:22:57.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:22:57.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.183356051000004, 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.892 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:22:57.894 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:22:57.895 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:22:57.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:22:57.897 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.183296615000003, 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.898 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.899 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.900 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.901 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.902 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.903 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.183215997999994, 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.904 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.905 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.906 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.907 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.908 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:57.909 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.183014792999998, 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.910 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:22:57.911 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:22:57.912 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:22:57.913 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.914 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182891814000001, 2024-04-26T11:22:57.915 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.916 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:22:57.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:22:57.919 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:22:57.920 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182836417999994, 2024-04-26T11:22:57.921 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.924 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.925 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.926 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182692606000003, 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.928 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.929 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.930 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.931 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.932 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182627912000001, 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:22:57.934 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:22:57.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:22:57.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.938 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182535473000002, 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.939 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.940 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.941 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.942 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.943 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182457382999999, 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.944 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.945 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.946 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.947 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.948 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.949 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182411888000004, 2024-04-26T11:22:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:22:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:22:57.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:22:57.956 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:22:57.957 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:22:57.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182380680999998, 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.959 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:22:57.960 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.961 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.962 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.963 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.964 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182340233999994, 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.965 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:22:57.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:22:57.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:22:57.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182302031000006, 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:22:57.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182251839000003, 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:22:57.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:22:57.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:22:57.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 64.182163321999994, 2024-04-26T11:22:57.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.986 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:22:57.987 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:22:57.987 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:22:57.988 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:57.989 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:57.986+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:58.090 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:58.086+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:58.119 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:58.119 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:58.120 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:22:58.120 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:58.135 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:58.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:58.188+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:58.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:22:58.256 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:22:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:22:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:22:58.256 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:22:58.256 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:22:58.270 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:58.291 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:58.290+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:58.389 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:22:58.389 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:22:58.393 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:58.390+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:58.408 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:22:58.409 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:22:58.429 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:22:58.429 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:22:58.435 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:58.436 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:58.450 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:58.494 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:58.490+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:58.581 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:58.581 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:58.595 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:22:58.596 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:58.594+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:58.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:22:58.696 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:58.694+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:58.760 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:58.760 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:58.775 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:22:58.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:58.796+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:58.896 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:58.896 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:58.898 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:58.894+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:58.912 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:22:58.998 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:58.998+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:59.042 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:59.042 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:59.056 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:22:59.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:59.100+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:59.171 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:59.171 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:59.185 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:22:59.200 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:59.198+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:59.301 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:59.300+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:59.307 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:59.307 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:59.321 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:22:59.402 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:59.402+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:59.453 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:59.453 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:59.467 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:22:59.512 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:59.512+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:59.588 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:59.588 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:59.602 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:22:59.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:59.644+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:59.693 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:22:59.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:22:59.704+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:22:59.766 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:59.766 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:59.780 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:22:59.830 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:22:59.830+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:22:59.906 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:22:59.902+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:22:59.915 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:22:59.915 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:22:59.929 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:00.006 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:00.002+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:00.096 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:00.096 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:00.107 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:00.104+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:00.110 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:00.208 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:00.206+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:00.227 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:00.227 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:00.241 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:00.309 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:00.306+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:00.370 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:00.370 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:00.384 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:00.411 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:00.410+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:00.447 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:00.506 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:00.506 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:00.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:00.508+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:00.520 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:00.598 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:23:00.599 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:23:00.614 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:00.614+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:00.618 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:00.618 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:00.639 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 76.868854569999996, 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:23:00.640 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:23:00.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:23:00.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:23:00.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:23:00.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:23:00.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:23:00.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:23:00.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:23:00.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.955025058999993, 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:23:00.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:23:00.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:23:00.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:23:00.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.652 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.954939323000005, 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:00.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:23:00.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:23:00.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:23:00.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:23:00.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:23:00.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:23:00.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:23:00.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:23:00.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:23:00.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:00.659 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.954880149999994, 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:23:00.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:23:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:23:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:23:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:23:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:23:00.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.666 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.954794684000007, 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:23:00.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:23:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:23:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:23:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:23:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.954735248000006, 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:23:00.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:23:00.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.954654630999997, 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.954453426000001, 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.685 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.686 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:23:00.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:23:00.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.954330447000004, 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:23:00.691 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.692 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.692 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:00.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.697 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.954275050999996, 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:23:00.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:23:00.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.954131239000006, 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:23:00.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:23:00.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:23:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:23:00.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.954066545000003, 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.710 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.714 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.953974106000004, 2024-04-26T11:23:00.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:23:00.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:23:00.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.953896016000002, 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:23:00.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:23:00.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.728 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.953850521000007, 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:23:00.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:00.734 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.953819314, 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:23:00.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:23:00.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:23:00.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.953778866999997, 2024-04-26T11:23:00.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.742 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.743 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.744 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.745 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.746 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:23:00.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:23:00.746 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.746 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.746 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.746 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.746 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.746 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.746 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:00.746 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.953740663999994, 2024-04-26T11:23:00.746 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.747 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.748 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.749 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.750 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.751 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.953690472000005, 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:00.752 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:00.753 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:23:00.754 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:23:00.755 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:23:00.756 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.757 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 66.953601954999996, 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:00.758 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.759 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:23:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:23:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:00.763 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:00.764 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:00.765 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:00.766 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:00.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:00.764+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:00.865 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:00.862+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:00.895 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:00.895 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:00.909 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:00.965 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:00.962+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:01.025 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:01.026 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:01.026 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:01.026 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:01.026 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:01.038 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:01.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:01.084+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:01.154 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.549539918999997, 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.470939485000002, 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:01.159 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:01.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:01.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.470004811999999, 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:01.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:01.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:01.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:01.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:01.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.469931696000003, 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:01.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.469880356000004, 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.176 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:01.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.469830087000005, 2024-04-26T11:23:01.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:01.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:01.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:01.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.469777786999998, 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:01.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:01.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.469728251000006, 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.469661720999994, 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:01.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:01.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:01.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.469375846000005, 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:01.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:01.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.204 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.467840171999995, 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:01.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.465969982000004, 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:01.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:01.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.465873869999996, 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.212 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:01.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.443838819999996, 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:01.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:01.220 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.443757747999996, 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:01.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.224 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.443704834000002, 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:01.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:01.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:01.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:01.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:01.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:01.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:01.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:01.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.443597599, 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:01.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:01.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:01.235 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.443543039000005, 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:01.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.239 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.442827738000005, 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:01.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 67.440934313, 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:01.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:01.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:01.248 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:01.250 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:01.246+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:01.251 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:01.275 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:23:01.275 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:23:01.276 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T11:23:01.276 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.109801 2024-04-26T11:23:01.276 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.10980138238368342 2024-04-26T11:23:01.354 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:01.352+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:01.383 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:01.383 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:01.383 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:01.397 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:01.452 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:01.452+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:01.517 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:01.517 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:01.517 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:01.518 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:01.518 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:01.531 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:01.578 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:01.578+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:01.654 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:01.652+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.970533360999994, 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:01.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.970406965999999, 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:01.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:01.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.970318172999995, 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:01.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:01.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:01.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:01.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.970213360000002, 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:01.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:01.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:01.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.970162704000003, 2024-04-26T11:23:01.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.683 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.970105751000006, 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:01.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:01.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.970046758999999, 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:01.692 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.969943752999995, 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.696 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.969867913000002, 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:01.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.954650350999998, 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.950262905000002, 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.949251089000001, 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:01.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:01.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.948927424999994, 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.712 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:01.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:01.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.948871147999995, 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:01.716 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.948819718999999, 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.720 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.948754929000003, 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:01.724 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:01.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:01.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.727 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.944270580999998, 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:01.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:01.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.939060131000005, 2024-04-26T11:23:01.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:01.735 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 67.938976619000002, 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:01.739 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 62.258287080000002, 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:01.744 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:01.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:23:01.746 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.1 primary-affinity to 0.109801 (871952) 2024-04-26T11:23:01.747 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:01.790 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:01.790+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:01.856 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:01.854+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:01.876 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:23:01.876 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:23:01.876 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:01.890 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:01.957 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:01.954+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:02.012 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:02.012 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:23:02.012 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:23:02.012 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:23:02.012 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:02.026 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:02.058 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:02.056+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:02.146 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:02.146 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:23:02.146 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 78.375449412999998, 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.147 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.148 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.149 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:23:02.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:23:02.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:23:02.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:23:02.150 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.150 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.150 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.150 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:23:02.150 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.151 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:02.152 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.461619901999995, 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:02.153 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.154 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:02.155 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.156 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.157 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.158 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.461534166000007, 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:02.159 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:23:02.160 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.161 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.162 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.163 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:02.164 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.461474992999996, 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.165 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:23:02.166 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.167 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:23:02.168 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.169 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:02.170 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.461389526999994, 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.171 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:23:02.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:02.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.172 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.172 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.172 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:23:02.172 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:23:02.172 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.173 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.174 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.175 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:23:02.176 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.461330090999994, 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.177 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.178 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:23:02.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.181 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:23:02.182 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.461249473999999, 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:02.183 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:23:02.184 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:23:02.185 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.186 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.187 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:23:02.188 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.461048269000003, 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.189 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.190 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.191 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.192 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.193 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.194 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460925290000006, 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:02.195 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:23:02.196 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.197 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.198 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.199 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:23:02.200 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460869893999998, 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.201 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:23:02.202 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:23:02.203 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:23:02.204 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:23:02.205 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.206 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460726081999994, 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.207 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.208 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.209 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.210 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.211 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.212 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460661388000005, 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.213 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.214 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.215 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:23:02.216 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:23:02.217 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460568949000006, 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.218 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.219 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.220 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.221 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.222 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:23:02.223 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460490859000004, 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:02.224 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.225 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.226 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.227 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.228 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:23:02.229 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460445363999995, 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.230 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.231 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.232 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:23:02.233 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:23:02.234 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.235 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460414157000002, 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:02.236 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:23:02.237 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:02.238 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.239 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.240 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460373709999999, 2024-04-26T11:23:02.241 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.242 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.243 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.244 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.245 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.246 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460335506999996, 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.247 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:23:02.248 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:23:02.249 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.250 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.251 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.252 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460285314999993, 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.253 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.257 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:23:02.258 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 68.460196797999998, 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.259 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:23:02.260 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:23:02.261 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:23:02.262 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:23:02.263 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:02.263 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:02.263 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:02.263 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:23:02.263 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:23:02.263 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.263 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.263 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.263 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:02.263 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:02.263 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:02.265 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:02.265 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:02.262+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:02.366 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:02.366+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:02.395 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:02.395 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:02.395 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:02.396 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:02.410 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:02.467 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:02.464+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:02.526 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:02.526 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:02.526 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:02.526 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:02.526 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:02.539 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:02.567 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:02.566+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:02.668 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:02.666+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:02.680 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-26T11:23:02.711 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:02.711 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:02.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:02.711 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:02.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.711 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:02.711 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 79.104296808000001, 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:02.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:02.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.025696374000006, 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.024761701000003, 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:02.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:02.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.024688585000007, 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.024637244999994, 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.731 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:02.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:02.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.024586975999995, 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.736 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:02.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:02.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:02.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:02.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.024534676000002, 2024-04-26T11:23:02.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:02.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:02.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:02.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.024485139999996, 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:02.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:02.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:02.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:02.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.024418609999998, 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:02.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:02.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:02.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.024132734999995, 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.022597060999999, 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:02.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:02.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.020726870999994, 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:02.763 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:02.767 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 69.020630758999999, 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:02.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.771 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.998595709, 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:02.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.998514637, 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:02.780 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.998461723000005, 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:02.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:02.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.784 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.998354488000004, 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.998299927999994, 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:02.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:02.793 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.997584626999995, 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.797 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 68.995691202000003, 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:02.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:02.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:02.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:02.802 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:02.802 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:02.802 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:02.804 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:02.805 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:02.804+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:02.904 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:02.902+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:02.934 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:02.934 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:02.934 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:02.934 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:02.935 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:23:02.935 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:23:02.948 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:02.966 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:02.966 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:02.984 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:02.985 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:03.005 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:03.004+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:03.106 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:03.106+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:03.109 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:03.109 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:03.123 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:03.210 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:03.210+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:03.290 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:03.291 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:03.304 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:03.308 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:03.308+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:03.409 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:03.408+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:03.438 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:03.438 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:03.452 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:03.510 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:03.510+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:03.574 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:03.574 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:03.589 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:03.635 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:03.634+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:03.710 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:03.710 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:03.711 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:03.710+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:03.724 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:03.811 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:03.810+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:03.855 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:03.856 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:03.871 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:03.913 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:03.910+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:03.994 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:03.994 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:04.008 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:04.014 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:04.014+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:04.115 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:04.114+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:04.126 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:04.126 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:04.140 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:04.216 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:04.214+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:04.271 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:04.271 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:04.286 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:04.316 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:04.316+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:04.417 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:04.414+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:04.451 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:04.451 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:04.466 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:04.517 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:04.514+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:04.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:04.616+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:04.630 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:04.631 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:04.645 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:04.704 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:23:04.719 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:04.718+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:04.776 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:04.776 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:04.790 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:04.819 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:04.816+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:04.910 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:04.911 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:04.920 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:04.920+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:04.924 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:05.000 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:05.021 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:05.018+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:05.041 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:05.041 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:05.055 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:05.061 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-26T11:23:05.122 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:05.120+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:05.147 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:23:05.147 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:23:05.177 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:05.177 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:05.185 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:05.185 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:05.185 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:05.185 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:05.196 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:05.197 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:05.199 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:05.222 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:05.218+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:05.323 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:05.320+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:05.366 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:05.366 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:05.366 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:05.380 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:05.424 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:05.424+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:05.525 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:05.522+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:05.549 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:05.549 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:05.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:05.549 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:05.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.549 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:05.549 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 81.942203594999995, 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:05.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:05.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:05.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:05.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:05.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:05.553 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.553 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.553 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.863603161, 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:05.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:05.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:05.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:05.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:05.558 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.862668487999997, 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:05.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:05.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:05.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:05.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:05.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:05.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:05.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:05.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:05.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:05.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:05.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:05.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:05.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:05.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:05.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:05.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:05.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:05.564 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.862595372000001, 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:05.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:05.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:05.570 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.862544032000002, 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:05.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.862493763000003, 2024-04-26T11:23:05.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:05.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.862441462999996, 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:05.580 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:05.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:05.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:05.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.862391927000004, 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.585 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:05.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:05.590 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.862325397000006, 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:05.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.862039522000003, 2024-04-26T11:23:05.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:05.597 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.860503847999993, 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:05.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:05.601 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.858633658000002, 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.858537545999994, 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.605 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:05.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:05.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:05.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:05.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:05.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:05.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.836502495999994, 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:05.609 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:05.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.836421423999994, 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:05.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:05.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.83636851, 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.836261274999998, 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:05.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:05.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:05.624 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.836206715000003, 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:05.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:05.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:05.628 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.835491414000003, 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 71.833597988999998, 2024-04-26T11:23:05.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:05.633 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:05.634 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:05.635 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:05.636 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:05.636 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:05.636 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:05.636 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.636 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.636 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.636 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:05.636 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:05.636 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:05.637 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:05.638 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:05.638+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:05.739 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:05.738+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:05.771 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:05.772 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:05.772 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:05.772 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:05.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:05.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:05.840+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:05.941 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:05.938+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:05.951 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:05.951 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:05.951 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:05.951 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:05.951 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:05.966 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:06.041 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:06.038+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:06.088 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:06.088 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:06.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:06.088 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:06.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.088 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.088 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:06.088 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.404173236999995, 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:06.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.093 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.404046842, 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:06.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.098 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.403958048999996, 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:06.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:06.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:06.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:06.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.403853236000003, 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:06.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.403802580000004, 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:06.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.403745627000006, 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.403686635, 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:06.119 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:06.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:06.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:06.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.403583628999996, 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.126 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.403507789000003, 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:06.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:06.130 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.388290226999999, 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:06.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:06.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:06.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:06.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:06.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:06.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.383902781000003, 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.382890965000001, 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:06.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:06.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:06.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.382567300999995, 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.382511023999996, 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:06.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.382459595, 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:06.150 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.382394805000004, 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:06.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.377910456999999, 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:06.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.161 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.372700007000006, 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:06.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.165 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.372616495000003, 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:06.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:06.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:06.170 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.170 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.170 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.170 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:06.170 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:06.170 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 66.691926956000003, 2024-04-26T11:23:06.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:06.170 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:06.175 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:06.177 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:06.174+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:06.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:06.278 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:06.276+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:06.306 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:06.306 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:23:06.306 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:23:06.306 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:06.320 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:06.378 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:06.374+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:06.441 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:06.441 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:23:06.441 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:23:06.441 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:23:06.441 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:06.455 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:06.480 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:06.478+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:06.581 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:06.578+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:06.627 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:23:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:23:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:23:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:23:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 82.856191170000002, 2024-04-26T11:23:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:23:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.627 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:06.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:23:06.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:23:06.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.942361658999999, 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:06.638 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.942275922999997, 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.94221675, 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.942131283999998, 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.655 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.942071847999998, 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941991231000003, 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:06.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:06.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:23:06.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:23:06.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.667 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941790026000007, 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:23:06.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:23:06.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:23:06.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:23:06.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:23:06.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:23:06.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941667046999996, 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:23:06.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:23:06.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:23:06.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941611651000002, 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:23:06.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:23:06.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:23:06.685 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941467838999998, 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:06.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:23:06.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:23:06.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:23:06.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941403144999995, 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.697 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941310705999996, 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941232615999994, 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.703 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.708 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941187120999999, 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:23:06.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.714 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941155914000007, 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:23:06.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:23:06.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:23:06.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:23:06.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941115467000003, 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:23:06.720 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.721 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:23:06.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:23:06.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.725 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941077264, 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:06.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:23:06.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:23:06.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:23:06.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:23:06.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.941027071999997, 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:06.737 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 72.940938555000002, 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:06.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:23:06.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:23:06.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:23:06.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:23:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:06.742 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:06.742 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:06.743 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:06.744 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:06.742+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:06.747 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:23:06.747 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:23:06.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:23:06.844 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:06.842+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:06.872 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:06.872 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:06.872 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:06.872 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:06.886 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:06.945 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:06.944+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:07.002 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:07.002 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:07.002 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:07.002 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:07.002 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:07.016 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:07.060 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:07.060+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:07.086 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:23:07.147 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:07.146+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:07.185 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:07.185 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:07.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:07.185 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:07.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.185 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:07.185 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:07.185 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 83.577870539000003, 2024-04-26T11:23:07.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:07.189 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.499270104999994, 2024-04-26T11:23:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:07.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:07.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:07.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.498335432000005, 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:07.195 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.196 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.196 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:07.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:07.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:07.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.498262315999995, 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:07.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.498210975999996, 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.206 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:07.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:07.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:07.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:07.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.498160706999997, 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.216 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.498108407000004, 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.221 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.498058870999998, 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:07.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.226 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.497992341, 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:07.230 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.497706465999997, 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:07.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:07.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:07.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:07.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.496170792000001, 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:07.237 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.494300601999996, 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:07.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.494204490000001, 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:07.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.245 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.472169440000002, 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:07.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.472088368000001, 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.472035453999993, 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.257 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.471928219000006, 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:07.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.471873658999996, 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:07.261 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:07.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.471158357999997, 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 73.469264933000005, 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:07.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:07.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.272 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.273 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:07.273 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:07.273 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:07.273 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:07.277 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:07.277 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:23:07.279 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:23:07.280 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-04-26T11:23:05.342249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597673,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":256,"num_write_kb":3483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":90428,"kb_used_data":1176,"kb_used_omap":4,"kb_used_meta":89211,"kb_avail":283025092,"statfs":{"total":289910292480,"available":289817694208,"internally_reserved":0,"allocated":1204224,"data_stored":1640612,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":4781,"internal_metadata":91352403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.653611"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672089+0000","last_change":"2024-04-26T11:21:53.713298+0000","last_active":"2024-04-26T11:22:56.672089+0000","last_peered":"2024-04-26T11:22:56.672089+0000","last_clean":"2024-04-26T11:22:56.672089+0000","last_became_active":"2024-04-26T11:21:53.712481+0000","last_became_peered":"2024-04-26T11:21:53.712481+0000","last_unstale":"2024-04-26T11:22:56.672089+0000","last_undegraded":"2024-04-26T11:22:56.672089+0000","last_fullsized":"2024-04-26T11:22:56.672089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671664+0000","last_change":"2024-04-26T11:21:53.716754+0000","last_active":"2024-04-26T11:22:56.671664+0000","last_peered":"2024-04-26T11:22:56.671664+0000","last_clean":"2024-04-26T11:22:56.671664+0000","last_became_active":"2024-04-26T11:21:53.716109+0000","last_became_peered":"2024-04-26T11:21:53.716109+0000","last_unstale":"2024-04-26T11:22:56.671664+0000","last_undegraded":"2024-04-26T11:22:56.671664+0000","last_fullsized":"2024-04-26T11:22:56.671664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672689+0000","last_change":"2024-04-26T11:21:53.710480+0000","last_active":"2024-04-26T11:22:56.672689+0000","last_peered":"2024-04-26T11:22:56.672689+0000","last_clean":"2024-04-26T11:22:56.672689+0000","last_became_active":"2024-04-26T11:21:53.709433+0000","last_became_peered":"2024-04-26T11:21:53.709433+0000","last_unstale":"2024-04-26T11:22:56.672689+0000","last_undegraded":"2024-04-26T11:22:56.672689+0000","last_fullsized":"2024-04-26T11:22:56.672689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:11.687344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672125+0000","last_change":"2024-04-26T11:21:53.719849+0000","last_active":"2024-04-26T11:22:56.672125+0000","last_peered":"2024-04-26T11:22:56.672125+0000","last_clean":"2024-04-26T11:22:56.672125+0000","last_became_active":"2024-04-26T11:21:53.719152+0000","last_became_peered":"2024-04-26T11:21:53.719152+0000","last_unstale":"2024-04-26T11:22:56.672125+0000","last_undegraded":"2024-04-26T11:22:56.672125+0000","last_fullsized":"2024-04-26T11:22:56.672125+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671131+0000","last_change":"2024-04-26T11:21:53.712493+0000","last_active":"2024-04-26T11:22:56.671131+0000","last_peered":"2024-04-26T11:22:56.671131+0000","last_clean":"2024-04-26T11:22:56.671131+0000","last_became_active":"2024-04-26T11:21:53.711704+0000","last_became_peered":"2024-04-26T11:21:53.711704+0000","last_unstale":"2024-04-26T11:22:56.671131+0000","last_undegraded":"2024-04-26T11:22:56.671131+0000","last_fullsized":"2024-04-26T11:22:56.671131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671734+0000","last_change":"2024-04-26T11:21:53.715149+0000","last_active":"2024-04-26T11:22:56.671734+0000","last_peered":"2024-04-26T11:22:56.671734+0000","last_clean":"2024-04-26T11:22:56.671734+0000","last_became_active":"2024-04-26T11:21:53.714125+0000","last_became_peered":"2024-04-26T11:21:53.714125+0000","last_unstale":"2024-04-26T11:22:56.671734+0000","last_undegraded":"2024-04-26T11:22:56.671734+0000","last_fullsized":"2024-04-26T11:22:56.671734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671453+0000","last_change":"2024-04-26T11:21:53.714653+0000","last_active":"2024-04-26T11:22:56.671453+0000","last_peered":"2024-04-26T11:22:56.671453+0000","last_clean":"2024-04-26T11:22:56.671453+0000","last_became_active":"2024-04-26T11:21:53.713586+0000","last_became_peered":"2024-04-26T11:21:53.713586+0000","last_unstale":"2024-04-26T11:22:56.671453+0000","last_undegraded":"2024-04-26T11:22:56.671453+0000","last_fullsized":"2024-04-26T11:22:56.671453+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:01.563026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671089+0000","last_change":"2024-04-26T11:21:53.715422+0000","last_active":"2024-04-26T11:22:56.671089+0000","last_peered":"2024-04-26T11:22:56.671089+0000","last_clean":"2024-04-26T11:22:56.671089+0000","last_became_active":"2024-04-26T11:21:53.714329+0000","last_became_peered":"2024-04-26T11:21:53.714329+0000","last_unstale":"2024-04-26T11:22:56.671089+0000","last_undegraded":"2024-04-26T11:22:56.671089+0000","last_fullsized":"2024-04-26T11:22:56.671089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:06.981197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855050+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:22:56.855050+0000","last_peered":"2024-04-26T11:22:56.855050+0000","last_clean":"2024-04-26T11:22:56.855050+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:22:56.855050+0000","last_undegraded":"2024-04-26T11:22:56.855050+0000","last_fullsized":"2024-04-26T11:22:56.855050+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671695+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:22:56.671695+0000","last_peered":"2024-04-26T11:22:56.671695+0000","last_clean":"2024-04-26T11:22:56.671695+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:22:56.671695+0000","last_undegraded":"2024-04-26T11:22:56.671695+0000","last_fullsized":"2024-04-26T11:22:56.671695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672884+0000","last_change":"2024-04-26T11:21:53.714245+0000","last_active":"2024-04-26T11:22:56.672884+0000","last_peered":"2024-04-26T11:22:56.672884+0000","last_clean":"2024-04-26T11:22:56.672884+0000","last_became_active":"2024-04-26T11:21:53.713331+0000","last_became_peered":"2024-04-26T11:21:53.713331+0000","last_unstale":"2024-04-26T11:22:56.672884+0000","last_undegraded":"2024-04-26T11:22:56.672884+0000","last_fullsized":"2024-04-26T11:22:56.672884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671238+0000","last_change":"2024-04-26T11:21:53.712269+0000","last_active":"2024-04-26T11:22:56.671238+0000","last_peered":"2024-04-26T11:22:56.671238+0000","last_clean":"2024-04-26T11:22:56.671238+0000","last_became_active":"2024-04-26T11:21:53.710740+0000","last_became_peered":"2024-04-26T11:21:53.710740+0000","last_unstale":"2024-04-26T11:22:56.671238+0000","last_undegraded":"2024-04-26T11:22:56.671238+0000","last_fullsized":"2024-04-26T11:22:56.671238+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:50.323053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671025+0000","last_change":"2024-04-26T11:21:53.712552+0000","last_active":"2024-04-26T11:22:56.671025+0000","last_peered":"2024-04-26T11:22:56.671025+0000","last_clean":"2024-04-26T11:22:56.671025+0000","last_became_active":"2024-04-26T11:21:53.711470+0000","last_became_peered":"2024-04-26T11:21:53.711470+0000","last_unstale":"2024-04-26T11:22:56.671025+0000","last_undegraded":"2024-04-26T11:22:56.671025+0000","last_fullsized":"2024-04-26T11:22:56.671025+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671826+0000","last_change":"2024-04-26T11:21:53.705872+0000","last_active":"2024-04-26T11:22:56.671826+0000","last_peered":"2024-04-26T11:22:56.671826+0000","last_clean":"2024-04-26T11:22:56.671826+0000","last_became_active":"2024-04-26T11:21:53.705040+0000","last_became_peered":"2024-04-26T11:21:53.705040+0000","last_unstale":"2024-04-26T11:22:56.671826+0000","last_undegraded":"2024-04-26T11:22:56.671826+0000","last_fullsized":"2024-04-26T11:22:56.671826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:02.015153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671447+0000","last_change":"2024-04-26T11:21:53.707324+0000","last_active":"2024-04-26T11:22:56.671447+0000","last_peered":"2024-04-26T11:22:56.671447+0000","last_clean":"2024-04-26T11:22:56.671447+0000","last_became_active":"2024-04-26T11:21:53.706602+0000","last_became_peered":"2024-04-26T11:21:53.706602+0000","last_unstale":"2024-04-26T11:22:56.671447+0000","last_undegraded":"2024-04-26T11:22:56.671447+0000","last_fullsized":"2024-04-26T11:22:56.671447+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:08.907498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671095+0000","last_change":"2024-04-26T11:21:53.714327+0000","last_active":"2024-04-26T11:22:56.671095+0000","last_peered":"2024-04-26T11:22:56.671095+0000","last_clean":"2024-04-26T11:22:56.671095+0000","last_became_active":"2024-04-26T11:21:53.712908+0000","last_became_peered":"2024-04-26T11:21:53.712908+0000","last_unstale":"2024-04-26T11:22:56.671095+0000","last_undegraded":"2024-04-26T11:22:56.671095+0000","last_fullsized":"2024-04-26T11:22:56.671095+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:20:31.158881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855807+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:22:56.855807+0000","last_peered":"2024-04-26T11:22:56.855807+0000","last_clean":"2024-04-26T11:22:56.855807+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:22:56.855807+0000","last_undegraded":"2024-04-26T11:22:56.855807+0000","last_fullsized":"2024-04-26T11:22:56.855807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671800+0000","last_change":"2024-04-26T11:21:53.714983+0000","last_active":"2024-04-26T11:22:56.671800+0000","last_peered":"2024-04-26T11:22:56.671800+0000","last_clean":"2024-04-26T11:22:56.671800+0000","last_became_active":"2024-04-26T11:21:53.711987+0000","last_became_peered":"2024-04-26T11:21:53.711987+0000","last_unstale":"2024-04-26T11:22:56.671800+0000","last_undegraded":"2024-04-26T11:22:56.671800+0000","last_fullsized":"2024-04-26T11:22:56.671800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:24:49.055365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855139+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:22:56.855139+0000","last_peered":"2024-04-26T11:22:56.855139+0000","last_clean":"2024-04-26T11:22:56.855139+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:22:56.855139+0000","last_undegraded":"2024-04-26T11:22:56.855139+0000","last_fullsized":"2024-04-26T11:22:56.855139+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672204+0000","last_change":"2024-04-26T11:21:53.715255+0000","last_active":"2024-04-26T11:22:56.672204+0000","last_peered":"2024-04-26T11:22:56.672204+0000","last_clean":"2024-04-26T11:22:56.672204+0000","last_became_active":"2024-04-26T11:21:53.714525+0000","last_became_peered":"2024-04-26T11:21:53.714525+0000","last_unstale":"2024-04-26T11:22:56.672204+0000","last_undegraded":"2024-04-26T11:22:56.672204+0000","last_fullsized":"2024-04-26T11:22:56.672204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672326+0000","last_change":"2024-04-26T11:21:53.714368+0000","last_active":"2024-04-26T11:22:56.672326+0000","last_peered":"2024-04-26T11:22:56.672326+0000","last_clean":"2024-04-26T11:22:56.672326+0000","last_became_active":"2024-04-26T11:21:53.713099+0000","last_became_peered":"2024-04-26T11:21:53.713099+0000","last_unstale":"2024-04-26T11:22:56.672326+0000","last_undegraded":"2024-04-26T11:22:56.672326+0000","last_fullsized":"2024-04-26T11:22:56.672326+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.670886+0000","last_change":"2024-04-26T11:21:53.709697+0000","last_active":"2024-04-26T11:22:56.670886+0000","last_peered":"2024-04-26T11:22:56.670886+0000","last_clean":"2024-04-26T11:22:56.670886+0000","last_became_active":"2024-04-26T11:21:53.708839+0000","last_became_peered":"2024-04-26T11:21:53.708839+0000","last_unstale":"2024-04-26T11:22:56.670886+0000","last_undegraded":"2024-04-26T11:22:56.670886+0000","last_fullsized":"2024-04-26T11:22:56.670886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.038896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.853176+0000","last_change":"2024-04-26T11:22:40.788692+0000","last_active":"2024-04-26T11:22:56.853176+0000","last_peered":"2024-04-26T11:22:56.853176+0000","last_clean":"2024-04-26T11:22:56.853176+0000","last_became_active":"2024-04-26T11:22:40.788099+0000","last_became_peered":"2024-04-26T11:22:40.788099+0000","last_unstale":"2024-04-26T11:22:56.853176+0000","last_undegraded":"2024-04-26T11:22:56.853176+0000","last_fullsized":"2024-04-26T11:22:56.853176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:49.604299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.670538+0000","last_change":"2024-04-26T11:21:53.692834+0000","last_active":"2024-04-26T11:22:56.670538+0000","last_peered":"2024-04-26T11:22:56.670538+0000","last_clean":"2024-04-26T11:22:56.670538+0000","last_became_active":"2024-04-26T11:21:53.690279+0000","last_became_peered":"2024-04-26T11:21:53.690279+0000","last_unstale":"2024-04-26T11:22:56.670538+0000","last_undegraded":"2024-04-26T11:22:56.670538+0000","last_fullsized":"2024-04-26T11:22:56.670538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:45.949598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672058+0000","last_change":"2024-04-26T11:21:53.698796+0000","last_active":"2024-04-26T11:22:56.672058+0000","last_peered":"2024-04-26T11:22:56.672058+0000","last_clean":"2024-04-26T11:22:56.672058+0000","last_became_active":"2024-04-26T11:21:53.697854+0000","last_became_peered":"2024-04-26T11:21:53.697854+0000","last_unstale":"2024-04-26T11:22:56.672058+0000","last_undegraded":"2024-04-26T11:22:56.672058+0000","last_fullsized":"2024-04-26T11:22:56.672058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855515+0000","last_change":"2024-04-26T11:21:53.706583+0000","last_active":"2024-04-26T11:22:56.855515+0000","last_peered":"2024-04-26T11:22:56.855515+0000","last_clean":"2024-04-26T11:22:56.855515+0000","last_became_active":"2024-04-26T11:21:53.704871+0000","last_became_peered":"2024-04-26T11:21:53.704871+0000","last_unstale":"2024-04-26T11:22:56.855515+0000","last_undegraded":"2024-04-26T11:22:56.855515+0000","last_fullsized":"2024-04-26T11:22:56.855515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:38:54.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.673004+0000","last_change":"2024-04-26T11:21:53.709813+0000","last_active":"2024-04-26T11:22:56.673004+0000","last_peered":"2024-04-26T11:22:56.673004+0000","last_clean":"2024-04-26T11:22:56.673004+0000","last_became_active":"2024-04-26T11:21:53.708399+0000","last_became_peered":"2024-04-26T11:21:53.708399+0000","last_unstale":"2024-04-26T11:22:56.673004+0000","last_undegraded":"2024-04-26T11:22:56.673004+0000","last_fullsized":"2024-04-26T11:22:56.673004+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:36.298230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671372+0000","last_change":"2024-04-26T11:21:53.710195+0000","last_active":"2024-04-26T11:22:56.671372+0000","last_peered":"2024-04-26T11:22:56.671372+0000","last_clean":"2024-04-26T11:22:56.671372+0000","last_became_active":"2024-04-26T11:21:53.709660+0000","last_became_peered":"2024-04-26T11:21:53.709660+0000","last_unstale":"2024-04-26T11:22:56.671372+0000","last_undegraded":"2024-04-26T11:22:56.671372+0000","last_fullsized":"2024-04-26T11:22:56.671372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.854740+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:22:56.854740+0000","last_peered":"2024-04-26T11:22:56.854740+0000","last_clean":"2024-04-26T11:22:56.854740+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:22:56.854740+0000","last_undegraded":"2024-04-26T11:22:56.854740+0000","last_fullsized":"2024-04-26T11:22:56.854740+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671172+0000","last_change":"2024-04-26T11:21:53.709264+0000","last_active":"2024-04-26T11:22:56.671172+0000","last_peered":"2024-04-26T11:22:56.671172+0000","last_clean":"2024-04-26T11:22:56.671172+0000","last_became_active":"2024-04-26T11:21:53.708529+0000","last_became_peered":"2024-04-26T11:21:53.708529+0000","last_unstale":"2024-04-26T11:22:56.671172+0000","last_undegraded":"2024-04-26T11:22:56.671172+0000","last_fullsized":"2024-04-26T11:22:56.671172+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.853577+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:22:56.853577+0000","last_peered":"2024-04-26T11:22:56.853577+0000","last_clean":"2024-04-26T11:22:56.853577+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:22:56.853577+0000","last_undegraded":"2024-04-26T11:22:56.853577+0000","last_fullsized":"2024-04-26T11:22:56.853577+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671300+0000","last_change":"2024-04-26T11:21:53.708939+0000","last_active":"2024-04-26T11:22:56.671300+0000","last_peered":"2024-04-26T11:22:56.671300+0000","last_clean":"2024-04-26T11:22:56.671300+0000","last_became_active":"2024-04-26T11:21:53.708120+0000","last_became_peered":"2024-04-26T11:21:53.708120+0000","last_unstale":"2024-04-26T11:22:56.671300+0000","last_undegraded":"2024-04-26T11:22:56.671300+0000","last_fullsized":"2024-04-26T11:22:56.671300+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671340+0000","last_change":"2024-04-26T11:21:53.712919+0000","last_active":"2024-04-26T11:22:56.671340+0000","last_peered":"2024-04-26T11:22:56.671340+0000","last_clean":"2024-04-26T11:22:56.671340+0000","last_became_active":"2024-04-26T11:21:53.710798+0000","last_became_peered":"2024-04-26T11:21:53.710798+0000","last_unstale":"2024-04-26T11:22:56.671340+0000","last_undegraded":"2024-04-26T11:22:56.671340+0000","last_fullsized":"2024-04-26T11:22:56.671340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.625555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672627+0000","last_change":"2024-04-26T11:21:53.343931+0000","last_active":"2024-04-26T11:22:56.672627+0000","last_peered":"2024-04-26T11:22:56.672627+0000","last_clean":"2024-04-26T11:22:56.672627+0000","last_became_active":"2024-04-26T11:21:53.342363+0000","last_became_peered":"2024-04-26T11:21:53.342363+0000","last_unstale":"2024-04-26T11:22:56.672627+0000","last_undegraded":"2024-04-26T11:22:56.672627+0000","last_fullsized":"2024-04-26T11:22:56.672627+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671667+0000","last_change":"2024-04-26T11:21:53.712613+0000","last_active":"2024-04-26T11:22:56.671667+0000","last_peered":"2024-04-26T11:22:56.671667+0000","last_clean":"2024-04-26T11:22:56.671667+0000","last_became_active":"2024-04-26T11:21:53.711848+0000","last_became_peered":"2024-04-26T11:21:53.711848+0000","last_unstale":"2024-04-26T11:22:56.671667+0000","last_undegraded":"2024-04-26T11:22:56.671667+0000","last_fullsized":"2024-04-26T11:22:56.671667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:45:49.327612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.854446+0000","last_change":"2024-04-26T11:21:53.333005+0000","last_active":"2024-04-26T11:22:56.854446+0000","last_peered":"2024-04-26T11:22:56.854446+0000","last_clean":"2024-04-26T11:22:56.854446+0000","last_became_active":"2024-04-26T11:21:53.332191+0000","last_became_peered":"2024-04-26T11:21:53.332191+0000","last_unstale":"2024-04-26T11:22:56.854446+0000","last_undegraded":"2024-04-26T11:22:56.854446+0000","last_fullsized":"2024-04-26T11:22:56.854446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:24.745593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.853280+0000","last_change":"2024-04-26T11:22:40.788833+0000","last_active":"2024-04-26T11:22:56.853280+0000","last_peered":"2024-04-26T11:22:56.853280+0000","last_clean":"2024-04-26T11:22:56.853280+0000","last_became_active":"2024-04-26T11:22:40.788294+0000","last_became_peered":"2024-04-26T11:22:40.788294+0000","last_unstale":"2024-04-26T11:22:56.853280+0000","last_undegraded":"2024-04-26T11:22:56.853280+0000","last_fullsized":"2024-04-26T11:22:56.853280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:39:08.719453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.670696+0000","last_change":"2024-04-26T11:21:53.341523+0000","last_active":"2024-04-26T11:22:56.670696+0000","last_peered":"2024-04-26T11:22:56.670696+0000","last_clean":"2024-04-26T11:22:56.670696+0000","last_became_active":"2024-04-26T11:21:53.340545+0000","last_became_peered":"2024-04-26T11:21:53.340545+0000","last_unstale":"2024-04-26T11:22:56.670696+0000","last_undegraded":"2024-04-26T11:22:56.670696+0000","last_fullsized":"2024-04-26T11:22:56.670696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:21.907675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855315+0000","last_change":"2024-04-26T11:21:53.706879+0000","last_active":"2024-04-26T11:22:56.855315+0000","last_peered":"2024-04-26T11:22:56.855315+0000","last_clean":"2024-04-26T11:22:56.855315+0000","last_became_active":"2024-04-26T11:21:53.705082+0000","last_became_peered":"2024-04-26T11:21:53.705082+0000","last_unstale":"2024-04-26T11:22:56.855315+0000","last_undegraded":"2024-04-26T11:22:56.855315+0000","last_fullsized":"2024-04-26T11:22:56.855315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:17.205506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671343+0000","last_change":"2024-04-26T11:21:53.341655+0000","last_active":"2024-04-26T11:22:56.671343+0000","last_peered":"2024-04-26T11:22:56.671343+0000","last_clean":"2024-04-26T11:22:56.671343+0000","last_became_active":"2024-04-26T11:21:53.340085+0000","last_became_peered":"2024-04-26T11:21:53.340085+0000","last_unstale":"2024-04-26T11:22:56.671343+0000","last_undegraded":"2024-04-26T11:22:56.671343+0000","last_fullsized":"2024-04-26T11:22:56.671343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.673601+0000","last_change":"2024-04-26T11:21:53.340063+0000","last_active":"2024-04-26T11:22:56.673601+0000","last_peered":"2024-04-26T11:22:56.673601+0000","last_clean":"2024-04-26T11:22:56.673601+0000","last_became_active":"2024-04-26T11:21:53.339256+0000","last_became_peered":"2024-04-26T11:21:53.339256+0000","last_unstale":"2024-04-26T11:22:56.673601+0000","last_undegraded":"2024-04-26T11:22:56.673601+0000","last_fullsized":"2024-04-26T11:22:56.673601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.853453+0000","last_change":"2024-04-26T11:22:40.571973+0000","last_active":"2024-04-26T11:22:56.853453+0000","last_peered":"2024-04-26T11:22:56.853453+0000","last_clean":"2024-04-26T11:22:56.853453+0000","last_became_active":"2024-04-26T11:22:40.571207+0000","last_became_peered":"2024-04-26T11:22:40.571207+0000","last_unstale":"2024-04-26T11:22:56.853453+0000","last_undegraded":"2024-04-26T11:22:56.853453+0000","last_fullsized":"2024-04-26T11:22:56.853453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:31.334310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671950+0000","last_change":"2024-04-26T11:21:53.341302+0000","last_active":"2024-04-26T11:22:56.671950+0000","last_peered":"2024-04-26T11:22:56.671950+0000","last_clean":"2024-04-26T11:22:56.671950+0000","last_became_active":"2024-04-26T11:21:53.340509+0000","last_became_peered":"2024-04-26T11:21:53.340509+0000","last_unstale":"2024-04-26T11:22:56.671950+0000","last_undegraded":"2024-04-26T11:22:56.671950+0000","last_fullsized":"2024-04-26T11:22:56.671950+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:16.781849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.670590+0000","last_change":"2024-04-26T11:21:53.716075+0000","last_active":"2024-04-26T11:22:56.670590+0000","last_peered":"2024-04-26T11:22:56.670590+0000","last_clean":"2024-04-26T11:22:56.670590+0000","last_became_active":"2024-04-26T11:21:53.714328+0000","last_became_peered":"2024-04-26T11:21:53.714328+0000","last_unstale":"2024-04-26T11:22:56.670590+0000","last_undegraded":"2024-04-26T11:22:56.670590+0000","last_fullsized":"2024-04-26T11:22:56.670590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:32:54.693251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":31,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.673459+0000","last_change":"2024-04-26T11:21:53.339171+0000","last_active":"2024-04-26T11:22:56.673459+0000","last_peered":"2024-04-26T11:22:56.673459+0000","last_clean":"2024-04-26T11:22:56.673459+0000","last_became_active":"2024-04-26T11:21:53.337433+0000","last_became_peered":"2024-04-26T11:21:53.337433+0000","last_unstale":"2024-04-26T11:22:56.673459+0000","last_undegraded":"2024-04-26T11:22:56.673459+0000","last_fullsized":"2024-04-26T11:22:56.673459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:28:50.378756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672000+0000","last_change":"2024-04-26T11:21:53.719666+0000","last_active":"2024-04-26T11:22:56.672000+0000","last_peered":"2024-04-26T11:22:56.672000+0000","last_clean":"2024-04-26T11:22:56.672000+0000","last_became_active":"2024-04-26T11:21:53.718871+0000","last_became_peered":"2024-04-26T11:21:53.718871+0000","last_unstale":"2024-04-26T11:22:56.672000+0000","last_undegraded":"2024-04-26T11:22:56.672000+0000","last_fullsized":"2024-04-26T11:22:56.672000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672665+0000","last_change":"2024-04-26T11:21:53.344744+0000","last_active":"2024-04-26T11:22:56.672665+0000","last_peered":"2024-04-26T11:22:56.672665+0000","last_clean":"2024-04-26T11:22:56.672665+0000","last_became_active":"2024-04-26T11:21:53.344055+0000","last_became_peered":"2024-04-26T11:21:53.344055+0000","last_unstale":"2024-04-26T11:22:56.672665+0000","last_undegraded":"2024-04-26T11:22:56.672665+0000","last_fullsized":"2024-04-26T11:22:56.672665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.854839+0000","last_change":"2024-04-26T11:21:53.709563+0000","last_active":"2024-04-26T11:22:56.854839+0000","last_peered":"2024-04-26T11:22:56.854839+0000","last_clean":"2024-04-26T11:22:56.854839+0000","last_became_active":"2024-04-26T11:21:53.706598+0000","last_became_peered":"2024-04-26T11:21:53.706598+0000","last_unstale":"2024-04-26T11:22:56.854839+0000","last_undegraded":"2024-04-26T11:22:56.854839+0000","last_fullsized":"2024-04-26T11:22:56.854839+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855124+0000","last_change":"2024-04-26T11:21:53.330145+0000","last_active":"2024-04-26T11:22:56.855124+0000","last_peered":"2024-04-26T11:22:56.855124+0000","last_clean":"2024-04-26T11:22:56.855124+0000","last_became_active":"2024-04-26T11:21:53.329256+0000","last_became_peered":"2024-04-26T11:21:53.329256+0000","last_unstale":"2024-04-26T11:22:56.855124+0000","last_undegraded":"2024-04-26T11:22:56.855124+0000","last_fullsized":"2024-04-26T11:22:56.855124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672350+0000","last_change":"2024-04-26T11:21:53.715233+0000","last_active":"2024-04-26T11:22:56.672350+0000","last_peered":"2024-04-26T11:22:56.672350+0000","last_clean":"2024-04-26T11:22:56.672350+0000","last_became_active":"2024-04-26T11:21:53.714405+0000","last_became_peered":"2024-04-26T11:21:53.714405+0000","last_unstale":"2024-04-26T11:22:56.672350+0000","last_undegraded":"2024-04-26T11:22:56.672350+0000","last_fullsized":"2024-04-26T11:22:56.672350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672518+0000","last_change":"2024-04-26T11:21:53.344659+0000","last_active":"2024-04-26T11:22:56.672518+0000","last_peered":"2024-04-26T11:22:56.672518+0000","last_clean":"2024-04-26T11:22:56.672518+0000","last_became_active":"2024-04-26T11:21:53.344024+0000","last_became_peered":"2024-04-26T11:21:53.344024+0000","last_unstale":"2024-04-26T11:22:56.672518+0000","last_undegraded":"2024-04-26T11:22:56.672518+0000","last_fullsized":"2024-04-26T11:22:56.672518+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:53.053244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.673180+0000","last_change":"2024-04-26T11:21:53.710093+0000","last_active":"2024-04-26T11:22:56.673180+0000","last_peered":"2024-04-26T11:22:56.673180+0000","last_clean":"2024-04-26T11:22:56.673180+0000","last_became_active":"2024-04-26T11:21:53.709020+0000","last_became_peered":"2024-04-26T11:21:53.709020+0000","last_unstale":"2024-04-26T11:22:56.673180+0000","last_undegraded":"2024-04-26T11:22:56.673180+0000","last_fullsized":"2024-04-26T11:22:56.673180+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.670745+0000","last_change":"2024-04-26T11:21:53.341961+0000","last_active":"2024-04-26T11:22:56.670745+0000","last_peered":"2024-04-26T11:22:56.670745+0000","last_clean":"2024-04-26T11:22:56.670745+0000","last_became_active":"2024-04-26T11:21:53.340768+0000","last_became_peered":"2024-04-26T11:21:53.340768+0000","last_unstale":"2024-04-26T11:22:56.670745+0000","last_undegraded":"2024-04-26T11:22:56.670745+0000","last_fullsized":"2024-04-26T11:22:56.670745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.673005+0000","last_change":"2024-04-26T11:21:53.706161+0000","last_active":"2024-04-26T11:22:56.673005+0000","last_peered":"2024-04-26T11:22:56.673005+0000","last_clean":"2024-04-26T11:22:56.673005+0000","last_became_active":"2024-04-26T11:21:53.705388+0000","last_became_peered":"2024-04-26T11:21:53.705388+0000","last_unstale":"2024-04-26T11:22:56.673005+0000","last_undegraded":"2024-04-26T11:22:56.673005+0000","last_fullsized":"2024-04-26T11:22:56.673005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.670769+0000","last_change":"2024-04-26T11:21:53.328489+0000","last_active":"2024-04-26T11:22:56.670769+0000","last_peered":"2024-04-26T11:22:56.670769+0000","last_clean":"2024-04-26T11:22:56.670769+0000","last_became_active":"2024-04-26T11:21:53.327836+0000","last_became_peered":"2024-04-26T11:21:53.327836+0000","last_unstale":"2024-04-26T11:22:56.670769+0000","last_undegraded":"2024-04-26T11:22:56.670769+0000","last_fullsized":"2024-04-26T11:22:56.670769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:32.644217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855370+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:22:56.855370+0000","last_peered":"2024-04-26T11:22:56.855370+0000","last_clean":"2024-04-26T11:22:56.855370+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:22:56.855370+0000","last_undegraded":"2024-04-26T11:22:56.855370+0000","last_fullsized":"2024-04-26T11:22:56.855370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":232,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671800+0000","last_change":"2024-04-26T11:21:43.225833+0000","last_active":"2024-04-26T11:22:56.671800+0000","last_peered":"2024-04-26T11:22:56.671800+0000","last_clean":"2024-04-26T11:22:56.671800+0000","last_became_active":"2024-04-26T11:21:43.225250+0000","last_became_peered":"2024-04-26T11:21:43.225250+0000","last_unstale":"2024-04-26T11:22:56.671800+0000","last_undegraded":"2024-04-26T11:22:56.671800+0000","last_fullsized":"2024-04-26T11:22:56.671800+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:22:05.690426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672871+0000","last_change":"2024-04-26T11:21:49.292076+0000","last_active":"2024-04-26T11:22:56.672871+0000","last_peered":"2024-04-26T11:22:56.672871+0000","last_clean":"2024-04-26T11:22:56.672871+0000","last_became_active":"2024-04-26T11:21:49.291406+0000","last_became_peered":"2024-04-26T11:21:49.291406+0000","last_unstale":"2024-04-26T11:22:56.672871+0000","last_undegraded":"2024-04-26T11:22:56.672871+0000","last_fullsized":"2024-04-26T11:22:56.672871+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:49.811169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.854593+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:22:56.854593+0000","last_peered":"2024-04-26T11:22:56.854593+0000","last_clean":"2024-04-26T11:22:56.854593+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:22:56.854593+0000","last_undegraded":"2024-04-26T11:22:56.854593+0000","last_fullsized":"2024-04-26T11:22:56.854593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.673371+0000","last_change":"2024-04-26T11:21:53.709499+0000","last_active":"2024-04-26T11:22:56.673371+0000","last_peered":"2024-04-26T11:22:56.673371+0000","last_clean":"2024-04-26T11:22:56.673371+0000","last_became_active":"2024-04-26T11:21:53.707573+0000","last_became_peered":"2024-04-26T11:21:53.707573+0000","last_unstale":"2024-04-26T11:22:56.673371+0000","last_undegraded":"2024-04-26T11:22:56.673371+0000","last_fullsized":"2024-04-26T11:22:56.673371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671592+0000","last_change":"2024-04-26T11:21:49.293497+0000","last_active":"2024-04-26T11:22:56.671592+0000","last_peered":"2024-04-26T11:22:56.671592+0000","last_clean":"2024-04-26T11:22:56.671592+0000","last_became_active":"2024-04-26T11:21:49.292666+0000","last_became_peered":"2024-04-26T11:21:49.292666+0000","last_unstale":"2024-04-26T11:22:56.671592+0000","last_undegraded":"2024-04-26T11:22:56.671592+0000","last_fullsized":"2024-04-26T11:22:56.671592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:55.106933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.853161+0000","last_change":"2024-04-26T11:22:40.788935+0000","last_active":"2024-04-26T11:22:56.853161+0000","last_peered":"2024-04-26T11:22:56.853161+0000","last_clean":"2024-04-26T11:22:56.853161+0000","last_became_active":"2024-04-26T11:22:40.788573+0000","last_became_peered":"2024-04-26T11:22:40.788573+0000","last_unstale":"2024-04-26T11:22:56.853161+0000","last_undegraded":"2024-04-26T11:22:56.853161+0000","last_fullsized":"2024-04-26T11:22:56.853161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:33.615604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671803+0000","last_change":"2024-04-26T11:21:53.716469+0000","last_active":"2024-04-26T11:22:56.671803+0000","last_peered":"2024-04-26T11:22:56.671803+0000","last_clean":"2024-04-26T11:22:56.671803+0000","last_became_active":"2024-04-26T11:21:53.715684+0000","last_became_peered":"2024-04-26T11:21:53.715684+0000","last_unstale":"2024-04-26T11:22:56.671803+0000","last_undegraded":"2024-04-26T11:22:56.671803+0000","last_fullsized":"2024-04-26T11:22:56.671803+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:02:19.716529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.854178+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:22:56.854178+0000","last_peered":"2024-04-26T11:22:56.854178+0000","last_clean":"2024-04-26T11:22:56.854178+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:22:56.854178+0000","last_undegraded":"2024-04-26T11:22:56.854178+0000","last_fullsized":"2024-04-26T11:22:56.854178+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.670709+0000","last_change":"2024-04-26T11:21:53.345743+0000","last_active":"2024-04-26T11:22:56.670709+0000","last_peered":"2024-04-26T11:22:56.670709+0000","last_clean":"2024-04-26T11:22:56.670709+0000","last_became_active":"2024-04-26T11:21:53.344967+0000","last_became_peered":"2024-04-26T11:21:53.344967+0000","last_unstale":"2024-04-26T11:22:56.670709+0000","last_undegraded":"2024-04-26T11:22:56.670709+0000","last_fullsized":"2024-04-26T11:22:56.670709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:10:08.280572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855540+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:22:56.855540+0000","last_peered":"2024-04-26T11:22:56.855540+0000","last_clean":"2024-04-26T11:22:56.855540+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:22:56.855540+0000","last_undegraded":"2024-04-26T11:22:56.855540+0000","last_fullsized":"2024-04-26T11:22:56.855540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672735+0000","last_change":"2024-04-26T11:21:49.292503+0000","last_active":"2024-04-26T11:22:56.672735+0000","last_peered":"2024-04-26T11:22:56.672735+0000","last_clean":"2024-04-26T11:22:56.672735+0000","last_became_active":"2024-04-26T11:21:49.291939+0000","last_became_peered":"2024-04-26T11:21:49.291939+0000","last_unstale":"2024-04-26T11:22:56.672735+0000","last_undegraded":"2024-04-26T11:22:56.672735+0000","last_fullsized":"2024-04-26T11:22:56.672735+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:55:31.195965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672788+0000","last_change":"2024-04-26T11:21:53.338037+0000","last_active":"2024-04-26T11:22:56.672788+0000","last_peered":"2024-04-26T11:22:56.672788+0000","last_clean":"2024-04-26T11:22:56.672788+0000","last_became_active":"2024-04-26T11:21:53.337004+0000","last_became_peered":"2024-04-26T11:21:53.337004+0000","last_unstale":"2024-04-26T11:22:56.672788+0000","last_undegraded":"2024-04-26T11:22:56.672788+0000","last_fullsized":"2024-04-26T11:22:56.672788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855107+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:22:56.855107+0000","last_peered":"2024-04-26T11:22:56.855107+0000","last_clean":"2024-04-26T11:22:56.855107+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:22:56.855107+0000","last_undegraded":"2024-04-26T11:22:56.855107+0000","last_fullsized":"2024-04-26T11:22:56.855107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.673592+0000","last_change":"2024-04-26T11:21:53.337312+0000","last_active":"2024-04-26T11:22:56.673592+0000","last_peered":"2024-04-26T11:22:56.673592+0000","last_clean":"2024-04-26T11:22:56.673592+0000","last_became_active":"2024-04-26T11:21:53.336587+0000","last_became_peered":"2024-04-26T11:21:53.336587+0000","last_unstale":"2024-04-26T11:22:56.673592+0000","last_undegraded":"2024-04-26T11:22:56.673592+0000","last_fullsized":"2024-04-26T11:22:56.673592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:44.942718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855565+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:22:56.855565+0000","last_peered":"2024-04-26T11:22:56.855565+0000","last_clean":"2024-04-26T11:22:56.855565+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:22:56.855565+0000","last_undegraded":"2024-04-26T11:22:56.855565+0000","last_fullsized":"2024-04-26T11:22:56.855565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.670923+0000","last_change":"2024-04-26T11:21:53.697386+0000","last_active":"2024-04-26T11:22:56.670923+0000","last_peered":"2024-04-26T11:22:56.670923+0000","last_clean":"2024-04-26T11:22:56.670923+0000","last_became_active":"2024-04-26T11:21:53.695847+0000","last_became_peered":"2024-04-26T11:21:53.695847+0000","last_unstale":"2024-04-26T11:22:56.670923+0000","last_undegraded":"2024-04-26T11:22:56.670923+0000","last_fullsized":"2024-04-26T11:22:56.670923+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855369+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:22:56.855369+0000","last_peered":"2024-04-26T11:22:56.855369+0000","last_clean":"2024-04-26T11:22:56.855369+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:22:56.855369+0000","last_undegraded":"2024-04-26T11:22:56.855369+0000","last_fullsized":"2024-04-26T11:22:56.855369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671936+0000","last_change":"2024-04-26T11:21:49.288999+0000","last_active":"2024-04-26T11:22:56.671936+0000","last_peered":"2024-04-26T11:22:56.671936+0000","last_clean":"2024-04-26T11:22:56.671936+0000","last_became_active":"2024-04-26T11:21:49.288429+0000","last_became_peered":"2024-04-26T11:21:49.288429+0000","last_unstale":"2024-04-26T11:22:56.671936+0000","last_undegraded":"2024-04-26T11:22:56.671936+0000","last_fullsized":"2024-04-26T11:22:56.671936+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:48:33.075551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671065+0000","last_change":"2024-04-26T11:21:53.696563+0000","last_active":"2024-04-26T11:22:56.671065+0000","last_peered":"2024-04-26T11:22:56.671065+0000","last_clean":"2024-04-26T11:22:56.671065+0000","last_became_active":"2024-04-26T11:21:53.695678+0000","last_became_peered":"2024-04-26T11:21:53.695678+0000","last_unstale":"2024-04-26T11:22:56.671065+0000","last_undegraded":"2024-04-26T11:22:56.671065+0000","last_fullsized":"2024-04-26T11:22:56.671065+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:24.619774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855940+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:22:56.855940+0000","last_peered":"2024-04-26T11:22:56.855940+0000","last_clean":"2024-04-26T11:22:56.855940+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:22:56.855940+0000","last_undegraded":"2024-04-26T11:22:56.855940+0000","last_fullsized":"2024-04-26T11:22:56.855940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855906+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:22:56.855906+0000","last_peered":"2024-04-26T11:22:56.855906+0000","last_clean":"2024-04-26T11:22:56.855906+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:22:56.855906+0000","last_undegraded":"2024-04-26T11:22:56.855906+0000","last_fullsized":"2024-04-26T11:22:56.855906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.853025+0000","last_change":"2024-04-26T11:22:40.787812+0000","last_active":"2024-04-26T11:22:56.853025+0000","last_peered":"2024-04-26T11:22:56.853025+0000","last_clean":"2024-04-26T11:22:56.853025+0000","last_became_active":"2024-04-26T11:22:40.787235+0000","last_became_peered":"2024-04-26T11:22:40.787235+0000","last_unstale":"2024-04-26T11:22:56.853025+0000","last_undegraded":"2024-04-26T11:22:56.853025+0000","last_fullsized":"2024-04-26T11:22:56.853025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:13.809010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'3","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855820+0000","last_change":"2024-04-26T11:21:53.332815+0000","last_active":"2024-04-26T11:22:56.855820+0000","last_peered":"2024-04-26T11:22:56.855820+0000","last_clean":"2024-04-26T11:22:56.855820+0000","last_became_active":"2024-04-26T11:21:53.332020+0000","last_became_peered":"2024-04-26T11:21:53.332020+0000","last_unstale":"2024-04-26T11:22:56.855820+0000","last_undegraded":"2024-04-26T11:22:56.855820+0000","last_fullsized":"2024-04-26T11:22:56.855820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:36:53.502029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.673593+0000","last_change":"2024-04-26T11:21:49.293487+0000","last_active":"2024-04-26T11:22:56.673593+0000","last_peered":"2024-04-26T11:22:56.673593+0000","last_clean":"2024-04-26T11:22:56.673593+0000","last_became_active":"2024-04-26T11:21:49.292608+0000","last_became_peered":"2024-04-26T11:21:49.292608+0000","last_unstale":"2024-04-26T11:22:56.673593+0000","last_undegraded":"2024-04-26T11:22:56.673593+0000","last_fullsized":"2024-04-26T11:22:56.673593+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:27:18.515339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.670635+0000","last_change":"2024-04-26T11:21:53.696546+0000","last_active":"2024-04-26T11:22:56.670635+0000","last_peered":"2024-04-26T11:22:56.670635+0000","last_clean":"2024-04-26T11:22:56.670635+0000","last_became_active":"2024-04-26T11:21:53.695670+0000","last_became_peered":"2024-04-26T11:21:53.695670+0000","last_unstale":"2024-04-26T11:22:56.670635+0000","last_undegraded":"2024-04-26T11:22:56.670635+0000","last_fullsized":"2024-04-26T11:22:56.670635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:32:44.655253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672066+0000","last_change":"2024-04-26T11:21:53.703599+0000","last_active":"2024-04-26T11:22:56.672066+0000","last_peered":"2024-04-26T11:22:56.672066+0000","last_clean":"2024-04-26T11:22:56.672066+0000","last_became_active":"2024-04-26T11:21:53.702893+0000","last_became_peered":"2024-04-26T11:21:53.702893+0000","last_unstale":"2024-04-26T11:22:56.672066+0000","last_undegraded":"2024-04-26T11:22:56.672066+0000","last_fullsized":"2024-04-26T11:22:56.672066+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"24'10","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672623+0000","last_change":"2024-04-26T11:21:53.340288+0000","last_active":"2024-04-26T11:22:56.672623+0000","last_peered":"2024-04-26T11:22:56.672623+0000","last_clean":"2024-04-26T11:22:56.672623+0000","last_became_active":"2024-04-26T11:21:53.339414+0000","last_became_peered":"2024-04-26T11:21:53.339414+0000","last_unstale":"2024-04-26T11:22:56.672623+0000","last_undegraded":"2024-04-26T11:22:56.672623+0000","last_fullsized":"2024-04-26T11:22:56.672623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:43.493907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6507,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.854022+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:22:56.854022+0000","last_peered":"2024-04-26T11:22:56.854022+0000","last_clean":"2024-04-26T11:22:56.854022+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:22:56.854022+0000","last_undegraded":"2024-04-26T11:22:56.854022+0000","last_fullsized":"2024-04-26T11:22:56.854022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671869+0000","last_change":"2024-04-26T11:21:53.343465+0000","last_active":"2024-04-26T11:22:56.671869+0000","last_peered":"2024-04-26T11:22:56.671869+0000","last_clean":"2024-04-26T11:22:56.671869+0000","last_became_active":"2024-04-26T11:21:53.342882+0000","last_became_peered":"2024-04-26T11:21:53.342882+0000","last_unstale":"2024-04-26T11:22:56.671869+0000","last_undegraded":"2024-04-26T11:22:56.671869+0000","last_fullsized":"2024-04-26T11:22:56.671869+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:05:41.508747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.673427+0000","last_change":"2024-04-26T11:21:53.344846+0000","last_active":"2024-04-26T11:22:56.673427+0000","last_peered":"2024-04-26T11:22:56.673427+0000","last_clean":"2024-04-26T11:22:56.673427+0000","last_became_active":"2024-04-26T11:21:53.342981+0000","last_became_peered":"2024-04-26T11:21:53.342981+0000","last_unstale":"2024-04-26T11:22:56.673427+0000","last_undegraded":"2024-04-26T11:22:56.673427+0000","last_fullsized":"2024-04-26T11:22:56.673427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.853679+0000","last_change":"2024-04-26T11:21:53.706890+0000","last_active":"2024-04-26T11:22:56.853679+0000","last_peered":"2024-04-26T11:22:56.853679+0000","last_clean":"2024-04-26T11:22:56.853679+0000","last_became_active":"2024-04-26T11:21:53.705229+0000","last_became_peered":"2024-04-26T11:21:53.705229+0000","last_unstale":"2024-04-26T11:22:56.853679+0000","last_undegraded":"2024-04-26T11:22:56.853679+0000","last_fullsized":"2024-04-26T11:22:56.853679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:11.445960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855834+0000","last_change":"2024-04-26T11:21:53.334527+0000","last_active":"2024-04-26T11:22:56.855834+0000","last_peered":"2024-04-26T11:22:56.855834+0000","last_clean":"2024-04-26T11:22:56.855834+0000","last_became_active":"2024-04-26T11:21:53.332325+0000","last_became_peered":"2024-04-26T11:21:53.332325+0000","last_unstale":"2024-04-26T11:22:56.855834+0000","last_undegraded":"2024-04-26T11:22:56.855834+0000","last_fullsized":"2024-04-26T11:22:56.855834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:04.264948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.854364+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:22:56.854364+0000","last_peered":"2024-04-26T11:22:56.854364+0000","last_clean":"2024-04-26T11:22:56.854364+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:22:56.854364+0000","last_undegraded":"2024-04-26T11:22:56.854364+0000","last_fullsized":"2024-04-26T11:22:56.854364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672117+0000","last_change":"2024-04-26T11:21:53.696949+0000","last_active":"2024-04-26T11:22:56.672117+0000","last_peered":"2024-04-26T11:22:56.672117+0000","last_clean":"2024-04-26T11:22:56.672117+0000","last_became_active":"2024-04-26T11:21:53.696068+0000","last_became_peered":"2024-04-26T11:21:53.696068+0000","last_unstale":"2024-04-26T11:22:56.672117+0000","last_undegraded":"2024-04-26T11:22:56.672117+0000","last_fullsized":"2024-04-26T11:22:56.672117+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.854218+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:22:56.854218+0000","last_peered":"2024-04-26T11:22:56.854218+0000","last_clean":"2024-04-26T11:22:56.854218+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:22:56.854218+0000","last_undegraded":"2024-04-26T11:22:56.854218+0000","last_fullsized":"2024-04-26T11:22:56.854218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.853286+0000","last_change":"2024-04-26T11:22:40.788324+0000","last_active":"2024-04-26T11:22:56.853286+0000","last_peered":"2024-04-26T11:22:56.853286+0000","last_clean":"2024-04-26T11:22:56.853286+0000","last_became_active":"2024-04-26T11:22:40.788127+0000","last_became_peered":"2024-04-26T11:22:40.788127+0000","last_unstale":"2024-04-26T11:22:56.853286+0000","last_undegraded":"2024-04-26T11:22:56.853286+0000","last_fullsized":"2024-04-26T11:22:56.853286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:13.953872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.853934+0000","last_change":"2024-04-26T11:21:53.334972+0000","last_active":"2024-04-26T11:22:56.853934+0000","last_peered":"2024-04-26T11:22:56.853934+0000","last_clean":"2024-04-26T11:22:56.853934+0000","last_became_active":"2024-04-26T11:21:53.332642+0000","last_became_peered":"2024-04-26T11:21:53.332642+0000","last_unstale":"2024-04-26T11:22:56.853934+0000","last_undegraded":"2024-04-26T11:22:56.853934+0000","last_fullsized":"2024-04-26T11:22:56.853934+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:28.299957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671635+0000","last_change":"2024-04-26T11:21:53.709701+0000","last_active":"2024-04-26T11:22:56.671635+0000","last_peered":"2024-04-26T11:22:56.671635+0000","last_clean":"2024-04-26T11:22:56.671635+0000","last_became_active":"2024-04-26T11:21:53.708905+0000","last_became_peered":"2024-04-26T11:21:53.708905+0000","last_unstale":"2024-04-26T11:22:56.671635+0000","last_undegraded":"2024-04-26T11:22:56.671635+0000","last_fullsized":"2024-04-26T11:22:56.671635+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671298+0000","last_change":"2024-04-26T11:21:53.330226+0000","last_active":"2024-04-26T11:22:56.671298+0000","last_peered":"2024-04-26T11:22:56.671298+0000","last_clean":"2024-04-26T11:22:56.671298+0000","last_became_active":"2024-04-26T11:21:53.329446+0000","last_became_peered":"2024-04-26T11:21:53.329446+0000","last_unstale":"2024-04-26T11:22:56.671298+0000","last_undegraded":"2024-04-26T11:22:56.671298+0000","last_fullsized":"2024-04-26T11:22:56.671298+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:52.599214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671274+0000","last_change":"2024-04-26T11:21:53.716629+0000","last_active":"2024-04-26T11:22:56.671274+0000","last_peered":"2024-04-26T11:22:56.671274+0000","last_clean":"2024-04-26T11:22:56.671274+0000","last_became_active":"2024-04-26T11:21:53.714799+0000","last_became_peered":"2024-04-26T11:21:53.714799+0000","last_unstale":"2024-04-26T11:22:56.671274+0000","last_undegraded":"2024-04-26T11:22:56.671274+0000","last_fullsized":"2024-04-26T11:22:56.671274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:54.995873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671184+0000","last_change":"2024-04-26T11:21:53.343318+0000","last_active":"2024-04-26T11:22:56.671184+0000","last_peered":"2024-04-26T11:22:56.671184+0000","last_clean":"2024-04-26T11:22:56.671184+0000","last_became_active":"2024-04-26T11:21:53.342789+0000","last_became_peered":"2024-04-26T11:21:53.342789+0000","last_unstale":"2024-04-26T11:22:56.671184+0000","last_undegraded":"2024-04-26T11:22:56.671184+0000","last_fullsized":"2024-04-26T11:22:56.671184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672178+0000","last_change":"2024-04-26T11:21:53.715726+0000","last_active":"2024-04-26T11:22:56.672178+0000","last_peered":"2024-04-26T11:22:56.672178+0000","last_clean":"2024-04-26T11:22:56.672178+0000","last_became_active":"2024-04-26T11:21:53.715126+0000","last_became_peered":"2024-04-26T11:21:53.715126+0000","last_unstale":"2024-04-26T11:22:56.672178+0000","last_undegraded":"2024-04-26T11:22:56.672178+0000","last_fullsized":"2024-04-26T11:22:56.672178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:19.514594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672439+0000","last_change":"2024-04-26T11:21:53.343934+0000","last_active":"2024-04-26T11:22:56.672439+0000","last_peered":"2024-04-26T11:22:56.672439+0000","last_clean":"2024-04-26T11:22:56.672439+0000","last_became_active":"2024-04-26T11:21:53.342401+0000","last_became_peered":"2024-04-26T11:21:53.342401+0000","last_unstale":"2024-04-26T11:22:56.672439+0000","last_undegraded":"2024-04-26T11:22:56.672439+0000","last_fullsized":"2024-04-26T11:22:56.672439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.672596+0000","last_change":"2024-04-26T11:21:53.713092+0000","last_active":"2024-04-26T11:22:56.672596+0000","last_peered":"2024-04-26T11:22:56.672596+0000","last_clean":"2024-04-26T11:22:56.672596+0000","last_became_active":"2024-04-26T11:21:53.712207+0000","last_became_peered":"2024-04-26T11:21:53.712207+0000","last_unstale":"2024-04-26T11:22:56.672596+0000","last_undegraded":"2024-04-26T11:22:56.672596+0000","last_fullsized":"2024-04-26T11:22:56.672596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:44.761700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671752+0000","last_change":"2024-04-26T11:21:53.345453+0000","last_active":"2024-04-26T11:22:56.671752+0000","last_peered":"2024-04-26T11:22:56.671752+0000","last_clean":"2024-04-26T11:22:56.671752+0000","last_became_active":"2024-04-26T11:21:53.344468+0000","last_became_peered":"2024-04-26T11:21:53.344468+0000","last_unstale":"2024-04-26T11:22:56.671752+0000","last_undegraded":"2024-04-26T11:22:56.671752+0000","last_fullsized":"2024-04-26T11:22:56.671752+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.295739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.670879+0000","last_change":"2024-04-26T11:21:53.712311+0000","last_active":"2024-04-26T11:22:56.670879+0000","last_peered":"2024-04-26T11:22:56.670879+0000","last_clean":"2024-04-26T11:22:56.670879+0000","last_became_active":"2024-04-26T11:21:53.711195+0000","last_became_peered":"2024-04-26T11:21:53.711195+0000","last_unstale":"2024-04-26T11:22:56.670879+0000","last_undegraded":"2024-04-26T11:22:56.670879+0000","last_fullsized":"2024-04-26T11:22:56.670879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:50.973181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855785+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:22:56.855785+0000","last_peered":"2024-04-26T11:22:56.855785+0000","last_clean":"2024-04-26T11:22:56.855785+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:22:56.855785+0000","last_undegraded":"2024-04-26T11:22:56.855785+0000","last_fullsized":"2024-04-26T11:22:56.855785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.671519+0000","last_change":"2024-04-26T11:21:53.713610+0000","last_active":"2024-04-26T11:22:56.671519+0000","last_peered":"2024-04-26T11:22:56.671519+0000","last_clean":"2024-04-26T11:22:56.671519+0000","last_became_active":"2024-04-26T11:21:53.712396+0000","last_became_peered":"2024-04-26T11:21:53.712396+0000","last_unstale":"2024-04-26T11:22:56.671519+0000","last_undegraded":"2024-04-26T11:22:56.671519+0000","last_fullsized":"2024-04-26T11:22:56.671519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-26T11:22:56.855558+0000","last_change":"2024-04-26T11:21:53.334939+0000","last_active":"2024-04-26T11:22:56.855558+0000","last_peered":"2024-04-26T11:22:56.855558+0000","last_clean":"2024-04-26T11:22:56.855558+0000","last_became_active":"2024-04-26T11:21:53.332735+0000","last_became_peered":"2024-04-26T11:21:53.332735+0000","last_unstale":"2024-04-26T11:22:56.855558+0000","last_undegraded":"2024-04-26T11:22:56.855558+0000","last_fullsized":"2024-04-26T11:22:56.855558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:23.907973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":7305,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":14610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738388,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":149038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.503}]}]},{"osd":1,"up_from":8,"seq":34359738388,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31532,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340308,"statfs":{"total":96636764160,"available":96604475392,"internally_reserved":0,"allocated":425984,"data_stored":745479,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738388,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31540,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340300,"statfs":{"total":96636764160,"available":96604467200,"internally_reserved":0,"allocated":434176,"data_stored":746095,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:22:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.67300000000000004}]},{"osd":2,"last update":"Fri Apr 26 11:22:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":6689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:23:07.284 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:07.274+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:07.376 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:07.374+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:07.415 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:07.415 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:07.415 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:07.415 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:07.429 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:07.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:07.476+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:07.521 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:23:07.521 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:23:07.544 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:07.544 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:07.545 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:07.545 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:07.545 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:07.553 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:07.553 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:07.559 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:07.579 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:07.578+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:07.584 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:07.584 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:07.675 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:07.675 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:07.679 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:07.676+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:07.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:07.783 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:07.782+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:07.819 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:07.820 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:07.835 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:07.883 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:07.882+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:07.955 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:07.955 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:07.969 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:07.987 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:07.984+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:08.084 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:08.084 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:08.088 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:08.086+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:08.098 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:08.188 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:08.186+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:08.228 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:08.228 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:08.242 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:08.289 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:08.288+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:08.359 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:08.359 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:08.373 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:08.390 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:08.386+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:08.399 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:23:08.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:08.488+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:08.536 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:08.536 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:08.550 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:08.598 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:08.598+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:08.681 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:08.681 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:08.692 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:08.692+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:08.695 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:08.793 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:08.790+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:08.861 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:08.861 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:08.877 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:08.894 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:08.892+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:08.995 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:08.996+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:09.000 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:09.000 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:09.015 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:09.096 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:09.096+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:09.144 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:09.144 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:09.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:09.207 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:09.206+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:09.278 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:09.279 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:09.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:09.335 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:09.334+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:09.399 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:09.396+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:09.453 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:09.454 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:09.468 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:09.499 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:09.498+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:09.597 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:09.597 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:09.600 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:09.598+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:09.606 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:09.613 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:09.701 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:09.698+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:09.730 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:09.730 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:09.744 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:09.800 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:23:09.800 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:23:09.801 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:09.798+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:09.830 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:09.830 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:09.861 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:09.861 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:09.870 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:09.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.263604091000005, 2024-04-26T11:23:09.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:09.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:09.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.185003656999996, 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:09.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:09.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:09.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.184068984000007, 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:09.881 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:09.886 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.183995867999997, 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:09.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:09.891 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.183944527999998, 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.183894258999999, 2024-04-26T11:23:09.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:09.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:09.901 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.183841959000006, 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:09.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:09.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:09.906 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.183792423, 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:09.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:09.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.911 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.183725893000002, 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:09.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:09.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.183440017999999, 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:09.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:09.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:09.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.181904344000003, 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:09.919 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:09.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.180034153999998, 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.926 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.179938042000003, 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:09.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:09.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:09.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.157902992000004, 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:09.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:09.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.157821920000004, 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.157769005999995, 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:09.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:09.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.157661770999994, 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.943 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:09.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.157607210999998, 2024-04-26T11:23:09.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:09.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.156891909999999, 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:09.951 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:09.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 76.154998484999993, 2024-04-26T11:23:09.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:09.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:09.959 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:09.961 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:09.962 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:09.958+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:10.062 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:10.062+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:10.092 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:10.092 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:10.093 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:10.093 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:10.107 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:10.162 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:10.160+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:10.263 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:10.262+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:10.271 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:10.271 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:10.271 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:10.271 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:10.272 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:10.285 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:10.364 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:10.364+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:10.423 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:23:10.451 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.766346126000002, 2024-04-26T11:23:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.766219731000007, 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.766130938000003, 2024-04-26T11:23:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:10.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.766026124999996, 2024-04-26T11:23:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.765975468999997, 2024-04-26T11:23:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.765918515999999, 2024-04-26T11:23:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.765859524000007, 2024-04-26T11:23:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.765756518000003, 2024-04-26T11:23:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.765680677999995, 2024-04-26T11:23:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.750463116000006, 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.746075669999996, 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.745063853999994, 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.744740190000002, 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.744683913000003, 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.744632483999993, 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:10.542 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.744567693999997, 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:10.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.740083346000006, 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:10.546 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:10.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.734872895999999, 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:10.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 76.734789383999995, 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 71.054099844999996, 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:10.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:10.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:10.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:10.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:10.563 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:10.565 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:10.565 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:10.564+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:10.666 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:10.664+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:10.697 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:10.697 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:23:10.697 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:23:10.697 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:10.711 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:10.767 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:10.766+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:10.828 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:10.828 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:23:10.828 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:23:10.828 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:23:10.828 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:10.842 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:10.891 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:10.890+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 87.196337405999998, 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:23:10.965 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.966 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.967 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.968 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:10.969 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.282507894999995, 2024-04-26T11:23:10.970 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:10.971 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.972 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:23:10.973 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.974 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.975 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.282422159000006, 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:10.976 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:10.977 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:23:10.978 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:23:10.979 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:23:10.980 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.282362985999995, 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.981 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:23:10.982 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:23:10.983 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:23:10.984 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:23:10.985 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:10.986 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.282277519999994, 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.987 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.988 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.989 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:23:10.990 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:23:10.991 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:10.992 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.282218083999993, 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.993 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.994 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:10.995 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:10.996 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:10.997 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:10.998 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.282137466999998, 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:10.999 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.000 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:23:11.001 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:11.002 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:23:11.003 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281936262000002, 2024-04-26T11:23:11.004 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.005 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:23:11.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:11.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.006 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:23:11.006 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:23:11.006 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.006 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.006 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.007 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.008 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:23:11.009 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.010 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281813283000005, 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.011 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.012 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:11.013 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:11.014 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.015 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281757886999998, 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:23:11.016 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.017 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:23:11.018 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:23:11.019 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:23:11.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:23:11.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:23:11.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.020 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.020 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:11.020 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:23:11.020 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:23:11.020 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:23:11.021 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281614074999993, 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:23:11.022 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.023 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:23:11.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:23:11.027 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281549381000005, 2024-04-26T11:23:11.028 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.029 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.030 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.031 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:23:11.032 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:23:11.033 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281456942000005, 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:23:11.034 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.035 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.036 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.037 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.038 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.039 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281378852000003, 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.040 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:11.041 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:23:11.042 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:23:11.043 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:23:11.044 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:23:11.045 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281333356999994, 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.046 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:11.047 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.047 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.047 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.047 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.047 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:11.047 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.047 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.047 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.047 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.047 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:11.049 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:11.049 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.049 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.049 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.050 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.051 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.052 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:23:11.053 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281302150000002, 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.055 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.056 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.057 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.058 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.059 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281261702999998, 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:11.060 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.061 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.062 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.063 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.064 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.065 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281223499999996, 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.066 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.067 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:11.068 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.069 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.070 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.071 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281173308000007, 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.072 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:23:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:11.074 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.075 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:11.076 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:11.077 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 77.281084790999998, 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:11.078 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:23:11.079 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:23:11.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:11.081 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:23:11.082 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:23:11.082 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.082 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.082 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.082 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:11.082 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:11.082 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:11.084 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:11.084 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:11.082+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:11.185 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:11.182+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:11.212 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:11.212 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:11.213 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:11.213 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:11.227 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:11.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:11.284+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:11.348 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:11.348 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:11.348 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:11.348 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:11.348 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:11.364 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:11.387 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:11.386+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:11.417 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:23:11.487 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:11.484+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:11.526 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 87.919867525000001, 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:11.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.841267091000006, 2024-04-26T11:23:11.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.840332418000003, 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.541 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.840259302000007, 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:11.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:11.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:11.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.840207961999994, 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:11.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:11.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:11.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.840157692999995, 2024-04-26T11:23:11.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:11.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.840105393000002, 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:11.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:11.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.840055856999996, 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.562 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:11.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:11.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:11.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.839989326999998, 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:11.567 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:11.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:11.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.839703451999995, 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:11.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.574 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.838167777999999, 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.836297587999994, 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.578 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:11.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.836201475999999, 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:11.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.814166426, 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:11.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:11.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.814085353999999, 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:11.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.814032440000005, 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:11.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:11.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.813925205000004, 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:11.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:11.603 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.603 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.603 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.603 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:11.603 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:11.603 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.813870644999994, 2024-04-26T11:23:11.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:11.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.604 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.604 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:11.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:11.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.813155343999995, 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.608 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:11.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 77.811261919000003, 2024-04-26T11:23:11.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:11.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:11.616 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:11.618 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:11.618 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:11.616+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:11.719 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:11.714+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:11.744 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:11.744 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:11.744 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:11.744 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:11.759 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:11.819 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:11.818+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:11.880 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:11.880 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:11.880 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:11.880 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:11.880 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:11.894 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:11.921 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:11.918+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:11.962 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:12.021 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:12.022+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:12.065 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.379619422999994, 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:12.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:12.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:12.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:12.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:12.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:12.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:12.074 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.379493027999999, 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:12.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.079 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.379404234999996, 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:12.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:12.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.379299422000003, 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.379248766000003, 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.379191813000006, 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.379132820999999, 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.379029814999996, 2024-04-26T11:23:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.378953975000002, 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.363736412999998, 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.359348967000003, 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.358337151000001, 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.358013486999994, 2024-04-26T11:23:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.357957209999995, 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.357905780999999, 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.357840991000003, 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.353356642999998, 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.348146193000005, 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 78.348062681000002, 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 72.667373142000002, 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:12.157 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:12.158 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:23:12.158 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:23:12.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:12.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:12.156+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:12.188 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:12.188 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:12.219 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:12.219 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:12.259 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:12.256+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:12.284 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:23:12.284 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:23:12.285 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-26T11:23:12.285 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T11:23:12.291 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:12.291 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:12.307 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:12.359 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:12.358+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:12.426 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:12.426 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:12.440 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:12.483 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:12.482+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:12.561 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:12.560+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:12.605 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:12.605 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:12.621 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:12.668 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:12.668+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:12.750 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:12.750 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:12.764 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:12.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:12.764+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:12.765 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 45, 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4", 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-04-26T11:21:32.561072+0000", 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-04-26T11:23:11.407696+0000", 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-04-26T11:21:41.209558+0000", 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-04-26T11:21:33.824306+0000", 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5799936, 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-04-26T11:23:12.766 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 4, 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "luminous", 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "reef", 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-04-26T11:23:12.767 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:41.373843+0000", 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:23:12.768 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-04-26T11:23:12.769 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:23:12.770 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:23:12.771 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.772 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.9900000095367432, 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.9900000095367432, 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 2, 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 2, 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.7032623291015625, 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.69999998807907104, 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.69999998807907104 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:48.112664+0000", 2024-04-26T11:23:12.773 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-04-26T11:23:12.774 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "14", 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:23:12.775 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:23:12.776 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:23:12.777 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5, 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5, 2024-04-26T11:23:12.778 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.7032623291015625, 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.69999998807907104, 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.69999998807907104 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:52.071918+0000", 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:23:12.779 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:23:12.780 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "17", 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:23:12.781 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:23:12.782 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:23:12.783 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.5900000333786011, 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.5900000333786011, 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-26T11:23:12.784 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5900000333786011, 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5900000333786011, 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.7032623291015625, 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.69999998807907104, 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.69999998807907104 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:52.677679+0000", 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:23:12.785 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:23:12.786 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:23:12.787 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:23:12.788 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:23:12.789 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.4500000476837158, 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.4500000476837158, 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 1, 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.4500000476837158, 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.4500000476837158, 2024-04-26T11:23:12.790 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.7032623291015625, 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.69999998807907104, 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.69999998807907104 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "8b4f67c6-5cab-46bf-b296-34fcc29c7766", 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:23:12.791 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 41, 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6800", 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6801", 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:12.792 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6802", 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6803", 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.793 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6806", 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6807", 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.794 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6804", 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6805", 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.795 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.88:6801/21480", 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.88:6803/21480", 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.88:6807/21480", 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.88:6805/21480", 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "d465bcda-9e32-469e-82f3-077db852411e", 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:23:12.796 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 0.1097869873046875, 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 28, 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6800", 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.797 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6801", 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6802", 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.798 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6803", 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6806", 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6807", 2024-04-26T11:23:12.799 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6804", 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6805", 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:12.800 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.107:6801/21474", 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.107:6803/21474", 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.107:6807/21474", 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.107:6805/21474", 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "61e99173-e480-4da1-a95b-d98715c3e713", 2024-04-26T11:23:12.801 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 41, 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.802 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6800", 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6801", 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.803 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6802", 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6803", 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.804 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6806", 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6807", 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:12.805 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6804", 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6805", 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.175:6801/21537", 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.175:6803/21537", 2024-04-26T11:23:12.806 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.175:6807/21537", 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.175:6805/21537", 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:23:12.807 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.131929+0000", 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.107573+0000", 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.808 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.162743+0000", 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [ 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: "pgid": "4.8", 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-26T11:23:12.809 INFO:teuthology.orchestra.run.smithi073.stdout: 2, 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: 1 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-04-26T11:23:12.810 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-04-26T11:23:12.811 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-04-26T11:23:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-04-26T11:23:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-04-26T11:23:12.812 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:12.812 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-26T11:23:12.813 INFO:tasks.thrashosds.thrasher:j is {'epoch': 45, 'fsid': 'ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4', 'created': '2024-04-26T11:21:32.561072+0000', 'modified': '2024-04-26T11:23:11.407696+0000', 'last_up_change': '2024-04-26T11:21:41.209558+0000', 'last_in_change': '2024-04-26T11:21:33.824306+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:21:41.373843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:21:48.112664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:21:52.071918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.590000033378601, 'score_stable': 1.590000033378601, 'optimal_score': 1, 'raw_score_acting': 1.590000033378601, 'raw_score_stable': 1.590000033378601, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:21:52.677679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.4500000476837158, 'score_stable': 1.4500000476837158, 'optimal_score': 1, 'raw_score_acting': 1.4500000476837158, 'raw_score_stable': 1.4500000476837158, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}], 'osds': [{'osd': 0, 'uuid': '8b4f67c6-5cab-46bf-b296-34fcc29c7766', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6800', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6801', 'nonce': 21480}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6802', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6803', 'nonce': 21480}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6806', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6807', 'nonce': 21480}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6804', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6805', 'nonce': 21480}]}, 'public_addr': '172.21.15.88:6801/21480', 'cluster_addr': '172.21.15.88:6803/21480', 'heartbeat_back_addr': '172.21.15.88:6807/21480', 'heartbeat_front_addr': '172.21.15.88:6805/21480', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'd465bcda-9e32-469e-82f3-077db852411e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1097869873046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 28, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 21474}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 21474}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 21474}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 21474}]}, 'public_addr': '172.21.15.107:6801/21474', 'cluster_addr': '172.21.15.107:6803/21474', 'heartbeat_back_addr': '172.21.15.107:6807/21474', 'heartbeat_front_addr': '172.21.15.107:6805/21474', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '61e99173-e480-4da1-a95b-d98715c3e713', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 41, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6800', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6801', 'nonce': 21537}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6802', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6803', 'nonce': 21537}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6806', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6807', 'nonce': 21537}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6804', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6805', 'nonce': 21537}]}, 'public_addr': '172.21.15.175:6801/21537', 'cluster_addr': '172.21.15.175:6803/21537', 'heartbeat_back_addr': '172.21.15.175:6807/21537', 'heartbeat_front_addr': '172.21.15.175:6805/21537', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.131929+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.107573+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.162743+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '4.8', 'osds': [2, 1]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T11:23:12.814 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 4.8 2024-04-26T11:23:12.814 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 4.8 2024-04-26T11:23:12.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:12.864+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:12.935 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:12.935 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:12.949 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:12.965 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:12.966+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:13.066 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:13.064+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:13.115 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:13.115 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:13.129 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:13.174 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:13.174+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:13.259 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:13.259 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:13.267 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:13.264+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:13.272 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:13.368 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:13.366+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:13.425 INFO:teuthology.orchestra.run.smithi073.stderr:clear 4.8 pg_upmap mapping 2024-04-26T11:23:13.438 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:13.438 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:13.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:23:13.452 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:13.494 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:13.494+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:13.571 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:13.570+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:13.613 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:13.613 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:13.628 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:13.671 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:13.670+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:13.760 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:13.760 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:13.772 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:13.770+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:13.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:13.874 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:13.870+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:13.893 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:13.894 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:13.908 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:13.975 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:13.974+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:14.071 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:14.071 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:14.076 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:14.074+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:14.085 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:14.177 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:14.176+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:14.218 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:14.219 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:14.232 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:14.240 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:14.278 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:14.278+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:14.379 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:14.378+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:14.398 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:14.398 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:14.413 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:14.430 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-26T11:23:14.436 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:23:14.437 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:23:14.453 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:14.454 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:14.480 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:14.478+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:14.485 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:14.485 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:14.538 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:14.538 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.931721011999997, 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:14.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:14.542 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.853120578000002, 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:14.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.852185904999999, 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.548 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:14.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:14.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.852112789000003, 2024-04-26T11:23:14.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.558 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.852061449000004, 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:14.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:14.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:14.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:14.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.852011180000005, 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:14.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:14.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:14.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:14.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:14.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.851958879999998, 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.569 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:14.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:14.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:14.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:14.574 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.851909344000006, 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:14.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:14.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:14.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:14.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:14.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:14.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.851842813999994, 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:14.580 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:14.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:14.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:14.583 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.851556939000005, 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:14.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:14.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.850021264999995, 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:14.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.848151075000004, 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:14.591 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:14.595 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.848054962999996, 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:14.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.826019912999996, 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:14.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.825938840999996, 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:14.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.825885927000002, 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.611 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.825778692, 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:14.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:14.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.825724132000005, 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:14.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:14.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:14.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.825008831000005, 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:14.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 80.823115405999999, 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:14.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:14.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:14.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:14.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:14.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.628 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:14.628 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:14.628 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:14.629 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:14.630 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:14.630+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:14.730 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:14.728+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:14.763 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:14.763 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:14.763 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:14.763 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:14.778 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:14.831 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:14.830+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:14.894 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:14.894 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:14.894 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:14.894 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:14.894 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:14.908 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:14.935 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:14.933+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:15.036 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:15.033+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.392916146999994, 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.079 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:15.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:15.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:15.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:15.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.392789751999999, 2024-04-26T11:23:15.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:15.089 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.392700958999995, 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:15.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.392596146000002, 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.099 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.392545490000003, 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:15.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:15.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:15.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.392488537000006, 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:15.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:15.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:15.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:15.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.392429544999999, 2024-04-26T11:23:15.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.392326538999995, 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:15.114 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.392250699000002, 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:15.118 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:15.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:15.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.377033136999998, 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:15.125 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.372645691000002, 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:15.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:15.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.129 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.371633875000001, 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.133 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.371310210999994, 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:15.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:15.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.371253933999995, 2024-04-26T11:23:15.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.371202504999999, 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:15.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:15.148 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.371137715000003, 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:15.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:15.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.366653366999998, 2024-04-26T11:23:15.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.361442917000005, 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.156 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:15.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:15.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:15.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.361359405000002, 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:15.160 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:15.164 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 75.680669866000002, 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:15.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:15.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:15.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:15.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:15.169 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:15.171 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:15.172 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:15.172+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:15.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:15.272+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:15.302 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:23:15.302 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:23:15.302 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:15.316 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:15.373 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:15.369+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:15.439 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:15.439 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:23:15.439 INFO:teuthology.orchestra.run.smithi088.stdout: "complaint_time": 30, 2024-04-26T11:23:15.439 INFO:teuthology.orchestra.run.smithi088.stdout: "num_blocked_ops": 0 2024-04-26T11:23:15.439 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:15.453 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:15.495 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:15.493+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:15.576 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:15.574+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:15.622 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:23:15.622 INFO:teuthology.orchestra.run.smithi088.stdout: "size": 20, 2024-04-26T11:23:15.622 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 600, 2024-04-26T11:23:15.622 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [ 2024-04-26T11:23:15.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.622 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(client.4173.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e10)", 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 91.853261653000004, 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020703135000000001, 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: "client_info": { 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: "client": "client.4173", 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: "client_addr": "172.21.15.73:0/2774352951", 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: "tid": 141 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766247+0000", 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766246+0000", 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766261+0000", 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5267000000000001e-05 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766280+0000", 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8583000000000001e-05 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.766294+0000", 2024-04-26T11:23:15.625 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3862999999999999e-05 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785023+0000", 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018729648000000002 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785167+0000", 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000143969 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.626 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.785372+0000", 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020507300000000001 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786733+0000", 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0013607560000000001 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786787+0000", 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3953999999999999e-05 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.627 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786867+0000", 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.0414999999999995e-05 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:43.786950+0000", 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2923999999999994e-05 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:15.628 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.939432142000001, 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040932797999999999, 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680077+0000", 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.629 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680074+0000", 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680090+0000", 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5648999999999999e-05 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680116+0000", 2024-04-26T11:23:15.630 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.6466999999999999e-05 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680134+0000", 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8105999999999999e-05 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680245+0000", 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000110633 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680273+0000", 2024-04-26T11:23:15.631 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.8603e-05 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694011+0000", 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013737106000000001 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694334+0000", 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032357000000000002 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.632 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694681+0000", 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000347418 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707286+0000", 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012604317 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720821+0000", 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013535037 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.633 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720916+0000", 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.5330999999999999e-05 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721010+0000", 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3337000000000004e-05 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:15.634 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.939346405999999, 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041230648000000002, 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680162+0000", 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.635 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680161+0000", 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680171+0000", 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0010000000000001e-05 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680189+0000", 2024-04-26T11:23:15.636 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7782999999999999e-05 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680203+0000", 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3917000000000001e-05 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680451+0000", 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000247848 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680463+0000", 2024-04-26T11:23:15.637 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1917e-05 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695295+0000", 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014832237999999999 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695496+0000", 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000201268 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.638 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695759+0000", 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00026231799999999999 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707302+0000", 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011543387 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721202+0000", 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013900256999999999 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.639 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721299+0000", 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7084999999999996e-05 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721393+0000", 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3802999999999996e-05 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.640 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.939287233000002, 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041738365999999999, 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680222+0000", 2024-04-26T11:23:15.641 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680220+0000", 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680252+0000", 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.1883e-05 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.642 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680274+0000", 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1906e-05 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680293+0000", 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.8484000000000001e-05 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680645+0000", 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035249400000000002 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.643 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680661+0000", 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5605999999999999e-05 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696722+0000", 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016061646999999998 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699599+0000", 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0028771130000000002 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.644 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699974+0000", 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037430100000000001 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707319+0000", 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0073454929999999998 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721745+0000", 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014425314 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.645 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721867+0000", 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000122359 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721960+0000", 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.3048999999999996e-05 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.646 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.939201767, 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041853478999999999, 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680307+0000", 2024-04-26T11:23:15.647 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680306+0000", 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680314+0000", 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2660000000000001e-06 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680334+0000", 2024-04-26T11:23:15.648 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680349+0000", 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5722999999999998e-05 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00048265299999999999 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.649 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680843+0000", 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1476e-05 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700991+0000", 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020147205000000001 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701129+0000", 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013880899999999999 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.650 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701305+0000", 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000175176 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707332+0000", 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0060274880000000001 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722052+0000", 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014720026000000001 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.651 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722116+0000", 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3901999999999999e-05 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722161+0000", 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4567000000000002e-05 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.652 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.939142330999999, 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042101210999999999, 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680367+0000", 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680366+0000", 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680373+0000", 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1570000000000003e-06 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680390+0000", 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7808999999999998e-05 2024-04-26T11:23:15.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680403+0000", 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2126999999999999e-05 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680914+0000", 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00051110000000000001 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680924+0000", 2024-04-26T11:23:15.655 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0557000000000001e-05 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701875+0000", 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.020950946000000002 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702197+0000", 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00032200399999999998 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702528+0000", 2024-04-26T11:23:15.656 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00033039400000000002 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.707347+0000", 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0048192870000000002 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722328+0000", 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014980797000000001 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722409+0000", 2024-04-26T11:23:15.657 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1079000000000001e-05 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722468+0000", 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.8956999999999998e-05 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.939061714000005, 2024-04-26T11:23:15.658 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042204522000000001, 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680447+0000", 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680446+0000", 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680454+0000", 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9170000000000006e-06 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680503+0000", 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.8875999999999998e-05 2024-04-26T11:23:15.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680520+0000", 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7787000000000001e-05 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681014+0000", 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00049317000000000002 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681022+0000", 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5299999999999996e-06 2024-04-26T11:23:15.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703466+0000", 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022444131999999999 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703668+0000", 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00020212799999999999 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.662 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704021+0000", 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035281499999999998 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.708761+0000", 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0047398300000000004 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722542+0000", 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013780789 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.663 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722607+0000", 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5519999999999996e-05 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722652+0000", 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.4271999999999999e-05 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:15.664 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938860508999994, 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042284561999999998, 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680648+0000", 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680647+0000", 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680658+0000", 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0763e-05 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680679+0000", 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0826999999999999e-05 2024-04-26T11:23:15.666 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680699+0000", 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.0216000000000001e-05 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681099+0000", 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000400374 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681110+0000", 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.047e-05 2024-04-26T11:23:15.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705053+0000", 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.023943219000000002 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705412+0000", 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035878400000000001 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705732+0000", 2024-04-26T11:23:15.668 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031992799999999998 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710875+0000", 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051437740000000003 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722739+0000", 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.011863406 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722853+0000", 2024-04-26T11:23:15.669 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114469 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722933+0000", 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:15.670 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938737529999997, 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.042342867999999999, 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680771+0000", 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.671 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680770+0000", 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680778+0000", 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2859999999999999e-06 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680798+0000", 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9313e-05 2024-04-26T11:23:15.672 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680812+0000", 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4147e-05 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681161+0000", 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00034935400000000002 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.673 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681167+0000", 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.9730000000000002e-06 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706398+0000", 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.02523131 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706591+0000", 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00019210200000000001 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.674 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706863+0000", 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027284100000000001 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710889+0000", 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0040258589999999997 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723009+0000", 2024-04-26T11:23:15.675 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.012119347000000001 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723072+0000", 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.3563000000000001e-05 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.723114+0000", 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.2018999999999999e-05 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.676 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938682134000004, 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040358472999999999, 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.677 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680827+0000", 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680826+0000", 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680832+0000", 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.754e-06 2024-04-26T11:23:15.678 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680855+0000", 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.2379999999999999e-05 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680872+0000", 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.6826000000000001e-05 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681051+0000", 2024-04-26T11:23:15.679 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00017927899999999999 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681065+0000", 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.366e-05 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695061+0000", 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013996567 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.680 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695301+0000", 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000239442 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695571+0000", 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00027085800000000001 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705537+0000", 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0099651779999999999 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.681 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720969+0000", 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015432454 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721084+0000", 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000115315 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721185+0000", 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00010084700000000001 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.682 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938538321999999, 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040567998000000001, 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.683 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680971+0000", 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680970+0000", 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680975+0000", 2024-04-26T11:23:15.684 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.4670000000000003e-06 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680987+0000", 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2255999999999999e-05 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.680997+0000", 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2699999999999993e-06 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.685 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681136+0000", 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013977600000000001 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681149+0000", 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2843000000000001e-05 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696832+0000", 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015683229 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.686 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697050+0000", 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000217875 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697426+0000", 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00037519099999999998 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705681+0000", 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0082550469999999997 2024-04-26T11:23:15.687 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721323+0000", 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015642284999999999 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721463+0000", 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013998299999999999 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721539+0000", 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5679000000000005e-05 2024-04-26T11:23:15.688 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938473627999997, 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037893481999999999, 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.689 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681035+0000", 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681062+0000", 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.7733999999999999e-05 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681076+0000", 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4029000000000001e-05 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681084+0000", 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681215+0000", 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013024299999999999 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.3859000000000001e-05 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703768+0000", 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022539646 2024-04-26T11:23:15.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704062+0000", 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00029334100000000002 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704851+0000", 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00078936800000000004 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.709829+0000", 2024-04-26T11:23:15.693 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0049781950000000004 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718703+0000", 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0088737729999999997 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718833+0000", 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00012967600000000001 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.694 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718929+0000", 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6162000000000005e-05 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938381188999998, 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.038107921000000003, 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.695 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681128+0000", 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681127+0000", 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.696 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681132+0000", 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.7199999999999997e-06 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681142+0000", 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0043e-05 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681153+0000", 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1547e-05 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.697 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013246500000000001 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681303+0000", 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.7113999999999999e-05 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705833+0000", 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.024529736999999999 2024-04-26T11:23:15.698 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706068+0000", 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00023539899999999999 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.706427+0000", 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035929100000000003 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.710673+0000", 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0042453509999999996 2024-04-26T11:23:15.699 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719047+0000", 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0083745650000000005 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719152+0000", 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105277 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.719236+0000", 2024-04-26T11:23:15.700 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3141999999999998e-05 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:27 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938303098999995, 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037425982000000003, 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.701 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681206+0000", 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681205+0000", 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.702 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681218+0000", 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2466999999999999e-05 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681229+0000", 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1902999999999999e-05 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681237+0000", 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.4800000000000004e-06 2024-04-26T11:23:15.703 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681308+0000", 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1008999999999997e-05 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681317+0000", 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.5599999999999994e-06 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.694861+0000", 2024-04-26T11:23:15.704 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013544801 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695180+0000", 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00031853699999999998 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695733+0000", 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00055354600000000003 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702870+0000", 2024-04-26T11:23:15.705 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.007136608 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718507+0000", 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.015636949000000001 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718578+0000", 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.0807000000000002e-05 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.706 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718632+0000", 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 5.3989000000000001e-05 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938257604, 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040850355999999997, 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.707 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681251+0000", 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.708 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681255+0000", 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.5800000000000002e-06 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681265+0000", 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6460000000000005e-06 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681272+0000", 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1969999999999999e-06 2024-04-26T11:23:15.709 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681364+0000", 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2310000000000002e-05 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681377+0000", 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2602999999999999e-05 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.710 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698144+0000", 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016767240999999999 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699721+0000", 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0015764659999999999 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.700597+0000", 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00087586700000000001 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.711 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705697+0000", 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.005100055 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721869+0000", 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016172809 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722009+0000", 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013961900000000001 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.712 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722102+0000", 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.2619000000000002e-05 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938226396999994, 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.040722266999999999, 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.713 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681282+0000", 2024-04-26T11:23:15.714 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681286+0000", 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.583e-06 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681298+0000", 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1994000000000001e-05 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681307+0000", 2024-04-26T11:23:15.715 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.2730000000000002e-06 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681403+0000", 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.6275999999999998e-05 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681417+0000", 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4133e-05 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.716 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701376+0000", 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019959109999999999 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701834+0000", 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00045808300000000003 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702218+0000", 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00038383100000000001 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.717 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705543+0000", 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0033251399999999999 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016271714999999999 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721921+0000", 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000105906 2024-04-26T11:23:15.718 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722005+0000", 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3832999999999995e-05 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938185950000005, 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041184559000000003, 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.719 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681323+0000", 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.720 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681322+0000", 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681333+0000", 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0813e-05 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681343+0000", 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.0247e-05 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.721 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681351+0000", 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.5499999999999997e-06 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681442+0000", 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.1426000000000002e-05 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681457+0000", 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.4589999999999999e-05 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.722 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.701340+0000", 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.019883436000000001 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702035+0000", 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00069466600000000003 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702508+0000", 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000473289 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.723 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.705916+0000", 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0034081710000000002 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722288+0000", 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016371067 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722419+0000", 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013097200000000001 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.724 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722507+0000", 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8938999999999997e-05 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:28 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938147747000002, 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.037571397999999999, 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.725 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681361+0000", 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681360+0000", 2024-04-26T11:23:15.726 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681365+0000", 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4.0500000000000002e-06 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681374+0000", 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.363e-06 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681387+0000", 2024-04-26T11:23:15.727 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2782999999999999e-05 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681490+0000", 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000103286 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681502+0000", 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2033e-05 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.728 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.697824+0000", 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.016321637999999999 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.698180+0000", 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00035628400000000001 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 2", 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.699807+0000", 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.001626656 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.729 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704988+0000", 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0051817469999999996 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718711+0000", 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.013723166 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718845+0000", 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00013400599999999999 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.730 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.718933+0000", 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.7035999999999998e-05 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:31 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938097554999999, 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.039706479000000003, 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.731 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681411+0000", 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681410+0000", 2024-04-26T11:23:15.732 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.999999 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681419+0000", 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.3569999999999998e-06 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681440+0000", 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 2.1727000000000001e-05 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.733 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681474+0000", 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 3.3655999999999998e-05 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681562+0000", 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 8.8232999999999994e-05 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op must wait for map", 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681574+0000", 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.1673e-05 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.734 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.695705+0000", 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.014130759999999999 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696383+0000", 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00067840100000000003 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.696661+0000", 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000278425 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "op_commit", 2024-04-26T11:23:15.735 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.702597+0000", 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.0059356900000000004 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.720948+0000", 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.018350828999999999 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "commit_sent", 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721046+0000", 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 9.7796999999999999e-05 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.736 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.721118+0000", 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 7.1990999999999996e-05 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: "initiated_at": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: "age": 81.938009038000004, 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.041287263999999997, 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: "type_data": { 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: "flag_point": "started", 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: "events": [ 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.737 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "initiated", 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "throttled", 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681500+0000", 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "header_read", 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681499+0000", 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.738 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "all_read", 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681505+0000", 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 6.5429999999999999e-06 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "dispatched", 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681525+0000", 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.9763e-05 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "queued_for_pg", 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681540+0000", 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.5217e-05 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.739 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681655+0000", 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.000114739 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "waiting_for_map not empty", 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.681668+0000", 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 1.2907e-05 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "reached_pg", 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.703957+0000", 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.022289030000000001 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.740 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "started", 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.704658+0000", 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.00070086200000000001 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: "event": "done", 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: "time": "2024-04-26T11:21:53.722787+0000", 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: "duration": 0.01812942 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-04-26T11:23:15.741 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:23:15.743 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:15.743 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:15.741+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:15.844 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:15.842+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:15.875 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:15.875 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:15.875 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:15.875 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:15.889 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:15.945 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:15.941+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:16.010 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:16.010 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:16.010 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:16.010 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:16.010 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:16.024 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:16.046 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:16.041+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:16.142 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:16.142 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:16.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 92.535642404000001, 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:16.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:16.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.457041970000006, 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:16.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.152 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.456107297000003, 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:16.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.154 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.157 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.456034181000007, 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:16.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:16.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:16.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.455982840999994, 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:16.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:16.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.455932571999995, 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.168 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.173 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.455880272000002, 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:16.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:16.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:16.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:16.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.455830735999996, 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:16.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:16.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.455764205999998, 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:16.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:16.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.455478330999995, 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:16.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.453942656999999, 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:16.192 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:16.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.195 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.452072466999994, 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.451976354999999, 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.200 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:16.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.429941305, 2024-04-26T11:23:16.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:16.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.429860232999999, 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:16.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.429807319000005, 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:16.213 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:16.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.429700084000004, 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:16.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:16.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.429645523999994, 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:16.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:16.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.428930222999995, 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.226 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:16.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:16.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:16.230 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 82.427036798000003, 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:16.234 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:16.236 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:16.236 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:16.234+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:16.337 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:16.335+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:16.368 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:16.368 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:16.368 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:16.384 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:16.438 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:16.433+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:16.453 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:23:16.500 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:16.500 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:16.500 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:16.500 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:16.500 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:16.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:16.516 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:16.562 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:16.562+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:16.639 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:16.639 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:16.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:16.639 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:16.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.639 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.639 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:16.639 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.952936628000003, 2024-04-26T11:23:16.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:16.639 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.639 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:16.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:16.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.952810232999994, 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:16.644 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:16.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:16.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:16.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.952721440000005, 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.649 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:16.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:16.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.952616626999998, 2024-04-26T11:23:16.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.659 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.952565970999999, 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:16.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.952509018000001, 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:16.664 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:16.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:16.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:16.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.952450025999994, 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.672 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.952347020000005, 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:16.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.952271179999997, 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.676 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:16.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:16.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.937053617999993, 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:16.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.683 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.932666171999998, 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:16.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:16.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:16.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.931654355999996, 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:16.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:16.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:16.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:16.691 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.931330692000003, 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.931274415000004, 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:16.695 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.698 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.931222985999995, 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:16.702 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.931158195999998, 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.926673847999993, 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:16.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.921463398, 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:16.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:16.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:16.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 82.921379885999997, 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.713 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:16.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:16.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 77.240690346999997, 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:16.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:16.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:16.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:16.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:16.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:16.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:16.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:16.722 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.722 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.722 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.722 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:16.722 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:16.722 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:16.723 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:23:16.723 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:23:16.724 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:16.722+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:16.724 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:16.735 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:16.736 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:16.767 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:16.767 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:16.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:16.823+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:16.856 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:16.856 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:16.870 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:16.925 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:16.923+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:16.993 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:16.993 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:17.009 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:17.055 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:17.053+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:17.127 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:17.125+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:17.131 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:17.132 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:17.146 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:17.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:17.227+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:17.276 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:17.276 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:17.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:17.329 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:17.330+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:17.430 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:17.425+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:17.436 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-26T11:23:17.454 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:17.454 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:17.468 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:17.531 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:17.527+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:17.585 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:17.585 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:17.601 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:17.631 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:17.629+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:17.732 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:17.732 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:17.732 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:17.731+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:17.745 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:17.834 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:17.831+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:17.862 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:17.862 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:17.878 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:17.934 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:17.934+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:18.004 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:18.004 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:18.019 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:23:18.067 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:18.065+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:18.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:18.135+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:18.151 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:18.151 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:18.167 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T11:23:18.237 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:18.234+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:18.333 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:18.333 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:18.338 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:18.335+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:18.347 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T11:23:18.438 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:23:18.433+0000 7fc537fb8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 21478) UID: 0 2024-04-26T11:23:18.449 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T11:23:18.449 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:23:18.449 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-04-26T11:23:18.449 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T11:23:18.450 INFO:teuthology.orchestra.console.smithi088:Power off 2024-04-26T11:23:18.450 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T11:23:18.470 INFO:teuthology.orchestra.run.smithi088.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:18.470 INFO:teuthology.orchestra.run.smithi088.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:18.475 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-04-26T11:23:18.475 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:23:18.486 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:18.501 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-04-26T11:23:18.540 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:18.539+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:18.618 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:18.618 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:18.632 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:18.640 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:18.639+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:18.742 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:18.739+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:18.756 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:18.757 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:18.771 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:18.789 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:18.842 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:18.842+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:18.891 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:18.891 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:18.905 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:18.946 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:18.946+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:18.984 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:23:18.984 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:23:19.015 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:19.015 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:19.036 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:19.036 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:19.036 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:19.036 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:19.044 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:19.042+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:19.045 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:19.046 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:19.050 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:19.145 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:19.143+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:19.172 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:19.172 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:19.172 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:19.172 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:19.172 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:19.186 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:19.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:19.271+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:19.347 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:19.343+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 95.747186889000005, 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:19.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:19.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.668586454999996, 2024-04-26T11:23:19.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:19.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.362 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.667651781999993, 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:19.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:19.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:19.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.667578665999997, 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.667527325999998, 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:19.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.667477056999999, 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:19.378 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:19.379 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:19.380 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:19.381 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.382 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.667424757000006, 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:19.383 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.384 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:19.385 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:19.386 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.387 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.667375221, 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.388 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.389 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.390 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.391 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.392 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.667308691000002, 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.393 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:19.394 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:19.395 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.396 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.667022815999999, 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:19.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:19.400 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.665487142000003, 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:19.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:19.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.663616951999998, 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:19.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:19.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.663520840000004, 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:19.408 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.641485790000004, 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:19.412 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:19.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:19.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.641404718000004, 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:19.416 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:19.420 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.641351803999996, 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:19.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.641244568999994, 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.428 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.641190008999999, 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:19.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:19.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:19.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.640474707999999, 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 85.638581282999994, 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:19.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:19.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:19.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:19.441 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:19.443 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:19.461 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:23:19.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:19.483+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:19.549 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:19.547+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:19.574 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:19.574 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:19.574 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:19.574 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:19.588 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:19.650 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:19.650+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:19.710 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:19.711 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:19.711 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:19.711 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:19.711 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:19.725 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:19.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:19.747+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:19.851 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:19.851+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.208671929000005, 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.895 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:19.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.208545533999995, 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.900 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.208456741000006, 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.208351927999999, 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:19.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:19.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:19.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.208301272, 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.915 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:19.920 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.208244319000002, 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:19.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:19.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:19.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.925 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.208185326999995, 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.929 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.208082321000006, 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:19.933 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.208006480999998, 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.192788918999995, 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.937 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.940 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.188401472999999, 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:19.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:19.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.944 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.187389656999997, 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:19.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:19.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.187065993000004, 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:19.949 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.187009716000006, 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:19.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:19.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:19.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.186958286999996, 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.186893497, 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:19.964 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.182409148999994, 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:19.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:19.968 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.177198699000002, 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:19.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:19.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.972 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 86.177115186999998, 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:19.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.976 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 80.496425647999999, 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:19.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:19.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:19.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:19.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:19.982 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.982 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.982 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.982 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:19.982 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:19.982 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:19.983 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:19.984 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:19.983+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:20.084 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:20.083+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:20.113 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:20.113 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:20.113 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:20.113 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:20.127 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:20.186 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:20.186+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:20.287 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:20.286+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:20.293 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:20.293 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:20.293 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:20.293 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:20.293 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:20.308 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:20.388 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:20.386+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:20.426 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:20.426 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:20.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:20.426 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:20.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.426 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:20.426 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:20.426 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.820396708000004, 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:20.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:20.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.430 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.741796273999995, 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.431 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:20.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:20.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:20.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.740861601000006, 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:20.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:20.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:20.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:20.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:20.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:20.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:20.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:20.441 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.740788484999996, 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:20.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:20.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.446 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.740737144999997, 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.451 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.740686875999998, 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:20.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:20.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:20.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.740634576000005, 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:20.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:20.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:20.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:20.459 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.459 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.459 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:20.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:20.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:20.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:20.463 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.740585039999999, 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:20.468 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.740518510000001, 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.469 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:20.470 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:20.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.740232634999998, 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:20.472 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:20.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:20.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:20.476 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.738696961000002, 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.736826770999997, 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.480 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:20.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:20.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:20.484 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.736730659000003, 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:20.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:20.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:20.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.714695609000003, 2024-04-26T11:23:20.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.714614537000003, 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.497 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.714561622999994, 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:20.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:20.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.714454388000007, 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:20.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:20.505 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.714399827999998, 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:20.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:20.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.509 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.713684526999998, 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:20.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:20.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:20.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 86.711791102000007, 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:20.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:20.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:20.518 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:20.520 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:23:20.520 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:20.521 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:20.518+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:20.621 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:20.618+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:20.651 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:20.651 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:20.651 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:20.651 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:20.665 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:20.750 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:20.750+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:20.822 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:20.822+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:20.827 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:20.827 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:20.827 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:20.842 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:20.934 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:20.934+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:21.012 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.326105548000001, 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.325979153000006, 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.325890360000002, 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.325785546999995, 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.325734890999996, 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.325677937999998, 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.325618946000006, 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.325515940000003, 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.325440099999994, 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.310222538000005, 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.305835091999995, 2024-04-26T11:23:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.304823275999993, 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.304499612000001, 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.304443335000002, 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.304391906000006, 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.304327115999996, 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.299842768000005, 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.294632317999998, 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 87.294548805999995, 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 81.613859266999995, 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:21.097 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:21.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:21.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:21.102 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:21.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:21.105 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:21.102+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:21.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:21.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:21.203+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:21.236 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:21.236 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:21.236 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:21.251 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:21.297 INFO:teuthology.orchestra.run.smithi073.stdout:osd.0: {} 2024-04-26T11:23:21.297 INFO:teuthology.orchestra.run.smithi073.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T11:23:21.305 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:21.306+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:21.327 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:21.327 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:21.359 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:21.359 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:21.406 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:21.403+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:21.420 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:21.420 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:21.434 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:21.507 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:21.506+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:21.600 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:21.600 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:21.607 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:21.603+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:21.615 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:21.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:21.707+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:21.746 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:21.746 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:21.762 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:21.810 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:21.807+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:22.014 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:22.014 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:22.014 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:22.014 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:22.010+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:22.114 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:22.114+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:22.186 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:22.186 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:22.201 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:22.248 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:22.247+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:22.315 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:22.311+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:22.332 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:22.332 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:22.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:22.432 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:22.431+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:22.502 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:23:22.514 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:22.515 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:22.518 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:22.514+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:22.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:23:22.530 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:22.613 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-04-26T11:23:22.618 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:22.618+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:22.694 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:22.695 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:22.709 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:22.754 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:22.754+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:22.820 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:22.818+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:22.838 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:22.839 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:22.853 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:22.921 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:22.919+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:23.015 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:23.015 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:23.022 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:23.022+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:23.030 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:23.122 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:23.122+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:23.193 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:23.193 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:23.207 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:23.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:23.251+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:23.324 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:23.323+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:23.339 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:23.340 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:23.354 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:23.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:23.440 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:23.439+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:23.474 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:23:23.516 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:23.517 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:23.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:23.523+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:23.531 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:23.547 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:23.579 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:23.579 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:23.611 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:23.612 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:23.615 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:23.616 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:23.627 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:23.623+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:23.699 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:23.700 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:23.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:23.700 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:23.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.700 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:23.700 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:23.701 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 100.09180211499999, 2024-04-26T11:23:23.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:23.701 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:23.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:23.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:23.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:23.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:23.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:23.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:23.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:23.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:23.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:23.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:23.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:23.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:23.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:23.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:23.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:23.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:23.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:23.710 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.710 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.711 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.711 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:23.711 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:23.712 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.013201680999998, 2024-04-26T11:23:23.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:23.712 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.712 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.712 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:23.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.012267007999995, 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:23.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:23.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:23.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.012193891999999, 2024-04-26T11:23:23.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:23.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.727 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.012142552, 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:23.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.732 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.012092283000001, 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:23.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:23.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.012039982999994, 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.738 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:23.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:23.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:23.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:23.743 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.011990447000002, 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:23.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.748 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.011923917000004, 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:23.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.011638042000001, 2024-04-26T11:23:23.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.010102368000005, 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:23.759 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.008232178, 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:23.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:23.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:23.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 90.008136066000006, 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 89.986101016000006, 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 89.986019944000006, 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.775 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 89.985967029999998, 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:23.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:23.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 89.985859794999996, 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 89.985805235000001, 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 89.985089934000001, 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.788 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:23.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:23.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:23.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 89.983196508999995, 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:23.792 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:23.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:23.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:23.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:23.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:23.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:23.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:23.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:23.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:23.796 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.796 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.796 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.796 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:23.796 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:23.796 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:23.798 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:23.798 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:23.795+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:23.899 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:23.895+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:23.926 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:23.927 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:23.927 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:23.927 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:23.940 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:24.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:23.999+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:24.056 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:24.056 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:24.056 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:24.056 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:24.056 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:24.072 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:24.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:24.099+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:24.191 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:24.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.505377640000006, 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:24.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:24.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:24.196 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.505251244999997, 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:24.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:24.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:24.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.505162451999993, 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:24.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:24.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.505057639, 2024-04-26T11:23:24.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.212 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.505006983000001, 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:24.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:24.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.217 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.504950030000003, 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:24.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:24.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:24.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:24.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.504891037999997, 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.226 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.504788031999993, 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:24.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:24.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.504712192, 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.489494629999996, 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:24.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.485107184, 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.238 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.242 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.484095367999998, 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:24.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:24.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:24.247 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.483771704000006, 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:24.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.483715427000007, 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:24.251 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.483663997999997, 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:24.255 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:24.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:24.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.483599208000001, 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:24.259 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.262 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.479114859999996, 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:24.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:24.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.473904410000003, 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:24.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:24.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:24.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:24.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:24.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:24.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:24.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:24.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:24.272 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.272 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.272 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.272 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:24.273 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:24.273 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 90.473820898, 2024-04-26T11:23:24.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:24.273 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.273 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.273 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:24.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:24.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:24.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:24.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:24.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:24.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:24.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:24.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:24.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:24.277 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.277 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.277 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 84.793131359, 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:24.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:24.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:24.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:24.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:24.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:24.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:24.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:24.283 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.283 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.283 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.283 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:24.283 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:24.283 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:24.285 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:24.286 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:24.283+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:24.385 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:24.383+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:24.418 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:24.419 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:24.419 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:24.419 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:24.433 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:24.520 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:24.519+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:24.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:24.587+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:24.595 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:24.595 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:24.595 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:24.595 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:24.595 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:24.609 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:24.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:24.695+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:24.778 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:24.778 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:24.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:24.778 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:24.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.778 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:24.778 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:24.778 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 101.170815086, 2024-04-26T11:23:24.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:24.778 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.782 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.092214651999996, 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:24.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:24.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:24.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.091279979000007, 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.792 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.091206862999996, 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:24.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:24.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:24.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:24.797 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.091155522999998, 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:24.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.091105253999999, 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:24.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:24.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.091052954000006, 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.808 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:24.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:24.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:24.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:24.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.091003418, 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:24.813 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:24.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:24.818 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.090936888000002, 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.090651012999999, 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:24.822 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:24.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:24.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:24.825 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.089115339000003, 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:24.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:24.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.087245148999997, 2024-04-26T11:23:24.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:24.833 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.087149037000003, 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:24.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:24.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.837 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.065113987000004, 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:24.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:24.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:24.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.065032915000003, 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.845 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.064980000999995, 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:24.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:24.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:24.849 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.064872765999993, 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:24.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:24.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:24.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.064818205999998, 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.064102904999999, 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:24.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:24.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 91.062209480000007, 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:24.862 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:24.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:24.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:24.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:24.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:24.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:24.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:24.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:24.866 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.866 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.866 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.866 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:24.866 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:24.866 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:24.868 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:24.868 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:24.866+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:24.969 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:24.966+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:24.998 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:24.998 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:24.998 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:25.013 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:25.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:25.067+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:25.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:25.171+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:25.173 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:25.173 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:25.174 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:25.174 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:25.188 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:25.272 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:25.271+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:25.318 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:25.318 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.632182255999993, 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:25.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:25.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.632055860999998, 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:25.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:25.329 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.631967067999994, 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:25.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:25.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:25.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.334 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.631862255000001, 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:25.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:25.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.631811599000002, 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:25.340 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.631754646000005, 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:25.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:25.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:25.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:25.352 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.631695653999998, 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:25.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:25.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.631592647999994, 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:25.356 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:25.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:25.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:25.360 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.631516808000001, 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:25.364 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.616299245999997, 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:25.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:25.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.611911800000001, 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.610899984, 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.372 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:25.376 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.610576320000007, 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:25.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:25.380 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.610520042999994, 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:25.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:25.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.610468613999998, 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:25.384 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.610403824000002, 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.388 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:25.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.605919475999997, 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:25.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:25.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.600709026000004, 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:25.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:25.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 91.600625514000001, 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:25.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:25.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 85.919935975000001, 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:25.404 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:25.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:25.409 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:25.411 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:25.410+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:25.411 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:25.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:23:25.511 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:25.507+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:25.541 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:25.541 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:25.541 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:25.541 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:25.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:25.612 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:25.610+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:25.617 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:25.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-26T11:23:25.713 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:25.710+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:25.717 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:25.717 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:25.717 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:25.717 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:25.717 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:25.732 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:25.733 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:25.752 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:25.752 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:25.772 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:25.773 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:25.775 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:25.775 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:25.815 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:25.811+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:25.850 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:25.850 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:25.864 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:25.916 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:25.915+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:25.994 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:25.995 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:26.008 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:26.017 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:26.015+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:26.118 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:26.118+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:26.134 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:26.134 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:26.148 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:26.234 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:26.234+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:26.312 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:26.313 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:26.320 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:26.319+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:26.326 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:26.421 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:26.418+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:26.458 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:26.458 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:26.473 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:26.489 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-26T11:23:26.521 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:26.519+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:26.593 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:26.594 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:26.607 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:26.614 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:23:26.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:26.651+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:26.656 INFO:tasks.workunit.client.0.smithi073.stderr:Note: switching to '7d2137f0a666c92a9411c1af5c33e4968be54da6'. 2024-04-26T11:23:26.656 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-26T11:23:26.656 INFO:tasks.workunit.client.0.smithi073.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T11:23:26.656 INFO:tasks.workunit.client.0.smithi073.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T11:23:26.656 INFO:tasks.workunit.client.0.smithi073.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T11:23:26.657 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-26T11:23:26.657 INFO:tasks.workunit.client.0.smithi073.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T11:23:26.657 INFO:tasks.workunit.client.0.smithi073.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T11:23:26.657 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-26T11:23:26.657 INFO:tasks.workunit.client.0.smithi073.stderr: git switch -c 2024-04-26T11:23:26.657 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-26T11:23:26.657 INFO:tasks.workunit.client.0.smithi073.stderr:Or undo this operation with: 2024-04-26T11:23:26.657 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-26T11:23:26.658 INFO:tasks.workunit.client.0.smithi073.stderr: git switch - 2024-04-26T11:23:26.658 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-26T11:23:26.658 INFO:tasks.workunit.client.0.smithi073.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T11:23:26.658 INFO:tasks.workunit.client.0.smithi073.stderr: 2024-04-26T11:23:26.658 INFO:tasks.workunit.client.0.smithi073.stderr:HEAD is now at 7d2137f0a66 Merge pull request #57086 from zdover23/wip-doc-2024-04-25-backport-57057-to-reef 2024-04-26T11:23:26.664 DEBUG:teuthology.orchestra.run.smithi073:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T11:23:26.671 INFO:tasks.workunit.client.0.smithi073.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T11:23:26.674 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T11:23:26.674 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T11:23:26.724 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-04-26T11:23:26.724 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:26.722+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:26.773 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:26.773 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:26.790 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:26.824 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-04-26T11:23:26.825 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:26.823+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:26.921 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:26.921 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:26.926 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:26.923+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:26.936 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:27.027 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:27.027+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:27.052 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:27.052 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:27.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:27.127 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:27.127+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:27.191 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:27.191 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:27.207 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:27.229 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:27.226+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:27.330 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:27.327+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:27.337 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:27.338 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:27.352 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:27.419 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T11:23:27.430 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:27.429+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:27.503 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T11:23:27.519 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:27.520 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:27.531 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:27.529+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:27.533 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:27.552 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T11:23:27.554 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T11:23:27.554 INFO:tasks.workunit.client.0.smithi073.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T11:23:27.597 INFO:tasks.workunit.client.0.smithi073.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T11:23:27.600 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:23:27.600 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T11:23:27.633 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:27.631+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:27.646 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-26T11:23:27.648 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-26T11:23:27.648 DEBUG:teuthology.orchestra.run.smithi073:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d2137f0a666c92a9411c1af5c33e4968be54da6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-26T11:23:27.649 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:27.649 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:27.663 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:27.704 INFO:tasks.workunit.client.0.smithi073.stderr:+ mkdir -p fsstress 2024-04-26T11:23:27.706 INFO:tasks.workunit.client.0.smithi073.stderr:+ pushd fsstress 2024-04-26T11:23:27.708 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T11:23:27.708 INFO:tasks.workunit.client.0.smithi073.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-26T11:23:27.733 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:27.729+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:27.776 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:27.794 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:27.794 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:27.808 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:27.850 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:27.849+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:27.909 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:27.930 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:27.930 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:27.935 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:27.931+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:27.949 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:27.949 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:27.952 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:27.952 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:27.971 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:27.972 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:27.972 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:27.972 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:27.972 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:27.988 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:28.036 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:28.035+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:28.111 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:28.111 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:28.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:28.111 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:28.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.111 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.425370006999998, 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:28.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:28.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.425243612000003, 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:28.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:28.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.425154818999999, 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:28.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:28.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:28.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.425050006000006, 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:28.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:28.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:28.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.424999349999993, 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.132 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.137 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.424942396999995, 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:28.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:28.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:28.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.424883405000003, 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.424780398999999, 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.424704559000006, 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.409486997000002, 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.405099551000006, 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.404087735000004, 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.403764070999998, 2024-04-26T11:23:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.403707793999999, 2024-04-26T11:23:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:28.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.403656365000003, 2024-04-26T11:23:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.403591574999993, 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.399107227000002, 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.393896776999995, 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.393813265000006, 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 88.713123726000006, 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:28.200 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:28.202 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:28.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:28.199+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:28.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:28.299+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:28.332 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:28.332 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:28.332 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:28.333 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:28.347 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:28.405 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:28.401+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:28.506 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:28.505+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:28.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:23:28.511 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:28.511 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:28.511 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:28.512 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:28.512 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:28.526 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:28.606 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:28.605+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:28.649 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:28.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.043596583, 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:28.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.653 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.964996149000001, 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.654 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:28.660 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.964061475999998, 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:28.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.665 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:28.666 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.963988360000002, 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:28.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:28.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:28.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:28.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:28.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:28.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:28.672 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.672 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.672 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.672 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.672 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:28.672 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.963937020000003, 2024-04-26T11:23:28.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:28.673 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.673 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.673 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:28.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:28.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:28.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:28.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:28.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.678 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.963886751000004, 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:28.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.963834450999997, 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.963784915000005, 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.963718384999993, 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:28.694 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:28.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:28.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:28.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.963432510000004, 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.701 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.961896835999994, 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:28.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:28.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:28.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.960026646000003, 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:28.705 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:28.709 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.959930533999994, 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:28.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:28.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.937895483999995, 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.717 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.937814411999994, 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:28.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:28.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:28.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.937761498, 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.937654262999999, 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.937599703000004, 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.936884402000004, 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.734 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 94.934990976999998, 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:28.738 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:28.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:28.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:28.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:28.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:28.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:28.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:28.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:28.742 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.742 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.742 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.742 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:28.742 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:28.742 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:28.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:28.744 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:28.743+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:28.845 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:28.843+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:28.875 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:28.875 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:28.875 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:28.875 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:28.889 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:28.946 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:28.943+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:29.007 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:29.008 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:29.008 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:29.008 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:29.008 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:29.023 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:29.070 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:29.069+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:29.144 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:29.144 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:29.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:29.144 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:29.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.144 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.144 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:29.144 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.459524138999996, 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:29.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:29.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:29.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:29.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:29.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.459397744, 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:29.150 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:29.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:29.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:29.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:29.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:29.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.459308950999997, 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.156 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:29.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:29.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.459204138000004, 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:29.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:29.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:29.167 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.459153482000005, 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:29.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:29.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:29.172 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.459096528999993, 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:29.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.459037537, 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.182 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.458934530999997, 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:29.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:29.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.458858691000003, 2024-04-26T11:23:29.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:29.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:29.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:29.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:29.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:29.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:29.190 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.443641129, 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.193 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.439253683000004, 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:29.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.438241867000002, 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.198 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:29.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:29.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.437918202999995, 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:29.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:29.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:29.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:29.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:29.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:29.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:5 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.437861925999997, 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017892089999999999, 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:29.207 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705191+0000", 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705190+0000", 2024-04-26T11:23:29.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705195+0000", 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0429999999999998e-06 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705211+0000", 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5434000000000002e-05 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705223+0000", 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1803e-05 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706682+0000", 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014591490000000001 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706704+0000", 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2336000000000001e-05 2024-04-26T11:23:29.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706980+0000", 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027599100000000001 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.437810497000001, 2024-04-26T11:23:29.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:29.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:29.215 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.437745707000005, 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:29.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:29.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:29.219 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.219 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.219 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.219 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:29.219 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:29.219 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.433261358999999, 2024-04-26T11:23:29.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:29.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:29.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:29.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:29.223 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.223 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.223 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.428050909000007, 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:29.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 95.427967397000003, 2024-04-26T11:23:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:29.228 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.229 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.229 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:29.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:29.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 89.747277858000004, 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:29.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:29.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:29.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:29.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.238 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:29.239 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:29.239 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:29.240 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:29.241 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:29.239+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:29.341 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:29.339+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:29.370 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:29.370 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:29.370 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:29.370 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:29.384 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:29.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:29.471+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:29.489 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-26T11:23:29.542 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:29.541+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:29.553 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:29.553 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:29.553 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:29.567 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:29.643 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:29.641+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:29.733 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:29.734 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:29.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:29.734 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:29.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.734 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:29.734 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:29.734 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 106.126902824, 2024-04-26T11:23:29.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:29.734 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.734 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.738 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.048302390000003, 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:29.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:29.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:29.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:29.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:29.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:29.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:29.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:29.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:29.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:29.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:29.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:29.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:29.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:29.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:29.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:29.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.047367717, 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:29.746 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:29.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:29.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:29.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:29.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:29.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:29.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:29.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:29.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:29.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:29.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:29.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:29.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:29.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:29.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:29.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:29.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.047294601000004, 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.753 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:29.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:29.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:29.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:29.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:29.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:29.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:29.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:29.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:29.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.047243261000006, 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.759 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:29.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.764 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.047192992000006, 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:29.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:29.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:29.770 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.047140691999999, 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:29.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:29.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:29.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:29.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.047091155999993, 2024-04-26T11:23:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.779 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:29.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:29.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:29.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.047024625999995, 2024-04-26T11:23:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:29.789 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.793 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.046738751000007, 2024-04-26T11:23:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:29.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:29.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.045203076999996, 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:29.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.802 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:29.803 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.043332887000005, 2024-04-26T11:23:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:29.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:29.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.043236774999997, 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:29.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:29.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.021201724999997, 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.814 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:29.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:29.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:29.818 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.021120652999997, 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:29.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:29.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.021067739000003, 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:29.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.020960504000001, 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.020905944000006, 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:29.834 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:29.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.020190643000007, 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:29.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:29.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 96.018297218000001, 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:29.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:29.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:29.851 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:29.851 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:29.853 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:29.854 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:29.849+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:29.953 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:29.954 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:29.951+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:29.985 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:29.985 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:29.985 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:29.985 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:29.999 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:30.054 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:30.051+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:30.091 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:30.112 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:30.112 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:30.120 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:30.120 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:30.120 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:30.120 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:30.121 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:30.130 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:30.130 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:30.135 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:30.135 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:30.136 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:30.155 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:30.151+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:30.256 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:30.253+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:30.257 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:30.257 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:30.272 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:30.357 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:30.355+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:30.405 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:30.405 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:30.418 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:30.458 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:30.457+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:30.559 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:30.557+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:30.574 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:30.575 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:30.589 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:30.659 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:30.655+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:30.706 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:30.706 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:30.720 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:30.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:30.763+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:30.853 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:30.853 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:30.861 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:30.857+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:30.867 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:30.962 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:30.961+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:31.035 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:31.035 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:31.049 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:31.064 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:31.063+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:31.165 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:31.161+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:31.213 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:31.213 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:31.227 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:31.270 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:31.269+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:31.358 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:31.358 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:31.366 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:31.363+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:31.372 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:31.467 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:31.465+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:31.519 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:23:31.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-04-26T11:23:31.531 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:31.532 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:31.546 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:31.569 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:31.565+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:31.663 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:31.663 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:31.670 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:31.669+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:31.677 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:31.770 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:31.769+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:31.806 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:31.806 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:31.820 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:31.871 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:31.871+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:31.925 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T11:23:31.925 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:23:31.926 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-26T11:23:31.926 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T11:23:31.926 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T11:23:31.926 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-26T11:23:31.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:31.971+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:31.984 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:31.985 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:32.000 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:32.049 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:32.050 INFO:teuthology.orchestra.run.smithi175.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T11:23:32.050 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:32.072 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:32.071+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:32.116 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:32.116 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:32.132 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:32.136 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:32.173 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:32.169+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:32.264 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:32.264 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:32.265 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:32.274 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:32.273+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:32.279 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:32.283 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:32.283 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:32.305 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:32.306 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:32.308 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:32.308 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:32.376 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:32.373+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:32.399 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:32.399 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:32.399 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:32.399 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:32.400 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:32.413 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:32.476 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:32.475+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:32.493 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:23:32.539 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:32.539 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.932575352, 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:32.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:32.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:32.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:32.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.544 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.544 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.544 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:32.544 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:32.545 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.853974918000006, 2024-04-26T11:23:32.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:32.545 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.545 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.545 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:32.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:32.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:32.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:32.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.853040245000003, 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:32.550 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:32.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:32.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:32.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:32.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:32.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:32.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:32.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:32.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:32.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.852967129000007, 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:32.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.562 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.852915788999994, 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:32.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:32.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.852865519999995, 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:32.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:32.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.852813220000002, 2024-04-26T11:23:32.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:32.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:32.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:32.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.852763683999996, 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.583 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.852697153999998, 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:32.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:32.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.587 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.852411278999995, 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:32.591 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.850875604999999, 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:32.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:32.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.849005414999993, 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:32.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.848909302999999, 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.599 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:32.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:32.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:32.603 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.826874253, 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:32.607 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.826793180999999, 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:32.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:32.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.826740267000005, 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.613 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:32.614 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:32.615 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.826633032000004, 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.616 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.617 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.618 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.826578471999994, 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.620 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:32.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:32.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:32.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.825863170999995, 2024-04-26T11:23:32.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:32.628 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 98.823969746000003, 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:32.629 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:32.630 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:32.631 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:32.632 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:32.634 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:32.634 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:32.631+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:32.735 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:32.733+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:32.764 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:32.764 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:32.764 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:32.764 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:32.778 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:32.837 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:32.835+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:32.937 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:32.933+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:32.943 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:32.943 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:32.943 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:32.943 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:32.943 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:32.957 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:33.046 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:33.045+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:33.129 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.129 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.443089031, 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:33.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:33.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.137 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.442962636000004, 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:33.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.442873843000001, 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.143 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:33.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:33.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:33.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:33.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:33.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:33.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.442769029999994, 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:33.149 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.150 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.150 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:33.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:33.154 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.442718373999995, 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:33.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:33.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:33.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.160 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.442661420999997, 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:33.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:33.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:33.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:33.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:33.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.442602429000004, 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.166 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:33.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.442499423000001, 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:33.170 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:33.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:33.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:33.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:33.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:33.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.442423582999993, 2024-04-26T11:23:33.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.427206021000003, 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.178 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.181 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.422818574999994, 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:33.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:33.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:33.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:33.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.421806759000006, 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.421483094999999, 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:33.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:33.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.421375389000005, 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:33.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.421310598999995, 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.416826251000003, 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:33.201 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:33.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:33.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.411615800999996, 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 99.411532288999993, 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.209 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:33.213 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 93.730842749999994, 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:33.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:48 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.7295124739999999, 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022555349999999999, 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397102+0000", 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397118+0000", 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6146000000000001e-05 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:33.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397151+0000", 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2629000000000002e-05 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397167+0000", 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5945999999999999e-05 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397265+0000", 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8048999999999996e-05 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:33.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397517+0000", 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000252162 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399144+0000", 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016267230000000001 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399233+0000", 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8685999999999998e-05 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:33.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399361+0000", 2024-04-26T11:23:33.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000127971 2024-04-26T11:23:33.223 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.223 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.223 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.223 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:33.223 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:33.223 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:33.224 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:33.221+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:33.225 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:33.325 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:33.325+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:33.355 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:33.355 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:33.355 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:33.355 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:33.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:33.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:33.423+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:33.492 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:33.492 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:33.492 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:33.492 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:33.492 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:33.506 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:33.527 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:33.525+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:33.628 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:33.625+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:33.672 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 110.065375953, 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:33.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.677 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.986775519000005, 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:33.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:33.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.985840846000002, 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:33.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:33.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.985767730000006, 2024-04-26T11:23:33.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:33.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.693 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.985716389999993, 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.694 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:33.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.985666120999994, 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.699 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:33.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.985613821000001, 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.985564284999995, 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:33.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:33.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.985497754999997, 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.715 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.985211879999994, 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:33.722 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.983676205999998, 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:33.726 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.981806015999993, 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:33.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:33.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.981709903999999, 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:33.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.959674853999999, 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.959593781999999, 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:33.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.743 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:33.745 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:33.745 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.959540868000005, 2024-04-26T11:23:33.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:33.745 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.745 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.745 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:33.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:33.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.959433633000003, 2024-04-26T11:23:33.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:33.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.753 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.959379072999994, 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:33.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:33.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.958663771999994, 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.758 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:33.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:33.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:33.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 99.956770347000003, 2024-04-26T11:23:33.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:33.766 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:33.769 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:33.769 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:33.767+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:33.869 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:33.865+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:33.902 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:33.902 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:33.902 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:33.902 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:33.916 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:34.006 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:34.005+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:34.072 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:34.069+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:34.081 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:34.081 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:34.081 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:34.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:34.174 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:34.171+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:34.257 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:34.257 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:34.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:34.257 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:34.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.257 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:34.257 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:34.257 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.570749823, 2024-04-26T11:23:34.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:34.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.570623428, 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.263 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:34.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:34.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.570534635, 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.273 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.57042982199999, 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:34.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:34.279 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.570379166, 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.284 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.570322213, 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:34.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:34.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:34.289 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.570263221, 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.293 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.570160215, 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.297 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.57008437499999, 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:34.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.301 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.554866813, 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:34.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.55047936699999, 2024-04-26T11:23:34.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:34.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:34.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:34.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:34.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:34.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:34.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:34.310 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.54946755100001, 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:34.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:34.314 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.549143887, 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:34.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:34.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:34.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:26 3.1f e17/15 ondisk, result = 0)", 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.54903618100001, 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020170309999999999, 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705242+0000", 2024-04-26T11:23:34.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705248+0000", 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0440000000000001e-06 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705264+0000", 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6328999999999999e-05 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705296+0000", 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2317000000000002e-05 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707017+0000", 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001720437 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707026+0000", 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4599999999999992e-06 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707259+0000", 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233031 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.54897139099999, 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.323 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.326 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.544487043, 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:34.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:34.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:34.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:34.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.539276593, 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.331 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:34.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.335 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 100.53919308099999, 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:34.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:34.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.340 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.341 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.341 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:34.341 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:34.341 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 94.858503541999994, 2024-04-26T11:23:34.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:34.341 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.341 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.341 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:34.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:34.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:34.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:34.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:34.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:34.346 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.346 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.346 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:48 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8571732660000002, 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022555349999999999, 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397102+0000", 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397118+0000", 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6146000000000001e-05 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397151+0000", 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2629000000000002e-05 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397167+0000", 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5945999999999999e-05 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397265+0000", 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8048999999999996e-05 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397517+0000", 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000252162 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399144+0000", 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016267230000000001 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399233+0000", 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8685999999999998e-05 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399361+0000", 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000127971 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:34.351 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:34.352 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:34.353 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:34.349+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:34.354 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:34.453 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:34.451+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:34.485 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:34.485 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:34.485 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:34.485 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:34.488 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:34.499 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:34.507 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:34.507 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:34.522 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:23:34.529 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:34.530 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:34.532 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:34.533 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:34.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:34.587+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:34.655 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:34.653+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:34.664 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:34.664 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:34.679 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:34.757 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:34.753+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:34.845 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:34.845 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:34.857 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:34.855+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:34.860 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:34.958 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:34.959+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:34.991 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:34.991 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:35.007 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:35.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:35.059+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:35.126 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:35.126 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:35.140 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:35.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:35.159+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:35.261 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:35.261 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:35.262 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:35.259+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:35.275 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:35.363 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:35.359+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:35.405 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:35.405 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:35.420 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:35.464 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:35.463+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:35.527 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:23:35.564 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:35.563+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:35.588 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:35.589 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:35.603 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:35.688 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:35.687+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:35.764 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:35.765 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:35.766 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:35.763+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:35.778 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:35.867 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:35.865+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:35.908 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:35.908 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:35.924 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:35.968 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:35.965+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:36.068 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:36.067+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:36.086 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:36.087 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:36.101 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:36.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:36.167+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:36.217 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:36.217 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:36.232 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:36.276 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:36.275+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:36.362 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:36.362 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:36.371 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:36.367+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:36.377 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:36.471 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:36.469+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:36.534 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:36.540 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:36.540 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:36.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:36.600 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:36.599+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:36.669 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:36.673 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:36.669+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:36.676 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:36.676 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:36.689 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:36.689 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:36.691 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:36.708 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:36.708 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:36.711 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:36.712 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:36.774 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:36.773+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:36.820 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:36.820 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:36.821 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:36.821 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:36.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:36.875 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:36.871+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:36.976 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:36.975+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:37.001 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:37.001 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:37.001 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:37.001 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:37.001 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:37.017 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:37.065 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T11:23:37.065 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:23:37.065 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T11:23:37.065 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T11:23:37.076 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:37.073+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:37.141 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:37.141 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:37.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:37.142 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:37.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.142 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.142 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:37.142 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.454836644, 2024-04-26T11:23:37.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:37.143 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.143 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.143 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:37.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:37.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:37.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:37.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:37.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:37.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:37.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:37.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:37.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:37.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:37.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:37.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:37.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:37.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.150 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.454710249, 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:37.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:37.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:37.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:37.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:37.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:37.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:37.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:37.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:37.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.454621456, 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.161 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.45451664300001, 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:37.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:37.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:37.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:37.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.45446598700001, 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.45440903399999, 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.172 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:37.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:37.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:37.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.454350042, 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.177 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.454247036, 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.184 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.454171196, 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:37.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:37.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:37.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.438953634, 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.43456618800001, 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.433554372, 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.196 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:37.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:37.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:37.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.433230708, 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:37.200 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:37.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.43305821200001, 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:37.204 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.428573864, 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:37.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:37.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.42336341399999, 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:37.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:37.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:37.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:37.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 103.423279902, 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:37.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:37.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 97.742590363000005, 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:37.220 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:37.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:37.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:37.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:37.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:37.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:37.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.226 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:48 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.7412600869999997, 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022555349999999999, 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:37.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397102+0000", 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397118+0000", 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6146000000000001e-05 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397151+0000", 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2629000000000002e-05 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397167+0000", 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5945999999999999e-05 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397265+0000", 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8048999999999996e-05 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397517+0000", 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000252162 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399144+0000", 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016267230000000001 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399233+0000", 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8685999999999998e-05 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399361+0000", 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000127971 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:49 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:23:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:34.397122+0000", 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 2.7412429490000001, 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022710059999999999, 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397122+0000", 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397122+0000", 2024-04-26T11:23:37.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397119+0000", 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397142+0000", 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2796e-05 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:37.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397178+0000", 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6556e-05 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397196+0000", 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7541999999999999e-05 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397303+0000", 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107656 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397455+0000", 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015161800000000001 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.399188+0000", 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001733273 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.399277+0000", 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8960000000000002e-05 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:37.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:37.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.399393+0000", 2024-04-26T11:23:37.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011601500000000001 2024-04-26T11:23:37.236 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.236 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.236 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.236 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:37.236 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:37.236 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:37.238 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:37.238 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:37.235+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:37.338 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-04-26T11:23:37.339 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:37.337+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:37.366 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:37.367 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:37.367 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:37.367 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:37.380 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:37.381 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:23:37.381 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-26T11:23:37.381 INFO:teuthology.orchestra.run.smithi073.stdout: "epoch": 55, 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "fsid": "ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4", 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "created": "2024-04-26T11:21:32.561072+0000", 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "modified": "2024-04-26T11:23:35.515629+0000", 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "last_up_change": "2024-04-26T11:23:22.452731+0000", 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "last_in_change": "2024-04-26T11:21:33.824306+0000", 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_num": 5799936, 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_set": [ 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "pglog_hardlimit", 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "purged_snapdirs", 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_deletes", 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "sortbitwise" 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:23:37.382 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_version": 4, 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_snapshot": "", 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_max": 4, 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "max_osd": 3, 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "require_min_compat_client": "luminous", 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "min_compat_client": "jewel", 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "require_osd_release": "reef", 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "allow_crimson": false, 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "pools": [ 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 1, 2024-04-26T11:23:37.383 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": ".mgr", 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:41.373843+0000", 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:23:37.384 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 1, 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 1, 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 1, 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 1, 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 1, 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "11", 2024-04-26T11:23:37.385 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:23:37.386 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:23:37.387 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_max": 32, 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 1 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:23:37.388 INFO:teuthology.orchestra.run.smithi073.stdout: "mgr": {} 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 3.0299999713897705, 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 3.0299999713897705, 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.33000001311302185, 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1, 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1, 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.7032623291015625, 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.69999998807907104, 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.69999998807907104 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 2, 2024-04-26T11:23:37.389 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "rbd", 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:48.112664+0000", 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:23:37.390 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 8, 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 8, 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 8, 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 8, 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 8, 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "14", 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:23:37.391 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:23:37.392 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:23:37.393 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "options": {}, 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "rbd": {} 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:23:37.394 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.2400000095367432, 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.2400000095367432, 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.5, 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.5, 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.7032623291015625, 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.69999998807907104, 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.69999998807907104 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 3, 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_metadata", 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:52.071918+0000", 2024-04-26T11:23:37.395 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 32, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 32, 2024-04-26T11:23:37.396 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 32, 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 32, 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 32, 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "17", 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:23:37.397 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:23:37.398 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:23:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_bias": 4, 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 16, 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_priority": 5 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-26T11:23:37.400 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": "cephfs" 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 1.9600000381469727, 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 1.9600000381469727, 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.309999942779541, 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.309999942779541, 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.7032623291015625, 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.69999998807907104, 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.69999998807907104 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.401 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "pool": 4, 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_name": "cephfs_data", 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "create_time": "2024-04-26T11:21:52.677679+0000", 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "flags": 1, 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "flags_names": "hashpspool", 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "type": 1, 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "size": 2, 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "min_size": 1, 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_rule": 0, 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_count": 0, 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_target": 0, 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T11:23:37.402 INFO:teuthology.orchestra.run.smithi073.stdout: "object_hash": 2, 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_autoscale_mode": "off", 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num": 64, 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num": 64, 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_placement_num_target": 64, 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_target": 64, 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_pending": 64, 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "last_pg_merge_meta": { 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "source_pgid": "0.0", 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "ready_epoch": 0, 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_started": 0, 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "last_epoch_clean": 0, 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "source_version": "0'0", 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "target_version": "0'0" 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.403 INFO:teuthology.orchestra.run.smithi073.stdout: "last_change": "18", 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend": "0", 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "auid": 0, 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_mode": "selfmanaged", 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_seq": 0, 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "snap_epoch": 0, 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "pool_snaps": [], 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps": "[]", 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_bytes": 0, 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "quota_max_objects": 0, 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "tiers": [], 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "tier_of": -1, 2024-04-26T11:23:37.404 INFO:teuthology.orchestra.run.smithi073.stdout: "read_tier": -1, 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "write_tier": -1, 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_mode": "none", 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_bytes": 0, 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "target_max_objects": 0, 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_flush_age": 0, 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "cache_min_evict_age": 0, 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profile": "", 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_params": { 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "none" 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_period": 0, 2024-04-26T11:23:37.405 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_count": 0, 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "use_gmt_hitset": true, 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "min_read_recency_for_promote": 0, 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "min_write_recency_for_promote": 0, 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "hit_set_search_last_n": 0, 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "grade_table": [], 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "stripe_width": 0, 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "expected_num_objects": 0, 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "fast_read": false, 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "options": { 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_num_min": 64, 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.406 INFO:teuthology.orchestra.run.smithi073.stdout: "application_metadata": { 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: "cephfs": { 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: "data": "cephfs" 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: "read_balance": { 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: "score_acting": 2.059999942779541, 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: "score_stable": 2.059999942779541, 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: "optimal_score": 0.67000001668930054, 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_acting": 1.3799999952316284, 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: "raw_score_stable": 1.3799999952316284, 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity_weighted": 0.7032623291015625, 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity": 0.69999998807907104, 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: "average_primary_affinity_weighted": 0.69999998807907104 2024-04-26T11:23:37.407 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "osds": [ 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "8b4f67c6-5cab-46bf-b296-34fcc29c7766", 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 0, 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 46, 2024-04-26T11:23:37.408 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 50, 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6800", 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6801", 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.409 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6802", 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6803", 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.410 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6806", 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6807", 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.411 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6804", 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.88:6805", 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21480 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.412 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.88:6801/21480", 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.88:6803/21480", 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.88:6807/21480", 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.88:6805/21480", 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "exists" 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "d465bcda-9e32-469e-82f3-077db852411e", 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 0.1097869873046875, 2024-04-26T11:23:37.413 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 50, 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6800", 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.414 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6801", 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6802", 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.415 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6803", 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6806", 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.416 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6807", 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6804", 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.417 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.107:6805", 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21474 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.107:6801/21474", 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.107:6803/21474", 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.107:6807/21474", 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.107:6805/21474", 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.418 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "uuid": "61e99173-e480-4da1-a95b-d98715c3e713", 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "up": 1, 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "in": 1, 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "weight": 1, 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_affinity": 1, 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_begin": 0, 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "last_clean_end": 0, 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "up_from": 8, 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "up_thru": 50, 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "down_at": 0, 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "lost_at": 0, 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addrs": { 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.419 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6800", 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6801", 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addrs": { 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.420 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6802", 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6803", 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addrs": { 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.421 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6806", 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6807", 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addrs": { 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: "addrvec": [ 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.422 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v2", 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6804", 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "172.21.15.175:6805", 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 21537 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: "public_addr": "172.21.15.175:6801/21537", 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: "cluster_addr": "172.21.15.175:6803/21537", 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_back_addr": "172.21.15.175:6807/21537", 2024-04-26T11:23:37.423 INFO:teuthology.orchestra.run.smithi073.stdout: "heartbeat_front_addr": "172.21.15.175:6805/21537", 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: "state": [ 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: "exists", 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: "up" 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_xinfo": [ 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 0, 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:23:37.424 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.131929+0000", 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 49 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 1, 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.107573+0000", 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: { 2024-04-26T11:23:37.425 INFO:teuthology.orchestra.run.smithi073.stdout: "osd": 2, 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "down_stamp": "0.000000", 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_probability": 0, 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "laggy_interval": 0, 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "features": 4540138322906710015, 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "old_weight": 0, 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "last_purged_snaps_scrub": "2024-04-26T11:21:39.162743+0000", 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "dead_epoch": 0 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: ], 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap": [], 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_items": [], 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_upmap_primaries": [], 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "pg_temp": [], 2024-04-26T11:23:37.426 INFO:teuthology.orchestra.run.smithi073.stdout: "primary_temp": [], 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklist": {}, 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "range_blocklist": {}, 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "erasure_code_profiles": { 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "default": { 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "crush-failure-domain": "osd", 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "k": "2", 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "m": "1", 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "plugin": "jerasure", 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "technique": "reed_sol_van" 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "removed_snaps_queue": [], 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "new_removed_snaps": [], 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "new_purged_snaps": [], 2024-04-26T11:23:37.427 INFO:teuthology.orchestra.run.smithi073.stdout: "crush_node_flags": {}, 2024-04-26T11:23:37.428 INFO:teuthology.orchestra.run.smithi073.stdout: "device_class_flags": {}, 2024-04-26T11:23:37.428 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode": { 2024-04-26T11:23:37.428 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_enabled": false, 2024-04-26T11:23:37.428 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_bucket_count": 0, 2024-04-26T11:23:37.428 INFO:teuthology.orchestra.run.smithi073.stdout: "degraded_stretch_mode": 0, 2024-04-26T11:23:37.428 INFO:teuthology.orchestra.run.smithi073.stdout: "recovering_stretch_mode": 0, 2024-04-26T11:23:37.428 INFO:teuthology.orchestra.run.smithi073.stdout: "stretch_mode_bucket": 0 2024-04-26T11:23:37.428 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-04-26T11:23:37.428 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-26T11:23:37.430 INFO:tasks.thrashosds.thrasher:j is {'epoch': 55, 'fsid': 'ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4', 'created': '2024-04-26T11:21:32.561072+0000', 'modified': '2024-04-26T11:23:35.515629+0000', 'last_up_change': '2024-04-26T11:23:22.452731+0000', 'last_in_change': '2024-04-26T11:21:33.824306+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:21:41.373843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:21:48.112664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:21:52.071918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.9600000381469727, 'score_stable': 1.9600000381469727, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:21:52.677679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}], 'osds': [{'osd': 0, 'uuid': '8b4f67c6-5cab-46bf-b296-34fcc29c7766', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 46, 'down_at': 50, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6800', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6801', 'nonce': 21480}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6802', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6803', 'nonce': 21480}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6806', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6807', 'nonce': 21480}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6804', 'nonce': 21480}, {'type': 'v1', 'addr': '172.21.15.88:6805', 'nonce': 21480}]}, 'public_addr': '172.21.15.88:6801/21480', 'cluster_addr': '172.21.15.88:6803/21480', 'heartbeat_back_addr': '172.21.15.88:6807/21480', 'heartbeat_front_addr': '172.21.15.88:6805/21480', 'state': ['exists']}, {'osd': 1, 'uuid': 'd465bcda-9e32-469e-82f3-077db852411e', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1097869873046875, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6800', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6801', 'nonce': 21474}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6802', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6803', 'nonce': 21474}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6806', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6807', 'nonce': 21474}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6804', 'nonce': 21474}, {'type': 'v1', 'addr': '172.21.15.107:6805', 'nonce': 21474}]}, 'public_addr': '172.21.15.107:6801/21474', 'cluster_addr': '172.21.15.107:6803/21474', 'heartbeat_back_addr': '172.21.15.107:6807/21474', 'heartbeat_front_addr': '172.21.15.107:6805/21474', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '61e99173-e480-4da1-a95b-d98715c3e713', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6800', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6801', 'nonce': 21537}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6802', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6803', 'nonce': 21537}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6806', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6807', 'nonce': 21537}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6804', 'nonce': 21537}, {'type': 'v1', 'addr': '172.21.15.175:6805', 'nonce': 21537}]}, 'public_addr': '172.21.15.175:6801/21537', 'cluster_addr': '172.21.15.175:6803/21537', 'heartbeat_back_addr': '172.21.15.175:6807/21537', 'heartbeat_front_addr': '172.21.15.175:6805/21537', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.131929+0000', 'dead_epoch': 49}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.107573+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T11:21:39.162743+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T11:23:37.430 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-26T11:23:37.472 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:37.471+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:37.540 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:37.537+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:37.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:23:37.552 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:37.552 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:37.552 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:37.553 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:37.553 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:37.566 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:37.652 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:37.651+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:37.735 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:37.735 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:37.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:37.735 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:37.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.735 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 114.12770799499999, 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.739 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.049107561, 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:37.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:37.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:37.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:37.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.048172888, 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.048099772, 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.750 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:37.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:37.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:37.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:37.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.048048432, 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:37.755 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.760 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.047998163, 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:37.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.765 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.047945863, 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:37.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:37.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:37.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:37.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.047896327, 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.04782979700001, 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:37.776 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.047543922, 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.780 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:37.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:37.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:37.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.04600824800001, 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:37.787 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.044138058, 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:37.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.791 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.04404194599999, 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:37.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:37.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:37.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.02200689599999, 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:37.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:37.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.02192582399999, 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.02187291, 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.807 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.021765675, 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:37.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:37.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:37.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:37.811 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.021711115, 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:37.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:37.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.020995814, 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 104.019102389, 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:37.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:37.824 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:37.824 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:37.825 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:37.826 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:37.825+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:37.927 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:37.925+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:37.957 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:37.958 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:37.958 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:37.958 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:37.973 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:38.028 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:38.023+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:38.129 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:38.125+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:38.136 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:38.136 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:38.136 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:38.136 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:38.136 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:38.150 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:38.230 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:38.227+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:38.321 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:38.321 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:38.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:38.321 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:38.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.321 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.321 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:38.321 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.635966474, 2024-04-26T11:23:38.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:38.321 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.326 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.635840079, 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:38.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.635751286, 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.337 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.63564647299999, 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:38.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:38.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:38.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.635595817, 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:38.347 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.635538864, 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:38.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:38.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:38.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.635479872, 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:38.353 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.635376866, 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:38.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:38.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:38.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.63530102599999, 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:38.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.364 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing(3.1a epoch 17/15 rep_tid 1 entries 17'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.620083464, 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070750630000000004, 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699412+0000", 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699411+0000", 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699428+0000", 2024-04-26T11:23:38.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7524e-05 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699465+0000", 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6210000000000001e-05 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699497+0000", 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802999999999997e-05 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.699672+0000", 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000174935 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706487+0000", 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068142180000000004 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.61569601799999, 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:38.368 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:38.372 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.61468420200001, 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:38.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:38.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:38.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:38.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.376 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:29 3.b e17/15 ondisk, result = 0)", 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.614360538, 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040648890000000003, 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:38.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705135+0000", 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705134+0000", 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705141+0000", 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705157+0000", 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5783000000000001e-05 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705174+0000", 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7113e-05 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707936+0000", 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002761739 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707954+0000", 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8193999999999999e-05 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709199+0000", 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001245463 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.380 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 17/15 rep_tid 8 lcod 17'4)", 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.61418804199999, 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022293159999999998, 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:38.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705307+0000", 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705312+0000", 2024-04-26T11:23:38.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.733e-06 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705329+0000", 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7073000000000001e-05 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705354+0000", 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4803e-05 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707283+0000", 2024-04-26T11:23:38.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019284459999999999 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707536+0000", 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025373099999999999 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:25 3.7 e17/15 ondisk, result = 0)", 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.609703694, 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043098600000000004, 2024-04-26T11:23:38.384 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709791+0000", 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709797+0000", 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2940000000000002e-06 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709813+0000", 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6169000000000001e-05 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709824+0000", 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0664e-05 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711437+0000", 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001613134 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711452+0000", 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5393e-05 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714101+0000", 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026487559999999999 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:20 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.604493244, 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003029037, 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715002+0000", 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715001+0000", 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715012+0000", 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1423999999999999e-05 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715034+0000", 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1999000000000001e-05 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715053+0000", 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8357000000000001e-05 2024-04-26T11:23:38.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715218+0000", 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016560500000000001 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715287+0000", 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8483000000000001e-05 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.717936+0000", 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026497999999999999 2024-04-26T11:23:38.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718031+0000", 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4376000000000006e-05 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:21 3.1c e17/15 3:3ed09add:::607.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 104.60440973199999, 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003011054, 2024-04-26T11:23:38.392 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715085+0000", 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715137+0000", 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2479999999999999e-05 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715156+0000", 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9052999999999999e-05 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715169+0000", 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3403e-05 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715814+0000", 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064426200000000005 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715862+0000", 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7836000000000001e-05 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718040+0000", 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002178864 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.718096+0000", 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5952000000000002e-05 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 98.923720192999994, 2024-04-26T11:23:38.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028608040000000002, 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395775+0000", 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395773+0000", 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395787+0000", 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.412e-05 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395819+0000", 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1826999999999999e-05 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.395834+0000", 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5979999999999999e-05 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396007+0000", 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172595 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396218+0000", 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000210688 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.396419+0000", 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000201075 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.397747+0000", 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00132767 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398496+0000", 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074949399999999996 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398577+0000", 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1065999999999999e-05 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:59.398636+0000", 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8573000000000003e-05 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.401 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:48 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e52)", 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.9223899170000003, 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022555349999999999, 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397105+0000", 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397102+0000", 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397118+0000", 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6146000000000001e-05 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397151+0000", 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2629000000000002e-05 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397167+0000", 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5945999999999999e-05 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397265+0000", 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8048999999999996e-05 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.397517+0000", 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000252162 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399144+0000", 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016267230000000001 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399233+0000", 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8685999999999998e-05 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:29.399361+0000", 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000127971 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:49 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e54)", 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:34.397122+0000", 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.9223727789999998, 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022710059999999999, 2024-04-26T11:23:38.406 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397122+0000", 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397122+0000", 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397119+0000", 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397142+0000", 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2796e-05 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397178+0000", 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6556e-05 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397196+0000", 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7541999999999999e-05 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397303+0000", 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107656 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.397455+0000", 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015161800000000001 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.399188+0000", 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001733273 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.399277+0000", 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8960000000000002e-05 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:34.399393+0000", 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011601500000000001 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.410 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:38.411 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:38.411 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:38.412 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:38.409+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:38.413 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:38.513 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:38.513+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:38.540 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-26T11:23:38.547 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:38.547 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:38.547 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:38.562 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:38.614 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:38.613+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:38.677 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:38.677 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:38.677 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:38.677 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:38.677 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:38.691 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:38.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:38.736 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:38.735+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:38.812 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:38.812 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:38.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:38.812 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:38.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.812 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4173.0:109 1.0 e10/9 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 10'71, mlcod=10'64)", 2024-04-26T11:23:38.812 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:38.812 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 115.20633201, 2024-04-26T11:23:38.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079983789999999999, 2024-04-26T11:23:38.812 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604720+0000", 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604718+0000", 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604783+0000", 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4951999999999997e-05 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604810+0000", 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7107e-05 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.604824+0000", 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4027e-05 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.606990+0000", 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002166173 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.607023+0000", 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2543000000000003e-05 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612646+0000", 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005623177 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:43.612718+0000", 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2513000000000002e-05 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:38.816 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.127731576, 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:38.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:38.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:38.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.821 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.126796903, 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.126723787, 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:38.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:38.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:38.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:38.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.126672447, 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.12662217800001, 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:38.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:38.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:38.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:38.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.126569878, 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:38.842 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:38.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:38.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:38.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:38.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.12652034200001, 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:38.847 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:38.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.12645381199999, 2024-04-26T11:23:38.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:38.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:38.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.12616793700001, 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:38.856 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:38.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:38.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:38.861 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.861 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.861 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.124632263, 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.122762073, 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:38.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:38.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:38.869 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.122665961, 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:38.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:38.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.100630911, 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.877 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.100549839, 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:38.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:38.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:7 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.100496925, 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087552150000000002, 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710555+0000", 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710554+0000", 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710604+0000", 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0331999999999999e-05 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710624+0000", 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.969e-05 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710636+0000", 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1917e-05 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711195+0000", 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00055917599999999999 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711243+0000", 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7454999999999999e-05 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719255+0000", 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008012379 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719310+0000", 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5226000000000003e-05 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.10038969, 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.886 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:38.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:38.890 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.10033513, 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:38.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:38.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.09961982900001, 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:38.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:38.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:1 3.14 e17/15 3:292cf221:::200.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 105.097726404, 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084898449999999993, 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713326+0000", 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713316+0000", 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.99999 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713373+0000", 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7333000000000001e-05 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713393+0000", 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9763999999999999e-05 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713411+0000", 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8615999999999999e-05 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714836+0000", 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0014252259999999999 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.714891+0000", 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4945999999999999e-05 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721751+0000", 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068598900000000004 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:38.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:38.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:38.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721815+0000", 2024-04-26T11:23:38.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4109999999999994e-05 2024-04-26T11:23:38.903 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.903 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.903 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.903 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:38.903 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:38.903 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:38.904 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:38.904 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:38.905 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:38.905 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:38.906 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:38.906 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:38.903+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:38.907 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:38.907 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:38.907 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:39.005 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:39.001+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:39.038 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:39.039 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:39.053 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:39.106 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:39.103+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:39.207 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:39.205+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:39.218 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:39.218 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:39.232 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:39.309 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:39.307+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:39.396 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:39.396 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:39.410 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:39.411 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:39.407+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:39.510 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:39.507+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:39.543 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:39.543 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:39.557 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:39.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:39.643+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:39.712 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:39.709+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:39.721 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:39.721 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:39.735 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:39.814 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:39.809+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:39.897 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:39.897 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:39.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:39.914 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:39.911+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:40.015 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:40.013+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:40.042 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:40.043 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:40.059 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:40.146 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:40.145+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:40.217 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:40.213+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:40.226 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:40.226 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:40.242 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:40.334 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:40.333+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:40.409 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:40.410 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:40.419 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:40.417+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:40.424 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:40.521 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:40.517+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:40.557 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:40.557 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:40.566 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:23:40.571 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:40.622 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:40.621+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:40.686 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:40.686 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:40.700 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:40.748 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:40.747+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:40.818 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:40.819 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:40.824 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:40.819+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:40.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:40.908 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:40.925 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:40.921+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:40.966 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:40.966 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:40.981 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:41.026 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:41.023+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:41.048 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:41.069 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:41.069 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:41.086 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:41.086 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:41.089 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:41.090 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:41.127 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:41.125+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:41.136 INFO:tasks.workunit.client.0.smithi073.stderr:+ tar xzf ltp-full.tgz 2024-04-26T11:23:41.146 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:41.147 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:41.147 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:41.147 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:41.147 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:41.166 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:41.228 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:41.223+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:41.329 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:41.325+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:41.355 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 107.668148014, 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:41.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:41.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:41.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:41.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:41.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:41.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:41.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:41.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:41.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:41.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:41.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:41.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:41.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:41.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:41.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:41.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:41.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:41.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:41.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:41.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:41.364 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.364 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.365 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.365 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:41.365 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 107.668021619, 2024-04-26T11:23:41.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:41.365 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.366 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.366 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:41.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:41.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:41.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:41.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:41.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:41.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:41.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:41.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:41.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:41.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:41.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.372 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.373 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.373 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.373 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:41.373 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 107.667932826, 2024-04-26T11:23:41.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:41.373 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.373 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.373 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:41.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:41.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:41.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:41.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 107.667828013, 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:41.379 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:41.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:41.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 107.66777735700001, 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:41.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:41.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.390 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 107.66772040399999, 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:41.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:41.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 107.667661412, 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:41.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:41.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:41.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 107.667558406, 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:41.400 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:41.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:41.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:41.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:41.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:41.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:41.404 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 107.667482566, 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:41.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:41.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:41.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:41.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 107.647877558, 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:41.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:41.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 107.646865742, 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:41.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:41.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.21156833799999999, 2024-04-26T11:23:41.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.029900301000000001, 2024-04-26T11:23:41.418 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.418 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.418 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:41.418 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:41.418 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:41.418 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5 2024-04-26T11:23:41.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.418 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140105+0000", 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146164+0000", 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060589709999999998 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146195+0000", 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0618999999999999e-05 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146210+0000", 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4856e-05 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146386+0000", 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017677799999999999 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146752+0000", 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000366065 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.147102+0000", 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034963300000000002 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.167955+0000", 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020852956999999998 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169930+0000", 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001975325 2024-04-26T11:23:41.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169977+0000", 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7151999999999998e-05 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.170009+0000", 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1075000000000003e-05 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:10 4.19 4:992a6246:::10000000200.00000000:head [write 0~1162] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.20307007499999999, 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085791029999999994, 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 10 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148604+0000", 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148620+0000", 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5943e-05 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148652+0000", 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1628999999999998e-05 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148671+0000", 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9216e-05 2024-04-26T11:23:41.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148752+0000", 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1477000000000006e-05 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148856+0000", 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103849 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148968+0000", 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011183699999999999 2024-04-26T11:23:41.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153970+0000", 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050022210000000003 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156997+0000", 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00302718 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157118+0000", 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120847 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157186+0000", 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7323999999999994e-05 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.20214954700000001, 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013991071000000001, 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 11 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149525+0000", 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149536+0000", 2024-04-26T11:23:41.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0976e-05 2024-04-26T11:23:41.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149558+0000", 2024-04-26T11:23:41.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2096e-05 2024-04-26T11:23:41.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149586+0000", 2024-04-26T11:23:41.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7803000000000001e-05 2024-04-26T11:23:41.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149644+0000", 2024-04-26T11:23:41.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8371000000000001e-05 2024-04-26T11:23:41.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149741+0000", 2024-04-26T11:23:41.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6898000000000006e-05 2024-04-26T11:23:41.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:41.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149843+0000", 2024-04-26T11:23:41.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102252 2024-04-26T11:23:41.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157109+0000", 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007265245 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163241+0000", 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061323510000000003 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163417+0000", 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017638800000000001 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163518+0000", 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100717 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.436 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.20132069499999999, 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013385179000000001, 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 12 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150355+0000", 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150364+0000", 2024-04-26T11:23:41.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0939999999999997e-06 2024-04-26T11:23:41.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150379+0000", 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5156e-05 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150388+0000", 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8259999999999999e-06 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150427+0000", 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9366999999999998e-05 2024-04-26T11:23:41.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150532+0000", 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104666 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150671+0000", 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013879300000000001 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157773+0000", 2024-04-26T11:23:41.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071026140000000001 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163538+0000", 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649659999999998 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163650+0000", 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011216 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163741+0000", 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0810999999999995e-05 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.197906044, 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0103135, 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:41.443 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 15 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153767+0000", 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153794+0000", 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6706000000000001e-05 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153826+0000", 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2446000000000001e-05 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153846+0000", 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9349000000000001e-05 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153906+0000", 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0584999999999997e-05 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154046+0000", 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013916699999999999 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163766+0000", 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097205829999999997 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163880+0000", 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113757 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.164084+0000", 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000204193 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.447 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:16 4.7 4:e15a914f:::10000000207.00000000:head [write 0~1320] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.154638+0000", 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.197038343, 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075881830000000001, 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 16 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.448 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154638+0000", 2024-04-26T11:23:41.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154638+0000", 2024-04-26T11:23:41.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154637+0000", 2024-04-26T11:23:41.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154648+0000", 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1029000000000001e-05 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154670+0000", 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2237000000000001e-05 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154681+0000", 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1499e-05 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154733+0000", 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1490999999999999e-05 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154872+0000", 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013893400000000001 2024-04-26T11:23:41.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154998+0000", 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012585 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157693+0000", 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002695837 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.161988+0000", 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042948939999999996 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.162126+0000", 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000137136 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.162226+0000", 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010090300000000001 2024-04-26T11:23:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:18 4.2c 4:37389ade:::10000000209.00000000:head [write 0~2134] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.19506853399999999, 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0091208439999999995, 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 18 2024-04-26T11:23:41.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156605+0000", 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156623+0000", 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8556e-05 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156660+0000", 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6418999999999998e-05 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156679+0000", 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8946000000000001e-05 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156748+0000", 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9593999999999998e-05 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156891+0000", 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014316900000000001 2024-04-26T11:23:41.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165488+0000", 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085964319999999993 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165557+0000", 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9351999999999996e-05 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165729+0000", 2024-04-26T11:23:41.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017183899999999999 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:20 4.20 4:05552577:::1000000020b.00000000:head [write 0~1995] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.158589+0000", 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.19308774200000001, 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072526880000000002, 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:41.460 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 20 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.158589+0000", 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.158589+0000", 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.158587+0000", 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.158598+0000", 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.147e-05 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.158626+0000", 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7492999999999999e-05 2024-04-26T11:23:41.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.158638+0000", 2024-04-26T11:23:41.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1843e-05 2024-04-26T11:23:41.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.158709+0000", 2024-04-26T11:23:41.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0753999999999994e-05 2024-04-26T11:23:41.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.158884+0000", 2024-04-26T11:23:41.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017567099999999999 2024-04-26T11:23:41.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165532+0000", 2024-04-26T11:23:41.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066482499999999996 2024-04-26T11:23:41.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165656+0000", 2024-04-26T11:23:41.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012359599999999999 2024-04-26T11:23:41.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165842+0000", 2024-04-26T11:23:41.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018548100000000001 2024-04-26T11:23:41.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.466 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.467 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:145 4.16 4:696afb02:::1000000028a.00000000:head [write 0~55211] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:41.467 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.290402+0000", 2024-04-26T11:23:41.467 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.061274397000000001, 2024-04-26T11:23:41.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073289979999999998, 2024-04-26T11:23:41.467 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:41.468 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.468 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:41.468 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:41.468 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:41.468 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 145 2024-04-26T11:23:41.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.468 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:41.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:41.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290402+0000", 2024-04-26T11:23:41.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:41.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290402+0000", 2024-04-26T11:23:41.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:41.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:41.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290397+0000", 2024-04-26T11:23:41.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999948 2024-04-26T11:23:41.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:41.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290447+0000", 2024-04-26T11:23:41.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0368000000000003e-05 2024-04-26T11:23:41.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:41.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290467+0000", 2024-04-26T11:23:41.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0020000000000001e-05 2024-04-26T11:23:41.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290478+0000", 2024-04-26T11:23:41.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0946e-05 2024-04-26T11:23:41.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:41.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290557+0000", 2024-04-26T11:23:41.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8461000000000007e-05 2024-04-26T11:23:41.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:41.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290744+0000", 2024-04-26T11:23:41.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018713099999999999 2024-04-26T11:23:41.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:41.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.297405+0000", 2024-04-26T11:23:41.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006661569 2024-04-26T11:23:41.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:41.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.297528+0000", 2024-04-26T11:23:41.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000123046 2024-04-26T11:23:41.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:41.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:41.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:41.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.297731+0000", 2024-04-26T11:23:41.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000202924 2024-04-26T11:23:41.476 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.476 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.476 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.476 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:41.476 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:41.476 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:41.478 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:41.478 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:41.477+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:41.565 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-26T11:23:41.578 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:41.577+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:41.619 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.619 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:442 4.13 4:caa0e284:::100000003e2.00000000:head [write 0~41 in=41b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T11:23:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.617573+0000", 2024-04-26T11:23:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.001634538, 2024-04-26T11:23:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016749829999999999, 2024-04-26T11:23:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:41.620 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 442 2024-04-26T11:23:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.621 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.617573+0000", 2024-04-26T11:23:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.622 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.617573+0000", 2024-04-26T11:23:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:41.623 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.617572+0000", 2024-04-26T11:23:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.617580+0000", 2024-04-26T11:23:41.624 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8529999999999998e-06 2024-04-26T11:23:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.617598+0000", 2024-04-26T11:23:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8068999999999999e-05 2024-04-26T11:23:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.625 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.617611+0000", 2024-04-26T11:23:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2133000000000001e-05 2024-04-26T11:23:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.626 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.617692+0000", 2024-04-26T11:23:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1178000000000001e-05 2024-04-26T11:23:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:41.627 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.617924+0000", 2024-04-26T11:23:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000232062 2024-04-26T11:23:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-04-26T11:23:41.628 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-04-26T11:23:41.629 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:41.635 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:41.679 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:41.677+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:41.766 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:41.766 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:41.766 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:41.781 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:41.779+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:41.783 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:41.881 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:41.877+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:41.951 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.26655826, 2024-04-26T11:23:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.951 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:41.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:41.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:41.956 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.26562358699999, 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:41.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:41.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:41.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.961 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.265550471, 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:41.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:41.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:41.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:41.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.265499131, 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:41.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:41.969 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:41.970 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:41.971 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.265448862, 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.972 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.973 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:41.974 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:41.975 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:41.976 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.26539656200001, 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:41.977 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.978 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.979 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.980 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.981 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:41.982 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.265347026, 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.983 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.984 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.985 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:41.986 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.987 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.265280496, 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:41.988 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:41.989 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:41.990 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.264994621, 2024-04-26T11:23:41.991 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.992 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.993 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.994 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.263458947, 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:41.995 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:41.996 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:41.997 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.998 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.261588757, 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:41.999 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:42.000 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:42.001 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.002 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.261492645, 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.003 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.004 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.005 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:42.006 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.239457595, 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.007 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.008 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.009 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.010 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.239376523, 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.011 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.012 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.013 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.014 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.23921637399999, 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.015 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:42.016 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:42.017 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:42.018 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.239161814, 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:42.019 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.020 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.021 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.022 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 108.238446513, 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.023 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:42.024 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:42.025 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:42.026 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.81155274300000002, 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010637816, 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:42.027 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 6 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:42.028 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138323+0000", 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140749+0000", 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002425581 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140786+0000", 2024-04-26T11:23:42.029 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7218999999999997e-05 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140809+0000", 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3166000000000001e-05 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140921+0000", 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111109 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.141332+0000", 2024-04-26T11:23:42.030 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041137699999999999 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148635+0000", 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007302668 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148752+0000", 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117879 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:42.031 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148964+0000", 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021127299999999999 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4728.0:5 4.10 e56/16 4:09a4c37f:::10000000003.00000001:head v 56'1, mlcod=0'0)", 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.80243787300000002, 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02238656, 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.032 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147440+0000", 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.033 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154519+0000", 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007079442 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154556+0000", 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6217999999999998e-05 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154581+0000", 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5415999999999999e-05 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.034 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154710+0000", 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012871200000000001 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154759+0000", 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9568999999999999e-05 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169755+0000", 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014995982 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.035 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169827+0000", 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2053999999999998e-05 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:57 3.14 3:2e2fa760:::200.00000001:head [write 28971~994469 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.32574650599999999, 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091939129999999997, 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.036 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624130+0000", 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.037 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625748+0000", 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016182119999999999 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625777+0000", 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8979000000000002e-05 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625798+0000", 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0528999999999999e-05 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.038 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625915+0000", 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117613 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.626058+0000", 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014251199999999999 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.632946+0000", 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068882850000000001 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.039 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633095+0000", 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149192 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633326+0000", 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023091499999999999 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:42.040 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:42.042 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:42.042 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:42.039+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:42.142 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:42.139+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:42.183 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:42.183 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:42.183 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:42.183 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:42.199 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:42.246 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:42.245+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:42.330 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:42.330 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:42.330 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:42.330 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:42.331 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:42.345 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:42.341+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:42.347 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:42.431 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-26T11:23:42.431 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T11:23:42.431 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-04-26T11:23:42.432 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T11:23:42.432 INFO:teuthology.orchestra.console.smithi088:Power on 2024-04-26T11:23:42.432 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T11:23:42.446 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:42.443+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:42.457 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2024-04-26T11:23:42.457 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:23:42.482 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-04-26T11:23:42.522 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 108.834767703, 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 108.834641308, 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 108.834552515, 2024-04-26T11:23:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 108.83444770200001, 2024-04-26T11:23:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 108.83439704600001, 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 108.83434009299999, 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 108.834281101, 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 108.834178095, 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 108.834102255, 2024-04-26T11:23:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 108.81449724700001, 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 108.813485431, 2024-04-26T11:23:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.378188027, 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.029900301000000001, 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140105+0000", 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146164+0000", 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060589709999999998 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146195+0000", 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0618999999999999e-05 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146210+0000", 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4856e-05 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146386+0000", 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017677799999999999 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146752+0000", 2024-04-26T11:23:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000366065 2024-04-26T11:23:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.147102+0000", 2024-04-26T11:23:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034963300000000002 2024-04-26T11:23:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.167955+0000", 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020852956999999998 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169930+0000", 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001975325 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169977+0000", 2024-04-26T11:23:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7151999999999998e-05 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.170009+0000", 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1075000000000003e-05 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:10 4.19 4:992a6246:::10000000200.00000000:head [write 0~1162] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.3696897639999999, 2024-04-26T11:23:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085791029999999994, 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 10 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148604+0000", 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148620+0000", 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5943e-05 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148652+0000", 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1628999999999998e-05 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148671+0000", 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9216e-05 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148752+0000", 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1477000000000006e-05 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148856+0000", 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103849 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148968+0000", 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011183699999999999 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153970+0000", 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050022210000000003 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156997+0000", 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00302718 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157118+0000", 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120847 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157186+0000", 2024-04-26T11:23:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7323999999999994e-05 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.3687692359999999, 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013991071000000001, 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 11 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:42.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149525+0000", 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149536+0000", 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0976e-05 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149558+0000", 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2096e-05 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149586+0000", 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7803000000000001e-05 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149644+0000", 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8371000000000001e-05 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149741+0000", 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6898000000000006e-05 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149843+0000", 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102252 2024-04-26T11:23:42.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157109+0000", 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007265245 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163241+0000", 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061323510000000003 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163417+0000", 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017638800000000001 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163518+0000", 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100717 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.606 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:42.606 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:42.606 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.367940384, 2024-04-26T11:23:42.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013385179000000001, 2024-04-26T11:23:42.606 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.606 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.606 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:42.606 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:42.606 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:42.606 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 12 2024-04-26T11:23:42.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.607 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:42.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:42.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150355+0000", 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150364+0000", 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0939999999999997e-06 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150379+0000", 2024-04-26T11:23:42.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5156e-05 2024-04-26T11:23:42.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150388+0000", 2024-04-26T11:23:42.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8259999999999999e-06 2024-04-26T11:23:42.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150427+0000", 2024-04-26T11:23:42.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9366999999999998e-05 2024-04-26T11:23:42.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150532+0000", 2024-04-26T11:23:42.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104666 2024-04-26T11:23:42.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:42.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150671+0000", 2024-04-26T11:23:42.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013879300000000001 2024-04-26T11:23:42.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157773+0000", 2024-04-26T11:23:42.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071026140000000001 2024-04-26T11:23:42.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163538+0000", 2024-04-26T11:23:42.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649659999999998 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163650+0000", 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011216 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163741+0000", 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0810999999999995e-05 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.613 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.613 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:42.613 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:42.613 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.364525733, 2024-04-26T11:23:42.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0103135, 2024-04-26T11:23:42.613 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.613 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.613 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:42.613 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:42.614 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:42.614 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 15 2024-04-26T11:23:42.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.614 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:42.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:42.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153767+0000", 2024-04-26T11:23:42.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:42.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153794+0000", 2024-04-26T11:23:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6706000000000001e-05 2024-04-26T11:23:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153826+0000", 2024-04-26T11:23:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2446000000000001e-05 2024-04-26T11:23:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153846+0000", 2024-04-26T11:23:42.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9349000000000001e-05 2024-04-26T11:23:42.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153906+0000", 2024-04-26T11:23:42.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0584999999999997e-05 2024-04-26T11:23:42.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154046+0000", 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013916699999999999 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163766+0000", 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097205829999999997 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163880+0000", 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113757 2024-04-26T11:23:42.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.164084+0000", 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000204193 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:16 4.7 4:e15a914f:::10000000207.00000000:head [write 0~1320] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.154638+0000", 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.363658032, 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075881830000000001, 2024-04-26T11:23:42.619 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 16 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154638+0000", 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154638+0000", 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154637+0000", 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154648+0000", 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1029000000000001e-05 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154670+0000", 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2237000000000001e-05 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154681+0000", 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1499e-05 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154733+0000", 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1490999999999999e-05 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154872+0000", 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013893400000000001 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154998+0000", 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012585 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157693+0000", 2024-04-26T11:23:42.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002695837 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.161988+0000", 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042948939999999996 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.162126+0000", 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000137136 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.162226+0000", 2024-04-26T11:23:42.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010090300000000001 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:18 4.2c 4:37389ade:::10000000209.00000000:head [write 0~2134] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.361688223, 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0091208439999999995, 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:42.625 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 18 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156605+0000", 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156623+0000", 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8556e-05 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156660+0000", 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6418999999999998e-05 2024-04-26T11:23:42.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156679+0000", 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8946000000000001e-05 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156748+0000", 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9593999999999998e-05 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156891+0000", 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014316900000000001 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165488+0000", 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085964319999999993 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165557+0000", 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9351999999999996e-05 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165729+0000", 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017183899999999999 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:145 4.16 4:696afb02:::1000000028a.00000000:head [write 0~55211] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.290402+0000", 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.2278940860000001, 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073289979999999998, 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.630 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 145 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290402+0000", 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290402+0000", 2024-04-26T11:23:42.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290397+0000", 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999948 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290447+0000", 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0368000000000003e-05 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290467+0000", 2024-04-26T11:23:42.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0020000000000001e-05 2024-04-26T11:23:42.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290478+0000", 2024-04-26T11:23:42.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0946e-05 2024-04-26T11:23:42.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290557+0000", 2024-04-26T11:23:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8461000000000007e-05 2024-04-26T11:23:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290744+0000", 2024-04-26T11:23:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018713099999999999 2024-04-26T11:23:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.297405+0000", 2024-04-26T11:23:42.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006661569 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.297528+0000", 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000123046 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.297731+0000", 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000202924 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.635 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:242 4.9 4:91a6d67d:::100000002ef.00000000:head [write 0~17017] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.390760+0000", 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.1275363030000001, 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088250039999999991, 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:42.636 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 242 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390760+0000", 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390760+0000", 2024-04-26T11:23:42.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:42.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:42.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390759+0000", 2024-04-26T11:23:42.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:42.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:42.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390772+0000", 2024-04-26T11:23:42.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-04-26T11:23:42.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:42.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390778+0000", 2024-04-26T11:23:42.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5780000000000004e-06 2024-04-26T11:23:42.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:42.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390783+0000", 2024-04-26T11:23:42.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2189999999999998e-06 2024-04-26T11:23:42.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390811+0000", 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8747000000000001e-05 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390878+0000", 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6698000000000004e-05 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390948+0000", 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0222000000000006e-05 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.391756+0000", 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000807806 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.399536+0000", 2024-04-26T11:23:42.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077793719999999997 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.399565+0000", 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9269e-05 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.399585+0000", 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0157e-05 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.642 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.643 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.643 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:42.643 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:42.643 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:42.645 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:42.641+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:42.646 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:42.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:42.743+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:42.777 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:42.777 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:42.778 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:42.778 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:42.792 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:42.881 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:42.879+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:42.947 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:42.943+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:42.965 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:42.965 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:42.966 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:42.980 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:43.048 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:43.045+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:43.091 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:43.149 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:43.145+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:43.158 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:43.158 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:43.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:43.158 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.473465195, 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.159 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.160 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.161 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:43.162 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:43.163 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.472530522, 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.164 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.165 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.166 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.167 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.168 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.169 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:43.169 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:43.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.169 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.169 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.169 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.169 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.169 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:43.170 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:43.170 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.472457406, 2024-04-26T11:23:43.170 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:43.170 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.170 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.170 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.170 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.170 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.170 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.171 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.172 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:43.173 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.174 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.175 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.176 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:43.176 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:43.176 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.472406066, 2024-04-26T11:23:43.176 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:43.176 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.176 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.176 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.176 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.176 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.176 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:43.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:43.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:43.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:43.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:43.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:43.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:43.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:43.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:43.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:43.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:43.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:43.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:43.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:43.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:43.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:43.183 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.47235579700001, 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:43.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:43.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:43.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:43.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:43.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:43.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:43.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:43.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:43.189 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.189 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.190 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.190 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:43.190 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:43.190 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.472303497, 2024-04-26T11:23:43.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:43.190 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.190 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.190 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:43.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:43.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:43.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:43.195 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.47225396100001, 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:43.200 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.47218743099999, 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:43.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:43.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.47190155600001, 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:43.205 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.206 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:43.206 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:43.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:43.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:43.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:43.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:43.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:43.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:43.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:43.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:43.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:43.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:43.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:43.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:43.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:43.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:43.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:43.210 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.210 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.210 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.211 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:43.211 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:43.211 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.470365882, 2024-04-26T11:23:43.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:43.212 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.212 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:43.212 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:43.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:43.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:43.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:43.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:43.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:43.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:43.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:43.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:43.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:43.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:43.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:43.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:43.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:43.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.219 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.219 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.219 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:43.220 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:43.220 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.468495692, 2024-04-26T11:23:43.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:43.220 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.220 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.221 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:43.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:43.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:43.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:43.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:43.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:43.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:43.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:43.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:43.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:43.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:43.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.46839958, 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:43.227 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:43.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:43.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.44636453, 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:43.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:43.236 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.446283458, 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:43.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:43.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:43.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:43.241 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.241 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.241 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.242 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:43.242 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:43.242 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.446123309, 2024-04-26T11:23:43.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:43.242 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.242 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.243 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:43.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:43.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:43.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:43.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:43.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:43.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:43.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.247 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.44606874900001, 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:43.251 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 109.44535344800001, 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:43.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:43.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:43.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:43.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:43.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:43.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:43.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:43.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:43.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:43.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:43.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:43.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:43.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:43.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:43.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:43.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:43.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:43.260 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.260 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.260 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.260 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:43.260 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.0184596780000001, 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010637816, 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 6 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138323+0000", 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140749+0000", 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002425581 2024-04-26T11:23:43.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140786+0000", 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7218999999999997e-05 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140809+0000", 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3166000000000001e-05 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140921+0000", 2024-04-26T11:23:43.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111109 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.141332+0000", 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041137699999999999 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148635+0000", 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007302668 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148752+0000", 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117879 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148964+0000", 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021127299999999999 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4728.0:5 4.10 e56/16 4:09a4c37f:::10000000003.00000001:head v 56'1, mlcod=0'0)", 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 2.0093448079999998, 2024-04-26T11:23:43.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02238656, 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:43.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147440+0000", 2024-04-26T11:23:43.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:43.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154519+0000", 2024-04-26T11:23:43.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007079442 2024-04-26T11:23:43.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154556+0000", 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6217999999999998e-05 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154581+0000", 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5415999999999999e-05 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154710+0000", 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012871200000000001 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154759+0000", 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9568999999999999e-05 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169755+0000", 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014995982 2024-04-26T11:23:43.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169827+0000", 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2053999999999998e-05 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:57 3.14 3:2e2fa760:::200.00000001:head [write 28971~994469 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:43.270 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.5326534409999999, 2024-04-26T11:23:43.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091939129999999997, 2024-04-26T11:23:43.271 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:43.271 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:43.271 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:43.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:43.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:43.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:43.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:43.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:43.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:43.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624130+0000", 2024-04-26T11:23:43.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:43.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:43.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625748+0000", 2024-04-26T11:23:43.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016182119999999999 2024-04-26T11:23:43.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:43.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625777+0000", 2024-04-26T11:23:43.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8979000000000002e-05 2024-04-26T11:23:43.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:43.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625798+0000", 2024-04-26T11:23:43.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0528999999999999e-05 2024-04-26T11:23:43.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:43.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625915+0000", 2024-04-26T11:23:43.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117613 2024-04-26T11:23:43.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:43.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.626058+0000", 2024-04-26T11:23:43.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014251199999999999 2024-04-26T11:23:43.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:43.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.632946+0000", 2024-04-26T11:23:43.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068882850000000001 2024-04-26T11:23:43.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:43.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633095+0000", 2024-04-26T11:23:43.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149192 2024-04-26T11:23:43.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:43.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:43.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:43.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633326+0000", 2024-04-26T11:23:43.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023091499999999999 2024-04-26T11:23:43.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.280 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.281 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.281 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:43.281 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:43.281 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:43.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~17s 2024-04-26T11:23:43.283 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:43.284 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:43.285 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:43.286 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:43.286 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:43.287 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:43.279+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:43.287 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:43.288 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:43.288 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:43.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:43.383+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:43.420 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:43.421 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:43.436 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:43.484 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:43.481+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:43.570 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:43.571 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:43.584 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:43.586 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:43.583+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:43.586 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:23:43.686 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:43.685+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:43.778 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:43.778 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:43.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:43.783+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:43.792 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:43.888 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:43.885+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:43.928 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:43.929 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:43.943 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:43.990 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:43.985+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:44.073 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:44.073 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:44.088 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:44.091 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:44.089+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:44.192 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:44.189+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:44.209 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:44.209 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:44.225 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:44.292 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:44.291+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:44.365 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:44.365 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:44.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:44.426 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:44.425+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:44.494 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:44.493+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:44.521 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:44.521 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:44.536 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:44.583 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:23:44.596 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:44.591+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:44.696 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:44.693+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:44.706 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:44.706 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:44.722 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:44.799 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:44.795+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:44.860 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:44.860 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:44.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:44.900 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:44.897+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:45.001 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:44.997+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:45.050 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:45.051 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:45.065 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:45.117 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:45.115+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:45.201 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:45.202 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:45.206 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:45.203+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:45.217 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:45.289 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:45.305 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:45.303+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:45.368 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:45.368 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:45.388 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:45.433 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:45.434 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:45.433+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:45.456 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:45.456 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:45.475 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:45.475 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:45.478 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:45.478 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:45.506 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:45.503+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:45.522 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:45.522 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:45.522 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:45.523 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:45.523 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:45.538 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:45.622 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:45.621+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:45.708 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:45.706+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:45.709 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 112.022725963, 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:45.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:45.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:45.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:45.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:45.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:45.716 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 112.022599568, 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:45.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.721 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 112.022510775, 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:45.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:45.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:45.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:45.727 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.727 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.727 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.728 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:45.728 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:45.728 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 112.02240596199999, 2024-04-26T11:23:45.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:45.728 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.728 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.728 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:45.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:45.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.733 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 112.02235530599999, 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:45.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:45.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:45.738 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 112.022298353, 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:45.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:45.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:45.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.744 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:45.745 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:45.745 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 112.022239361, 2024-04-26T11:23:45.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:45.745 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.745 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:45.745 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.748 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 112.022136355, 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:45.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:45.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.752 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 112.02206051500001, 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:45.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.756 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 112.00245550699999, 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:45.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:45.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 112.00144369100001, 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.761 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.762 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5661462870000005, 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.029900301000000001, 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140105+0000", 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146164+0000", 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060589709999999998 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146195+0000", 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0618999999999999e-05 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146210+0000", 2024-04-26T11:23:45.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4856e-05 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146386+0000", 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017677799999999999 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146752+0000", 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000366065 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.147102+0000", 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034963300000000002 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.167955+0000", 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020852956999999998 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169930+0000", 2024-04-26T11:23:45.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001975325 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169977+0000", 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7151999999999998e-05 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.170009+0000", 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1075000000000003e-05 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:10 4.19 4:992a6246:::10000000200.00000000:head [write 0~1162] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5576480239999997, 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085791029999999994, 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 10 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148604+0000", 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:45.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148620+0000", 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5943e-05 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148652+0000", 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1628999999999998e-05 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148671+0000", 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9216e-05 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148752+0000", 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1477000000000006e-05 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148856+0000", 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103849 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148968+0000", 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011183699999999999 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153970+0000", 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050022210000000003 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156997+0000", 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00302718 2024-04-26T11:23:45.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157118+0000", 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120847 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157186+0000", 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7323999999999994e-05 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.777 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5567274959999997, 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013991071000000001, 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 11 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149525+0000", 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149536+0000", 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0976e-05 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149558+0000", 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2096e-05 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149586+0000", 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7803000000000001e-05 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149644+0000", 2024-04-26T11:23:45.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8371000000000001e-05 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149741+0000", 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6898000000000006e-05 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149843+0000", 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102252 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157109+0000", 2024-04-26T11:23:45.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007265245 2024-04-26T11:23:45.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163241+0000", 2024-04-26T11:23:45.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061323510000000003 2024-04-26T11:23:45.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163417+0000", 2024-04-26T11:23:45.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017638800000000001 2024-04-26T11:23:45.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163518+0000", 2024-04-26T11:23:45.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100717 2024-04-26T11:23:45.783 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.555898644, 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013385179000000001, 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 12 2024-04-26T11:23:45.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.785 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:45.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150355+0000", 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150364+0000", 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0939999999999997e-06 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150379+0000", 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5156e-05 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150388+0000", 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8259999999999999e-06 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150427+0000", 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9366999999999998e-05 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150532+0000", 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104666 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150671+0000", 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013879300000000001 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157773+0000", 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071026140000000001 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163538+0000", 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649659999999998 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163650+0000", 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011216 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163741+0000", 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0810999999999995e-05 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.789 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5524839930000001, 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0103135, 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 15 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.790 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153767+0000", 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153794+0000", 2024-04-26T11:23:45.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6706000000000001e-05 2024-04-26T11:23:45.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153826+0000", 2024-04-26T11:23:45.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2446000000000001e-05 2024-04-26T11:23:45.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153846+0000", 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9349000000000001e-05 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153906+0000", 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0584999999999997e-05 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154046+0000", 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013916699999999999 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163766+0000", 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097205829999999997 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163880+0000", 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113757 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.164084+0000", 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000204193 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.794 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:16 4.7 4:e15a914f:::10000000207.00000000:head [write 0~1320] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.154638+0000", 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5516162920000003, 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075881830000000001, 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:45.795 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 16 2024-04-26T11:23:45.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.796 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154638+0000", 2024-04-26T11:23:45.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154638+0000", 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154637+0000", 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154648+0000", 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1029000000000001e-05 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154670+0000", 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2237000000000001e-05 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154681+0000", 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1499e-05 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154733+0000", 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1490999999999999e-05 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154872+0000", 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013893400000000001 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154998+0000", 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012585 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157693+0000", 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002695837 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.161988+0000", 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042948939999999996 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.162126+0000", 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000137136 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.162226+0000", 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010090300000000001 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.800 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:18 4.2c 4:37389ade:::10000000209.00000000:head [write 0~2134] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5496464830000001, 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0091208439999999995, 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 18 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156605+0000", 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156623+0000", 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8556e-05 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156660+0000", 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6418999999999998e-05 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156679+0000", 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8946000000000001e-05 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156748+0000", 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9593999999999998e-05 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156891+0000", 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014316900000000001 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165488+0000", 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085964319999999993 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165557+0000", 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9351999999999996e-05 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165729+0000", 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017183899999999999 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:145 4.16 4:696afb02:::1000000028a.00000000:head [write 0~55211] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.290402+0000", 2024-04-26T11:23:45.805 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.4158523460000003, 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073289979999999998, 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 145 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290402+0000", 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290402+0000", 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290397+0000", 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999948 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290447+0000", 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0368000000000003e-05 2024-04-26T11:23:45.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290467+0000", 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0020000000000001e-05 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290478+0000", 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0946e-05 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290557+0000", 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8461000000000007e-05 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.290744+0000", 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018713099999999999 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.297405+0000", 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006661569 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.297528+0000", 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000123046 2024-04-26T11:23:45.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.297731+0000", 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000202924 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:242 4.9 4:91a6d67d:::100000002ef.00000000:head [write 0~17017] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.390760+0000", 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3154945629999997, 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088250039999999991, 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:45.810 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 242 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390760+0000", 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390760+0000", 2024-04-26T11:23:45.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390759+0000", 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390772+0000", 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:45.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390778+0000", 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5780000000000004e-06 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390783+0000", 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2189999999999998e-06 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390811+0000", 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8747000000000001e-05 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:45.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390878+0000", 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6698000000000004e-05 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390948+0000", 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0222000000000006e-05 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.391756+0000", 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000807806 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.399536+0000", 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077793719999999997 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.399565+0000", 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9269e-05 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.399585+0000", 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0157e-05 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.815 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.816 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:45.816 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:45.816 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:45.819 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:45.817+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:45.820 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:45.919 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:45.917+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:45.954 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:45.954 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:45.954 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:45.970 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:46.023 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:46.018+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:46.091 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:46.092 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:46.092 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:46.092 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:46.092 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:46.107 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:46.123 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:46.121+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:46.227 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:46.225+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:46.284 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:46.284 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:46.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:46.284 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:46.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.284 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.597590865, 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:46.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:46.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:46.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.596656192, 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.290 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:46.295 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.596583076, 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:46.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:46.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.596531736, 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:46.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:46.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.596481467, 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.311 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.596429167, 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:46.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:46.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.596379631, 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.317 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:46.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.322 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.59631310100001, 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:46.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:46.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:46.326 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.596027226, 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:46.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:46.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.59449155199999, 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:46.334 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.592621362, 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:46.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.59252524999999, 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:46.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:46.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.57049019999999, 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.343 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:46.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.347 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.57040912799999, 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:46.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.570248979, 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.352 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:46.356 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.570194419, 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:46.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.360 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 112.569479118, 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:46.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:46.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:46.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:46.364 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.1425853479999999, 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010637816, 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:46.365 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 6 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138323+0000", 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140749+0000", 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002425581 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140786+0000", 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7218999999999997e-05 2024-04-26T11:23:46.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140809+0000", 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3166000000000001e-05 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140921+0000", 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111109 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.141332+0000", 2024-04-26T11:23:46.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041137699999999999 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148635+0000", 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007302668 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148752+0000", 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117879 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148964+0000", 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021127299999999999 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4728.0:5 4.10 e56/16 4:09a4c37f:::10000000003.00000001:head v 56'1, mlcod=0'0)", 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.1334704779999996, 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02238656, 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147440+0000", 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154519+0000", 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007079442 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154556+0000", 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6217999999999998e-05 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154581+0000", 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5415999999999999e-05 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154710+0000", 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012871200000000001 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154759+0000", 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9568999999999999e-05 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169755+0000", 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014995982 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169827+0000", 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2053999999999998e-05 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:57 3.14 3:2e2fa760:::200.00000001:head [write 28971~994469 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.6567791109999996, 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091939129999999997, 2024-04-26T11:23:46.374 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:46.375 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624130+0000", 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625748+0000", 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016182119999999999 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625777+0000", 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8979000000000002e-05 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.376 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625798+0000", 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0528999999999999e-05 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625915+0000", 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117613 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.626058+0000", 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014251199999999999 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:46.377 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.632946+0000", 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068882850000000001 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633095+0000", 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149192 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633326+0000", 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023091499999999999 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.378 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:46.379 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:46.379 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:46.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:46.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:46.374+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:46.481 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:46.478+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:46.483 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T11:23:46.526 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:3420 4.9 4:90b0c49e:::100000010c4.00000000:head [write 0~3322 in=3322b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:46.524280+0000", 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.001921613, 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019624619999999999, 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 3420 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.527 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.524280+0000", 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.524280+0000", 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.524278+0000", 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:46.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.524291+0000", 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3337e-05 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.524314+0000", 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2279000000000001e-05 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.524327+0000", 2024-04-26T11:23:46.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3213e-05 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.524387+0000", 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9882e-05 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.524563+0000", 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017629500000000001 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:46.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.524747+0000", 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.525982+0000", 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0012347689999999999 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 1 2024-04-26T11:23:46.531 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:46.541 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:46.590 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:46.589+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:46.593 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-04-26T11:23:46.603 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:23:46.669 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:46.669 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:46.669 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:46.669 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:46.669 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:46.684 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:46.681+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:46.685 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:46.694 INFO:teuthology.orchestra.console.smithi088:Power on completed 2024-04-26T11:23:46.785 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:46.781+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:46.795 DEBUG:teuthology.orchestra.console.smithi088:Waiting for login prompt 2024-04-26T11:23:46.795 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi088 2024-04-26T11:23:46.870 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:46.871 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:46.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:46.871 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:46.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.871 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.871 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:46.871 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 113.182656365, 2024-04-26T11:23:46.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:46.871 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.871 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.871 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:46.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:46.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 113.18252997, 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.881 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 113.182441177, 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:46.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:46.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:46.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:46.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.888 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.888 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:46.888 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 113.18233636399999, 2024-04-26T11:23:46.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:46.888 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.888 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.888 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:46.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:46.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:46.893 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 113.18228570799999, 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:46.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:46.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:46.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:46.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:46.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:46.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:46.899 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.900 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.900 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.900 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.900 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:46.900 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 113.182228755, 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:46.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:46.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:46.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:46.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:46.905 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 113.182169763, 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:46.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:46.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:46.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 113.182066757, 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.910 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 113.18199091699999, 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.914 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:46.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:46.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:46.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 113.16238590899999, 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:46.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:46.922 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 113.16137409300001, 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:46.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.926 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7260766890000001, 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.029900301000000001, 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140105+0000", 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:46.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146164+0000", 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060589709999999998 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146195+0000", 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0618999999999999e-05 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146210+0000", 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4856e-05 2024-04-26T11:23:46.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146386+0000", 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017677799999999999 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146752+0000", 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000366065 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.147102+0000", 2024-04-26T11:23:46.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034963300000000002 2024-04-26T11:23:46.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.167955+0000", 2024-04-26T11:23:46.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020852956999999998 2024-04-26T11:23:46.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169930+0000", 2024-04-26T11:23:46.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001975325 2024-04-26T11:23:46.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169977+0000", 2024-04-26T11:23:46.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7151999999999998e-05 2024-04-26T11:23:46.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.170009+0000", 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1075000000000003e-05 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:10 4.19 4:992a6246:::10000000200.00000000:head [write 0~1162] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7175784260000002, 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085791029999999994, 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.933 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.934 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:46.934 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:46.934 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:46.934 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 10 2024-04-26T11:23:46.934 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.934 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.934 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.934 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.934 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:46.934 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.935 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.935 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.935 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148607+0000", 2024-04-26T11:23:46.935 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.935 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148604+0000", 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148620+0000", 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5943e-05 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148652+0000", 2024-04-26T11:23:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1628999999999998e-05 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148671+0000", 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9216e-05 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148752+0000", 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1477000000000006e-05 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.937 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148856+0000", 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103849 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.148968+0000", 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011183699999999999 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153970+0000", 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050022210000000003 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.938 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156997+0000", 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00302718 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157118+0000", 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000120847 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157186+0000", 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7323999999999994e-05 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.939 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7166578980000002, 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013991071000000001, 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 11 2024-04-26T11:23:46.940 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.941 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149525+0000", 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149536+0000", 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0976e-05 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149558+0000", 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2096e-05 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.942 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149586+0000", 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7803000000000001e-05 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149644+0000", 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8371000000000001e-05 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149741+0000", 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6898000000000006e-05 2024-04-26T11:23:46.943 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149843+0000", 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102252 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157109+0000", 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007265245 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163241+0000", 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061323510000000003 2024-04-26T11:23:46.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163417+0000", 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017638800000000001 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163518+0000", 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100717 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.945 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7158290459999996, 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013385179000000001, 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 12 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150355+0000", 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150364+0000", 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0939999999999997e-06 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150379+0000", 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5156e-05 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150388+0000", 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8259999999999999e-06 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150427+0000", 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9366999999999998e-05 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150532+0000", 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104666 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150671+0000", 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013879300000000001 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157773+0000", 2024-04-26T11:23:46.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071026140000000001 2024-04-26T11:23:46.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163538+0000", 2024-04-26T11:23:46.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649659999999998 2024-04-26T11:23:46.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163650+0000", 2024-04-26T11:23:46.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011216 2024-04-26T11:23:46.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163741+0000", 2024-04-26T11:23:46.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0810999999999995e-05 2024-04-26T11:23:46.951 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.951 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.952 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.952 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:46.952 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:46.952 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7124143949999997, 2024-04-26T11:23:46.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0103135, 2024-04-26T11:23:46.952 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.952 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.952 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:46.952 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 15 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153767+0000", 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153794+0000", 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6706000000000001e-05 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153826+0000", 2024-04-26T11:23:46.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2446000000000001e-05 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153846+0000", 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9349000000000001e-05 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153906+0000", 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0584999999999997e-05 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154046+0000", 2024-04-26T11:23:46.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013916699999999999 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163766+0000", 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097205829999999997 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163880+0000", 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113757 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.164084+0000", 2024-04-26T11:23:46.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000204193 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:18 4.2c 4:37389ade:::10000000209.00000000:head [write 0~2134] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7095768849999997, 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0091208439999999995, 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:46.957 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 18 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156605+0000", 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156623+0000", 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8556e-05 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156660+0000", 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6418999999999998e-05 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156679+0000", 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8946000000000001e-05 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156748+0000", 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9593999999999998e-05 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156891+0000", 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014316900000000001 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165488+0000", 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085964319999999993 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165557+0000", 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9351999999999996e-05 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165729+0000", 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017183899999999999 2024-04-26T11:23:46.961 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:242 4.9 4:91a6d67d:::100000002ef.00000000:head [write 0~17017] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.390760+0000", 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.4754249650000002, 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088250039999999991, 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 242 2024-04-26T11:23:46.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390760+0000", 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390760+0000", 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390759+0000", 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390772+0000", 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2696e-05 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390778+0000", 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5780000000000004e-06 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390783+0000", 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2189999999999998e-06 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390811+0000", 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8747000000000001e-05 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390878+0000", 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6698000000000004e-05 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.390948+0000", 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0222000000000006e-05 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.391756+0000", 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000807806 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.399536+0000", 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077793719999999997 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.399565+0000", 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9269e-05 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.399585+0000", 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0157e-05 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:3514 4.23 4:c4386ef4:::10000001124.00000000:head [write 0~1988] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:46.707155+0000", 2024-04-26T11:23:46.967 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.15902960499999999, 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0090366909999999995, 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 3514 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707155+0000", 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707155+0000", 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707154+0000", 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707165+0000", 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0858e-05 2024-04-26T11:23:46.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707182+0000", 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7025e-05 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707190+0000", 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707300+0000", 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000110164 2024-04-26T11:23:46.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707641+0000", 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034031300000000002 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.708001+0000", 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036053000000000002 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.709200+0000", 2024-04-26T11:23:46.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0011992229999999999 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.716141+0000", 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069400929999999996 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.716169+0000", 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8180000000000001e-05 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.716192+0000", 2024-04-26T11:23:46.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3329999999999999e-05 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:3522 4.21 4:855834a4:::1000000112d.00000000:head [write 0~1944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:46.719341+0000", 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.146844, 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095867039999999997, 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:46.973 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 3522 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719341+0000", 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719341+0000", 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719339+0000", 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719351+0000", 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2106000000000001e-05 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719381+0000", 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9802e-05 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719394+0000", 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3363999999999999e-05 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719438+0000", 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3921999999999997e-05 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719510+0000", 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2296e-05 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719582+0000", 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1585e-05 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.720344+0000", 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00076212000000000003 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.728708+0000", 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083634509999999992 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.728831+0000", 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000123394 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.728928+0000", 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6737000000000006e-05 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:46.978 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:46.980 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:46.981 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:46.974+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:47.081 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:47.077+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:47.129 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4728.0:3922 4.3b e58/41 4:dc26338a:::100000012ca.00000000:head v 58'71, mlcod=58'69)", 2024-04-26T11:23:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:47.127047+0000", 2024-04-26T11:23:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0021774849999999998, 2024-04-26T11:23:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002194479, 2024-04-26T11:23:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.129 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.127047+0000", 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.127047+0000", 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.127045+0000", 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.127063+0000", 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7532000000000001e-05 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.127089+0000", 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6398999999999999e-05 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.127102+0000", 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2622999999999999e-05 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.127172+0000", 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9827999999999996e-05 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.127210+0000", 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8389000000000001e-05 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:3924 4.32 4:4f817804:::100000012cc.00000000:head [write 0~1157 in=1157b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:23:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:47.128226+0000", 2024-04-26T11:23:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00099815199999999998, 2024-04-26T11:23:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001055835, 2024-04-26T11:23:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:47.133 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 3924 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128226+0000", 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128226+0000", 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128225+0000", 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128235+0000", 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0763e-05 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128257+0000", 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1223e-05 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128269+0000", 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2543e-05 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128370+0000", 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000100351 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128582+0000", 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021290600000000001 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4728.0:3923 4.3b e58/41 4:dd496ba5:::100000012cb.00000000:head v 58'72, mlcod=58'69)", 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:47.128280+0000", 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00094458400000000005, 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0010420780000000001, 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128280+0000", 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128280+0000", 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128278+0000", 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:47.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128317+0000", 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8448999999999997e-05 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128341+0000", 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4300000000000001e-05 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128354+0000", 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2619000000000001e-05 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128421+0000", 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7328000000000003e-05 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:47.128452+0000", 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.1359000000000002e-05 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.140 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-04-26T11:23:47.141 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 3 2024-04-26T11:23:47.141 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:47.146 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:47.192 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:47.190+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:47.279 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:47.280 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:47.280 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:47.283 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:47.278+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:47.297 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:47.388 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:47.386+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:47.469 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:47.469 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.782987288, 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:47.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.471 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:47.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:47.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.782052615, 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:47.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:47.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:47.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.481 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.781979499, 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.482 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:47.486 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.781928159, 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:47.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:47.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:47.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:47.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:47.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.78187789, 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.495 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:47.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:47.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:47.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:47.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:47.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:47.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:47.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:47.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:47.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.78182559, 2024-04-26T11:23:47.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.507 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:47.507 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:47.507 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.78177605400001, 2024-04-26T11:23:47.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:47.507 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.507 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.507 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:47.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:47.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.78170952400001, 2024-04-26T11:23:47.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.781423649, 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:47.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:47.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:47.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:47.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:47.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.77988797499999, 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:47.524 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.778017785, 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:47.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:47.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:47.528 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.77792167299999, 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:47.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:47.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:47.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.75588662299999, 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:47.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:47.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:47.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.537 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.537 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.75580555099999, 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:47.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:47.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:47.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:47.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:47.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:47.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:47.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:47.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:47.543 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.755645402, 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:47.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:47.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.755590842, 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:47.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:47.551 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 113.754875541, 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:47.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:47.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:47.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:47.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.556 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.3279817710000001, 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010637816, 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 6 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:47.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138323+0000", 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140749+0000", 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002425581 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140786+0000", 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7218999999999997e-05 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140809+0000", 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3166000000000001e-05 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140921+0000", 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111109 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.141332+0000", 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041137699999999999 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148635+0000", 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007302668 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148752+0000", 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117879 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148964+0000", 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021127299999999999 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.561 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4728.0:5 4.10 e56/16 4:09a4c37f:::10000000003.00000001:head v 56'1, mlcod=0'0)", 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.3188669009999998, 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02238656, 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147440+0000", 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154519+0000", 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007079442 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154556+0000", 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6217999999999998e-05 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154581+0000", 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5415999999999999e-05 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154710+0000", 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012871200000000001 2024-04-26T11:23:47.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154759+0000", 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9568999999999999e-05 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169755+0000", 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014995982 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169827+0000", 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2053999999999998e-05 2024-04-26T11:23:47.565 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:57 3.14 3:2e2fa760:::200.00000001:head [write 28971~994469 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.8421755339999999, 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091939129999999997, 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:47.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624130+0000", 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:47.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625748+0000", 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016182119999999999 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625777+0000", 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8979000000000002e-05 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625798+0000", 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0528999999999999e-05 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:47.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625915+0000", 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117613 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.626058+0000", 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014251199999999999 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.632946+0000", 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068882850000000001 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:47.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633095+0000", 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149192 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633326+0000", 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023091499999999999 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:47.570 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:47.571 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:47.573 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:47.573 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:47.570+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:47.597 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:23:47.673 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:47.670+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:47.710 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:47.712 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:47.712 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:47.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.712 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:4407 4.2e 4:77e625ba:::100000014d6.00000000:head [write 0~2541 in=2541b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:23:47.712 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:47.710686+0000", 2024-04-26T11:23:47.712 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0017445200000000001, 2024-04-26T11:23:47.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001760953, 2024-04-26T11:23:47.712 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:47.712 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:23:47.712 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:47.712 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 4407 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.710686+0000", 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.710686+0000", 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.710685+0000", 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.710691+0000", 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6439999999999997e-06 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.710702+0000", 2024-04-26T11:23:47.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0652000000000001e-05 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.710707+0000", 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5679999999999999e-06 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.710743+0000", 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5491000000000003e-05 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.710827+0000", 2024-04-26T11:23:47.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4215999999999995e-05 2024-04-26T11:23:47.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:47.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.710896+0000", 2024-04-26T11:23:47.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8740999999999998e-05 2024-04-26T11:23:47.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:47.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.711449+0000", 2024-04-26T11:23:47.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00055354299999999998 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:4408 4.39 4:9fbb53d1:::100000014d7.00000000:head [write 0~477 in=477b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:47.711750+0000", 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.00068106000000000004, 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074822500000000004, 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:47.717 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 4408 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.711750+0000", 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.711750+0000", 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.711749+0000", 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.711754+0000", 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9010000000000002e-06 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.711764+0000", 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7219999999999994e-06 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.711768+0000", 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8760000000000004e-06 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.711839+0000", 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0180999999999998e-05 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:47.711929+0000", 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0149999999999996e-05 2024-04-26T11:23:47.720 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:47.721 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:47.721 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:47.721 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:47.721 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-26T11:23:47.721 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 2 2024-04-26T11:23:47.721 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:47.727 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:47.734 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:47.734 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:47.753 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:47.753 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:47.756 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:47.756 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:47.774 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:47.770+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:47.857 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:47.857 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:47.873 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:47.874 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:47.873+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:47.975 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:47.970+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:48.003 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:48.003 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:48.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:48.076 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:48.074+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:48.158 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:48.158 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:48.173 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:48.177 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:48.173+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:48.277 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:48.274+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:48.346 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:48.347 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:48.361 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:48.379 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:48.377+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:48.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:48.478+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:48.534 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:48.535 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:48.549 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:48.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:48.590+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:48.683 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:48.678+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:48.684 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:48.684 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:48.699 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:48.783 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:48.778+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:48.817 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:48.817 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:48.833 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:48.884 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:48.881+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:48.957 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:48.958 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:48.973 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:49.020 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:49.018+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:49.087 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:49.085+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:49.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~23s 2024-04-26T11:23:49.105 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:49.105 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:49.120 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:49.188 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:49.185+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:49.290 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:49.289+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:49.296 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:49.296 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:49.310 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:49.391 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:49.389+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:49.428 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:49.428 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:49.443 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:49.494 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:49.490+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:49.580 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:49.580 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:49.595 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:49.596 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:49.593+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:49.622 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:23:49.696 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:49.690+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:49.757 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:49.775 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:49.775 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:49.791 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:49.838 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:49.837+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:49.887 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:49.898 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:49.893+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:49.914 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:49.915 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:49.933 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:49.934 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:49.936 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:49.936 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:49.938 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:49.939 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:49.951 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:49.999 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:49.997+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:50.087 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:50.087 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:50.087 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:50.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:50.094+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:50.107 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:50.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:50.198+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:50.289 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:50.289 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:50.289 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:50.289 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:50.289 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:50.303 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:50.298+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:50.306 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:50.404 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:50.401+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:50.487 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:50.487 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:50.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:50.487 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:50.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.487 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:50.487 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:50.487 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.799812151, 2024-04-26T11:23:50.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:50.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.492 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.79887747799999, 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:50.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:50.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:50.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:50.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:50.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:50.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:50.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:50.497 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.798804362, 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:50.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:50.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:50.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.798753022, 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:50.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:50.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:50.508 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.798702753, 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.79865045299999, 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:50.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:50.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.798600917, 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.798534387, 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:50.524 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:50.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:50.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.798248512, 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:50.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.796712838, 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:50.535 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.794842648, 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:50.539 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.79474653600001, 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:50.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:50.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.543 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:6 3.10 e17/15 3:0d82a743:::600.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.77271148600001, 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0088236819999999994, 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710421+0000", 2024-04-26T11:23:50.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710420+0000", 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710442+0000", 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2283e-05 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710462+0000", 2024-04-26T11:23:50.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0126e-05 2024-04-26T11:23:50.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710479+0000", 2024-04-26T11:23:50.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6473e-05 2024-04-26T11:23:50.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710577+0000", 2024-04-26T11:23:50.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.8172999999999997e-05 2024-04-26T11:23:50.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710626+0000", 2024-04-26T11:23:50.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9169999999999998e-05 2024-04-26T11:23:50.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719180+0000", 2024-04-26T11:23:50.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.008554351 2024-04-26T11:23:50.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719245+0000", 2024-04-26T11:23:50.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4286000000000001e-05 2024-04-26T11:23:50.551 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.551 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.551 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:18 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.77263041400001, 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087617930000000004, 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710502+0000", 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710501+0000", 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710510+0000", 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0429999999999996e-06 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710531+0000", 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0947000000000001e-05 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710543+0000", 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2197e-05 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711220+0000", 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00067693400000000002 2024-04-26T11:23:50.554 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711264+0000", 2024-04-26T11:23:50.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3452999999999999e-05 2024-04-26T11:23:50.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719196+0000", 2024-04-26T11:23:50.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079323659999999997 2024-04-26T11:23:50.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719264+0000", 2024-04-26T11:23:50.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7926e-05 2024-04-26T11:23:50.558 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.559 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.559 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.559 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:50.559 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:50.560 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.772470265, 2024-04-26T11:23:50.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:50.560 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.560 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.560 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:50.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:50.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:50.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:50.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:50.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:50.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:50.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:50.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:50.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:50.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:50.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:50.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:50.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:50.567 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.772415705, 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:50.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:50.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.571 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:50.572 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:50.572 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 116.771700404, 2024-04-26T11:23:50.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:50.572 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.572 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.572 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:50.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:50.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:50.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:50.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:50.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:50.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:50.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:50.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:50.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:50.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:50.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:50.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:50.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:50.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:50.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:50.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:50.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:50.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.579 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.579 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.580 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:50.580 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:50.580 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.3448066339999993, 2024-04-26T11:23:50.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010637816, 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 6 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:50.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138323+0000", 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140749+0000", 2024-04-26T11:23:50.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002425581 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140786+0000", 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7218999999999997e-05 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140809+0000", 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3166000000000001e-05 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140921+0000", 2024-04-26T11:23:50.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111109 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.141332+0000", 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041137699999999999 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148635+0000", 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007302668 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148752+0000", 2024-04-26T11:23:50.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117879 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148964+0000", 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021127299999999999 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4728.0:5 4.10 e56/16 4:09a4c37f:::10000000003.00000001:head v 56'1, mlcod=0'0)", 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 9.3356917639999999, 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02238656, 2024-04-26T11:23:50.585 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147440+0000", 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154519+0000", 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007079442 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154556+0000", 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6217999999999998e-05 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154581+0000", 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5415999999999999e-05 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154710+0000", 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012871200000000001 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154759+0000", 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9568999999999999e-05 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169755+0000", 2024-04-26T11:23:50.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014995982 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169827+0000", 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2053999999999998e-05 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:57 3.14 3:2e2fa760:::200.00000001:head [write 28971~994469 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8590003969999991, 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091939129999999997, 2024-04-26T11:23:50.589 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:50.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624130+0000", 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625748+0000", 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016182119999999999 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625777+0000", 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8979000000000002e-05 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625798+0000", 2024-04-26T11:23:50.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0528999999999999e-05 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625915+0000", 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117613 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.626058+0000", 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014251199999999999 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.632946+0000", 2024-04-26T11:23:50.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068882850000000001 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633095+0000", 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149192 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633326+0000", 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023091499999999999 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:50.593 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:50.595 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-26T11:23:50.595 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:50.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:50.590+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:50.696 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:50.693+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:50.732 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:50.732 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:50.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.732 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:6138 4.6 4:60322b16:::10000001c24.00000000:head [write 0~3335 in=3335b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:23:50.732 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:50.729033+0000", 2024-04-26T11:23:50.732 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0026985970000000001, 2024-04-26T11:23:50.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027526040000000001, 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 6138 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.729033+0000", 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.729033+0000", 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.729032+0000", 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.729038+0000", 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0560000000000001e-06 2024-04-26T11:23:50.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.729051+0000", 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2712e-05 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.729058+0000", 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0940000000000002e-06 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.729134+0000", 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5838000000000001e-05 2024-04-26T11:23:50.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.729433+0000", 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029904699999999998 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.729756+0000", 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032307199999999999 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.731009+0000", 2024-04-26T11:23:50.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0012527090000000001 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:6139 4.19 4:981f90a1:::10000001c25.00000000:head [write 0~18178 in=18178b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:50.730608+0000", 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0011242139999999999, 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001389267, 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:50.737 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 6139 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.730608+0000", 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.730608+0000", 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.730607+0000", 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.730622+0000", 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5031999999999999e-05 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.730636+0000", 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4337e-05 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.730644+0000", 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6799999999999993e-06 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.730740+0000", 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6843999999999996e-05 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.730905+0000", 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016502500000000001 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.731094+0000", 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018881200000000001 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:6140 4.38 4:1e64ac76:::10000001c26.00000000:head [write 0~2116 in=2116b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:50.731783+0000", 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4294967295.999949, 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033138999999999998, 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T11:23:50.741 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 6140 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.731783+0000", 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.731783+0000", 2024-04-26T11:23:50.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.731782+0000", 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.731787+0000", 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5280000000000003e-06 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.731799+0000", 2024-04-26T11:23:50.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1358e-05 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.731804+0000", 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8590000000000004e-06 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.731946+0000", 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014259 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(client.4728.0:6138 4.6 e60/41)", 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:50.732116+0000", 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4294967295.9996157, 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3837000000000004e-05, 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "queued for pg", 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.732116+0000", 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:50.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.732116+0000", 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.732114+0000", 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.732127+0000", 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.27e-05 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.732155+0000", 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7636000000000001e-05 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.732172+0000", 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7212999999999999e-05 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 4 2024-04-26T11:23:50.747 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:50.748 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:50.838 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:50.837+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:50.897 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:50.893+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:50.927 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:50.927 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:50.927 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:50.927 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:50.928 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:50.944 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:50.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:50.994+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:51.098 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:51.094+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:51.121 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:51.121 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:51.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:51.121 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 117.4361547, 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:51.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:51.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:51.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:51.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:51.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:51.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:51.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 117.43602830499999, 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 117.435939512, 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 117.435834699, 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 117.435784043, 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 117.43572709, 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 117.43566809799999, 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.158 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 117.435565092, 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:51.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:51.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:51.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:51.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 117.435489252, 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.163 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:51.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:51.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 117.415884244, 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:51.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:51.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:51.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 117.414872428, 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:51.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:51.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.9795750240000007, 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.029900301000000001, 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:51.175 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140105+0000", 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146164+0000", 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060589709999999998 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146195+0000", 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0618999999999999e-05 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146210+0000", 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4856e-05 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146386+0000", 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017677799999999999 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146752+0000", 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000366065 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.147102+0000", 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034963300000000002 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.167955+0000", 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020852956999999998 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169930+0000", 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001975325 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169977+0000", 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7151999999999998e-05 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.170009+0000", 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1075000000000003e-05 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:51.180 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.9701562330000009, 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013991071000000001, 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 11 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149525+0000", 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149536+0000", 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0976e-05 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149558+0000", 2024-04-26T11:23:51.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2096e-05 2024-04-26T11:23:51.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149586+0000", 2024-04-26T11:23:51.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7803000000000001e-05 2024-04-26T11:23:51.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149644+0000", 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8371000000000001e-05 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149741+0000", 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6898000000000006e-05 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149843+0000", 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102252 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157109+0000", 2024-04-26T11:23:51.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007265245 2024-04-26T11:23:51.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163241+0000", 2024-04-26T11:23:51.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061323510000000003 2024-04-26T11:23:51.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163417+0000", 2024-04-26T11:23:51.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017638800000000001 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163518+0000", 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100717 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:51.186 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.9693273809999994, 2024-04-26T11:23:51.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013385179000000001, 2024-04-26T11:23:51.187 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.187 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.187 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:51.187 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:51.187 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:51.187 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 12 2024-04-26T11:23:51.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.187 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150355+0000", 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150364+0000", 2024-04-26T11:23:51.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0939999999999997e-06 2024-04-26T11:23:51.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150379+0000", 2024-04-26T11:23:51.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5156e-05 2024-04-26T11:23:51.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150388+0000", 2024-04-26T11:23:51.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8259999999999999e-06 2024-04-26T11:23:51.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150427+0000", 2024-04-26T11:23:51.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9366999999999998e-05 2024-04-26T11:23:51.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150532+0000", 2024-04-26T11:23:51.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104666 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150671+0000", 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013879300000000001 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157773+0000", 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071026140000000001 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163538+0000", 2024-04-26T11:23:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649659999999998 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163650+0000", 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011216 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163741+0000", 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0810999999999995e-05 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.9659127299999994, 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0103135, 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 15 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153767+0000", 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153794+0000", 2024-04-26T11:23:51.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6706000000000001e-05 2024-04-26T11:23:51.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153826+0000", 2024-04-26T11:23:51.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2446000000000001e-05 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153846+0000", 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9349000000000001e-05 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153906+0000", 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0584999999999997e-05 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154046+0000", 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013916699999999999 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163766+0000", 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097205829999999997 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163880+0000", 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113757 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.164084+0000", 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000204193 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:18 4.2c 4:37389ade:::10000000209.00000000:head [write 0~2134] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.9630752200000003, 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0091208439999999995, 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:51.199 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 18 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156608+0000", 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156605+0000", 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156623+0000", 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8556e-05 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156660+0000", 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6418999999999998e-05 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156679+0000", 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8946000000000001e-05 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156748+0000", 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9593999999999998e-05 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.156891+0000", 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014316900000000001 2024-04-26T11:23:51.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165488+0000", 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085964319999999993 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165557+0000", 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9351999999999996e-05 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.165729+0000", 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017183899999999999 2024-04-26T11:23:51.203 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:3514 4.23 4:c4386ef4:::10000001124.00000000:head [write 0~1988] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:46.707155+0000", 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.4125279400000004, 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0090366909999999995, 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 3514 2024-04-26T11:23:51.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.205 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707155+0000", 2024-04-26T11:23:51.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707155+0000", 2024-04-26T11:23:51.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707154+0000", 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707165+0000", 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0858e-05 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707182+0000", 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7025e-05 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707190+0000", 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1599999999999998e-06 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707300+0000", 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000110164 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.707641+0000", 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034031300000000002 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:51.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.708001+0000", 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036053000000000002 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.709200+0000", 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0011992229999999999 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.716141+0000", 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069400929999999996 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.716169+0000", 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8180000000000001e-05 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.716192+0000", 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3329999999999999e-05 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:3522 4.21 4:855834a4:::1000000112d.00000000:head [write 0~1944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:46.719341+0000", 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.4003423350000004, 2024-04-26T11:23:51.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095867039999999997, 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 3522 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719341+0000", 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719341+0000", 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719339+0000", 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719351+0000", 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2106000000000001e-05 2024-04-26T11:23:51.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719381+0000", 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9802e-05 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719394+0000", 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3363999999999999e-05 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719438+0000", 2024-04-26T11:23:51.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3921999999999997e-05 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719510+0000", 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2296e-05 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719582+0000", 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1585e-05 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.720344+0000", 2024-04-26T11:23:51.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00076212000000000003 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.728708+0000", 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083634509999999992 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.728831+0000", 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000123394 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.728928+0000", 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6737000000000006e-05 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5628 4.37 4:ef3ee724:::100000019ea.00000000:head [write 0~166] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:50.014795+0000", 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.1048886019999999, 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0092079420000000002, 2024-04-26T11:23:51.216 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5628 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014795+0000", 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014795+0000", 2024-04-26T11:23:51.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014794+0000", 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014799+0000", 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6999999999999999e-06 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014823+0000", 2024-04-26T11:23:51.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4712e-05 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014833+0000", 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8980000000000008e-06 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014896+0000", 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3146999999999997e-05 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.015047+0000", 2024-04-26T11:23:51.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015047899999999999 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.015248+0000", 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020151300000000001 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.016838+0000", 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001589739 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.023793+0000", 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069547469999999998 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.023922+0000", 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000129407 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.024003+0000", 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0303999999999996e-05 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5945 4.19 4:9b29ec74:::10000001b49.00000000:head [write 0~845] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:50.451317+0000", 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.66836646899999996, 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0096191420000000007, 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5945 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:51.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451317+0000", 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451317+0000", 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451315+0000", 2024-04-26T11:23:51.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:51.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:51.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451328+0000", 2024-04-26T11:23:51.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3319000000000001e-05 2024-04-26T11:23:51.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:51.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451359+0000", 2024-04-26T11:23:51.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1640000000000002e-05 2024-04-26T11:23:51.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451374+0000", 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4423000000000001e-05 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451495+0000", 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121587 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451743+0000", 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024781 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:51.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.452075+0000", 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000331439 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.454306+0000", 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022316649999999999 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.460702+0000", 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063958549999999998 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:51.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.460819+0000", 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000116277 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.460936+0000", 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000117407 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:51.229 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:51.231 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:51.229+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:51.231 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:51.334 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:51.330+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:51.368 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:51.368 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:51.368 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:51.383 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:51.468 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:51.466+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:51.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:51.534+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:51.550 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:51.550 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:51.550 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:51.551 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:51.551 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:51.567 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:51.640 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:51.637+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:51.737 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:51.738 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:51.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:51.738 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:51.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.738 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.738 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:51.738 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.051483171, 2024-04-26T11:23:51.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.025221472000000002, 2024-04-26T11:23:51.738 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.738 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.738 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683320+0000", 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683317+0000", 2024-04-26T11:23:51.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683438+0000", 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000120683 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.683654+0000", 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021609799999999999 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:51.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00057243599999999995 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.690771+0000", 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065446769999999996 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691107+0000", 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000335543 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.691423+0000", 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00031645499999999999 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702359+0000", 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010935532 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708331+0000", 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059721499999999999 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708439+0000", 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107859 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708542+0000", 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103169 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.743 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.050548498, 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036616914, 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684255+0000", 2024-04-26T11:23:51.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684253+0000", 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684266+0000", 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2996999999999999e-05 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684289+0000", 2024-04-26T11:23:51.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2880000000000001e-05 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684312+0000", 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2819999999999998e-05 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698720+0000", 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014408384999999999 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.698942+0000", 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000221692 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699968+0000", 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001026162 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702515+0000", 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0025466809999999999 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720747+0000", 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018231911999999999 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720813+0000", 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6619999999999996e-05 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720872+0000", 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8561999999999999e-05 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.748 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.050475382, 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036732570999999999, 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684328+0000", 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684327+0000", 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684336+0000", 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7960000000000001e-06 2024-04-26T11:23:51.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684354+0000", 2024-04-26T11:23:51.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7597000000000001e-05 2024-04-26T11:23:51.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684368+0000", 2024-04-26T11:23:51.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4166e-05 2024-04-26T11:23:51.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699031+0000", 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014663783999999999 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699994+0000", 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000962739 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700267+0000", 2024-04-26T11:23:51.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00027256099999999999 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.702522+0000", 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022553600000000001 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720880+0000", 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.018358223999999999 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720973+0000", 2024-04-26T11:23:51.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2398999999999994e-05 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721061+0000", 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8051000000000001e-05 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.050424042, 2024-04-26T11:23:51.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036950332000000002, 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684380+0000", 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684378+0000", 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684386+0000", 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684403+0000", 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7056999999999999e-05 2024-04-26T11:23:51.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684416+0000", 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.364e-05 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700972+0000", 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016555349 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701134+0000", 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016237200000000001 2024-04-26T11:23:51.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701361+0000", 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000227221 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703298+0000", 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0019366730000000001 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721200+0000", 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017902267999999999 2024-04-26T11:23:51.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721277+0000", 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6428999999999996e-05 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721330+0000", 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3146999999999998e-05 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.759 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.050373773, 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024344919999999999, 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684430+0000", 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684429+0000", 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684435+0000", 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6069999999999996e-06 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684455+0000", 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9666000000000001e-05 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684468+0000", 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3414000000000001e-05 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693184+0000", 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087152789999999994 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693350+0000", 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016597899999999999 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.693534+0000", 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018400799999999999 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700045+0000", 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0065111700000000002 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708568+0000", 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0085228209999999999 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708679+0000", 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111179 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708775+0000", 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5989999999999994e-05 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.050321473, 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.024720009000000001, 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684482+0000", 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684481+0000", 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684488+0000", 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:23:51.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684507+0000", 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8763e-05 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684520+0000", 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3529999999999999e-05 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694203+0000", 2024-04-26T11:23:51.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0096827119999999996 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.694820+0000", 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00061700199999999996 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695337+0000", 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00051679899999999997 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:51.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700310+0000", 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0049732650000000002 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708973+0000", 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0086628069999999998 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709087+0000", 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114509 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.709202+0000", 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000114935 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.05027193700001, 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.036825204, 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684532+0000", 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684531+0000", 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684538+0000", 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1459999999999999e-06 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684555+0000", 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7050000000000001e-05 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684572+0000", 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.753e-05 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700933+0000", 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.016360471000000001 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701249+0000", 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000316297 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.701573+0000", 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00032430499999999999 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.703317+0000", 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017437360000000001 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721177+0000", 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017859682000000002 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721271+0000", 2024-04-26T11:23:51.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3725000000000001e-05 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721357+0000", 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6365000000000004e-05 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.05020540700001, 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023922981999999999, 2024-04-26T11:23:51.775 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684598+0000", 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684597+0000", 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684603+0000", 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.8200000000000002e-06 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684620+0000", 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7047000000000001e-05 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684637+0000", 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7312999999999998e-05 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685241+0000", 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00060398500000000003 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686026+0000", 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00078443800000000004 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.708521+0000", 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.022495586000000001 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.049919532, 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.028975121999999999, 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.779 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684884+0000", 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.684902+0000", 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9323000000000001e-05 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685143+0000", 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024044499999999999 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685191+0000", 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8396000000000002e-05 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.685670+0000", 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047894399999999997 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.687517+0000", 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0018472790000000001 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713859+0000", 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.026341959000000002 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "pg_update_log_missing(3.1e epoch 17/15 rep_tid 2 entries 17'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.04838385799999, 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.013554985, 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "reached pg", 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686420+0000", 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686419+0000", 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.686434+0000", 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.519e-05 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688042+0000", 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016075709999999999 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688082+0000", 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9983e-05 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.785 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.692861+0000", 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0047788429999999996 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.699975+0000", 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071139439999999996 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:24 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:51.786 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.046513668, 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012218517999999999, 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688290+0000", 2024-04-26T11:23:51.787 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688289+0000", 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688302+0000", 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3314e-05 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688332+0000", 2024-04-26T11:23:51.788 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0429e-05 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688372+0000", 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9520000000000001e-05 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695026+0000", 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0066538919999999998 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.789 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.695072+0000", 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5652000000000003e-05 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700437+0000", 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0053652659999999996 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700508+0000", 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.1638999999999996e-05 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.790 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:25 3.7 e17/15 3:e0b41d06:::609.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.04641755599999, 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.012187329, 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.791 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688386+0000", 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688385+0000", 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688405+0000", 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9564000000000001e-05 2024-04-26T11:23:51.792 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688422+0000", 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7153e-05 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.688435+0000", 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2850000000000001e-05 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696107+0000", 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007672117 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.793 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.696157+0000", 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0210000000000002e-05 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700518+0000", 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043605290000000001 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.700573+0000", 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5803000000000001e-05 2024-04-26T11:23:51.794 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:31 3.d e17/15 3:b50e409b:::mds_snaptable:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.024141285, 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0097118819999999998, 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.795 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710662+0000", 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710661+0000", 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.796 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710670+0000", 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.0769999999999997e-06 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710695+0000", 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.4312999999999999e-05 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710706+0000", 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0993e-05 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.797 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711955+0000", 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012493999999999999 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711996+0000", 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.108e-05 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720337+0000", 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0083405920000000008 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.798 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720374+0000", 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7360000000000001e-05 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:19 3.14 e17/15 3:2f55791f:::606.00000000:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.024086725, 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0093219879999999998, 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.799 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710717+0000", 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710716+0000", 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.800 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710733+0000", 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6436999999999999e-05 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710750+0000", 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7122999999999999e-05 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.710766+0000", 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6143000000000001e-05 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.801 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712376+0000", 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001610411 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712814+0000", 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00043801300000000001 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.719970+0000", 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071558350000000001 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.802 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.720039+0000", 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8670000000000005e-05 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:8 3.10 e17/15 3:09401a81:::601.00000000:head v 17'3, mlcod=0'0)", 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 118.023371424, 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010140128999999999, 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711432+0000", 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.711418+0000", 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999862 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712949+0000", 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.001530815 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.712972+0000", 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2456e-05 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713015+0000", 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3380000000000001e-05 2024-04-26T11:23:51.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713611+0000", 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00059559499999999998 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.713659+0000", 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8353999999999998e-05 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721468+0000", 2024-04-26T11:23:51.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078089730000000003 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:21:53.721572+0000", 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000104326 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:6 4.13 4:cbe72331:::10000000003.00000002:head [write 0~2368419] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.596477653999999, 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.010637816, 2024-04-26T11:23:51.807 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 6 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138326+0000", 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.138323+0000", 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140749+0000", 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.002425581 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140786+0000", 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7218999999999997e-05 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140809+0000", 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3166000000000001e-05 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.140921+0000", 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111109 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.141332+0000", 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041137699999999999 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148635+0000", 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007302668 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148752+0000", 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117879 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.148964+0000", 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021127299999999999 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4728.0:5 4.10 e56/16 4:09a4c37f:::10000000003.00000001:head v 56'1, mlcod=0'0)", 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.587362784, 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.02238656, 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.812 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147441+0000", 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.147440+0000", 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154519+0000", 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.007079442 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154556+0000", 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6217999999999998e-05 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154581+0000", 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5415999999999999e-05 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154710+0000", 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012871200000000001 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.154759+0000", 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9568999999999999e-05 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169755+0000", 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.014995982 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.169827+0000", 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2053999999999998e-05 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.816 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:57 3.14 3:2e2fa760:::200.00000001:head [write 28971~994469 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e57)", 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 10.110671417000001, 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0091939129999999997, 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624132+0000", 2024-04-26T11:23:51.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.624130+0000", 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625748+0000", 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0016182119999999999 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625777+0000", 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8979000000000002e-05 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625798+0000", 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0528999999999999e-05 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.625915+0000", 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000117613 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.626058+0000", 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014251199999999999 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.632946+0000", 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068882850000000001 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633095+0000", 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000149192 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:41.633326+0000", 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023091499999999999 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:6389 4.3d 4:bee789d0:::10000001d3e.00000000:head [write 0~455] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:51.053949+0000", 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.68085478799999999, 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0092842849999999998, 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:51.821 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 6389 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.053949+0000", 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.053949+0000", 2024-04-26T11:23:51.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.053947+0000", 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.053959+0000", 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.185e-05 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.053991+0000", 2024-04-26T11:23:51.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2529e-05 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.054007+0000", 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5566999999999999e-05 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.054144+0000", 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000136866 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.054526+0000", 2024-04-26T11:23:51.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00038245 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.062952+0000", 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084258110000000001 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.063089+0000", 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013645700000000001 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.063233+0000", 2024-04-26T11:23:51.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000144592 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(mds.0.3:151 3.1a e60/41 3:5e41ab69:::200.00000005:head v 60'2, mlcod=0'0)", 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:51.107796+0000", 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.62700771300000002, 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.023035744, 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.107796+0000", 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.107796+0000", 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.107794+0000", 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.827 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.113223+0000", 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054283250000000003 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.113249+0000", 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.6380000000000002e-05 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.113262+0000", 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2738999999999999e-05 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.113340+0000", 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7834000000000001e-05 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.113374+0000", 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3926e-05 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.130743+0000", 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.017369539 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:51.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:51.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:51.130832+0000", 2024-04-26T11:23:51.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8528000000000003e-05 2024-04-26T11:23:51.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.830 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.830 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:51.830 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:51.830 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:51.832 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:51.832 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:51.826+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:51.933 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:51.929+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:51.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:51.970 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:51.971 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:51.971 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:23:51.971 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:51.985 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:52.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:52.030+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:52.085 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:52.108 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:52.108 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:52.130 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:52.131 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:52.133 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:52.133 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:52.135 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:52.133+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:52.167 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:52.167 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:52.182 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:52.274 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:52.273+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:52.336 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:52.333+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:52.355 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:52.355 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:52.367 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:52.437 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:52.433+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:52.505 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:52.634 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:52.635 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:23:52.636 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:52.637 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:52.630+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:52.737 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:52.733+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:52.811 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:52.811 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:52.827 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:52.838 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:52.833+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:52.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:52.934+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:52.955 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:52.955 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:52.971 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:53.040 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:53.038+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:53.110 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:53.111 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:53.127 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:53.141 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:53.138+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:53.242 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:53.237+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:53.271 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:53.271 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:53.290 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:53.378 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:53.377+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:53.443 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:53.438+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:53.467 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:53.467 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:53.483 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:53.544 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:53.541+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:53.614 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:53.614 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:53.630 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:53.632 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-26T11:23:53.645 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:53.641+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:53.745 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:53.742+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:53.759 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:53.774 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:53.847 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:53.845+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:53.947 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:53.947 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:53.948 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:53.945+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:53.963 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:54.051 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:54.049+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:54.098 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:54.098 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:54.113 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:54.134 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:54.151 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:54.146+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:54.252 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:54.250+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:54.267 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:54.283 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:54.284 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:54.293 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:54.293 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:54.299 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:54.313 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:54.313 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:54.315 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:54.316 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:54.353 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:54.350+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:54.447 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 120.76070855499999, 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:54.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:54.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 120.76058216, 2024-04-26T11:23:54.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:54.454 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.454 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.454 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:54.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:54.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:54.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:54.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:54.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:54.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:54.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:54.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 120.760493367, 2024-04-26T11:23:54.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:54.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:54.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 120.760388554, 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:54.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:54.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 120.760337898, 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 120.76028094500001, 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.476 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:54.481 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 120.760221953, 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:54.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:54.485 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 120.760118947, 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:54.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:54.489 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 120.760043107, 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:54.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:27 3.13 e17/15 3:cd5a64a3:::100.00000000:head v 17'1, mlcod=0'0)", 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:54.493 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 120.740438099, 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010640741, 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703799+0000", 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703798+0000", 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703832+0000", 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4226000000000001e-05 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703849+0000", 2024-04-26T11:23:54.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6650000000000002e-05 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.703865+0000", 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.641e-05 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705375+0000", 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001509102 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705423+0000", 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8829000000000003e-05 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714369+0000", 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089457749999999996 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714440+0000", 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0615000000000001e-05 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.497 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop(mds.0.3:28 3.13 e17/15 3:c91d4a1d:::mds0_inotable:head v 17'2, mlcod=0'0)", 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 120.739426283, 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010513649, 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704811+0000", 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704810+0000", 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704836+0000", 2024-04-26T11:23:54.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6766000000000001e-05 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704861+0000", 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4719000000000002e-05 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.704880+0000", 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9046999999999999e-05 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707589+0000", 2024-04-26T11:23:54.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027091160000000001 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707672+0000", 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.276e-05 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715256+0000", 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075840040000000001 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.715324+0000", 2024-04-26T11:23:54.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8453000000000003e-05 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.304128879, 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.029900301000000001, 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:54.502 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:54.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140105+0000", 2024-04-26T11:23:54.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:54.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146164+0000", 2024-04-26T11:23:54.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060589709999999998 2024-04-26T11:23:54.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146195+0000", 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0618999999999999e-05 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146210+0000", 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4856e-05 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146386+0000", 2024-04-26T11:23:54.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017677799999999999 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146752+0000", 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000366065 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.147102+0000", 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034963300000000002 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.167955+0000", 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020852956999999998 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169930+0000", 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001975325 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169977+0000", 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7151999999999998e-05 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.170009+0000", 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1075000000000003e-05 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.294710088, 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013991071000000001, 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:54.508 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 11 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149525+0000", 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149536+0000", 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0976e-05 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149558+0000", 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2096e-05 2024-04-26T11:23:54.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149586+0000", 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7803000000000001e-05 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149644+0000", 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8371000000000001e-05 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149741+0000", 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6898000000000006e-05 2024-04-26T11:23:54.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149843+0000", 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102252 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157109+0000", 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007265245 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163241+0000", 2024-04-26T11:23:54.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061323510000000003 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163417+0000", 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017638800000000001 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163518+0000", 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100717 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.293881236000001, 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013385179000000001, 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 12 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150355+0000", 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150364+0000", 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0939999999999997e-06 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150379+0000", 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5156e-05 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150388+0000", 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8259999999999999e-06 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150427+0000", 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9366999999999998e-05 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150532+0000", 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104666 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150671+0000", 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013879300000000001 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157773+0000", 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071026140000000001 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163538+0000", 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649659999999998 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163650+0000", 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011216 2024-04-26T11:23:54.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163741+0000", 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0810999999999995e-05 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:15 4.0 4:012cdbc7:::10000000206.00000000:head [write 0~4391] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.290466585000001, 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0103135, 2024-04-26T11:23:54.519 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 15 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153771+0000", 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153767+0000", 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153794+0000", 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6706000000000001e-05 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153826+0000", 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2446000000000001e-05 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153846+0000", 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9349000000000001e-05 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.153906+0000", 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0584999999999997e-05 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.154046+0000", 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013916699999999999 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163766+0000", 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097205829999999997 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163880+0000", 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113757 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.164084+0000", 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000204193 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:3522 4.21 4:855834a4:::1000000112d.00000000:head [write 0~1944] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:46.719341+0000", 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.7248961899999999, 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095867039999999997, 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.524 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 3522 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719341+0000", 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719341+0000", 2024-04-26T11:23:54.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719339+0000", 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719351+0000", 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2106000000000001e-05 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719381+0000", 2024-04-26T11:23:54.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9802e-05 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719394+0000", 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3363999999999999e-05 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719438+0000", 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3921999999999997e-05 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719510+0000", 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2296e-05 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.719582+0000", 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1585e-05 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.720344+0000", 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00076212000000000003 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.728708+0000", 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083634509999999992 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.728831+0000", 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000123394 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:46.728928+0000", 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6737000000000006e-05 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5628 4.37 4:ef3ee724:::100000019ea.00000000:head [write 0~166] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:50.014795+0000", 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.4294424570000004, 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0092079420000000002, 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5628 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.530 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014795+0000", 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014795+0000", 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014794+0000", 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:54.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014799+0000", 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6999999999999999e-06 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014823+0000", 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4712e-05 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014833+0000", 2024-04-26T11:23:54.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8980000000000008e-06 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.014896+0000", 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3146999999999997e-05 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.015047+0000", 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015047899999999999 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:54.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.015248+0000", 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020151300000000001 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.016838+0000", 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001589739 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.023793+0000", 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069547469999999998 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.023922+0000", 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000129407 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.024003+0000", 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0303999999999996e-05 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5945 4.19 4:9b29ec74:::10000001b49.00000000:head [write 0~845] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T11:23:54.535 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:50.451317+0000", 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.992920324, 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0096191420000000007, 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5945 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451317+0000", 2024-04-26T11:23:54.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451317+0000", 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451315+0000", 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451328+0000", 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3319000000000001e-05 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451359+0000", 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1640000000000002e-05 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451374+0000", 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4423000000000001e-05 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451495+0000", 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121587 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.451743+0000", 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024781 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.452075+0000", 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000331439 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.454306+0000", 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022316649999999999 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.460702+0000", 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063958549999999998 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.460819+0000", 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000116277 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:50.460936+0000", 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000117407 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:151 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:51.100102+0000", 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.344134967, 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030897556999999999, 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.100102+0000", 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.100102+0000", 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.100100+0000", 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:54.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107187+0000", 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070870680000000002 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107209+0000", 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1835999999999999e-05 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107221+0000", 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.169e-05 2024-04-26T11:23:54.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107277+0000", 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6923999999999999e-05 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107402+0000", 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012408800000000001 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107522+0000", 2024-04-26T11:23:54.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012063200000000001 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.119336+0000", 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011813716 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.130905+0000", 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011568858 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:54.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.130953+0000", 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7907000000000001e-05 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.131000+0000", 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7077999999999999e-05 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:152 3.2 3:4272d415:::200.0000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:51.107237+0000", 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.3370003600000002, 2024-04-26T11:23:54.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010370503, 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107237+0000", 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107237+0000", 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107236+0000", 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107240+0000", 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.51e-06 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107250+0000", 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5089999999999999e-06 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107259+0000", 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.217e-06 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107340+0000", 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1267999999999995e-05 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107512+0000", 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017151199999999999 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:54.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:54.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:54.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.117607+0000", 2024-04-26T11:23:54.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010095737 2024-04-26T11:23:54.550 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.550 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.550 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.550 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:54.550 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:54.550 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:54.552 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:54.549+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:54.552 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:54.653 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:54.650+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:54.685 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_repop(client.4728.0:8313 4.2e e61/41 4:750a2545:::100000025da.00000000:head v 61'129, mlcod=61'127)", 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.685599+0000", 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00018195599999999999, 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021773199999999999, 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.685599+0000", 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:54.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.685599+0000", 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.685598+0000", 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.685610+0000", 2024-04-26T11:23:54.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2306e-05 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.685639+0000", 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8756e-05 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.685651+0000", 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.226e-05 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:54.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.685695+0000", 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3594999999999998e-05 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.685708+0000", 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3164e-05 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-04-26T11:23:54.689 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:54.701 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:54.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:54.790+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:54.855 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:54.853+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:54.871 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:54.871 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:54.871 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:54.871 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:54.871 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:54.886 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:54.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-04-26T11:23:54.972 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:54.970+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:55.057 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:55.053+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:55.065 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:55.065 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:55.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:55.065 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:55.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.065 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3873410~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.065 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:23:55.065 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.65049728500000004, 2024-04-26T11:23:55.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.049732789999999999, 2024-04-26T11:23:55.065 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.065 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410916+0000", 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410925+0000", 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1030000000000002e-06 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410943+0000", 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8139999999999999e-05 2024-04-26T11:23:55.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410957+0000", 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3939e-05 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.453976+0000", 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043019730999999999 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.454179+0000", 2024-04-26T11:23:55.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000202964 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460360+0000", 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061803910000000004 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460473+0000", 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113402 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460650+0000", 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177236 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3874807~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.65044640899999995, 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.049989594999999998, 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410967+0000", 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410985+0000", 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7580000000000001e-05 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411007+0000", 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1752000000000001e-05 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411021+0000", 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749999999999999e-05 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455415+0000", 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044393763000000003 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455544+0000", 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012836299999999999 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460672+0000", 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051280620000000001 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460775+0000", 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010309 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460958+0000", 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018335500000000001 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.074 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3876210~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.65038054099999998, 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050240140000000003, 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411033+0000", 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411042+0000", 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7930000000000003e-06 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411064+0000", 2024-04-26T11:23:55.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1869999999999999e-05 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411077+0000", 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.456448+0000", 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.045371178999999998 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.456668+0000", 2024-04-26T11:23:55.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022021899999999999 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460979+0000", 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043111490000000002 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461088+0000", 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010888 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461274+0000", 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018618000000000001 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3877613~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.65032661899999999, 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.052990624, 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.079 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411087+0000", 2024-04-26T11:23:55.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411105+0000", 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7580000000000001e-05 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411124+0000", 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9108999999999999e-05 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411139+0000", 2024-04-26T11:23:55.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4676e-05 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.458214+0000", 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.047075327 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.458359+0000", 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537299999999999 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.463839+0000", 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054799050000000002 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.463918+0000", 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8887999999999994e-05 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464079+0000", 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160719 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3879013~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.65026295000000001, 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053236793999999997, 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411151+0000", 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411160+0000", 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9760000000000001e-06 2024-04-26T11:23:55.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411180+0000", 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9902999999999999e-05 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411196+0000", 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6129000000000001e-05 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459318+0000", 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048122047000000001 2024-04-26T11:23:55.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459507+0000", 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189598 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464107+0000", 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045994979999999996 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464199+0000", 2024-04-26T11:23:55.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2083999999999995e-05 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464389+0000", 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189662 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3880419~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.65020638900000005, 2024-04-26T11:23:55.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.055882977, 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.089 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411207+0000", 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411215+0000", 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000007e-06 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411234+0000", 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8563000000000002e-05 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411248+0000", 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4499e-05 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461384+0000", 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050136067999999999 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461534+0000", 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014934400000000001 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.466771+0000", 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052373610000000003 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.466900+0000", 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012929200000000001 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467091+0000", 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000191153 2024-04-26T11:23:55.092 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3881822~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.65015411000000001, 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.057533475000000001, 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411260+0000", 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411279+0000", 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9055999999999998e-05 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411300+0000", 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1556000000000002e-05 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411315+0000", 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4307e-05 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.462268+0000", 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050953713999999997 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.462480+0000", 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021157500000000001 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468480+0000", 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059997169999999999 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468609+0000", 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012991700000000001 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468794+0000", 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000184766 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.097 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3883227~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.65008780499999996, 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.060065495000000003, 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:23:55.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411326+0000", 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411334+0000", 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7570000000000004e-06 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411351+0000", 2024-04-26T11:23:55.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7523000000000001e-05 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411367+0000", 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5909e-05 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464493+0000", 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053126200999999998 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464716+0000", 2024-04-26T11:23:55.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000222244 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471192+0000", 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064765689999999997 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471299+0000", 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010697200000000001 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471393+0000", 2024-04-26T11:23:55.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3399999999999993e-05 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3884626~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.65003562299999995, 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.060192189, 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:23:55.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:23:55.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411378+0000", 2024-04-26T11:23:55.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411394+0000", 2024-04-26T11:23:55.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6047000000000001e-05 2024-04-26T11:23:55.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411413+0000", 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9159000000000001e-05 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411428+0000", 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4543e-05 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465657+0000", 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.054228982000000002 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465838+0000", 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000180719 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471407+0000", 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055695709999999997 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.106 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471487+0000", 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9555999999999995e-05 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471571+0000", 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4635000000000005e-05 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.107 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 3886023~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.64997463700000002, 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064564381000000004, 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411439+0000", 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411449+0000", 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0056e-05 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411467+0000", 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7367000000000002e-05 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411484+0000", 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6949e-05 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467227+0000", 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.055743085999999997 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467347+0000", 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012048999999999999 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.475804+0000", 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084571980000000008 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.475897+0000", 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2601000000000003e-05 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476005+0000", 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010764099999999999 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 3887426~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.64991955599999995, 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064774331000000004, 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.112 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411494+0000", 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411509+0000", 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4463e-05 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411526+0000", 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7226000000000001e-05 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411540+0000", 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4063000000000001e-05 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468882+0000", 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.057341548999999999 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.469023+0000", 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141357 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476029+0000", 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070060829999999998 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476132+0000", 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103045 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476270+0000", 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013762099999999999 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:8088 4.5 4:a3b551eb:::100000024d3.00000000:head [write 0~479] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.64111752899999996, 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.056313184000000002, 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 8088 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.117 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420295+0000", 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420310+0000", 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.554e-05 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420344+0000", 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4195e-05 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420365+0000", 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0726000000000001e-05 2024-04-26T11:23:55.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468869+0000", 2024-04-26T11:23:55.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048503444 2024-04-26T11:23:55.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.469179+0000", 2024-04-26T11:23:55.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030999599999999999 2024-04-26T11:23:55.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476290+0000", 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071110239999999996 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476425+0000", 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013510200000000001 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476611+0000", 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018590699999999999 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.121 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 3985361~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.60622059900000003, 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048391816999999997, 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:23:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455192+0000", 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455205+0000", 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2816000000000001e-05 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455231+0000", 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455247+0000", 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6446000000000001e-05 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.495318+0000", 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.040070460000000002 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.495514+0000", 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019605800000000001 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503340+0000", 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078268000000000001 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503478+0000", 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137847 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503586+0000", 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0001078 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 3986766~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:23:55.126 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.60613883099999999, 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048511780999999997, 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455275+0000", 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455295+0000", 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9556999999999999e-05 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455309+0000", 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4129e-05 2024-04-26T11:23:55.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455318+0000", 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9099999999999994e-06 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.497677+0000", 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042359494999999997 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.497779+0000", 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101652 2024-04-26T11:23:55.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503601+0000", 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058225500000000001 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503667+0000", 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6165000000000001e-05 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503788+0000", 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012043 2024-04-26T11:23:55.130 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 4002753~2766 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.60155859099999998, 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.051229524999999998, 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459855+0000", 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459863+0000", 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1429999999999998e-06 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459873+0000", 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459885+0000", 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.253e-05 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.501870+0000", 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041984759000000003 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.502112+0000", 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241387 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510903+0000", 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087910309999999995 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510975+0000", 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2683999999999997e-05 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511086+0000", 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110534 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 4005519~5851 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.135 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.60152248500000005, 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.051351761000000003, 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:55.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459920+0000", 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8198999999999999e-05 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459931+0000", 2024-04-26T11:23:55.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0896e-05 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459939+0000", 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8040000000000002e-06 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503910+0000", 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043971057000000001 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.504155+0000", 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024487100000000002 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511096+0000", 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069414660000000003 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511153+0000", 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7126999999999997e-05 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511244+0000", 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1044000000000004e-05 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 4011370~3881 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.60146797299999999, 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053603985999999999, 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459946+0000", 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459963+0000", 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7090000000000001e-05 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459985+0000", 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1889e-05 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459998+0000", 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.344e-05 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.505665+0000", 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.045666292999999997 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.505878+0000", 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021291999999999999 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513229+0000", 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073514380000000001 2024-04-26T11:23:55.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513355+0000", 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012582000000000001 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513551+0000", 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019610600000000001 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.144 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 4015251~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.60067820199999999, 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053137220999999998, 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460735+0000", 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460752+0000", 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7016000000000001e-05 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460797+0000", 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5136000000000003e-05 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460813+0000", 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6138999999999999e-05 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.508005+0000", 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0471923 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.147 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.508158+0000", 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152096 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513572+0000", 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054148490000000002 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513680+0000", 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107243 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.148 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513874+0000", 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019425200000000001 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 4017160~11347 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.59722080399999999, 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053850265000000001, 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.149 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464192+0000", 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:55.150 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464228+0000", 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6162999999999999e-05 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464256+0000", 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7665999999999999e-05 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464276+0000", 2024-04-26T11:23:55.151 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0403000000000001e-05 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.509181+0000", 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044904685999999999 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.509391+0000", 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021012299999999999 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.517888+0000", 2024-04-26T11:23:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084974600000000001 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.517941+0000", 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2484000000000001e-05 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518044+0000", 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103424 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.153 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:8119 4.5 4:a024dd33:::100000024f3.00000000:head [write 0~1435] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.59573354099999998, 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.052532417999999997, 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 8119 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.154 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465679+0000", 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:55.155 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465695+0000", 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5287000000000001e-05 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465725+0000", 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0284999999999999e-05 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465744+0000", 2024-04-26T11:23:55.156 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9414000000000001e-05 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510010+0000", 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044265697999999999 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510296+0000", 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000286323 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518060+0000", 2024-04-26T11:23:55.157 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077638289999999999 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518111+0000", 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1144999999999999e-05 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518214+0000", 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102564 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.158 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.159 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.159 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:55.161 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:55.161 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:55.157+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:55.261 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:55.258+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:55.304 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:55.304 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:55.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.304 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8822 4.33 4:ccbcbdf9:::1000000285c.00000000:head [write 0~13518 in=13518b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:55.304 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:55.302575+0000", 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0016852989999999999, 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001725245, 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8822 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:55.302575+0000", 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:55.302575+0000", 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:55.302568+0000", 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999933 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:55.302601+0000", 2024-04-26T11:23:55.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3556999999999997e-05 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:55.302625+0000", 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3762000000000001e-05 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:55.302637+0000", 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2217e-05 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:55.302738+0000", 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100314 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:55.302947+0000", 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020923900000000001 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:55.303161+0000", 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021401100000000001 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.308 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-26T11:23:55.309 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 1 2024-04-26T11:23:55.309 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:55.321 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:55.366 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:55.365+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:55.445 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:55.446 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:23:55.446 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:23:55.446 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:23:55.446 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:55.461 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:55.463 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:55.458+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:55.564 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:55.561+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:55.633 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:55.633 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:55.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:55.633 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:55.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.633 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:55.633 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:55.633 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 121.945797748, 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:55.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:55.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 121.94567135299999, 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:55.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:55.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:55.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 121.94558256000001, 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:55.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 121.945477747, 2024-04-26T11:23:55.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:55.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:55.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 121.945427091, 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:55.659 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.660 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.660 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.660 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:55.660 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:55.660 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 121.945370138, 2024-04-26T11:23:55.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:55.660 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.660 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.661 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:55.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:55.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.665 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 121.94531114599999, 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:55.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.669 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 121.94520814000001, 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:55.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:55.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 121.9451323, 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:55.677 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.489218072, 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.029900301000000001, 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140105+0000", 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146164+0000", 2024-04-26T11:23:55.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060589709999999998 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146195+0000", 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0618999999999999e-05 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146210+0000", 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4856e-05 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146386+0000", 2024-04-26T11:23:55.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017677799999999999 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146752+0000", 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000366065 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.147102+0000", 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034963300000000002 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.167955+0000", 2024-04-26T11:23:55.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020852956999999998 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169930+0000", 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001975325 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169977+0000", 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7151999999999998e-05 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.170009+0000", 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1075000000000003e-05 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.479799281, 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013991071000000001, 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.683 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 11 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:55.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149525+0000", 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149536+0000", 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0976e-05 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149558+0000", 2024-04-26T11:23:55.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2096e-05 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149586+0000", 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7803000000000001e-05 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149644+0000", 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8371000000000001e-05 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149741+0000", 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6898000000000006e-05 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149843+0000", 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102252 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157109+0000", 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007265245 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163241+0000", 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061323510000000003 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163417+0000", 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017638800000000001 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163518+0000", 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100717 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.688 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.478970429, 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013385179000000001, 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 12 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.689 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150355+0000", 2024-04-26T11:23:55.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150364+0000", 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0939999999999997e-06 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150379+0000", 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5156e-05 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150388+0000", 2024-04-26T11:23:55.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8259999999999999e-06 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150427+0000", 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9366999999999998e-05 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150532+0000", 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104666 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150671+0000", 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013879300000000001 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157773+0000", 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071026140000000001 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163538+0000", 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649659999999998 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163650+0000", 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011216 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163741+0000", 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0810999999999995e-05 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.694 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:151 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:51.100102+0000", 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5292241600000001, 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030897556999999999, 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.100102+0000", 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.100102+0000", 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.100100+0000", 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107187+0000", 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070870680000000002 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107209+0000", 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1835999999999999e-05 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107221+0000", 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.169e-05 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107277+0000", 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6923999999999999e-05 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107402+0000", 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012408800000000001 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107522+0000", 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012063200000000001 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.119336+0000", 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011813716 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.130905+0000", 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011568858 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.130953+0000", 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7907000000000001e-05 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.131000+0000", 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7077999999999999e-05 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.699 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:158 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.411146+0000", 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.218180748, 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.039515683000000003, 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411146+0000", 2024-04-26T11:23:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411146+0000", 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411145+0000", 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411623+0000", 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047895000000000001 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411632+0000", 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5809999999999997e-06 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411637+0000", 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4599999999999996e-06 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411691+0000", 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4735999999999999e-05 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411777+0000", 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6106999999999994e-05 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450553+0000", 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.038775865999999999 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450595+0000", 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2218000000000001e-05 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450661+0000", 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5819000000000001e-05 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8084 4.3e 4:7db30d2d:::100000024cf.00000000:head [write 0~556] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:55.704 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.416677+0000", 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.212649077, 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016860281000000001, 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8084 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416677+0000", 2024-04-26T11:23:55.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416677+0000", 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416676+0000", 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416684+0000", 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5629999999999992e-06 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416699+0000", 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5094e-05 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416709+0000", 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6500000000000008e-06 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416770+0000", 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0730999999999998e-05 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.417003+0000", 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233012 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.417228+0000", 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022515499999999999 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.419061+0000", 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018333379999999999 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433440+0000", 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014378905000000001 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433498+0000", 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7442000000000003e-05 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433538+0000", 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9814999999999997e-05 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8101 4.6 4:6184a118:::100000024e0.00000000:head [write 0~758] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.431332+0000", 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.197993962, 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019211669000000001, 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:55.710 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8101 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431332+0000", 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431332+0000", 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431331+0000", 2024-04-26T11:23:55.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431338+0000", 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4960000000000001e-06 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431350+0000", 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.236e-05 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431357+0000", 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0380000000000002e-06 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431465+0000", 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010759 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431702+0000", 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023764200000000001 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431920+0000", 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021747499999999999 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.434899+0000", 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029786280000000001 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450464+0000", 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015565903000000001 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450501+0000", 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6698e-05 2024-04-26T11:23:55.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450544+0000", 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2855000000000002e-05 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8102 4.16 4:69fb0660:::100000024e1.00000000:head [write 0~754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.432119+0000", 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.1972070669999999, 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018700907999999999, 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.717 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8102 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432119+0000", 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432119+0000", 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432119+0000", 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432124+0000", 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0080000000000002e-06 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432133+0000", 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4299999999999995e-06 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432141+0000", 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6190000000000002e-06 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432863+0000", 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00072231599999999997 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433138+0000", 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027466399999999998 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450738+0000", 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017599895000000001 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450768+0000", 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0778000000000002e-05 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450820+0000", 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1869000000000001e-05 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8103 4.29 4:9509e2f0:::100000024e2.00000000:head [write 0~1508] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.432951+0000", 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.1963748590000001, 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017877201999999998, 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.722 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8103 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432951+0000", 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432951+0000", 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432950+0000", 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432959+0000", 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7909999999999993e-06 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432977+0000", 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8068e-05 2024-04-26T11:23:55.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432990+0000", 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3324e-05 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433039+0000", 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8998000000000001e-05 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433175+0000", 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000135473 2024-04-26T11:23:55.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450596+0000", 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017421326000000001 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450700+0000", 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010399399999999999 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450829+0000", 2024-04-26T11:23:55.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012846999999999999 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8106 4.20 4:050a9529:::100000024e5.00000000:head [write 0~669] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.435788+0000", 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.193538757, 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015307497, 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:55.727 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8106 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435788+0000", 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435788+0000", 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435787+0000", 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435792+0000", 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.631e-06 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435804+0000", 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.185e-05 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435811+0000", 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5300000000000002e-06 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435850+0000", 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9338000000000002e-05 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435936+0000", 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6212999999999996e-05 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451009+0000", 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015072478 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451036+0000", 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7373e-05 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451095+0000", 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9089999999999998e-05 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.731 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8107 4.a 4:51e7f5fe:::100000024e6.00000000:head [write 0~1022] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.437795+0000", 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.1915310450000001, 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013426875, 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8107 2024-04-26T11:23:55.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437795+0000", 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437795+0000", 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437795+0000", 2024-04-26T11:23:55.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437799+0000", 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8149999999999996e-06 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437809+0000", 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3149999999999998e-06 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437813+0000", 2024-04-26T11:23:55.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6199999999999998e-06 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437846+0000", 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2702e-05 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437928+0000", 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1984000000000007e-05 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:55.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451073+0000", 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013145436999999999 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451146+0000", 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2878000000000003e-05 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451222+0000", 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5884999999999996e-05 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.737 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:55.737 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:55.737 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:55.737 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:23:55.739 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:55.737+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:55.739 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:55.841 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:55.837+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:55.880 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:9120 4.3d 4:bf1894e8:::100000029d1.00000000:head [write 0~8706 in=8706b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:55.879226+0000", 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0016800560000000001, 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0017014809999999999, 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 9120 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.881 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:55.879226+0000", 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:55.879226+0000", 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:55.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:55.879224+0000", 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:55.879247+0000", 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.3663e-05 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:55.879277+0000", 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0108999999999999e-05 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:55.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:55.879292+0000", 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4317e-05 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:55.879346+0000", 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.3891999999999998e-05 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:55.879459+0000", 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011372200000000001 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:55.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:55.880664+0000", 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0012049070000000001 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:55.880753+0000", 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8707000000000003e-05 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:55.880929+0000", 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000176353 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:55.886 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.886 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:55.886 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-04-26T11:23:55.886 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-04-26T11:23:55.886 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:55.898 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:55.941 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:55.937+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:56.025 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:56.025 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:56.026 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:56.026 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:56.026 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:56.040 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:56.042 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:56.037+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:56.143 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:56.138+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:56.177 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:56.177 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:56.177 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:56.177 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:56.177 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3873410~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.763125498, 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.049732789999999999, 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.178 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410916+0000", 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410925+0000", 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1030000000000002e-06 2024-04-26T11:23:56.179 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410943+0000", 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8139999999999999e-05 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410957+0000", 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3939e-05 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.453976+0000", 2024-04-26T11:23:56.180 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043019730999999999 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.454179+0000", 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000202964 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460360+0000", 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061803910000000004 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.181 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460473+0000", 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113402 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460650+0000", 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177236 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.182 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3874807~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.763074622, 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.049989594999999998, 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.183 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410967+0000", 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.184 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410985+0000", 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7580000000000001e-05 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411007+0000", 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1752000000000001e-05 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411021+0000", 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749999999999999e-05 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455415+0000", 2024-04-26T11:23:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044393763000000003 2024-04-26T11:23:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455544+0000", 2024-04-26T11:23:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012836299999999999 2024-04-26T11:23:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460672+0000", 2024-04-26T11:23:56.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051280620000000001 2024-04-26T11:23:56.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460775+0000", 2024-04-26T11:23:56.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010309 2024-04-26T11:23:56.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460958+0000", 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018335500000000001 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3876210~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7630087539999999, 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050240140000000003, 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.188 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411033+0000", 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411042+0000", 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7930000000000003e-06 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411064+0000", 2024-04-26T11:23:56.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1869999999999999e-05 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411077+0000", 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.456448+0000", 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.045371178999999998 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.456668+0000", 2024-04-26T11:23:56.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022021899999999999 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460979+0000", 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043111490000000002 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461088+0000", 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010888 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461274+0000", 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018618000000000001 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3877613~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7629548320000001, 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.052990624, 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.194 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411087+0000", 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411105+0000", 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7580000000000001e-05 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411124+0000", 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9108999999999999e-05 2024-04-26T11:23:56.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411139+0000", 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4676e-05 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.458214+0000", 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.047075327 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.458359+0000", 2024-04-26T11:23:56.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537299999999999 2024-04-26T11:23:56.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.463839+0000", 2024-04-26T11:23:56.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054799050000000002 2024-04-26T11:23:56.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.463918+0000", 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8887999999999994e-05 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464079+0000", 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160719 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.198 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3879013~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7628911629999999, 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053236793999999997, 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:23:56.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411151+0000", 2024-04-26T11:23:56.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411160+0000", 2024-04-26T11:23:56.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9760000000000001e-06 2024-04-26T11:23:56.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411180+0000", 2024-04-26T11:23:56.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9902999999999999e-05 2024-04-26T11:23:56.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411196+0000", 2024-04-26T11:23:56.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6129000000000001e-05 2024-04-26T11:23:56.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459318+0000", 2024-04-26T11:23:56.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048122047000000001 2024-04-26T11:23:56.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459507+0000", 2024-04-26T11:23:56.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189598 2024-04-26T11:23:56.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464107+0000", 2024-04-26T11:23:56.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045994979999999996 2024-04-26T11:23:56.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.203 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464199+0000", 2024-04-26T11:23:56.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2083999999999995e-05 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464389+0000", 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189662 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3880419~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.204 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7628346019999999, 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.055882977, 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411207+0000", 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411215+0000", 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000007e-06 2024-04-26T11:23:56.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411234+0000", 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8563000000000002e-05 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411248+0000", 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4499e-05 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461384+0000", 2024-04-26T11:23:56.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050136067999999999 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461534+0000", 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014934400000000001 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.466771+0000", 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052373610000000003 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.466900+0000", 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012929200000000001 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467091+0000", 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000191153 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.209 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3881822~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7627823230000002, 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.057533475000000001, 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411260+0000", 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411279+0000", 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9055999999999998e-05 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411300+0000", 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1556000000000002e-05 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411315+0000", 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4307e-05 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.462268+0000", 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050953713999999997 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.462480+0000", 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021157500000000001 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468480+0000", 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059997169999999999 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468609+0000", 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012991700000000001 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.213 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468794+0000", 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000184766 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3883227~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7627160179999999, 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.060065495000000003, 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.214 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411326+0000", 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411334+0000", 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7570000000000004e-06 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411351+0000", 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7523000000000001e-05 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411367+0000", 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5909e-05 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464493+0000", 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053126200999999998 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464716+0000", 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000222244 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471192+0000", 2024-04-26T11:23:56.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064765689999999997 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471299+0000", 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010697200000000001 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471393+0000", 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3399999999999993e-05 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.218 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3884626~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.762663836, 2024-04-26T11:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.060192189, 2024-04-26T11:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411378+0000", 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.220 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411394+0000", 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6047000000000001e-05 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411413+0000", 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9159000000000001e-05 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411428+0000", 2024-04-26T11:23:56.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4543e-05 2024-04-26T11:23:56.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465657+0000", 2024-04-26T11:23:56.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.054228982000000002 2024-04-26T11:23:56.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465838+0000", 2024-04-26T11:23:56.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000180719 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471407+0000", 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055695709999999997 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471487+0000", 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9555999999999995e-05 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471571+0000", 2024-04-26T11:23:56.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4635000000000005e-05 2024-04-26T11:23:56.224 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.224 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.224 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.224 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 3886023~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.224 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:23:56.224 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7626028499999999, 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064564381000000004, 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:23:56.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411439+0000", 2024-04-26T11:23:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411449+0000", 2024-04-26T11:23:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0056e-05 2024-04-26T11:23:56.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411467+0000", 2024-04-26T11:23:56.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7367000000000002e-05 2024-04-26T11:23:56.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411484+0000", 2024-04-26T11:23:56.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6949e-05 2024-04-26T11:23:56.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467227+0000", 2024-04-26T11:23:56.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.055743085999999997 2024-04-26T11:23:56.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467347+0000", 2024-04-26T11:23:56.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012048999999999999 2024-04-26T11:23:56.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.475804+0000", 2024-04-26T11:23:56.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084571980000000008 2024-04-26T11:23:56.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.475897+0000", 2024-04-26T11:23:56.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2601000000000003e-05 2024-04-26T11:23:56.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476005+0000", 2024-04-26T11:23:56.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010764099999999999 2024-04-26T11:23:56.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.230 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.230 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.230 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 3887426~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.230 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:23:56.230 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.762547769, 2024-04-26T11:23:56.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064774331000000004, 2024-04-26T11:23:56.231 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.231 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.231 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:23:56.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411494+0000", 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.234 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411509+0000", 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4463e-05 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411526+0000", 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7226000000000001e-05 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411540+0000", 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4063000000000001e-05 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468882+0000", 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.057341548999999999 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.469023+0000", 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141357 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476029+0000", 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070060829999999998 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476132+0000", 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103045 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476270+0000", 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013762099999999999 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:8088 4.5 4:a3b551eb:::100000024d3.00000000:head [write 0~479] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:56.237 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.753745742, 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.056313184000000002, 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 8088 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:23:56.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420295+0000", 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420310+0000", 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.554e-05 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420344+0000", 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4195e-05 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420365+0000", 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0726000000000001e-05 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468869+0000", 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048503444 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.469179+0000", 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030999599999999999 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476290+0000", 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071110239999999996 2024-04-26T11:23:56.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476425+0000", 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013510200000000001 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476611+0000", 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018590699999999999 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 3985361~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7188488120000001, 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048391816999999997, 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455192+0000", 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455205+0000", 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2816000000000001e-05 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455231+0000", 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455247+0000", 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6446000000000001e-05 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.495318+0000", 2024-04-26T11:23:56.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.040070460000000002 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.495514+0000", 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019605800000000001 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503340+0000", 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078268000000000001 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503478+0000", 2024-04-26T11:23:56.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137847 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503586+0000", 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0001078 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 3986766~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.718767044, 2024-04-26T11:23:56.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048511780999999997, 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455275+0000", 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455295+0000", 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9556999999999999e-05 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455309+0000", 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4129e-05 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455318+0000", 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9099999999999994e-06 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.497677+0000", 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042359494999999997 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.497779+0000", 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101652 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503601+0000", 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058225500000000001 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503667+0000", 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6165000000000001e-05 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503788+0000", 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012043 2024-04-26T11:23:56.251 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 4002753~2766 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7141868040000001, 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.051229524999999998, 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:23:56.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459855+0000", 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459863+0000", 2024-04-26T11:23:56.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1429999999999998e-06 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459873+0000", 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459885+0000", 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.253e-05 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.501870+0000", 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041984759000000003 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.502112+0000", 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241387 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510903+0000", 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087910309999999995 2024-04-26T11:23:56.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510975+0000", 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2683999999999997e-05 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511086+0000", 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110534 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.256 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 4005519~5851 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7141506980000001, 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.051351761000000003, 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:56.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459920+0000", 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8198999999999999e-05 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459931+0000", 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0896e-05 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459939+0000", 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8040000000000002e-06 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503910+0000", 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043971057000000001 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.504155+0000", 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024487100000000002 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511096+0000", 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069414660000000003 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511153+0000", 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7126999999999997e-05 2024-04-26T11:23:56.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511244+0000", 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1044000000000004e-05 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 4011370~3881 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7140961859999999, 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053603985999999999, 2024-04-26T11:23:56.261 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459946+0000", 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459963+0000", 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7090000000000001e-05 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459985+0000", 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1889e-05 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459998+0000", 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.344e-05 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.505665+0000", 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.045666292999999997 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.505878+0000", 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021291999999999999 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513229+0000", 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073514380000000001 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513355+0000", 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012582000000000001 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513551+0000", 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019610600000000001 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 4015251~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.7133064149999999, 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053137220999999998, 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460735+0000", 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460752+0000", 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7016000000000001e-05 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460797+0000", 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5136000000000003e-05 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460813+0000", 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6138999999999999e-05 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.508005+0000", 2024-04-26T11:23:56.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0471923 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.508158+0000", 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152096 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513572+0000", 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054148490000000002 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513680+0000", 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107243 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513874+0000", 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019425200000000001 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 4017160~11347 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:23:56.270 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.709849017, 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053850265000000001, 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464192+0000", 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464228+0000", 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6162999999999999e-05 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464256+0000", 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7665999999999999e-05 2024-04-26T11:23:56.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464276+0000", 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0403000000000001e-05 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.509181+0000", 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044904685999999999 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.509391+0000", 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021012299999999999 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.517888+0000", 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084974600000000001 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.517941+0000", 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2484000000000001e-05 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518044+0000", 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103424 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:8119 4.5 4:a024dd33:::100000024f3.00000000:head [write 0~1435] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 1.708361754, 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.052532417999999997, 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:56.275 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 8119 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:56.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465679+0000", 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465695+0000", 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5287000000000001e-05 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465725+0000", 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0284999999999999e-05 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465744+0000", 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9414000000000001e-05 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510010+0000", 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044265697999999999 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510296+0000", 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000286323 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518060+0000", 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077638289999999999 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518111+0000", 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1144999999999999e-05 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:56.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:56.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:56.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518214+0000", 2024-04-26T11:23:56.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102564 2024-04-26T11:23:56.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.280 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:56.280 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:56.280 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:56.282 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:56.282 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:56.277+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:56.317 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:23:56.383 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:56.381+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:56.423 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:56.423 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:56.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:56.423 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:9498 4.39 4:9d779cc7:::10000002b99.00000000:head [write 0~9446 in=9446b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:56.423 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:56.421478+0000", 2024-04-26T11:23:56.423 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0017003980000000001, 2024-04-26T11:23:56.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001759697, 2024-04-26T11:23:56.424 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:56.424 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:56.424 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:56.424 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:56.424 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:56.424 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 9498 2024-04-26T11:23:56.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:56.424 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:56.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:56.421478+0000", 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:56.421478+0000", 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:56.421476+0000", 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:56.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:56.421503+0000", 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6957e-05 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:56.421532+0000", 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9762000000000001e-05 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:56.421546+0000", 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3593e-05 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:56.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:56.421646+0000", 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9596e-05 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:56.421964+0000", 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031865600000000001 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:56.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:56.428 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-26T11:23:56.428 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 1 2024-04-26T11:23:56.428 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:56.439 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:56.452 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:56.474 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:56.475 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:56.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:56.482+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:56.494 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:56.495 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:56.499 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:56.499 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:56.585 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:56.581+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:56.619 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:56.619 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:56.634 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:56.637 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:23:56.722 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:56.721+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:56.786 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:56.786+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:56.801 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:56.801 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:56.817 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:56.887 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:56.885+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:56.954 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:56.954 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:56.969 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:57.013 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:57.010+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:57.089 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:57.086+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:57.102 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:57.103 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:57.119 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:57.205 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:57.202+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:57.292 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:57.289+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:57.295 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:57.295 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:57.312 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:57.393 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:57.390+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:57.454 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:57.455 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:57.470 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:57.514 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:57.513+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:57.595 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:57.590+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:57.603 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:57.603 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:57.620 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:57.706 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:57.705+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:57.761 INFO:tasks.workunit.client.0.smithi073.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-26T11:23:57.765 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T11:23:57.765 INFO:tasks.workunit.client.0.smithi073.stderr:+ make 2024-04-26T11:23:57.796 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:57.797 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:57.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:57.794+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:57.802 INFO:tasks.workunit.client.0.smithi073.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-26T11:23:57.811 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:57.897 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:57.893+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:57.941 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:57.941 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:57.956 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:58.000 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:57.998+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:58.078 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:58.078 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:58.089 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:58.099 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:58.097+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:58.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:58.194+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:58.256 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:58.257 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:58.270 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:58.313 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:58.310+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:58.400 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:58.400 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:58.401 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:58.397+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:58.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:58.427 INFO:tasks.workunit.client.0.smithi073.stderr:++ readlink -f fsstress 2024-04-26T11:23:58.429 INFO:tasks.workunit.client.0.smithi073.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-26T11:23:58.429 INFO:tasks.workunit.client.0.smithi073.stderr:+ popd 2024-04-26T11:23:58.430 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-26T11:23:58.430 INFO:tasks.workunit.client.0.smithi073.stderr:+ popd 2024-04-26T11:23:58.430 INFO:tasks.workunit.client.0.smithi073.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-26T11:23:58.431 INFO:tasks.workunit.client.0.smithi073.stderr:++ mktemp -d -p . 2024-04-26T11:23:58.432 INFO:tasks.workunit.client.0.smithi073.stderr:+ T=./tmp.nUDyr3VotE 2024-04-26T11:23:58.432 INFO:tasks.workunit.client.0.smithi073.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.nUDyr3VotE -l 1 -n 1000 -p 10 -v 2024-04-26T11:23:58.434 INFO:tasks.workunit.client.0.smithi073.stdout:seed = 1714235594 2024-04-26T11:23:58.436 INFO:tasks.workunit.client.0.smithi073.stdout:0/0: unlink - no file 2024-04-26T11:23:58.437 INFO:tasks.workunit.client.0.smithi073.stdout:0/1: symlink l0 0 2024-04-26T11:23:58.438 INFO:tasks.workunit.client.0.smithi073.stdout:2/0: dwrite - no filename 2024-04-26T11:23:58.438 INFO:tasks.workunit.client.0.smithi073.stdout:0/2: symlink l1 0 2024-04-26T11:23:58.438 INFO:tasks.workunit.client.0.smithi073.stdout:1/0: getdents . 0 2024-04-26T11:23:58.438 INFO:tasks.workunit.client.0.smithi073.stdout:1/1: chown . 8016 1 2024-04-26T11:23:58.439 INFO:tasks.workunit.client.0.smithi073.stdout:2/1: creat f0 x:0 0 0 2024-04-26T11:23:58.439 INFO:tasks.workunit.client.0.smithi073.stdout:0/3: mkdir d2 0 2024-04-26T11:23:58.440 INFO:tasks.workunit.client.0.smithi073.stdout:1/2: creat f0 x:0 0 0 2024-04-26T11:23:58.440 INFO:tasks.workunit.client.0.smithi073.stdout:1/3: rmdir - no directory 2024-04-26T11:23:58.440 INFO:tasks.workunit.client.0.smithi073.stdout:2/2: mknod c1 0 2024-04-26T11:23:58.440 INFO:tasks.workunit.client.0.smithi073.stdout:3/0: getdents . 0 2024-04-26T11:23:58.440 INFO:tasks.workunit.client.0.smithi073.stdout:3/1: truncate - no filename 2024-04-26T11:23:58.440 INFO:tasks.workunit.client.0.smithi073.stdout:3/2: dread - no filename 2024-04-26T11:23:58.440 INFO:tasks.workunit.client.0.smithi073.stdout:3/3: write - no filename 2024-04-26T11:23:58.440 INFO:tasks.workunit.client.0.smithi073.stdout:3/4: stat - no entries 2024-04-26T11:23:58.440 INFO:tasks.workunit.client.0.smithi073.stdout:0/4: unlink l1 0 2024-04-26T11:23:58.441 INFO:tasks.workunit.client.0.smithi073.stdout:4/0: creat f0 x:0 0 0 2024-04-26T11:23:58.441 INFO:tasks.workunit.client.0.smithi073.stdout:2/3: read - f0 zero size 2024-04-26T11:23:58.441 INFO:tasks.workunit.client.0.smithi073.stdout:1/4: mkdir d1 0 2024-04-26T11:23:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:0/5: rename d2 to d2/d3 22 2024-04-26T11:23:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:5/0: truncate - no filename 2024-04-26T11:23:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:5/1: read - no filename 2024-04-26T11:23:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:5/2: write - no filename 2024-04-26T11:23:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:5/3: dread - no filename 2024-04-26T11:23:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:3/5: mkdir d0 0 2024-04-26T11:23:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:0/6: chown l0 38795 1 2024-04-26T11:23:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:4/1: creat f1 x:0 0 0 2024-04-26T11:23:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:6/0: truncate - no filename 2024-04-26T11:23:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:6/1: chown . 517 1 2024-04-26T11:23:58.442 INFO:tasks.workunit.client.0.smithi073.stdout:2/4: creat f2 x:0 0 0 2024-04-26T11:23:58.444 INFO:tasks.workunit.client.0.smithi073.stdout:6/2: chown . 469162 1 2024-04-26T11:23:58.444 INFO:tasks.workunit.client.0.smithi073.stdout:7/0: rmdir - no directory 2024-04-26T11:23:58.444 INFO:tasks.workunit.client.0.smithi073.stdout:7/1: readlink - no filename 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:5/4: creat f0 x:0 0 0 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:4/2: unlink f0 0 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:1/5: mknod d1/c2 0 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:3/6: mknod d0/c1 0 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:0/7: rename l0 to d2/l4 0 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:1/6: read - f0 zero size 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:2/5: mknod c3 0 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:5/5: creat f1 x:0 0 0 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:4/3: unlink f1 0 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:4/4: dread - no filename 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:4/5: dwrite - no filename 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:4/6: write - no filename 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:6/3: mkdir d0 0 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:6/4: dread - no filename 2024-04-26T11:23:58.445 INFO:tasks.workunit.client.0.smithi073.stdout:2/6: fdatasync f0 0 2024-04-26T11:23:58.446 INFO:tasks.workunit.client.0.smithi073.stdout:7/2: creat f0 x:0 0 0 2024-04-26T11:23:58.446 INFO:tasks.workunit.client.0.smithi073.stdout:1/7: creat d1/f3 x:0 0 0 2024-04-26T11:23:58.446 INFO:tasks.workunit.client.0.smithi073.stdout:4/7: mknod c2 0 2024-04-26T11:23:58.446 INFO:tasks.workunit.client.0.smithi073.stdout:3/7: mkdir d0/d2 0 2024-04-26T11:23:58.446 INFO:tasks.workunit.client.0.smithi073.stdout:7/3: write f0 [62071,63342] 0 2024-04-26T11:23:58.446 INFO:tasks.workunit.client.0.smithi073.stdout:2/7: symlink l4 0 2024-04-26T11:23:58.447 INFO:tasks.workunit.client.0.smithi073.stdout:6/5: creat d0/f1 x:0 0 0 2024-04-26T11:23:58.447 INFO:tasks.workunit.client.0.smithi073.stdout:3/8: rename d0 to d0/d3 22 2024-04-26T11:23:58.447 INFO:tasks.workunit.client.0.smithi073.stdout:3/9: dread - no filename 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:4/8: creat f3 x:0 0 0 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:2/8: chown l4 1232 1 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:9/0: mkdir d0 0 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:9/1: fsync - no filename 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:9/2: truncate - no filename 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:4/9: symlink l4 0 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:2/9: creat f5 x:0 0 0 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:2/10: dread - f5 zero size 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:9/3: mkdir d0/d1 0 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:9/4: readlink - no filename 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:1/8: write f0 [788518,117234] 0 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:2/11: write f5 [230148,1845] 0 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:9/5: rename d0 to d0/d2 22 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:9/6: dwrite - no filename 2024-04-26T11:23:58.448 INFO:tasks.workunit.client.0.smithi073.stdout:9/7: fdatasync - no filename 2024-04-26T11:23:58.449 INFO:tasks.workunit.client.0.smithi073.stdout:9/8: chown d0/d1 1996670664 1 2024-04-26T11:23:58.449 INFO:tasks.workunit.client.0.smithi073.stdout:3/10: symlink d0/d2/l4 0 2024-04-26T11:23:58.449 INFO:tasks.workunit.client.0.smithi073.stdout:2/12: write f0 [163094,48777] 0 2024-04-26T11:23:58.449 INFO:tasks.workunit.client.0.smithi073.stdout:9/9: symlink d0/l3 0 2024-04-26T11:23:58.449 INFO:tasks.workunit.client.0.smithi073.stdout:9/10: dread - no filename 2024-04-26T11:23:58.449 INFO:tasks.workunit.client.0.smithi073.stdout:9/11: truncate - no filename 2024-04-26T11:23:58.450 INFO:tasks.workunit.client.0.smithi073.stdout:9/12: dread - no filename 2024-04-26T11:23:58.450 INFO:tasks.workunit.client.0.smithi073.stdout:9/13: fdatasync - no filename 2024-04-26T11:23:58.450 INFO:tasks.workunit.client.0.smithi073.stdout:9/14: dwrite - no filename 2024-04-26T11:23:58.450 INFO:tasks.workunit.client.0.smithi073.stdout:1/9: link d1/c2 d1/c4 0 2024-04-26T11:23:58.450 INFO:tasks.workunit.client.0.smithi073.stdout:3/11: readlink d0/d2/l4 0 2024-04-26T11:23:58.451 INFO:tasks.workunit.client.0.smithi073.stdout:2/13: link f0 f6 0 2024-04-26T11:23:58.452 INFO:tasks.workunit.client.0.smithi073.stdout:9/15: getdents d0/d1 0 2024-04-26T11:23:58.452 INFO:tasks.workunit.client.0.smithi073.stdout:9/16: dwrite - no filename 2024-04-26T11:23:58.452 INFO:tasks.workunit.client.0.smithi073.stdout:9/17: write - no filename 2024-04-26T11:23:58.452 INFO:tasks.workunit.client.0.smithi073.stdout:3/12: symlink d0/l5 0 2024-04-26T11:23:58.453 INFO:tasks.workunit.client.0.smithi073.stdout:2/14: write f2 [473664,5120] 0 2024-04-26T11:23:58.455 INFO:tasks.workunit.client.0.smithi073.stdout:9/18: symlink d0/d1/l4 0 2024-04-26T11:23:58.456 INFO:tasks.workunit.client.0.smithi073.stdout:3/13: creat d0/d2/f6 x:0 0 0 2024-04-26T11:23:58.461 INFO:tasks.workunit.client.0.smithi073.stdout:7/4: dwrite f0 [0,4194304] 0 2024-04-26T11:23:58.463 INFO:tasks.workunit.client.0.smithi073.stdout:6/6: dwrite d0/f1 [0,4194304] 0 2024-04-26T11:23:58.464 INFO:tasks.workunit.client.0.smithi073.stdout:7/5: truncate f0 4737764 0 2024-04-26T11:23:58.472 INFO:tasks.workunit.client.0.smithi073.stdout:1/10: dwrite d1/f3 [0,4194304] 0 2024-04-26T11:23:58.474 INFO:tasks.workunit.client.0.smithi073.stdout:1/11: read d1/f3 [796987,2295] 0 2024-04-26T11:23:58.474 INFO:tasks.workunit.client.0.smithi073.stdout:2/15: dwrite f5 [0,4194304] 0 2024-04-26T11:23:58.475 INFO:tasks.workunit.client.0.smithi073.stdout:9/19: creat d0/f5 x:0 0 0 2024-04-26T11:23:58.478 INFO:tasks.workunit.client.0.smithi073.stdout:3/14: dwrite d0/d2/f6 [0,4194304] 0 2024-04-26T11:23:58.482 INFO:tasks.workunit.client.0.smithi073.stdout:0/8: getdents d2 0 2024-04-26T11:23:58.482 INFO:tasks.workunit.client.0.smithi073.stdout:5/6: getdents . 0 2024-04-26T11:23:58.482 INFO:tasks.workunit.client.0.smithi073.stdout:0/9: chown d2 56 1 2024-04-26T11:23:58.482 INFO:tasks.workunit.client.0.smithi073.stdout:6/7: creat d0/f2 x:0 0 0 2024-04-26T11:23:58.482 INFO:tasks.workunit.client.0.smithi073.stdout:5/7: unlink f0 0 2024-04-26T11:23:58.483 INFO:tasks.workunit.client.0.smithi073.stdout:3/15: write d0/d2/f6 [4710235,29594] 0 2024-04-26T11:23:58.486 INFO:tasks.workunit.client.0.smithi073.stdout:2/16: write f0 [924082,15451] 0 2024-04-26T11:23:58.487 INFO:tasks.workunit.client.0.smithi073.stdout:9/20: link d0/d1/l4 d0/d1/l6 0 2024-04-26T11:23:58.487 INFO:tasks.workunit.client.0.smithi073.stdout:2/17: read f5 [3067034,4045] 0 2024-04-26T11:23:58.487 INFO:tasks.workunit.client.0.smithi073.stdout:5/8: creat f2 x:0 0 0 2024-04-26T11:23:58.487 INFO:tasks.workunit.client.0.smithi073.stdout:0/10: link d2/l4 d2/l5 0 2024-04-26T11:23:58.487 INFO:tasks.workunit.client.0.smithi073.stdout:0/11: dwrite - no filename 2024-04-26T11:23:58.488 INFO:tasks.workunit.client.0.smithi073.stdout:5/9: write f1 [550028,80695] 0 2024-04-26T11:23:58.489 INFO:tasks.workunit.client.0.smithi073.stdout:0/12: symlink d2/l6 0 2024-04-26T11:23:58.489 INFO:tasks.workunit.client.0.smithi073.stdout:9/21: link d0/d1/l6 d0/d1/l7 0 2024-04-26T11:23:58.490 INFO:tasks.workunit.client.0.smithi073.stdout:5/10: mknod c3 0 2024-04-26T11:23:58.490 INFO:tasks.workunit.client.0.smithi073.stdout:0/13: mknod d2/c7 0 2024-04-26T11:23:58.491 INFO:tasks.workunit.client.0.smithi073.stdout:1/12: dwrite d1/f3 [4194304,4194304] 0 2024-04-26T11:23:58.491 INFO:tasks.workunit.client.0.smithi073.stdout:5/11: dread - f2 zero size 2024-04-26T11:23:58.491 INFO:tasks.workunit.client.0.smithi073.stdout:2/18: write f5 [4724813,94436] 0 2024-04-26T11:23:58.492 INFO:tasks.workunit.client.0.smithi073.stdout:9/22: creat d0/f8 x:0 0 0 2024-04-26T11:23:58.493 INFO:tasks.workunit.client.0.smithi073.stdout:0/14: mknod d2/c8 0 2024-04-26T11:23:58.493 INFO:tasks.workunit.client.0.smithi073.stdout:7/6: dwrite f0 [4194304,4194304] 0 2024-04-26T11:23:58.493 INFO:tasks.workunit.client.0.smithi073.stdout:6/8: dread d0/f1 [0,4194304] 0 2024-04-26T11:23:58.494 INFO:tasks.workunit.client.0.smithi073.stdout:5/12: mkdir d4 0 2024-04-26T11:23:58.494 INFO:tasks.workunit.client.0.smithi073.stdout:9/23: write d0/f8 [269426,16064] 0 2024-04-26T11:23:58.494 INFO:tasks.workunit.client.0.smithi073.stdout:7/7: mkdir d1 0 2024-04-26T11:23:58.494 INFO:tasks.workunit.client.0.smithi073.stdout:0/15: creat d2/f9 x:0 0 0 2024-04-26T11:23:58.495 INFO:tasks.workunit.client.0.smithi073.stdout:7/8: stat f0 0 2024-04-26T11:23:58.495 INFO:tasks.workunit.client.0.smithi073.stdout:5/13: write f1 [1396274,102340] 0 2024-04-26T11:23:58.495 INFO:tasks.workunit.client.0.smithi073.stdout:7/9: chown d1 482614 1 2024-04-26T11:23:58.496 INFO:tasks.workunit.client.0.smithi073.stdout:9/24: write d0/f5 [928281,63384] 0 2024-04-26T11:23:58.497 INFO:tasks.workunit.client.0.smithi073.stdout:5/14: stat f1 0 2024-04-26T11:23:58.498 INFO:tasks.workunit.client.0.smithi073.stdout:7/10: write f0 [3705290,86523] 0 2024-04-26T11:23:58.499 INFO:tasks.workunit.client.0.smithi073.stdout:9/25: rename d0/d1 to d0/d1/d9 22 2024-04-26T11:23:58.499 INFO:tasks.workunit.client.0.smithi073.stdout:5/15: creat d4/f5 x:0 0 0 2024-04-26T11:23:58.499 INFO:tasks.workunit.client.0.smithi073.stdout:5/16: readlink - no filename 2024-04-26T11:23:58.500 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:23:58.502 INFO:tasks.workunit.client.0.smithi073.stdout:5/17: mknod d4/c6 0 2024-04-26T11:23:58.502 INFO:tasks.workunit.client.0.smithi073.stdout:7/11: link f0 d1/f2 0 2024-04-26T11:23:58.502 INFO:tasks.workunit.client.0.smithi073.stdout:5/18: rename d4 to d4/d7 22 2024-04-26T11:23:58.504 INFO:tasks.workunit.client.0.smithi073.stdout:0/16: getdents d2 0 2024-04-26T11:23:58.504 INFO:tasks.workunit.client.0.smithi073.stdout:6/9: dread d0/f1 [0,4194304] 0 2024-04-26T11:23:58.504 INFO:tasks.workunit.client.0.smithi073.stdout:5/19: mkdir d4/d8 0 2024-04-26T11:23:58.504 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:58.501+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:58.504 INFO:tasks.workunit.client.0.smithi073.stdout:0/17: readlink d2/l6 0 2024-04-26T11:23:58.505 INFO:tasks.workunit.client.0.smithi073.stdout:2/19: dwrite f6 [0,4194304] 0 2024-04-26T11:23:58.505 INFO:tasks.workunit.client.0.smithi073.stdout:1/13: dwrite f0 [0,4194304] 0 2024-04-26T11:23:58.505 INFO:tasks.workunit.client.0.smithi073.stdout:0/18: read - d2/f9 zero size 2024-04-26T11:23:58.505 INFO:tasks.workunit.client.0.smithi073.stdout:2/20: fdatasync f2 0 2024-04-26T11:23:58.506 INFO:tasks.workunit.client.0.smithi073.stdout:7/12: truncate d1/f2 949965 0 2024-04-26T11:23:58.506 INFO:tasks.workunit.client.0.smithi073.stdout:0/19: symlink d2/la 0 2024-04-26T11:23:58.507 INFO:tasks.workunit.client.0.smithi073.stdout:0/20: stat d2 0 2024-04-26T11:23:58.507 INFO:tasks.workunit.client.0.smithi073.stdout:1/14: mknod d1/c5 0 2024-04-26T11:23:58.507 INFO:tasks.workunit.client.0.smithi073.stdout:5/20: mkdir d4/d8/d9 0 2024-04-26T11:23:58.507 INFO:tasks.workunit.client.0.smithi073.stdout:2/21: creat f7 x:0 0 0 2024-04-26T11:23:58.508 INFO:tasks.workunit.client.0.smithi073.stdout:0/21: dread - d2/f9 zero size 2024-04-26T11:23:58.508 INFO:tasks.workunit.client.0.smithi073.stdout:5/21: fdatasync f2 0 2024-04-26T11:23:58.508 INFO:tasks.workunit.client.0.smithi073.stdout:5/22: stat f2 0 2024-04-26T11:23:58.509 INFO:tasks.workunit.client.0.smithi073.stdout:0/22: dread - d2/f9 zero size 2024-04-26T11:23:58.509 INFO:tasks.workunit.client.0.smithi073.stdout:1/15: chown d1/c5 2 1 2024-04-26T11:23:58.509 INFO:tasks.workunit.client.0.smithi073.stdout:2/22: write f7 [656464,29352] 0 2024-04-26T11:23:58.509 INFO:tasks.workunit.client.0.smithi073.stdout:0/23: dread - d2/f9 zero size 2024-04-26T11:23:58.509 INFO:tasks.workunit.client.0.smithi073.stdout:5/23: symlink d4/d8/la 0 2024-04-26T11:23:58.509 INFO:tasks.workunit.client.0.smithi073.stdout:5/24: write f1 [1572336,116441] 0 2024-04-26T11:23:58.510 INFO:tasks.workunit.client.0.smithi073.stdout:5/25: stat d4/c6 0 2024-04-26T11:23:58.511 INFO:tasks.workunit.client.0.smithi073.stdout:5/26: creat d4/d8/fb x:0 0 0 2024-04-26T11:23:58.511 INFO:tasks.workunit.client.0.smithi073.stdout:5/27: mknod d4/cc 0 2024-04-26T11:23:58.512 INFO:tasks.workunit.client.0.smithi073.stdout:5/28: symlink d4/d8/ld 0 2024-04-26T11:23:58.512 INFO:tasks.workunit.client.0.smithi073.stdout:5/29: chown d4/f5 1 1 2024-04-26T11:23:58.514 INFO:tasks.workunit.client.0.smithi073.stdout:2/23: getdents . 0 2024-04-26T11:23:58.515 INFO:tasks.workunit.client.0.smithi073.stdout:2/24: write f5 [2414259,103058] 0 2024-04-26T11:23:58.515 INFO:tasks.workunit.client.0.smithi073.stdout:1/16: truncate d1/f3 219848 0 2024-04-26T11:23:58.515 INFO:tasks.workunit.client.0.smithi073.stdout:5/30: getdents d4/d8 0 2024-04-26T11:23:58.516 INFO:tasks.workunit.client.0.smithi073.stdout:2/25: creat f8 x:0 0 0 2024-04-26T11:23:58.516 INFO:tasks.workunit.client.0.smithi073.stdout:1/17: mkdir d1/d6 0 2024-04-26T11:23:58.516 INFO:tasks.workunit.client.0.smithi073.stdout:5/31: write d4/d8/fb [722234,111241] 0 2024-04-26T11:23:58.517 INFO:tasks.workunit.client.0.smithi073.stdout:1/18: rename f0 to d1/f7 0 2024-04-26T11:23:58.517 INFO:tasks.workunit.client.0.smithi073.stdout:5/32: write f1 [1455715,15691] 0 2024-04-26T11:23:58.518 INFO:tasks.workunit.client.0.smithi073.stdout:1/19: mkdir d1/d8 0 2024-04-26T11:23:58.518 INFO:tasks.workunit.client.0.smithi073.stdout:5/33: mkdir d4/de 0 2024-04-26T11:23:58.519 INFO:tasks.workunit.client.0.smithi073.stdout:5/34: truncate d4/d8/fb 938832 0 2024-04-26T11:23:58.519 INFO:tasks.workunit.client.0.smithi073.stdout:5/35: fsync f2 0 2024-04-26T11:23:58.520 INFO:tasks.workunit.client.0.smithi073.stdout:5/36: mknod d4/d8/cf 0 2024-04-26T11:23:58.521 INFO:tasks.workunit.client.0.smithi073.stdout:9/26: dread d0/f8 [0,4194304] 0 2024-04-26T11:23:58.522 INFO:tasks.workunit.client.0.smithi073.stdout:2/26: dwrite f0 [0,4194304] 0 2024-04-26T11:23:58.524 INFO:tasks.workunit.client.0.smithi073.stdout:3/16: dread d0/d2/f6 [4194304,4194304] 0 2024-04-26T11:23:58.524 INFO:tasks.workunit.client.0.smithi073.stdout:2/27: creat f9 x:0 0 0 2024-04-26T11:23:58.524 INFO:tasks.workunit.client.0.smithi073.stdout:3/17: write d0/d2/f6 [5354514,37756] 0 2024-04-26T11:23:58.527 INFO:tasks.workunit.client.0.smithi073.stdout:1/20: write d1/f3 [1261467,99874] 0 2024-04-26T11:23:58.527 INFO:tasks.workunit.client.0.smithi073.stdout:5/37: getdents d4/d8 0 2024-04-26T11:23:58.528 INFO:tasks.workunit.client.0.smithi073.stdout:5/38: creat d4/de/f10 x:0 0 0 2024-04-26T11:23:58.528 INFO:tasks.workunit.client.0.smithi073.stdout:2/28: dread f5 [0,4194304] 0 2024-04-26T11:23:58.530 INFO:tasks.workunit.client.0.smithi073.stdout:1/21: link d1/f3 d1/d8/f9 0 2024-04-26T11:23:58.530 INFO:tasks.workunit.client.0.smithi073.stdout:2/29: readlink l4 0 2024-04-26T11:23:58.530 INFO:tasks.workunit.client.0.smithi073.stdout:2/30: symlink la 0 2024-04-26T11:23:58.530 INFO:tasks.workunit.client.0.smithi073.stdout:2/31: rmdir - no directory 2024-04-26T11:23:58.530 INFO:tasks.workunit.client.0.smithi073.stdout:1/22: rename d1/f7 to d1/d6/fa 0 2024-04-26T11:23:58.530 INFO:tasks.workunit.client.0.smithi073.stdout:1/23: creat d1/d6/fb x:0 0 0 2024-04-26T11:23:58.531 INFO:tasks.workunit.client.0.smithi073.stdout:1/24: mknod d1/d8/cc 0 2024-04-26T11:23:58.533 INFO:tasks.workunit.client.0.smithi073.stdout:9/27: dread d0/f5 [0,4194304] 0 2024-04-26T11:23:58.533 INFO:tasks.workunit.client.0.smithi073.stdout:1/25: link d1/d6/fb d1/d8/fd 0 2024-04-26T11:23:58.533 INFO:tasks.workunit.client.0.smithi073.stdout:2/32: dread f0 [0,4194304] 0 2024-04-26T11:23:58.533 INFO:tasks.workunit.client.0.smithi073.stdout:9/28: creat d0/fa x:0 0 0 2024-04-26T11:23:58.534 INFO:tasks.workunit.client.0.smithi073.stdout:2/33: write f7 [1658872,52859] 0 2024-04-26T11:23:58.534 INFO:tasks.workunit.client.0.smithi073.stdout:1/26: mknod d1/d8/ce 0 2024-04-26T11:23:58.535 INFO:tasks.workunit.client.0.smithi073.stdout:5/39: dwrite f2 [0,4194304] 0 2024-04-26T11:23:58.535 INFO:tasks.workunit.client.0.smithi073.stdout:1/27: mkdir d1/df 0 2024-04-26T11:23:58.535 INFO:tasks.workunit.client.0.smithi073.stdout:9/29: readlink d0/d1/l7 0 2024-04-26T11:23:58.535 INFO:tasks.workunit.client.0.smithi073.stdout:5/40: write f2 [2199319,26594] 0 2024-04-26T11:23:58.536 INFO:tasks.workunit.client.0.smithi073.stdout:9/30: dread d0/f5 [0,4194304] 0 2024-04-26T11:23:58.537 INFO:tasks.workunit.client.0.smithi073.stdout:1/28: creat d1/d8/f10 x:0 0 0 2024-04-26T11:23:58.537 INFO:tasks.workunit.client.0.smithi073.stdout:5/41: mknod d4/de/c11 0 2024-04-26T11:23:58.537 INFO:tasks.workunit.client.0.smithi073.stdout:3/18: fsync d0/d2/f6 0 2024-04-26T11:23:58.537 INFO:tasks.workunit.client.0.smithi073.stdout:2/34: link f5 fb 0 2024-04-26T11:23:58.538 INFO:tasks.workunit.client.0.smithi073.stdout:2/35: mknod cc 0 2024-04-26T11:23:58.538 INFO:tasks.workunit.client.0.smithi073.stdout:9/31: dread d0/f5 [0,4194304] 0 2024-04-26T11:23:58.538 INFO:tasks.workunit.client.0.smithi073.stdout:1/29: chown d1/d8/ce 3 1 2024-04-26T11:23:58.539 INFO:tasks.workunit.client.0.smithi073.stdout:1/30: symlink d1/df/l11 0 2024-04-26T11:23:58.539 INFO:tasks.workunit.client.0.smithi073.stdout:9/32: write d0/f8 [1177050,94860] 0 2024-04-26T11:23:58.540 INFO:tasks.workunit.client.0.smithi073.stdout:1/31: fsync d1/d8/f9 0 2024-04-26T11:23:58.540 INFO:tasks.workunit.client.0.smithi073.stdout:9/33: mkdir d0/d1/db 0 2024-04-26T11:23:58.541 INFO:tasks.workunit.client.0.smithi073.stdout:9/34: write d0/fa [237769,39181] 0 2024-04-26T11:23:58.541 INFO:tasks.workunit.client.0.smithi073.stdout:1/32: fsync d1/d8/fd 0 2024-04-26T11:23:58.541 INFO:tasks.workunit.client.0.smithi073.stdout:1/33: mkdir d1/df/d12 0 2024-04-26T11:23:58.542 INFO:tasks.workunit.client.0.smithi073.stdout:1/34: chown d1/d8/f10 66538 1 2024-04-26T11:23:58.542 INFO:tasks.workunit.client.0.smithi073.stdout:2/36: getdents . 0 2024-04-26T11:23:58.542 INFO:tasks.workunit.client.0.smithi073.stdout:5/42: truncate f1 29875 0 2024-04-26T11:23:58.542 INFO:tasks.workunit.client.0.smithi073.stdout:2/37: write f2 [1506864,61145] 0 2024-04-26T11:23:58.542 INFO:tasks.workunit.client.0.smithi073.stdout:1/35: creat d1/f13 x:0 0 0 2024-04-26T11:23:58.543 INFO:tasks.workunit.client.0.smithi073.stdout:2/38: read fb [3598350,92952] 0 2024-04-26T11:23:58.543 INFO:tasks.workunit.client.0.smithi073.stdout:2/39: rmdir - no directory 2024-04-26T11:23:58.544 INFO:tasks.workunit.client.0.smithi073.stdout:9/35: rename d0/d1 to d0/dc 0 2024-04-26T11:23:58.544 INFO:tasks.workunit.client.0.smithi073.stdout:9/36: symlink d0/dc/ld 0 2024-04-26T11:23:58.545 INFO:tasks.workunit.client.0.smithi073.stdout:9/37: symlink d0/dc/db/le 0 2024-04-26T11:23:58.546 INFO:tasks.workunit.client.0.smithi073.stdout:1/36: dread d1/d6/fa [0,4194304] 0 2024-04-26T11:23:58.546 INFO:tasks.workunit.client.0.smithi073.stdout:9/38: write d0/fa [946586,75564] 0 2024-04-26T11:23:58.547 INFO:tasks.workunit.client.0.smithi073.stdout:1/37: rename d1 to d1/d6/d14 22 2024-04-26T11:23:58.547 INFO:tasks.workunit.client.0.smithi073.stdout:9/39: chown d0/f8 865888686 1 2024-04-26T11:23:58.547 INFO:tasks.workunit.client.0.smithi073.stdout:9/40: write d0/fa [837374,88716] 0 2024-04-26T11:23:58.548 INFO:tasks.workunit.client.0.smithi073.stdout:3/19: dread d0/d2/f6 [4194304,4194304] 0 2024-04-26T11:23:58.548 INFO:tasks.workunit.client.0.smithi073.stdout:9/41: stat d0/dc/ld 0 2024-04-26T11:23:58.548 INFO:tasks.workunit.client.0.smithi073.stdout:1/38: truncate d1/d8/f10 103019 0 2024-04-26T11:23:58.549 INFO:tasks.workunit.client.0.smithi073.stdout:9/42: write d0/fa [884628,73149] 0 2024-04-26T11:23:58.549 INFO:tasks.workunit.client.0.smithi073.stdout:3/20: creat d0/f7 x:0 0 0 2024-04-26T11:23:58.550 INFO:tasks.workunit.client.0.smithi073.stdout:1/39: chown d1/df/l11 783951 1 2024-04-26T11:23:58.550 INFO:tasks.workunit.client.0.smithi073.stdout:1/40: read - d1/d8/fd zero size 2024-04-26T11:23:58.550 INFO:tasks.workunit.client.0.smithi073.stdout:9/43: fsync d0/f5 0 2024-04-26T11:23:58.551 INFO:tasks.workunit.client.0.smithi073.stdout:9/44: write d0/f8 [2283134,69818] 0 2024-04-26T11:23:58.551 INFO:tasks.workunit.client.0.smithi073.stdout:1/41: fsync d1/d6/fa 0 2024-04-26T11:23:58.551 INFO:tasks.workunit.client.0.smithi073.stdout:2/40: truncate fb 5268073 0 2024-04-26T11:23:58.551 INFO:tasks.workunit.client.0.smithi073.stdout:5/43: dread f1 [0,4194304] 0 2024-04-26T11:23:58.551 INFO:tasks.workunit.client.0.smithi073.stdout:1/42: readlink d1/df/l11 0 2024-04-26T11:23:58.551 INFO:tasks.workunit.client.0.smithi073.stdout:9/45: write d0/fa [1729272,5800] 0 2024-04-26T11:23:58.551 INFO:tasks.workunit.client.0.smithi073.stdout:2/41: mkdir dd 0 2024-04-26T11:23:58.552 INFO:tasks.workunit.client.0.smithi073.stdout:5/44: chown d4/d8/la 547374 1 2024-04-26T11:23:58.552 INFO:tasks.workunit.client.0.smithi073.stdout:5/45: chown c3 34825264 1 2024-04-26T11:23:58.552 INFO:tasks.workunit.client.0.smithi073.stdout:1/43: creat d1/d8/f15 x:0 0 0 2024-04-26T11:23:58.552 INFO:tasks.workunit.client.0.smithi073.stdout:2/42: write f0 [3184653,68745] 0 2024-04-26T11:23:58.553 INFO:tasks.workunit.client.0.smithi073.stdout:5/46: write f2 [1837991,116745] 0 2024-04-26T11:23:58.553 INFO:tasks.workunit.client.0.smithi073.stdout:1/44: unlink d1/c4 0 2024-04-26T11:23:58.554 INFO:tasks.workunit.client.0.smithi073.stdout:1/45: dread - d1/d8/fd zero size 2024-04-26T11:23:58.554 INFO:tasks.workunit.client.0.smithi073.stdout:5/47: creat d4/d8/d9/f12 x:0 0 0 2024-04-26T11:23:58.557 INFO:tasks.workunit.client.0.smithi073.stdout:3/21: dwrite d0/f7 [0,4194304] 0 2024-04-26T11:23:58.561 INFO:tasks.workunit.client.0.smithi073.stdout:9/46: dwrite d0/f5 [0,4194304] 0 2024-04-26T11:23:58.564 INFO:tasks.workunit.client.0.smithi073.stdout:9/47: truncate d0/f8 2834945 0 2024-04-26T11:23:58.564 INFO:tasks.workunit.client.0.smithi073.stdout:9/48: chown d0/dc/db 26717 1 2024-04-26T11:23:58.566 INFO:tasks.workunit.client.0.smithi073.stdout:1/46: dwrite d1/d6/fa [0,4194304] 0 2024-04-26T11:23:58.566 INFO:tasks.workunit.client.0.smithi073.stdout:9/49: chown d0/dc/l6 83068803 1 2024-04-26T11:23:58.566 INFO:tasks.workunit.client.0.smithi073.stdout:5/48: dwrite d4/d8/fb [0,4194304] 0 2024-04-26T11:23:58.567 INFO:tasks.workunit.client.0.smithi073.stdout:1/47: fdatasync d1/f13 0 2024-04-26T11:23:58.567 INFO:tasks.workunit.client.0.smithi073.stdout:2/43: dread f7 [0,4194304] 0 2024-04-26T11:23:58.567 INFO:tasks.workunit.client.0.smithi073.stdout:1/48: read d1/d6/fa [2788063,107669] 0 2024-04-26T11:23:58.567 INFO:tasks.workunit.client.0.smithi073.stdout:3/22: dread d0/f7 [0,4194304] 0 2024-04-26T11:23:58.567 INFO:tasks.workunit.client.0.smithi073.stdout:1/49: readlink d1/df/l11 0 2024-04-26T11:23:58.570 INFO:tasks.workunit.client.0.smithi073.stdout:2/44: mkdir dd/de 0 2024-04-26T11:23:58.571 INFO:tasks.workunit.client.0.smithi073.stdout:2/45: rename f8 to dd/de/ff 0 2024-04-26T11:23:58.573 INFO:tasks.workunit.client.0.smithi073.stdout:2/46: truncate dd/de/ff 370989 0 2024-04-26T11:23:58.573 INFO:tasks.workunit.client.0.smithi073.stdout:3/23: dwrite d0/d2/f6 [0,4194304] 0 2024-04-26T11:23:58.575 INFO:tasks.workunit.client.0.smithi073.stdout:3/24: mknod d0/d2/c8 0 2024-04-26T11:23:58.579 INFO:tasks.workunit.client.0.smithi073.stdout:2/47: dwrite f2 [0,4194304] 0 2024-04-26T11:23:58.580 INFO:tasks.workunit.client.0.smithi073.stdout:2/48: write f9 [793543,20577] 0 2024-04-26T11:23:58.581 INFO:tasks.workunit.client.0.smithi073.stdout:3/25: getdents d0/d2 0 2024-04-26T11:23:58.582 INFO:tasks.workunit.client.0.smithi073.stdout:3/26: rename d0/d2/l4 to d0/d2/l9 0 2024-04-26T11:23:58.583 INFO:tasks.workunit.client.0.smithi073.stdout:3/27: creat d0/fa x:0 0 0 2024-04-26T11:23:58.583 INFO:tasks.workunit.client.0.smithi073.stdout:3/28: write d0/d2/f6 [4801737,32357] 0 2024-04-26T11:23:58.584 INFO:tasks.workunit.client.0.smithi073.stdout:3/29: chown d0/fa 101 1 2024-04-26T11:23:58.585 INFO:tasks.workunit.client.0.smithi073.stdout:2/49: truncate f9 545557 0 2024-04-26T11:23:58.586 INFO:tasks.workunit.client.0.smithi073.stdout:2/50: getdents dd 0 2024-04-26T11:23:58.586 INFO:tasks.workunit.client.0.smithi073.stdout:2/51: chown f7 12 1 2024-04-26T11:23:58.587 INFO:tasks.workunit.client.0.smithi073.stdout:2/52: creat dd/de/f10 x:0 0 0 2024-04-26T11:23:58.588 INFO:tasks.workunit.client.0.smithi073.stdout:2/53: dread - dd/de/f10 zero size 2024-04-26T11:23:58.589 INFO:tasks.workunit.client.0.smithi073.stdout:2/54: rename dd/de/f10 to dd/de/f11 0 2024-04-26T11:23:58.590 INFO:tasks.workunit.client.0.smithi073.stdout:1/50: dread d1/d8/f9 [0,4194304] 0 2024-04-26T11:23:58.591 INFO:tasks.workunit.client.0.smithi073.stdout:3/30: dwrite d0/f7 [0,4194304] 0 2024-04-26T11:23:58.594 INFO:tasks.workunit.client.0.smithi073.stdout:2/55: dread f6 [0,4194304] 0 2024-04-26T11:23:58.596 INFO:tasks.workunit.client.0.smithi073.stdout:2/56: link f5 dd/de/f12 0 2024-04-26T11:23:58.596 INFO:tasks.workunit.client.0.smithi073.stdout:3/31: dread d0/f7 [0,4194304] 0 2024-04-26T11:23:58.597 INFO:tasks.workunit.client.0.smithi073.stdout:3/32: chown d0 7236187 1 2024-04-26T11:23:58.597 INFO:tasks.workunit.client.0.smithi073.stdout:2/57: read f5 [3185900,39100] 0 2024-04-26T11:23:58.597 INFO:tasks.workunit.client.0.smithi073.stdout:3/33: mkdir d0/d2/db 0 2024-04-26T11:23:58.598 INFO:tasks.workunit.client.0.smithi073.stdout:2/58: mknod dd/c13 0 2024-04-26T11:23:58.599 INFO:tasks.workunit.client.0.smithi073.stdout:3/34: write d0/fa [25258,118881] 0 2024-04-26T11:23:58.599 INFO:tasks.workunit.client.0.smithi073.stdout:1/51: dwrite d1/d8/f9 [0,4194304] 0 2024-04-26T11:23:58.602 INFO:tasks.workunit.client.0.smithi073.stdout:1/52: mkdir d1/d16 0 2024-04-26T11:23:58.602 INFO:tasks.workunit.client.0.smithi073.stdout:3/35: creat d0/d2/fc x:0 0 0 2024-04-26T11:23:58.602 INFO:tasks.workunit.client.0.smithi073.stdout:1/53: symlink d1/d16/l17 0 2024-04-26T11:23:58.603 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:58.598+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:58.605 INFO:tasks.workunit.client.0.smithi073.stdout:3/36: dread d0/fa [0,4194304] 0 2024-04-26T11:23:58.606 INFO:tasks.workunit.client.0.smithi073.stdout:1/54: write d1/d6/fb [116625,42703] 0 2024-04-26T11:23:58.606 INFO:tasks.workunit.client.0.smithi073.stdout:2/59: dread fb [4194304,4194304] 0 2024-04-26T11:23:58.606 INFO:tasks.workunit.client.0.smithi073.stdout:3/37: fsync d0/fa 0 2024-04-26T11:23:58.607 INFO:tasks.workunit.client.0.smithi073.stdout:2/60: read f7 [1198701,31030] 0 2024-04-26T11:23:58.607 INFO:tasks.workunit.client.0.smithi073.stdout:1/55: rmdir d1/d6 39 2024-04-26T11:23:58.607 INFO:tasks.workunit.client.0.smithi073.stdout:1/56: stat d1/d16 0 2024-04-26T11:23:58.607 INFO:tasks.workunit.client.0.smithi073.stdout:3/38: mknod d0/d2/cd 0 2024-04-26T11:23:58.607 INFO:tasks.workunit.client.0.smithi073.stdout:2/61: mkdir dd/de/d14 0 2024-04-26T11:23:58.608 INFO:tasks.workunit.client.0.smithi073.stdout:3/39: write d0/fa [993009,45796] 0 2024-04-26T11:23:58.608 INFO:tasks.workunit.client.0.smithi073.stdout:3/40: creat d0/d2/db/fe x:0 0 0 2024-04-26T11:23:58.611 INFO:tasks.workunit.client.0.smithi073.stdout:1/57: dread d1/d6/fb [0,4194304] 0 2024-04-26T11:23:58.612 INFO:tasks.workunit.client.0.smithi073.stdout:1/58: creat d1/d8/f18 x:0 0 0 2024-04-26T11:23:58.615 INFO:tasks.workunit.client.0.smithi073.stdout:2/62: dwrite f6 [0,4194304] 0 2024-04-26T11:23:58.617 INFO:tasks.workunit.client.0.smithi073.stdout:3/41: dwrite d0/d2/db/fe [0,4194304] 0 2024-04-26T11:23:58.618 INFO:tasks.workunit.client.0.smithi073.stdout:3/42: symlink d0/lf 0 2024-04-26T11:23:58.618 INFO:tasks.workunit.client.0.smithi073.stdout:2/63: link f7 dd/de/d14/f15 0 2024-04-26T11:23:58.619 INFO:tasks.workunit.client.0.smithi073.stdout:2/64: symlink dd/l16 0 2024-04-26T11:23:58.621 INFO:tasks.workunit.client.0.smithi073.stdout:2/65: dread f7 [0,4194304] 0 2024-04-26T11:23:58.621 INFO:tasks.workunit.client.0.smithi073.stdout:2/66: chown dd/de/f11 4 1 2024-04-26T11:23:58.622 INFO:tasks.workunit.client.0.smithi073.stdout:2/67: mkdir dd/de/d14/d17 0 2024-04-26T11:23:58.622 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:23:58.623 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:23:58.623 INFO:tasks.workunit.client.0.smithi073.stdout:2/68: creat dd/de/f18 x:0 0 0 2024-04-26T11:23:58.623 INFO:tasks.workunit.client.0.smithi073.stdout:2/69: chown l4 23041561 1 2024-04-26T11:23:58.625 INFO:tasks.workunit.client.0.smithi073.stdout:1/59: dwrite d1/d8/f9 [0,4194304] 0 2024-04-26T11:23:58.625 INFO:tasks.workunit.client.0.smithi073.stdout:1/60: chown d1/f13 318 1 2024-04-26T11:23:58.625 INFO:tasks.workunit.client.0.smithi073.stdout:1/61: chown d1/d8/f10 103 1 2024-04-26T11:23:58.626 INFO:tasks.workunit.client.0.smithi073.stdout:3/43: getdents d0 0 2024-04-26T11:23:58.627 INFO:tasks.workunit.client.0.smithi073.stdout:1/62: mknod d1/c19 0 2024-04-26T11:23:58.627 INFO:tasks.workunit.client.0.smithi073.stdout:3/44: unlink d0/l5 0 2024-04-26T11:23:58.627 INFO:tasks.workunit.client.0.smithi073.stdout:3/45: stat d0/d2 0 2024-04-26T11:23:58.628 INFO:tasks.workunit.client.0.smithi073.stdout:3/46: symlink d0/l10 0 2024-04-26T11:23:58.628 INFO:tasks.workunit.client.0.smithi073.stdout:1/63: link d1/f13 d1/f1a 0 2024-04-26T11:23:58.629 INFO:tasks.workunit.client.0.smithi073.stdout:3/47: chown d0/l10 119 1 2024-04-26T11:23:58.629 INFO:tasks.workunit.client.0.smithi073.stdout:2/70: dread dd/de/f12 [0,4194304] 0 2024-04-26T11:23:58.630 INFO:tasks.workunit.client.0.smithi073.stdout:2/71: symlink dd/de/d14/l19 0 2024-04-26T11:23:58.631 INFO:tasks.workunit.client.0.smithi073.stdout:2/72: write f9 [495682,56868] 0 2024-04-26T11:23:58.637 INFO:tasks.workunit.client.0.smithi073.stdout:1/64: dwrite d1/f3 [4194304,4194304] 0 2024-04-26T11:23:58.637 INFO:tasks.workunit.client.0.smithi073.stdout:3/48: dwrite d0/fa [0,4194304] 0 2024-04-26T11:23:58.640 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:23:58.641 INFO:tasks.workunit.client.0.smithi073.stdout:2/73: dwrite f6 [0,4194304] 0 2024-04-26T11:23:58.641 INFO:tasks.workunit.client.0.smithi073.stdout:3/49: mkdir d0/d11 0 2024-04-26T11:23:58.641 INFO:tasks.workunit.client.0.smithi073.stdout:3/50: stat d0/d2/fc 0 2024-04-26T11:23:58.642 INFO:tasks.workunit.client.0.smithi073.stdout:2/74: chown dd/c13 432657690 1 2024-04-26T11:23:58.642 INFO:tasks.workunit.client.0.smithi073.stdout:3/51: creat d0/d11/f12 x:0 0 0 2024-04-26T11:23:58.645 INFO:tasks.workunit.client.0.smithi073.stdout:1/65: dwrite d1/d8/f15 [0,4194304] 0 2024-04-26T11:23:58.646 INFO:tasks.workunit.client.0.smithi073.stdout:1/66: creat d1/df/f1b x:0 0 0 2024-04-26T11:23:58.646 INFO:tasks.workunit.client.0.smithi073.stdout:1/67: stat d1/c19 0 2024-04-26T11:23:58.646 INFO:tasks.workunit.client.0.smithi073.stdout:1/68: chown d1/d6 20685 1 2024-04-26T11:23:58.647 INFO:tasks.workunit.client.0.smithi073.stdout:1/69: creat d1/df/f1c x:0 0 0 2024-04-26T11:23:58.647 INFO:tasks.workunit.client.0.smithi073.stdout:1/70: rmdir d1/d16 39 2024-04-26T11:23:58.650 INFO:tasks.workunit.client.0.smithi073.stdout:3/52: truncate d0/d2/db/fe 2894837 0 2024-04-26T11:23:58.650 INFO:tasks.workunit.client.0.smithi073.stdout:1/71: symlink d1/l1d 0 2024-04-26T11:23:58.651 INFO:tasks.workunit.client.0.smithi073.stdout:3/53: chown d0/d2/cd 62794 1 2024-04-26T11:23:58.651 INFO:tasks.workunit.client.0.smithi073.stdout:3/54: fsync d0/d2/fc 0 2024-04-26T11:23:58.651 INFO:tasks.workunit.client.0.smithi073.stdout:1/72: write d1/d8/f15 [1696068,76219] 0 2024-04-26T11:23:58.652 INFO:tasks.workunit.client.0.smithi073.stdout:3/55: read - d0/d2/fc zero size 2024-04-26T11:23:58.652 INFO:tasks.workunit.client.0.smithi073.stdout:1/73: truncate d1/df/f1c 315818 0 2024-04-26T11:23:58.652 INFO:tasks.workunit.client.0.smithi073.stdout:3/56: creat d0/d11/f13 x:0 0 0 2024-04-26T11:23:58.653 INFO:tasks.workunit.client.0.smithi073.stdout:3/57: mknod d0/d11/c14 0 2024-04-26T11:23:58.654 INFO:tasks.workunit.client.0.smithi073.stdout:3/58: creat d0/d2/db/f15 x:0 0 0 2024-04-26T11:23:58.655 INFO:tasks.workunit.client.0.smithi073.stdout:3/59: mknod d0/d2/c16 0 2024-04-26T11:23:58.660 INFO:tasks.workunit.client.0.smithi073.stdout:1/74: dwrite d1/d8/f18 [0,4194304] 0 2024-04-26T11:23:58.662 INFO:tasks.workunit.client.0.smithi073.stdout:3/60: rmdir d0/d2/db 39 2024-04-26T11:23:58.662 INFO:tasks.workunit.client.0.smithi073.stdout:3/61: stat d0/fa 0 2024-04-26T11:23:58.662 INFO:tasks.workunit.client.0.smithi073.stdout:1/75: creat d1/d16/f1e x:0 0 0 2024-04-26T11:23:58.663 INFO:tasks.workunit.client.0.smithi073.stdout:1/76: unlink d1/d16/l17 0 2024-04-26T11:23:58.663 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:23:58.667 INFO:tasks.workunit.client.0.smithi073.stdout:1/77: dread d1/d8/f9 [0,4194304] 0 2024-04-26T11:23:58.668 INFO:tasks.workunit.client.0.smithi073.stdout:1/78: getdents d1/df/d12 0 2024-04-26T11:23:58.669 INFO:tasks.workunit.client.0.smithi073.stdout:2/75: fdatasync f0 0 2024-04-26T11:23:58.669 INFO:tasks.workunit.client.0.smithi073.stdout:1/79: rename d1/l1d to d1/d6/l1f 0 2024-04-26T11:23:58.670 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:23:58.670 INFO:tasks.workunit.client.0.smithi073.stdout:1/80: creat d1/d16/f20 x:0 0 0 2024-04-26T11:23:58.671 INFO:tasks.workunit.client.0.smithi073.stdout:1/81: write d1/d8/f10 [902946,48312] 0 2024-04-26T11:23:58.671 INFO:tasks.workunit.client.0.smithi073.stdout:1/82: creat d1/df/f21 x:0 0 0 2024-04-26T11:23:58.672 INFO:tasks.workunit.client.0.smithi073.stdout:1/83: read - d1/df/f21 zero size 2024-04-26T11:23:58.674 INFO:tasks.workunit.client.0.smithi073.stdout:1/84: rename d1/d8/f10 to d1/d6/f22 0 2024-04-26T11:23:58.674 INFO:tasks.workunit.client.0.smithi073.stdout:1/85: stat d1/f3 0 2024-04-26T11:23:58.676 INFO:tasks.workunit.client.0.smithi073.stdout:2/76: dwrite f2 [0,4194304] 0 2024-04-26T11:23:58.677 INFO:tasks.workunit.client.0.smithi073.stdout:2/77: read dd/de/f12 [1028873,128104] 0 2024-04-26T11:23:58.678 INFO:tasks.workunit.client.0.smithi073.stdout:1/86: fsync d1/d6/f22 0 2024-04-26T11:23:58.679 INFO:tasks.workunit.client.0.smithi073.stdout:2/78: creat dd/f1a x:0 0 0 2024-04-26T11:23:58.679 INFO:tasks.workunit.client.0.smithi073.stdout:2/79: creat dd/f1b x:0 0 0 2024-04-26T11:23:58.680 INFO:tasks.workunit.client.0.smithi073.stdout:2/80: chown dd/f1a 26 1 2024-04-26T11:23:58.680 INFO:tasks.workunit.client.0.smithi073.stdout:2/81: write dd/f1b [748581,122202] 0 2024-04-26T11:23:58.681 INFO:tasks.workunit.client.0.smithi073.stdout:2/82: mkdir dd/d1c 0 2024-04-26T11:23:58.681 INFO:tasks.workunit.client.0.smithi073.stdout:1/87: write d1/f13 [29626,84505] 0 2024-04-26T11:23:58.682 INFO:tasks.workunit.client.0.smithi073.stdout:1/88: write d1/f3 [2904242,89436] 0 2024-04-26T11:23:58.684 INFO:tasks.workunit.client.0.smithi073.stdout:1/89: truncate d1/d8/f18 4585804 0 2024-04-26T11:23:58.684 INFO:tasks.workunit.client.0.smithi073.stdout:1/90: creat d1/df/f23 x:0 0 0 2024-04-26T11:23:58.686 INFO:tasks.workunit.client.0.smithi073.stdout:1/91: symlink d1/l24 0 2024-04-26T11:23:58.686 INFO:tasks.workunit.client.0.smithi073.stdout:1/92: rename d1/d16/f1e to d1/d6/f25 0 2024-04-26T11:23:58.688 INFO:tasks.workunit.client.0.smithi073.stdout:1/93: write d1/df/f1c [1152551,103557] 0 2024-04-26T11:23:58.689 INFO:tasks.workunit.client.0.smithi073.stdout:2/83: dwrite dd/de/d14/f15 [0,4194304] 0 2024-04-26T11:23:58.689 INFO:tasks.workunit.client.0.smithi073.stdout:1/94: fsync d1/d6/f25 0 2024-04-26T11:23:58.690 INFO:tasks.workunit.client.0.smithi073.stdout:1/95: rename d1/c2 to d1/df/c26 0 2024-04-26T11:23:58.691 INFO:tasks.workunit.client.0.smithi073.stdout:1/96: fsync d1/d8/f9 0 2024-04-26T11:23:58.692 INFO:tasks.workunit.client.0.smithi073.stdout:1/97: mknod d1/c27 0 2024-04-26T11:23:58.692 INFO:tasks.workunit.client.0.smithi073.stdout:1/98: creat d1/df/d12/f28 x:0 0 0 2024-04-26T11:23:58.693 INFO:tasks.workunit.client.0.smithi073.stdout:1/99: read d1/d6/fa [1830441,78037] 0 2024-04-26T11:23:58.693 INFO:tasks.workunit.client.0.smithi073.stdout:1/100: dread - d1/df/f23 zero size 2024-04-26T11:23:58.695 INFO:tasks.workunit.client.0.smithi073.stdout:1/101: link d1/d6/fa d1/d6/f29 0 2024-04-26T11:23:58.697 INFO:tasks.workunit.client.0.smithi073.stdout:1/102: truncate d1/d6/f22 422220 0 2024-04-26T11:23:58.699 INFO:tasks.workunit.client.0.smithi073.stdout:2/84: dwrite dd/f1a [0,4194304] 0 2024-04-26T11:23:58.699 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:23:58.700 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:23:58.701 INFO:tasks.workunit.client.0.smithi073.stdout:2/85: rename dd/de/d14 to dd/d1c/d1d 0 2024-04-26T11:23:58.704 INFO:tasks.workunit.client.0.smithi073.stdout:2/86: link f2 dd/d1c/d1d/f1e 0 2024-04-26T11:23:58.704 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:58.702+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:58.705 INFO:tasks.workunit.client.0.smithi073.stdout:1/103: dwrite d1/d6/fa [0,4194304] 0 2024-04-26T11:23:58.708 INFO:tasks.workunit.client.0.smithi073.stdout:2/87: read dd/de/ff [277867,40057] 0 2024-04-26T11:23:58.709 INFO:tasks.workunit.client.0.smithi073.stdout:2/88: fdatasync f7 0 2024-04-26T11:23:58.709 INFO:tasks.workunit.client.0.smithi073.stdout:2/89: chown f7 263 1 2024-04-26T11:23:58.710 INFO:tasks.workunit.client.0.smithi073.stdout:2/90: mknod dd/d1c/d1d/c1f 0 2024-04-26T11:23:58.712 INFO:tasks.workunit.client.0.smithi073.stdout:2/91: write dd/f1a [206571,45007] 0 2024-04-26T11:23:58.712 INFO:tasks.workunit.client.0.smithi073.stdout:1/104: dwrite d1/df/f21 [0,4194304] 0 2024-04-26T11:23:58.721 INFO:tasks.workunit.client.0.smithi073.stdout:1/105: dwrite d1/df/d12/f28 [0,4194304] 0 2024-04-26T11:23:58.725 INFO:tasks.workunit.client.0.smithi073.stdout:1/106: getdents d1 0 2024-04-26T11:23:58.726 INFO:tasks.workunit.client.0.smithi073.stdout:1/107: unlink d1/d8/f9 0 2024-04-26T11:23:58.726 INFO:tasks.workunit.client.0.smithi073.stdout:1/108: rmdir d1/df 39 2024-04-26T11:23:58.727 INFO:tasks.workunit.client.0.smithi073.stdout:1/109: chown d1/d16/f20 124 1 2024-04-26T11:23:58.728 INFO:tasks.workunit.client.0.smithi073.stdout:1/110: fdatasync d1/d6/f25 0 2024-04-26T11:23:58.728 INFO:tasks.workunit.client.0.smithi073.stdout:1/111: creat d1/df/d12/f2a x:0 0 0 2024-04-26T11:23:58.729 INFO:tasks.workunit.client.0.smithi073.stdout:1/112: read - d1/d6/f25 zero size 2024-04-26T11:23:58.729 INFO:tasks.workunit.client.0.smithi073.stdout:1/113: readlink d1/d6/l1f 0 2024-04-26T11:23:58.729 INFO:tasks.workunit.client.0.smithi073.stdout:1/114: write d1/d6/f25 [74326,24911] 0 2024-04-26T11:23:58.730 INFO:tasks.workunit.client.0.smithi073.stdout:1/115: write d1/f1a [515027,1350] 0 2024-04-26T11:23:58.733 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:23:58.734 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:23:58.735 INFO:tasks.workunit.client.0.smithi073.stdout:1/116: truncate d1/f13 386911 0 2024-04-26T11:23:58.736 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:23:58.737 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:23:58.740 INFO:tasks.workunit.client.0.smithi073.stdout:1/117: truncate d1/f13 342991 0 2024-04-26T11:23:58.741 INFO:tasks.workunit.client.0.smithi073.stdout:1/118: fdatasync d1/f3 0 2024-04-26T11:23:58.741 INFO:tasks.workunit.client.0.smithi073.stdout:1/119: write d1/d8/f18 [2854754,7734] 0 2024-04-26T11:23:58.742 INFO:tasks.workunit.client.0.smithi073.stdout:1/120: creat d1/f2b x:0 0 0 2024-04-26T11:23:58.743 INFO:tasks.workunit.client.0.smithi073.stdout:1/121: dread d1/d8/fd [0,4194304] 0 2024-04-26T11:23:58.743 INFO:tasks.workunit.client.0.smithi073.stdout:1/122: chown d1/df/f1c 52 1 2024-04-26T11:23:58.749 INFO:tasks.workunit.client.0.smithi073.stdout:1/123: dwrite d1/df/f21 [0,4194304] 0 2024-04-26T11:23:58.750 INFO:tasks.workunit.client.0.smithi073.stdout:1/124: readlink d1/l24 0 2024-04-26T11:23:58.751 INFO:tasks.workunit.client.0.smithi073.stdout:1/125: creat d1/df/d12/f2c x:0 0 0 2024-04-26T11:23:58.751 INFO:tasks.workunit.client.0.smithi073.stdout:1/126: creat d1/d8/f2d x:0 0 0 2024-04-26T11:23:58.757 INFO:tasks.workunit.client.0.smithi073.stdout:1/127: dwrite d1/f3 [4194304,4194304] 0 2024-04-26T11:23:58.758 INFO:tasks.workunit.client.0.smithi073.stdout:1/128: read d1/d8/f18 [2545321,74615] 0 2024-04-26T11:23:58.759 INFO:tasks.workunit.client.0.smithi073.stdout:1/129: mkdir d1/d8/d2e 0 2024-04-26T11:23:58.761 INFO:tasks.workunit.client.0.smithi073.stdout:1/130: link d1/d6/fa d1/df/d12/f2f 0 2024-04-26T11:23:58.761 INFO:tasks.workunit.client.0.smithi073.stdout:1/131: write d1/f3 [7559406,68012] 0 2024-04-26T11:23:58.762 INFO:tasks.workunit.client.0.smithi073.stdout:1/132: fdatasync d1/d6/fa 0 2024-04-26T11:23:58.762 INFO:tasks.workunit.client.0.smithi073.stdout:1/133: mknod d1/c30 0 2024-04-26T11:23:58.806 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:58.802+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:58.812 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:58.813 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:23:58.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:23:58.813 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:58.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.813 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:58.813 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:58.813 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 125.12522060000001, 2024-04-26T11:23:58.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023018456, 2024-04-26T11:23:58.813 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.813 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.813 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683529+0000", 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683526+0000", 2024-04-26T11:23:58.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:58.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683561+0000", 2024-04-26T11:23:58.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5649999999999999e-05 2024-04-26T11:23:58.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683598+0000", 2024-04-26T11:23:58.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6726e-05 2024-04-26T11:23:58.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683626+0000", 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7852999999999999e-05 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684309+0000", 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00068314500000000002 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684485+0000", 2024-04-26T11:23:58.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000175778 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685093+0000", 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00060842899999999996 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688840+0000", 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037470479999999998 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.705566+0000", 2024-04-26T11:23:58.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016725963999999999 2024-04-26T11:23:58.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706436+0000", 2024-04-26T11:23:58.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00087013300000000004 2024-04-26T11:23:58.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706547+0000", 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011065000000000001 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 125.125094205, 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023294324000000002, 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.819 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683655+0000", 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683653+0000", 2024-04-26T11:23:58.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:58.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683665+0000", 2024-04-26T11:23:58.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1593000000000001e-05 2024-04-26T11:23:58.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683684+0000", 2024-04-26T11:23:58.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.927e-05 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683704+0000", 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.995e-05 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686068+0000", 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023638909999999999 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686190+0000", 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012224600000000001 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686577+0000", 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038646399999999999 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691584+0000", 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050076219999999998 2024-04-26T11:23:58.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706719+0000", 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015135009 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706830+0000", 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011061 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.706949+0000", 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011927200000000001 2024-04-26T11:23:58.824 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 125.12500541199999, 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027629687, 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:58.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683744+0000", 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683742+0000", 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683779+0000", 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6729e-05 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683799+0000", 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9823999999999999e-05 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683832+0000", 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3436000000000003e-05 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686047+0000", 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022141930000000002 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686296+0000", 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024977400000000002 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686581+0000", 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028416100000000001 2024-04-26T11:23:58.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691597+0000", 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050161989999999998 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711147+0000", 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019550112000000001 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711269+0000", 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012240299999999999 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711373+0000", 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104159 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.830 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 125.124900599, 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030226672999999999, 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683849+0000", 2024-04-26T11:23:58.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683847+0000", 2024-04-26T11:23:58.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:58.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683856+0000", 2024-04-26T11:23:58.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9060000000000008e-06 2024-04-26T11:23:58.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683873+0000", 2024-04-26T11:23:58.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T11:23:58.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683887+0000", 2024-04-26T11:23:58.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3900000000000001e-05 2024-04-26T11:23:58.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687168+0000", 2024-04-26T11:23:58.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032807180000000002 2024-04-26T11:23:58.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687338+0000", 2024-04-26T11:23:58.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016981799999999999 2024-04-26T11:23:58.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:58.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687515+0000", 2024-04-26T11:23:58.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017788600000000001 2024-04-26T11:23:58.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691620+0000", 2024-04-26T11:23:58.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041046149999999998 2024-04-26T11:23:58.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.711467+0000", 2024-04-26T11:23:58.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019846652999999999 2024-04-26T11:23:58.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.713972+0000", 2024-04-26T11:23:58.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025048480000000001 2024-04-26T11:23:58.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714075+0000", 2024-04-26T11:23:58.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103689 2024-04-26T11:23:58.839 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.840 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.840 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.840 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:58.840 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:58.840 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 125.124849943, 2024-04-26T11:23:58.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02331014, 2024-04-26T11:23:58.840 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.841 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.841 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:58.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683899+0000", 2024-04-26T11:23:58.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683898+0000", 2024-04-26T11:23:58.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:58.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683906+0000", 2024-04-26T11:23:58.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5530000000000004e-06 2024-04-26T11:23:58.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683922+0000", 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6483000000000001e-05 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683939+0000", 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6977e-05 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687147+0000", 2024-04-26T11:23:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003208388 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687314+0000", 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000166136 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.687487+0000", 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000172955 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.691662+0000", 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041753820000000001 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707033+0000", 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015371493999999999 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707119+0000", 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5562999999999994e-05 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707209+0000", 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0348999999999998e-05 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:29 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 125.12479299, 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025228707999999999, 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.848 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683956+0000", 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683955+0000", 2024-04-26T11:23:58.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683963+0000", 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4139999999999997e-06 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683978+0000", 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5342999999999999e-05 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.683991+0000", 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684126+0000", 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013540199999999999 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684452+0000", 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032583800000000001 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 0", 2024-04-26T11:23:58.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.685035+0000", 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058285499999999996 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688838+0000", 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038027270000000001 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708021+0000", 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019183722 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.708281+0000", 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025985199999999998 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.709185+0000", 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00090354900000000002 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:58.853 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 125.124733998, 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030555154000000001, 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684015+0000", 2024-04-26T11:23:58.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684014+0000", 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684021+0000", 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.64e-06 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684043+0000", 2024-04-26T11:23:58.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2073e-05 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684057+0000", 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4097000000000001e-05 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686084+0000", 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020268439999999999 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.686392+0000", 2024-04-26T11:23:58.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030809099999999997 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.714570+0000", 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028178712000000002 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 125.12463099199999, 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023404432999999999, 2024-04-26T11:23:58.857 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684118+0000", 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684117+0000", 2024-04-26T11:23:58.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:58.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684124+0000", 2024-04-26T11:23:58.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1539999999999996e-06 2024-04-26T11:23:58.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684144+0000", 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9629000000000001e-05 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684181+0000", 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6916999999999999e-05 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688008+0000", 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038269770000000001 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.688201+0000", 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019319199999999999 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.707523+0000", 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019321913999999999 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e17)", 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 125.124555152, 2024-04-26T11:23:58.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025846930000000001, 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684194+0000", 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684193+0000", 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684204+0000", 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0886999999999999e-05 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684227+0000", 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3583000000000001e-05 2024-04-26T11:23:58.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684241+0000", 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3813e-05 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684344+0000", 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103186 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.684883+0000", 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00053878200000000002 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:21:53.710041+0000", 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.025158006 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:5 4.10 4:09a4c37f:::10000000003.00000001:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.668640924000002, 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.029900301000000001, 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.865 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 5 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140108+0000", 2024-04-26T11:23:58.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.140105+0000", 2024-04-26T11:23:58.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999967 2024-04-26T11:23:58.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146164+0000", 2024-04-26T11:23:58.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060589709999999998 2024-04-26T11:23:58.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146195+0000", 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0618999999999999e-05 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146210+0000", 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4856e-05 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146386+0000", 2024-04-26T11:23:58.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017677799999999999 2024-04-26T11:23:58.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.146752+0000", 2024-04-26T11:23:58.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000366065 2024-04-26T11:23:58.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:58.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.147102+0000", 2024-04-26T11:23:58.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034963300000000002 2024-04-26T11:23:58.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.167955+0000", 2024-04-26T11:23:58.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020852956999999998 2024-04-26T11:23:58.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169930+0000", 2024-04-26T11:23:58.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001975325 2024-04-26T11:23:58.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.169977+0000", 2024-04-26T11:23:58.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7151999999999998e-05 2024-04-26T11:23:58.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.170009+0000", 2024-04-26T11:23:58.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1075000000000003e-05 2024-04-26T11:23:58.872 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.872 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.872 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.873 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:11 4.28 4:177a762d:::10000000201.00000000:head [write 0~2108] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:58.873 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:58.873 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.659222133, 2024-04-26T11:23:58.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013991071000000001, 2024-04-26T11:23:58.873 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.873 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.873 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:58.873 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:58.874 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:58.874 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 11 2024-04-26T11:23:58.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.874 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:58.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149527+0000", 2024-04-26T11:23:58.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149525+0000", 2024-04-26T11:23:58.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:58.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149536+0000", 2024-04-26T11:23:58.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0976e-05 2024-04-26T11:23:58.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149558+0000", 2024-04-26T11:23:58.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2096e-05 2024-04-26T11:23:58.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149586+0000", 2024-04-26T11:23:58.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7803000000000001e-05 2024-04-26T11:23:58.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149644+0000", 2024-04-26T11:23:58.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8371000000000001e-05 2024-04-26T11:23:58.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149741+0000", 2024-04-26T11:23:58.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6898000000000006e-05 2024-04-26T11:23:58.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:58.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.149843+0000", 2024-04-26T11:23:58.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102252 2024-04-26T11:23:58.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157109+0000", 2024-04-26T11:23:58.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007265245 2024-04-26T11:23:58.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163241+0000", 2024-04-26T11:23:58.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061323510000000003 2024-04-26T11:23:58.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163417+0000", 2024-04-26T11:23:58.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017638800000000001 2024-04-26T11:23:58.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163518+0000", 2024-04-26T11:23:58.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100717 2024-04-26T11:23:58.881 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.881 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.881 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.882 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:12 4.28 4:15246602:::10000000202.00000000:head [write 0~1238] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T11:23:58.882 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:58.882 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.658393280999999, 2024-04-26T11:23:58.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013385179000000001, 2024-04-26T11:23:58.882 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.882 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.882 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:58.883 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:58.883 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:58.883 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 12 2024-04-26T11:23:58.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.883 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:58.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150356+0000", 2024-04-26T11:23:58.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150355+0000", 2024-04-26T11:23:58.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:58.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150364+0000", 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0939999999999997e-06 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150379+0000", 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5156e-05 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150388+0000", 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8259999999999999e-06 2024-04-26T11:23:58.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150427+0000", 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9366999999999998e-05 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150532+0000", 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104666 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.150671+0000", 2024-04-26T11:23:58.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013879300000000001 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.157773+0000", 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071026140000000001 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163538+0000", 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057649659999999998 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163650+0000", 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011216 2024-04-26T11:23:58.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:41.163741+0000", 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0810999999999995e-05 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:151 3.1a 3:5e41ab69:::200.00000005:head [write 0~4194304 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e60)", 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:51.100102+0000", 2024-04-26T11:23:58.888 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.7086470120000001, 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.030897556999999999, 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.100102+0000", 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.100102+0000", 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.100100+0000", 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107187+0000", 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070870680000000002 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107209+0000", 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1835999999999999e-05 2024-04-26T11:23:58.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107221+0000", 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.169e-05 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107277+0000", 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6923999999999999e-05 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107402+0000", 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012408800000000001 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:58.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.107522+0000", 2024-04-26T11:23:58.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012063200000000001 2024-04-26T11:23:58.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.119336+0000", 2024-04-26T11:23:58.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011813716 2024-04-26T11:23:58.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.130905+0000", 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011568858 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.130953+0000", 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7907000000000001e-05 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:51.131000+0000", 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7077999999999999e-05 2024-04-26T11:23:58.896 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:158 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals,omap-rm-keys] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.411146+0000", 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3976036000000001, 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.039515683000000003, 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411146+0000", 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411146+0000", 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411145+0000", 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411623+0000", 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00047895000000000001 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411632+0000", 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5809999999999997e-06 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411637+0000", 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4599999999999996e-06 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411691+0000", 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4735999999999999e-05 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.411777+0000", 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6106999999999994e-05 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450553+0000", 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.038775865999999999 2024-04-26T11:23:58.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450595+0000", 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2218000000000001e-05 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450661+0000", 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5819000000000001e-05 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8084 4.3e 4:7db30d2d:::100000024cf.00000000:head [write 0~556] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.416677+0000", 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3920719290000001, 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016860281000000001, 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8084 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416677+0000", 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416677+0000", 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416676+0000", 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416684+0000", 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5629999999999992e-06 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416699+0000", 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5094e-05 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416709+0000", 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6500000000000008e-06 2024-04-26T11:23:58.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.416770+0000", 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0730999999999998e-05 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.417003+0000", 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000233012 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.417228+0000", 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022515499999999999 2024-04-26T11:23:58.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.419061+0000", 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018333379999999999 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433440+0000", 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014378905000000001 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433498+0000", 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7442000000000003e-05 2024-04-26T11:23:58.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433538+0000", 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9814999999999997e-05 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8101 4.6 4:6184a118:::100000024e0.00000000:head [write 0~758] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.431332+0000", 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.377416814, 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019211669000000001, 2024-04-26T11:23:58.907 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8101 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431332+0000", 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431332+0000", 2024-04-26T11:23:58.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431331+0000", 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431338+0000", 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4960000000000001e-06 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431350+0000", 2024-04-26T11:23:58.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.236e-05 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431357+0000", 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0380000000000002e-06 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431465+0000", 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010759 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431702+0000", 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023764200000000001 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.431920+0000", 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021747499999999999 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.434899+0000", 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029786280000000001 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450464+0000", 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015565903000000001 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450501+0000", 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6698e-05 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450544+0000", 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2855000000000002e-05 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8102 4.16 4:69fb0660:::100000024e1.00000000:head [write 0~754] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.432119+0000", 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.376629919, 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018700907999999999, 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8102 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432119+0000", 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432119+0000", 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432119+0000", 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432124+0000", 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0080000000000002e-06 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432133+0000", 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4299999999999995e-06 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432141+0000", 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6190000000000002e-06 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432863+0000", 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00072231599999999997 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433138+0000", 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027466399999999998 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450738+0000", 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017599895000000001 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450768+0000", 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0778000000000002e-05 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450820+0000", 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1869000000000001e-05 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8103 4.29 4:9509e2f0:::100000024e2.00000000:head [write 0~1508] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:58.917 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.432951+0000", 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3757977109999997, 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017877201999999998, 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8103 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432951+0000", 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432951+0000", 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432950+0000", 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432959+0000", 2024-04-26T11:23:58.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7909999999999993e-06 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432977+0000", 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8068e-05 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.432990+0000", 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3324e-05 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433039+0000", 2024-04-26T11:23:58.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8998000000000001e-05 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.433175+0000", 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000135473 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450596+0000", 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017421326000000001 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450700+0000", 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010399399999999999 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.450829+0000", 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012846999999999999 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.922 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8106 4.20 4:050a9529:::100000024e5.00000000:head [write 0~669] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.435788+0000", 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3729616089999999, 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015307497, 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8106 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435788+0000", 2024-04-26T11:23:58.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435788+0000", 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435787+0000", 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435792+0000", 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.631e-06 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435804+0000", 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.185e-05 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435811+0000", 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5300000000000002e-06 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435850+0000", 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9338000000000002e-05 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.435936+0000", 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6212999999999996e-05 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451009+0000", 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015072478 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451036+0000", 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7373e-05 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451095+0000", 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9089999999999998e-05 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:8107 4.a 4:51e7f5fe:::100000024e6.00000000:head [write 0~1022] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:58.927 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:54.437795+0000", 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3709538969999997, 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013426875, 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 8107 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:58.928 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437795+0000", 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437795+0000", 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437795+0000", 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:58.929 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437799+0000", 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8149999999999996e-06 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437809+0000", 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3149999999999998e-06 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437813+0000", 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6199999999999998e-06 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.930 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437846+0000", 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2702e-05 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.437928+0000", 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1984000000000007e-05 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451073+0000", 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013145436999999999 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.931 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451146+0000", 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2878000000000003e-05 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:54.451222+0000", 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5884999999999996e-05 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:58.932 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:58.935 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:23:58.939 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:58.930+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:58.947 INFO:tasks.workunit.client.0.smithi073.stdout:0/24: sync 2024-04-26T11:23:58.947 INFO:tasks.workunit.client.0.smithi073.stdout:7/13: sync 2024-04-26T11:23:58.947 INFO:tasks.workunit.client.0.smithi073.stdout:6/10: sync 2024-04-26T11:23:58.947 INFO:tasks.workunit.client.0.smithi073.stdout:4/10: sync 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/0: sync 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/1: readlink - no filename 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:6/11: stat d0/f2 0 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:4/11: truncate f3 194255 0 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:6/12: chown d0/f1 38199 1 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:0/25: stat d2/l5 0 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:7/14: mkdir d1/d3 0 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:6/13: rename d0 to d0/d3 22 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/2: mknod c0 0 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/3: read - no filename 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:7/15: chown f0 7035 1 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:6/14: write d0/f2 [239596,50345] 0 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/4: mkdir d1 0 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:8/5: write - no filename 2024-04-26T11:23:58.948 INFO:tasks.workunit.client.0.smithi073.stdout:4/12: dread f3 [0,4194304] 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:7/16: link d1/f2 d1/d3/f4 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:6/15: rename d0/f1 to d0/f4 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:8/6: creat d1/f2 x:0 0 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:6/16: symlink d0/l5 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:7/17: write d1/d3/f4 [1276110,69712] 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:8/7: creat d1/f3 x:0 0 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:6/17: mknod d0/c6 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:7/18: unlink d1/d3/f4 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:8/8: mkdir d1/d4 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:6/18: chown d0/c6 497692 1 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:6/19: symlink d0/l7 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:8/9: mknod d1/d4/c5 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:6/20: mknod d0/c8 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:7/19: link d1/f2 d1/f5 0 2024-04-26T11:23:58.949 INFO:tasks.workunit.client.0.smithi073.stdout:0/26: dwrite d2/f9 [0,4194304] 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:7/20: mknod d1/d3/c6 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:4/13: truncate f3 48350 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:0/27: creat d2/fb x:0 0 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:4/14: creat f5 x:0 0 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:0/28: symlink d2/lc 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:8/10: fsync d1/f3 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:4/15: mknod c6 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:0/29: write d2/fb [860571,27068] 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:8/11: creat d1/f6 x:0 0 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:7/21: dread d1/f5 [0,4194304] 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:6/21: dwrite d0/f4 [0,4194304] 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:4/16: chown f3 4 1 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:8/12: creat d1/d4/f7 x:0 0 0 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:6/22: rmdir d0 39 2024-04-26T11:23:58.950 INFO:tasks.workunit.client.0.smithi073.stdout:7/22: write f0 [1818514,106372] 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:8/13: mkdir d1/d4/d8 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:6/23: chown d0/l7 808 1 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:8/14: rename d1/d4 to d1/d4/d9 22 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:7/23: symlink d1/d3/l7 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:6/24: fsync d0/f2 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:6/25: fsync d0/f2 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:8/15: getdents d1/d4/d8 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:6/26: creat d0/f9 x:0 0 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:6/27: mknod d0/ca 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:8/16: write d1/d4/f7 [827070,98599] 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:0/30: dwrite d2/fb [0,4194304] 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:8/17: unlink d1/f2 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:6/28: write d0/f9 [331737,98540] 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:7/24: dwrite d1/f2 [0,4194304] 0 2024-04-26T11:23:58.951 INFO:tasks.workunit.client.0.smithi073.stdout:0/31: dread d2/fb [0,4194304] 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:0/32: readlink d2/l6 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:8/18: rmdir d1 39 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:4/17: dwrite f3 [0,4194304] 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:7/25: mkdir d1/d8 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:7/26: stat d1/d8 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:0/33: creat d2/fd x:0 0 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:8/19: creat d1/fa x:0 0 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:0/34: mknod d2/ce 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:8/20: write d1/fa [229042,100783] 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:4/18: dwrite f3 [4194304,4194304] 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:4/19: read - f5 zero size 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:4/20: creat f7 x:0 0 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:0/35: fsync d2/fd 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:7/27: truncate f0 3859385 0 2024-04-26T11:23:58.952 INFO:tasks.workunit.client.0.smithi073.stdout:0/36: creat d2/ff x:0 0 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:7/28: creat d1/d3/f9 x:0 0 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:0/37: symlink d2/l10 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:7/29: mkdir d1/da 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:7/30: symlink d1/lb 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:8/21: dread d1/fa [0,4194304] 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:7/31: chown d1/lb 844 1 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:8/22: unlink d1/f3 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:8/23: readlink - no filename 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:8/24: mknod d1/d4/cb 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:4/21: dwrite f7 [0,4194304] 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:8/25: creat d1/d4/d8/fc x:0 0 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:4/22: dread - f5 zero size 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:0/38: dwrite d2/ff [0,4194304] 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:7/32: write f0 [1321492,92899] 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:0/39: creat d2/f11 x:0 0 0 2024-04-26T11:23:58.953 INFO:tasks.workunit.client.0.smithi073.stdout:0/40: creat d2/f12 x:0 0 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:0/41: dread - d2/fd zero size 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:8/26: getdents d1/d4/d8 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:8/27: stat d1/d4/c5 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:8/28: mkdir d1/dd 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:7/33: dwrite d1/f2 [0,4194304] 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:7/34: write d1/f5 [3190265,61350] 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:0/42: dwrite d2/fd [0,4194304] 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:4/23: fsync f7 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:4/24: read f7 [1849541,28865] 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:0/43: unlink d2/f9 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:0/44: write d2/fd [2367985,26775] 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:4/25: getdents . 0 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:4/26: rmdir - no directory 2024-04-26T11:23:58.954 INFO:tasks.workunit.client.0.smithi073.stdout:4/27: fdatasync f5 0 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:0/45: dread - d2/f11 zero size 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:4/28: readlink l4 0 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:4/29: read - f5 zero size 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:4/30: dread - f5 zero size 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:4/31: chown c2 0 1 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:4/32: fsync f3 0 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:4/33: mkdir d8 0 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:8/29: truncate d1/d4/f7 873996 0 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:4/34: mknod d8/c9 0 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:4/35: stat l4 0 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:4/36: chown d8 20 1 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:8/30: write d1/fa [115078,48194] 0 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:8/31: symlink d1/d4/le 0 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:7/35: truncate d1/f2 1229735 0 2024-04-26T11:23:58.955 INFO:tasks.workunit.client.0.smithi073.stdout:7/36: rmdir d1/d3 39 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:8/32: chown d1/d4/f7 27887404 1 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:7/37: mknod d1/cc 0 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/37: dread f7 [0,4194304] 0 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/38: symlink d8/la 0 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/39: chown c6 27 1 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/40: fdatasync f7 0 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:9/50: sync 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/41: chown d8/la 3206 1 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:9/51: readlink d0/dc/l7 0 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/42: write f3 [6421321,43184] 0 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/43: mknod d8/cb 0 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/44: rename d8 to d8/dc 22 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/45: chown c2 1068 1 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:4/46: write f7 [2689577,82844] 0 2024-04-26T11:23:58.956 INFO:tasks.workunit.client.0.smithi073.stdout:7/38: dread f0 [0,4194304] 0 2024-04-26T11:23:58.957 INFO:tasks.workunit.client.0.smithi073.stdout:4/47: mknod d8/cd 0 2024-04-26T11:23:58.957 INFO:tasks.workunit.client.0.smithi073.stdout:4/48: rmdir d8 39 2024-04-26T11:23:58.957 INFO:tasks.workunit.client.0.smithi073.stdout:7/39: rename d1/f2 to d1/d3/fd 0 2024-04-26T11:23:58.957 INFO:tasks.workunit.client.0.smithi073.stdout:4/49: dread - f5 zero size 2024-04-26T11:23:58.957 INFO:tasks.workunit.client.0.smithi073.stdout:8/33: read d1/d4/f7 [264166,10462] 0 2024-04-26T11:23:58.957 INFO:tasks.workunit.client.0.smithi073.stdout:4/50: creat d8/fe x:0 0 0 2024-04-26T11:23:58.957 INFO:tasks.workunit.client.0.smithi073.stdout:8/34: mknod d1/d4/d8/cf 0 2024-04-26T11:23:58.957 INFO:tasks.workunit.client.0.smithi073.stdout:8/35: chown d1/d4/d8 687 1 2024-04-26T11:23:58.957 INFO:tasks.workunit.client.0.smithi073.stdout:4/51: creat d8/ff x:0 0 0 2024-04-26T11:23:58.958 INFO:tasks.workunit.client.0.smithi073.stdout:9/52: dwrite d0/fa [0,4194304] 0 2024-04-26T11:23:58.958 INFO:tasks.workunit.client.0.smithi073.stdout:8/36: truncate d1/d4/d8/fc 79659 0 2024-04-26T11:23:58.958 INFO:tasks.workunit.client.0.smithi073.stdout:8/37: truncate d1/fa 599827 0 2024-04-26T11:23:58.958 INFO:tasks.workunit.client.0.smithi073.stdout:8/38: symlink d1/l10 0 2024-04-26T11:23:58.959 INFO:tasks.workunit.client.0.smithi073.stdout:9/53: link d0/fa d0/dc/ff 0 2024-04-26T11:23:58.959 INFO:tasks.workunit.client.0.smithi073.stdout:9/54: chown d0/dc/ld 48283 1 2024-04-26T11:23:58.959 INFO:tasks.workunit.client.0.smithi073.stdout:9/55: creat d0/f10 x:0 0 0 2024-04-26T11:23:58.959 INFO:tasks.workunit.client.0.smithi073.stdout:7/40: dwrite d1/d3/f9 [0,4194304] 0 2024-04-26T11:23:58.959 INFO:tasks.workunit.client.0.smithi073.stdout:7/41: read d1/f5 [273393,36068] 0 2024-04-26T11:23:58.959 INFO:tasks.workunit.client.0.smithi073.stdout:7/42: creat d1/fe x:0 0 0 2024-04-26T11:23:58.960 INFO:tasks.workunit.client.0.smithi073.stdout:8/39: dwrite d1/fa [0,4194304] 0 2024-04-26T11:23:58.962 INFO:tasks.workunit.client.0.smithi073.stdout:8/40: rename d1/d4/f7 to d1/d4/f11 0 2024-04-26T11:23:58.962 INFO:tasks.workunit.client.0.smithi073.stdout:9/56: truncate d0/fa 3653882 0 2024-04-26T11:23:58.964 INFO:tasks.workunit.client.0.smithi073.stdout:9/57: mknod d0/dc/c11 0 2024-04-26T11:23:58.964 INFO:tasks.workunit.client.0.smithi073.stdout:8/41: rename d1/d4/d8/fc to d1/d4/f12 0 2024-04-26T11:23:58.965 INFO:tasks.workunit.client.0.smithi073.stdout:9/58: rename d0/dc to d0/dc/d12 22 2024-04-26T11:23:58.966 INFO:tasks.workunit.client.0.smithi073.stdout:7/43: dwrite d1/d3/f9 [0,4194304] 0 2024-04-26T11:23:58.968 INFO:tasks.workunit.client.0.smithi073.stdout:9/59: rename d0/dc to d0/d13 0 2024-04-26T11:23:58.969 INFO:tasks.workunit.client.0.smithi073.stdout:7/44: creat d1/d8/ff x:0 0 0 2024-04-26T11:23:58.970 INFO:tasks.workunit.client.0.smithi073.stdout:9/60: mknod d0/d13/c14 0 2024-04-26T11:23:58.970 INFO:tasks.workunit.client.0.smithi073.stdout:9/61: read d0/f5 [1387111,108512] 0 2024-04-26T11:23:58.971 INFO:tasks.workunit.client.0.smithi073.stdout:9/62: rename d0/d13/db to d0/d13/db/d15 22 2024-04-26T11:23:58.972 INFO:tasks.workunit.client.0.smithi073.stdout:8/42: write d1/d4/f11 [1755349,10291] 0 2024-04-26T11:23:58.973 INFO:tasks.workunit.client.0.smithi073.stdout:8/43: rmdir d1/dd 0 2024-04-26T11:23:58.973 INFO:tasks.workunit.client.0.smithi073.stdout:7/45: dread d1/d3/f9 [0,4194304] 0 2024-04-26T11:23:58.974 INFO:tasks.workunit.client.0.smithi073.stdout:7/46: mkdir d1/d3/d10 0 2024-04-26T11:23:58.974 INFO:tasks.workunit.client.0.smithi073.stdout:8/44: getdents d1/d4/d8 0 2024-04-26T11:23:58.974 INFO:tasks.workunit.client.0.smithi073.stdout:7/47: read - d1/d8/ff zero size 2024-04-26T11:23:58.978 INFO:tasks.workunit.client.0.smithi073.stdout:8/45: dread d1/fa [0,4194304] 0 2024-04-26T11:23:58.978 INFO:tasks.workunit.client.0.smithi073.stdout:9/63: truncate d0/d13/ff 2132955 0 2024-04-26T11:23:58.979 INFO:tasks.workunit.client.0.smithi073.stdout:9/64: dread - d0/f10 zero size 2024-04-26T11:23:58.980 INFO:tasks.workunit.client.0.smithi073.stdout:9/65: symlink d0/l16 0 2024-04-26T11:23:58.980 INFO:tasks.workunit.client.0.smithi073.stdout:9/66: readlink d0/d13/db/le 0 2024-04-26T11:23:58.981 INFO:tasks.workunit.client.0.smithi073.stdout:7/48: dwrite d1/d8/ff [0,4194304] 0 2024-04-26T11:23:58.986 INFO:tasks.workunit.client.0.smithi073.stdout:8/46: dwrite d1/f6 [0,4194304] 0 2024-04-26T11:23:58.987 INFO:tasks.workunit.client.0.smithi073.stdout:8/47: chown d1/d4/f12 97872296 1 2024-04-26T11:23:58.987 INFO:tasks.workunit.client.0.smithi073.stdout:8/48: fdatasync d1/d4/f11 0 2024-04-26T11:23:58.988 INFO:tasks.workunit.client.0.smithi073.stdout:8/49: creat d1/d4/d8/f13 x:0 0 0 2024-04-26T11:23:58.995 INFO:tasks.workunit.client.0.smithi073.stdout:8/50: dwrite d1/f6 [4194304,4194304] 0 2024-04-26T11:23:58.997 INFO:tasks.workunit.client.0.smithi073.stdout:8/51: mknod d1/d4/d8/c14 0 2024-04-26T11:23:58.998 INFO:tasks.workunit.client.0.smithi073.stdout:8/52: readlink d1/l10 0 2024-04-26T11:23:59.000 INFO:tasks.workunit.client.0.smithi073.stdout:8/53: mkdir d1/d4/d15 0 2024-04-26T11:23:59.001 INFO:tasks.workunit.client.0.smithi073.stdout:8/54: truncate d1/d4/f12 559400 0 2024-04-26T11:23:59.001 INFO:tasks.workunit.client.0.smithi073.stdout:9/67: dwrite d0/d13/ff [0,4194304] 0 2024-04-26T11:23:59.004 INFO:tasks.workunit.client.0.smithi073.stdout:8/55: rename d1/d4/f11 to d1/f16 0 2024-04-26T11:23:59.005 INFO:tasks.workunit.client.0.smithi073.stdout:9/68: dread d0/fa [0,4194304] 0 2024-04-26T11:23:59.005 INFO:tasks.workunit.client.0.smithi073.stdout:9/69: rmdir d0/d13 39 2024-04-26T11:23:59.006 INFO:tasks.workunit.client.0.smithi073.stdout:8/56: rmdir d1/d4/d8 39 2024-04-26T11:23:59.007 INFO:tasks.workunit.client.0.smithi073.stdout:9/70: link d0/d13/l4 d0/d13/l17 0 2024-04-26T11:23:59.007 INFO:tasks.workunit.client.0.smithi073.stdout:8/57: creat d1/f17 x:0 0 0 2024-04-26T11:23:59.008 INFO:tasks.workunit.client.0.smithi073.stdout:9/71: creat d0/d13/f18 x:0 0 0 2024-04-26T11:23:59.008 INFO:tasks.workunit.client.0.smithi073.stdout:8/58: creat d1/f18 x:0 0 0 2024-04-26T11:23:59.008 INFO:tasks.workunit.client.0.smithi073.stdout:9/72: rename d0/d13/l7 to d0/d13/db/l19 0 2024-04-26T11:23:59.009 INFO:tasks.workunit.client.0.smithi073.stdout:9/73: mkdir d0/d1a 0 2024-04-26T11:23:59.010 INFO:tasks.workunit.client.0.smithi073.stdout:9/74: mknod d0/d13/db/c1b 0 2024-04-26T11:23:59.011 INFO:tasks.workunit.client.0.smithi073.stdout:9/75: write d0/d13/ff [1778508,76449] 0 2024-04-26T11:23:59.011 INFO:tasks.workunit.client.0.smithi073.stdout:8/59: fdatasync d1/f6 0 2024-04-26T11:23:59.011 INFO:tasks.workunit.client.0.smithi073.stdout:9/76: dread - d0/f10 zero size 2024-04-26T11:23:59.011 INFO:tasks.workunit.client.0.smithi073.stdout:8/60: mknod d1/d4/d15/c19 0 2024-04-26T11:23:59.012 INFO:tasks.workunit.client.0.smithi073.stdout:9/77: creat d0/d13/f1c x:0 0 0 2024-04-26T11:23:59.012 INFO:tasks.workunit.client.0.smithi073.stdout:8/61: mknod d1/d4/c1a 0 2024-04-26T11:23:59.018 INFO:tasks.workunit.client.0.smithi073.stdout:8/62: dread d1/f6 [4194304,4194304] 0 2024-04-26T11:23:59.020 INFO:tasks.workunit.client.0.smithi073.stdout:8/63: mknod d1/d4/c1b 0 2024-04-26T11:23:59.020 INFO:tasks.workunit.client.0.smithi073.stdout:9/78: dread d0/f8 [0,4194304] 0 2024-04-26T11:23:59.020 INFO:tasks.workunit.client.0.smithi073.stdout:8/64: symlink d1/d4/d8/l1c 0 2024-04-26T11:23:59.020 INFO:tasks.workunit.client.0.smithi073.stdout:9/79: write d0/f5 [4726172,59868] 0 2024-04-26T11:23:59.027 INFO:tasks.workunit.client.0.smithi073.stdout:8/65: dread d1/f16 [0,4194304] 0 2024-04-26T11:23:59.027 INFO:tasks.workunit.client.0.smithi073.stdout:8/66: rmdir d1/d4/d8 39 2024-04-26T11:23:59.028 INFO:tasks.workunit.client.0.smithi073.stdout:8/67: creat d1/d4/d15/f1d x:0 0 0 2024-04-26T11:23:59.029 INFO:tasks.workunit.client.0.smithi073.stdout:8/68: mknod d1/d4/d8/c1e 0 2024-04-26T11:23:59.034 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:59.030+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:59.056 INFO:tasks.workunit.client.0.smithi073.stdout:5/49: sync 2024-04-26T11:23:59.056 INFO:tasks.workunit.client.0.smithi073.stdout:5/50: write f2 [3622647,72814] 0 2024-04-26T11:23:59.057 INFO:tasks.workunit.client.0.smithi073.stdout:5/51: write d4/f5 [810070,109534] 0 2024-04-26T11:23:59.057 INFO:tasks.workunit.client.0.smithi073.stdout:5/52: truncate d4/d8/fb 4869249 0 2024-04-26T11:23:59.058 INFO:tasks.workunit.client.0.smithi073.stdout:5/53: creat d4/de/f13 x:0 0 0 2024-04-26T11:23:59.058 INFO:tasks.workunit.client.0.smithi073.stdout:5/54: write d4/d8/fb [1593577,2051] 0 2024-04-26T11:23:59.059 INFO:tasks.workunit.client.0.smithi073.stdout:5/55: mkdir d4/de/d14 0 2024-04-26T11:23:59.061 INFO:tasks.workunit.client.0.smithi073.stdout:5/56: mkdir d4/de/d15 0 2024-04-26T11:23:59.061 INFO:tasks.workunit.client.0.smithi073.stdout:5/57: creat d4/de/d14/f16 x:0 0 0 2024-04-26T11:23:59.062 INFO:tasks.workunit.client.0.smithi073.stdout:5/58: symlink d4/de/d15/l17 0 2024-04-26T11:23:59.062 INFO:tasks.workunit.client.0.smithi073.stdout:5/59: mknod d4/d8/c18 0 2024-04-26T11:23:59.062 INFO:tasks.workunit.client.0.smithi073.stdout:5/60: write d4/de/f13 [564363,111995] 0 2024-04-26T11:23:59.068 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:59.068 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:23:59.069 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:59.069 INFO:tasks.workunit.client.0.smithi073.stdout:5/61: getdents d4/de/d15 0 2024-04-26T11:23:59.070 INFO:tasks.workunit.client.0.smithi073.stdout:5/62: write d4/de/f13 [463634,79785] 0 2024-04-26T11:23:59.071 INFO:tasks.workunit.client.0.smithi073.stdout:5/63: getdents d4/de/d14 0 2024-04-26T11:23:59.071 INFO:tasks.workunit.client.0.smithi073.stdout:5/64: stat d4/de/d15 0 2024-04-26T11:23:59.071 INFO:tasks.workunit.client.0.smithi073.stdout:5/65: rmdir d4 39 2024-04-26T11:23:59.072 INFO:tasks.workunit.client.0.smithi073.stdout:5/66: creat d4/de/d15/f19 x:0 0 0 2024-04-26T11:23:59.072 INFO:tasks.workunit.client.0.smithi073.stdout:5/67: creat d4/de/d14/f1a x:0 0 0 2024-04-26T11:23:59.073 INFO:tasks.workunit.client.0.smithi073.stdout:5/68: dread - d4/de/d14/f16 zero size 2024-04-26T11:23:59.073 INFO:tasks.workunit.client.0.smithi073.stdout:5/69: chown d4/d8 1976 1 2024-04-26T11:23:59.073 INFO:tasks.workunit.client.0.smithi073.stdout:5/70: creat d4/d8/d9/f1b x:0 0 0 2024-04-26T11:23:59.076 INFO:tasks.workunit.client.0.smithi073.stdout:5/71: truncate d4/d8/d9/f1b 571173 0 2024-04-26T11:23:59.076 INFO:tasks.workunit.client.0.smithi073.stdout:5/72: stat d4/de 0 2024-04-26T11:23:59.077 INFO:tasks.workunit.client.0.smithi073.stdout:5/73: creat d4/de/d14/f1c x:0 0 0 2024-04-26T11:23:59.077 INFO:tasks.workunit.client.0.smithi073.stdout:5/74: rename f1 to d4/f1d 0 2024-04-26T11:23:59.077 INFO:tasks.workunit.client.0.smithi073.stdout:5/75: mknod d4/de/c1e 0 2024-04-26T11:23:59.077 INFO:tasks.workunit.client.0.smithi073.stdout:5/76: chown d4/d8/c18 8 1 2024-04-26T11:23:59.077 INFO:tasks.workunit.client.0.smithi073.stdout:5/77: write d4/f1d [425498,79366] 0 2024-04-26T11:23:59.078 INFO:tasks.workunit.client.0.smithi073.stdout:5/78: truncate d4/de/d14/f16 540285 0 2024-04-26T11:23:59.078 INFO:tasks.workunit.client.0.smithi073.stdout:5/79: creat d4/f1f x:0 0 0 2024-04-26T11:23:59.081 INFO:tasks.workunit.client.0.smithi073.stdout:5/80: truncate d4/f1d 259541 0 2024-04-26T11:23:59.084 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:23:59.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/81: stat d4/d8/d9/f1b 0 2024-04-26T11:23:59.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/82: creat d4/f20 x:0 0 0 2024-04-26T11:23:59.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/83: write d4/d8/d9/f12 [701152,33103] 0 2024-04-26T11:23:59.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/84: chown d4/d8/cf 363 1 2024-04-26T11:23:59.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/85: truncate d4/de/d14/f16 1570454 0 2024-04-26T11:23:59.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/86: write d4/de/d14/f16 [2377167,57481] 0 2024-04-26T11:23:59.086 INFO:tasks.workunit.client.0.smithi073.stdout:5/87: chown d4/de/d14/f1c 27336453 1 2024-04-26T11:23:59.087 INFO:tasks.workunit.client.0.smithi073.stdout:5/88: fsync d4/de/d14/f16 0 2024-04-26T11:23:59.142 INFO:tasks.workunit.client.0.smithi073.stdout:3/62: sync 2024-04-26T11:23:59.169 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:59.166+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:59.176 INFO:tasks.workunit.client.0.smithi073.stdout:2/92: sync 2024-04-26T11:23:59.176 INFO:tasks.workunit.client.0.smithi073.stdout:7/49: sync 2024-04-26T11:23:59.177 INFO:tasks.workunit.client.0.smithi073.stdout:1/134: sync 2024-04-26T11:23:59.177 INFO:tasks.workunit.client.0.smithi073.stdout:5/89: sync 2024-04-26T11:23:59.177 INFO:tasks.workunit.client.0.smithi073.stdout:4/52: sync 2024-04-26T11:23:59.177 INFO:tasks.workunit.client.0.smithi073.stdout:0/46: sync 2024-04-26T11:23:59.177 INFO:tasks.workunit.client.0.smithi073.stdout:6/29: sync 2024-04-26T11:23:59.177 INFO:tasks.workunit.client.0.smithi073.stdout:8/69: sync 2024-04-26T11:23:59.177 INFO:tasks.workunit.client.0.smithi073.stdout:3/63: sync 2024-04-26T11:23:59.177 INFO:tasks.workunit.client.0.smithi073.stdout:9/80: sync 2024-04-26T11:23:59.179 INFO:tasks.workunit.client.0.smithi073.stdout:1/135: readlink d1/l24 0 2024-04-26T11:23:59.179 INFO:tasks.workunit.client.0.smithi073.stdout:5/90: stat d4/de/c1e 0 2024-04-26T11:23:59.179 INFO:tasks.workunit.client.0.smithi073.stdout:9/81: dread - d0/d13/f18 zero size 2024-04-26T11:23:59.179 INFO:tasks.workunit.client.0.smithi073.stdout:4/53: write f3 [8983738,80164] 0 2024-04-26T11:23:59.179 INFO:tasks.workunit.client.0.smithi073.stdout:8/70: dread - d1/d4/d15/f1d zero size 2024-04-26T11:23:59.179 INFO:tasks.workunit.client.0.smithi073.stdout:2/93: write dd/de/ff [1002709,75723] 0 2024-04-26T11:23:59.180 INFO:tasks.workunit.client.0.smithi073.stdout:0/47: write d2/ff [5209452,124697] 0 2024-04-26T11:23:59.180 INFO:tasks.workunit.client.0.smithi073.stdout:5/91: creat d4/d8/d9/f21 x:0 0 0 2024-04-26T11:23:59.180 INFO:tasks.workunit.client.0.smithi073.stdout:1/136: mknod d1/df/d12/c31 0 2024-04-26T11:23:59.181 INFO:tasks.workunit.client.0.smithi073.stdout:7/50: rename d1/d3 to d1/d11 0 2024-04-26T11:23:59.181 INFO:tasks.workunit.client.0.smithi073.stdout:0/48: creat d2/f13 x:0 0 0 2024-04-26T11:23:59.181 INFO:tasks.workunit.client.0.smithi073.stdout:5/92: rmdir d4/de/d15 39 2024-04-26T11:23:59.183 INFO:tasks.workunit.client.0.smithi073.stdout:8/71: creat d1/d4/d15/f1f x:0 0 0 2024-04-26T11:23:59.183 INFO:tasks.workunit.client.0.smithi073.stdout:0/49: mknod d2/c14 0 2024-04-26T11:23:59.184 INFO:tasks.workunit.client.0.smithi073.stdout:9/82: dread d0/f8 [0,4194304] 0 2024-04-26T11:23:59.184 INFO:tasks.workunit.client.0.smithi073.stdout:5/93: symlink d4/de/d15/l22 0 2024-04-26T11:23:59.186 INFO:tasks.workunit.client.0.smithi073.stdout:8/72: dread - d1/d4/d15/f1d zero size 2024-04-26T11:23:59.186 INFO:tasks.workunit.client.0.smithi073.stdout:0/50: link d2/f13 d2/f15 0 2024-04-26T11:23:59.186 INFO:tasks.workunit.client.0.smithi073.stdout:9/83: dread - d0/f10 zero size 2024-04-26T11:23:59.186 INFO:tasks.workunit.client.0.smithi073.stdout:8/73: readlink d1/l10 0 2024-04-26T11:23:59.186 INFO:tasks.workunit.client.0.smithi073.stdout:0/51: rename d2 to d2/d16 22 2024-04-26T11:23:59.187 INFO:tasks.workunit.client.0.smithi073.stdout:5/94: truncate d4/f1f 462352 0 2024-04-26T11:23:59.187 INFO:tasks.workunit.client.0.smithi073.stdout:3/64: dwrite d0/f7 [0,4194304] 0 2024-04-26T11:23:59.187 INFO:tasks.workunit.client.0.smithi073.stdout:9/84: chown d0/d13/db/le 299 1 2024-04-26T11:23:59.188 INFO:tasks.workunit.client.0.smithi073.stdout:0/52: write d2/fb [358163,24074] 0 2024-04-26T11:23:59.188 INFO:tasks.workunit.client.0.smithi073.stdout:6/30: dwrite d0/f9 [0,4194304] 0 2024-04-26T11:23:59.188 INFO:tasks.workunit.client.0.smithi073.stdout:3/65: read d0/f7 [34607,42876] 0 2024-04-26T11:23:59.189 INFO:tasks.workunit.client.0.smithi073.stdout:3/66: fsync d0/fa 0 2024-04-26T11:23:59.189 INFO:tasks.workunit.client.0.smithi073.stdout:4/54: dread f7 [0,4194304] 0 2024-04-26T11:23:59.189 INFO:tasks.workunit.client.0.smithi073.stdout:6/31: write d0/f2 [681187,21570] 0 2024-04-26T11:23:59.189 INFO:tasks.workunit.client.0.smithi073.stdout:6/32: write d0/f2 [1304705,117176] 0 2024-04-26T11:23:59.190 INFO:tasks.workunit.client.0.smithi073.stdout:6/33: chown d0/l7 203 1 2024-04-26T11:23:59.190 INFO:tasks.workunit.client.0.smithi073.stdout:8/74: unlink d1/d4/d8/c1e 0 2024-04-26T11:23:59.195 INFO:tasks.workunit.client.0.smithi073.stdout:4/55: creat d8/f10 x:0 0 0 2024-04-26T11:23:59.195 INFO:tasks.workunit.client.0.smithi073.stdout:6/34: rename d0/l7 to d0/lb 0 2024-04-26T11:23:59.196 INFO:tasks.workunit.client.0.smithi073.stdout:5/95: mkdir d4/de/d23 0 2024-04-26T11:23:59.196 INFO:tasks.workunit.client.0.smithi073.stdout:2/94: write fb [661620,114067] 0 2024-04-26T11:23:59.197 INFO:tasks.workunit.client.0.smithi073.stdout:4/56: symlink d8/l11 0 2024-04-26T11:23:59.197 INFO:tasks.workunit.client.0.smithi073.stdout:0/53: dwrite d2/f11 [0,4194304] 0 2024-04-26T11:23:59.197 INFO:tasks.workunit.client.0.smithi073.stdout:5/96: readlink d4/de/d15/l17 0 2024-04-26T11:23:59.197 INFO:tasks.workunit.client.0.smithi073.stdout:2/95: chown dd/d1c/d1d/c1f 1986 1 2024-04-26T11:23:59.198 INFO:tasks.workunit.client.0.smithi073.stdout:4/57: rename d8/la to d8/l12 0 2024-04-26T11:23:59.198 INFO:tasks.workunit.client.0.smithi073.stdout:0/54: creat d2/f17 x:0 0 0 2024-04-26T11:23:59.199 INFO:tasks.workunit.client.0.smithi073.stdout:5/97: rmdir d4/de/d15 39 2024-04-26T11:23:59.199 INFO:tasks.workunit.client.0.smithi073.stdout:4/58: chown d8 0 1 2024-04-26T11:23:59.199 INFO:tasks.workunit.client.0.smithi073.stdout:2/96: creat dd/d1c/d1d/f20 x:0 0 0 2024-04-26T11:23:59.199 INFO:tasks.workunit.client.0.smithi073.stdout:0/55: fdatasync d2/f15 0 2024-04-26T11:23:59.199 INFO:tasks.workunit.client.0.smithi073.stdout:2/97: chown f7 13896087 1 2024-04-26T11:23:59.200 INFO:tasks.workunit.client.0.smithi073.stdout:4/59: creat d8/f13 x:0 0 0 2024-04-26T11:23:59.200 INFO:tasks.workunit.client.0.smithi073.stdout:2/98: write f0 [4928860,22459] 0 2024-04-26T11:23:59.200 INFO:tasks.workunit.client.0.smithi073.stdout:0/56: rename d2/c14 to d2/c18 0 2024-04-26T11:23:59.200 INFO:tasks.workunit.client.0.smithi073.stdout:4/60: mkdir d8/d14 0 2024-04-26T11:23:59.200 INFO:tasks.workunit.client.0.smithi073.stdout:4/61: fdatasync d8/ff 0 2024-04-26T11:23:59.200 INFO:tasks.workunit.client.0.smithi073.stdout:0/57: rename d2/la to d2/l19 0 2024-04-26T11:23:59.200 INFO:tasks.workunit.client.0.smithi073.stdout:6/35: dread d0/f4 [0,4194304] 0 2024-04-26T11:23:59.201 INFO:tasks.workunit.client.0.smithi073.stdout:6/36: read d0/f4 [1176065,62755] 0 2024-04-26T11:23:59.206 INFO:tasks.workunit.client.0.smithi073.stdout:0/58: dread d2/fd [0,4194304] 0 2024-04-26T11:23:59.207 INFO:tasks.workunit.client.0.smithi073.stdout:5/98: dwrite d4/de/d14/f16 [0,4194304] 0 2024-04-26T11:23:59.208 INFO:tasks.workunit.client.0.smithi073.stdout:5/99: mknod d4/d8/c24 0 2024-04-26T11:23:59.209 INFO:tasks.workunit.client.0.smithi073.stdout:4/62: dwrite d8/ff [0,4194304] 0 2024-04-26T11:23:59.210 INFO:tasks.workunit.client.0.smithi073.stdout:1/137: write d1/f1a [1110388,124851] 0 2024-04-26T11:23:59.210 INFO:tasks.workunit.client.0.smithi073.stdout:3/67: truncate d0/fa 1565025 0 2024-04-26T11:23:59.211 INFO:tasks.workunit.client.0.smithi073.stdout:4/63: mkdir d8/d15 0 2024-04-26T11:23:59.211 INFO:tasks.workunit.client.0.smithi073.stdout:6/37: dwrite d0/f2 [0,4194304] 0 2024-04-26T11:23:59.212 INFO:tasks.workunit.client.0.smithi073.stdout:1/138: read d1/d6/fb [8458,67931] 0 2024-04-26T11:23:59.212 INFO:tasks.workunit.client.0.smithi073.stdout:7/51: sync 2024-04-26T11:23:59.212 INFO:tasks.workunit.client.0.smithi073.stdout:8/75: sync 2024-04-26T11:23:59.212 INFO:tasks.workunit.client.0.smithi073.stdout:3/68: creat d0/d2/f17 x:0 0 0 2024-04-26T11:23:59.213 INFO:tasks.workunit.client.0.smithi073.stdout:4/64: creat d8/d14/f16 x:0 0 0 2024-04-26T11:23:59.213 INFO:tasks.workunit.client.0.smithi073.stdout:1/139: write d1/df/d12/f28 [1296564,41990] 0 2024-04-26T11:23:59.214 INFO:tasks.workunit.client.0.smithi073.stdout:1/140: stat d1/d8/d2e 0 2024-04-26T11:23:59.214 INFO:tasks.workunit.client.0.smithi073.stdout:4/65: unlink d8/c9 0 2024-04-26T11:23:59.214 INFO:tasks.workunit.client.0.smithi073.stdout:3/69: dread - d0/d2/db/f15 zero size 2024-04-26T11:23:59.214 INFO:tasks.workunit.client.0.smithi073.stdout:8/76: write d1/d4/d15/f1f [802533,46439] 0 2024-04-26T11:23:59.214 INFO:tasks.workunit.client.0.smithi073.stdout:7/52: dread d1/f5 [0,4194304] 0 2024-04-26T11:23:59.215 INFO:tasks.workunit.client.0.smithi073.stdout:4/66: chown c2 1025820301 1 2024-04-26T11:23:59.215 INFO:tasks.workunit.client.0.smithi073.stdout:4/67: sync 2024-04-26T11:23:59.215 INFO:tasks.workunit.client.0.smithi073.stdout:8/77: chown d1/d4/c1a 121 1 2024-04-26T11:23:59.216 INFO:tasks.workunit.client.0.smithi073.stdout:4/68: chown d8/f13 9467806 1 2024-04-26T11:23:59.216 INFO:tasks.workunit.client.0.smithi073.stdout:1/141: symlink d1/l32 0 2024-04-26T11:23:59.217 INFO:tasks.workunit.client.0.smithi073.stdout:4/69: dread - d8/fe zero size 2024-04-26T11:23:59.217 INFO:tasks.workunit.client.0.smithi073.stdout:7/53: dread d1/f5 [0,4194304] 0 2024-04-26T11:23:59.217 INFO:tasks.workunit.client.0.smithi073.stdout:4/70: stat f3 0 2024-04-26T11:23:59.218 INFO:tasks.workunit.client.0.smithi073.stdout:1/142: mknod d1/d8/c33 0 2024-04-26T11:23:59.218 INFO:tasks.workunit.client.0.smithi073.stdout:4/71: dread - d8/fe zero size 2024-04-26T11:23:59.218 INFO:tasks.workunit.client.0.smithi073.stdout:5/100: dwrite d4/f5 [0,4194304] 0 2024-04-26T11:23:59.219 INFO:tasks.workunit.client.0.smithi073.stdout:7/54: rmdir d1/da 0 2024-04-26T11:23:59.219 INFO:tasks.workunit.client.0.smithi073.stdout:5/101: readlink d4/d8/la 0 2024-04-26T11:23:59.219 INFO:tasks.workunit.client.0.smithi073.stdout:1/143: mkdir d1/df/d34 0 2024-04-26T11:23:59.219 INFO:tasks.workunit.client.0.smithi073.stdout:4/72: write d8/fe [535424,7246] 0 2024-04-26T11:23:59.220 INFO:tasks.workunit.client.0.smithi073.stdout:7/55: write d1/fe [635866,32242] 0 2024-04-26T11:23:59.220 INFO:tasks.workunit.client.0.smithi073.stdout:5/102: write d4/f1d [848948,126597] 0 2024-04-26T11:23:59.220 INFO:tasks.workunit.client.0.smithi073.stdout:7/56: write d1/fe [1208451,96952] 0 2024-04-26T11:23:59.220 INFO:tasks.workunit.client.0.smithi073.stdout:4/73: creat d8/d15/f17 x:0 0 0 2024-04-26T11:23:59.220 INFO:tasks.workunit.client.0.smithi073.stdout:5/103: fsync d4/d8/d9/f1b 0 2024-04-26T11:23:59.222 INFO:tasks.workunit.client.0.smithi073.stdout:4/74: rename d8/ff to d8/d15/f18 0 2024-04-26T11:23:59.222 INFO:tasks.workunit.client.0.smithi073.stdout:5/104: symlink d4/de/d14/l25 0 2024-04-26T11:23:59.223 INFO:tasks.workunit.client.0.smithi073.stdout:4/75: write d8/f10 [494493,120420] 0 2024-04-26T11:23:59.223 INFO:tasks.workunit.client.0.smithi073.stdout:5/105: write d4/f1f [766782,21333] 0 2024-04-26T11:23:59.224 INFO:tasks.workunit.client.0.smithi073.stdout:5/106: read - d4/d8/d9/f21 zero size 2024-04-26T11:23:59.224 INFO:tasks.workunit.client.0.smithi073.stdout:4/76: symlink d8/l19 0 2024-04-26T11:23:59.224 INFO:tasks.workunit.client.0.smithi073.stdout:4/77: dread - f5 zero size 2024-04-26T11:23:59.225 INFO:tasks.workunit.client.0.smithi073.stdout:4/78: fdatasync f7 0 2024-04-26T11:23:59.225 INFO:tasks.workunit.client.0.smithi073.stdout:4/79: mkdir d8/d1a 0 2024-04-26T11:23:59.226 INFO:tasks.workunit.client.0.smithi073.stdout:4/80: mkdir d8/d1a/d1b 0 2024-04-26T11:23:59.226 INFO:tasks.workunit.client.0.smithi073.stdout:4/81: chown l4 5800394 1 2024-04-26T11:23:59.227 INFO:tasks.workunit.client.0.smithi073.stdout:2/99: fdatasync f0 0 2024-04-26T11:23:59.227 INFO:tasks.workunit.client.0.smithi073.stdout:2/100: fsync f7 0 2024-04-26T11:23:59.228 INFO:tasks.workunit.client.0.smithi073.stdout:4/82: mkdir d8/d15/d1c 0 2024-04-26T11:23:59.228 INFO:tasks.workunit.client.0.smithi073.stdout:7/57: dwrite d1/d11/fd [0,4194304] 0 2024-04-26T11:23:59.229 INFO:tasks.workunit.client.0.smithi073.stdout:4/83: mkdir d8/d1a/d1b/d1d 0 2024-04-26T11:23:59.229 INFO:tasks.workunit.client.0.smithi073.stdout:4/84: chown d8/d1a 306023076 1 2024-04-26T11:23:59.229 INFO:tasks.workunit.client.0.smithi073.stdout:4/85: mknod d8/d1a/c1e 0 2024-04-26T11:23:59.234 INFO:tasks.workunit.client.0.smithi073.stdout:8/78: read d1/d4/f12 [447588,121582] 0 2024-04-26T11:23:59.236 INFO:tasks.workunit.client.0.smithi073.stdout:7/58: dwrite d1/d8/ff [0,4194304] 0 2024-04-26T11:23:59.236 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:59.232+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:59.237 INFO:tasks.workunit.client.0.smithi073.stdout:4/86: dwrite d8/f10 [0,4194304] 0 2024-04-26T11:23:59.237 INFO:tasks.workunit.client.0.smithi073.stdout:8/79: read d1/d4/d15/f1f [453821,125995] 0 2024-04-26T11:23:59.238 INFO:tasks.workunit.client.0.smithi073.stdout:4/87: write d8/d14/f16 [497604,9058] 0 2024-04-26T11:23:59.238 INFO:tasks.workunit.client.0.smithi073.stdout:8/80: mkdir d1/d20 0 2024-04-26T11:23:59.238 INFO:tasks.workunit.client.0.smithi073.stdout:7/59: getdents d1/d8 0 2024-04-26T11:23:59.238 INFO:tasks.workunit.client.0.smithi073.stdout:4/88: mkdir d8/d1f 0 2024-04-26T11:23:59.239 INFO:tasks.workunit.client.0.smithi073.stdout:7/60: link d1/cc d1/c12 0 2024-04-26T11:23:59.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/107: dread d4/d8/d9/f1b [0,4194304] 0 2024-04-26T11:23:59.242 INFO:tasks.workunit.client.0.smithi073.stdout:4/89: dread f3 [0,4194304] 0 2024-04-26T11:23:59.243 INFO:tasks.workunit.client.0.smithi073.stdout:5/108: mknod d4/de/d14/c26 0 2024-04-26T11:23:59.244 INFO:tasks.workunit.client.0.smithi073.stdout:9/85: truncate d0/f8 485744 0 2024-04-26T11:23:59.246 INFO:tasks.workunit.client.0.smithi073.stdout:9/86: creat d0/d1a/f1d x:0 0 0 2024-04-26T11:23:59.246 INFO:tasks.workunit.client.0.smithi073.stdout:8/81: dwrite d1/d4/f12 [0,4194304] 0 2024-04-26T11:23:59.247 INFO:tasks.workunit.client.0.smithi073.stdout:9/87: unlink d0/f5 0 2024-04-26T11:23:59.247 INFO:tasks.workunit.client.0.smithi073.stdout:4/90: dread f7 [0,4194304] 0 2024-04-26T11:23:59.249 INFO:tasks.workunit.client.0.smithi073.stdout:8/82: getdents d1/d4/d15 0 2024-04-26T11:23:59.249 INFO:tasks.workunit.client.0.smithi073.stdout:9/88: mknod d0/d1a/c1e 0 2024-04-26T11:23:59.249 INFO:tasks.workunit.client.0.smithi073.stdout:2/101: truncate f6 4789104 0 2024-04-26T11:23:59.250 INFO:tasks.workunit.client.0.smithi073.stdout:0/59: getdents d2 0 2024-04-26T11:23:59.250 INFO:tasks.workunit.client.0.smithi073.stdout:4/91: symlink d8/d1a/d1b/l20 0 2024-04-26T11:23:59.251 INFO:tasks.workunit.client.0.smithi073.stdout:4/92: sync 2024-04-26T11:23:59.251 INFO:tasks.workunit.client.0.smithi073.stdout:2/102: read fb [172999,56894] 0 2024-04-26T11:23:59.253 INFO:tasks.workunit.client.0.smithi073.stdout:6/38: fsync d0/f2 0 2024-04-26T11:23:59.253 INFO:tasks.workunit.client.0.smithi073.stdout:0/60: chown d2/ce 3 1 2024-04-26T11:23:59.255 INFO:tasks.workunit.client.0.smithi073.stdout:4/93: write d8/f10 [2174650,14512] 0 2024-04-26T11:23:59.255 INFO:tasks.workunit.client.0.smithi073.stdout:3/70: dread d0/fa [0,4194304] 0 2024-04-26T11:23:59.255 INFO:tasks.workunit.client.0.smithi073.stdout:8/83: fsync d1/f16 0 2024-04-26T11:23:59.255 INFO:tasks.workunit.client.0.smithi073.stdout:9/89: creat d0/d13/f1f x:0 0 0 2024-04-26T11:23:59.255 INFO:tasks.workunit.client.0.smithi073.stdout:3/71: stat d0 0 2024-04-26T11:23:59.255 INFO:tasks.workunit.client.0.smithi073.stdout:6/39: mkdir d0/dc 0 2024-04-26T11:23:59.256 INFO:tasks.workunit.client.0.smithi073.stdout:2/103: mknod dd/d1c/c21 0 2024-04-26T11:23:59.256 INFO:tasks.workunit.client.0.smithi073.stdout:0/61: mknod d2/c1a 0 2024-04-26T11:23:59.256 INFO:tasks.workunit.client.0.smithi073.stdout:6/40: stat d0/f2 0 2024-04-26T11:23:59.256 INFO:tasks.workunit.client.0.smithi073.stdout:5/109: dwrite d4/de/f13 [0,4194304] 0 2024-04-26T11:23:59.257 INFO:tasks.workunit.client.0.smithi073.stdout:9/90: chown d0/d13/f18 111707 1 2024-04-26T11:23:59.257 INFO:tasks.workunit.client.0.smithi073.stdout:0/62: dread - d2/f17 zero size 2024-04-26T11:23:59.257 INFO:tasks.workunit.client.0.smithi073.stdout:8/84: truncate d1/d4/d15/f1f 1659028 0 2024-04-26T11:23:59.258 INFO:tasks.workunit.client.0.smithi073.stdout:3/72: creat d0/d11/f18 x:0 0 0 2024-04-26T11:23:59.259 INFO:tasks.workunit.client.0.smithi073.stdout:5/110: symlink d4/l27 0 2024-04-26T11:23:59.259 INFO:tasks.workunit.client.0.smithi073.stdout:0/63: write d2/f13 [628251,130956] 0 2024-04-26T11:23:59.259 INFO:tasks.workunit.client.0.smithi073.stdout:2/104: rename f2 to dd/d1c/f22 0 2024-04-26T11:23:59.259 INFO:tasks.workunit.client.0.smithi073.stdout:8/85: mkdir d1/d21 0 2024-04-26T11:23:59.259 INFO:tasks.workunit.client.0.smithi073.stdout:1/144: dwrite d1/d8/f18 [0,4194304] 0 2024-04-26T11:23:59.259 INFO:tasks.workunit.client.0.smithi073.stdout:6/41: symlink d0/dc/ld 0 2024-04-26T11:23:59.260 INFO:tasks.workunit.client.0.smithi073.stdout:2/105: stat dd/de 0 2024-04-26T11:23:59.261 INFO:tasks.workunit.client.0.smithi073.stdout:0/64: read d2/fb [682234,96273] 0 2024-04-26T11:23:59.261 INFO:tasks.workunit.client.0.smithi073.stdout:2/106: chown dd 7372074 1 2024-04-26T11:23:59.262 INFO:tasks.workunit.client.0.smithi073.stdout:1/145: chown d1/d8/f2d 941603 1 2024-04-26T11:23:59.263 INFO:tasks.workunit.client.0.smithi073.stdout:1/146: readlink d1/d6/l1f 0 2024-04-26T11:23:59.263 INFO:tasks.workunit.client.0.smithi073.stdout:6/42: mknod d0/dc/ce 0 2024-04-26T11:23:59.263 INFO:tasks.workunit.client.0.smithi073.stdout:0/65: mknod d2/c1b 0 2024-04-26T11:23:59.264 INFO:tasks.workunit.client.0.smithi073.stdout:5/111: write d4/d8/d9/f1b [507435,34017] 0 2024-04-26T11:23:59.265 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:59.265 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:23:59.265 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:23:59.265 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:23:59.266 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:59.266 INFO:tasks.workunit.client.0.smithi073.stdout:3/73: getdents d0/d2 0 2024-04-26T11:23:59.266 INFO:tasks.workunit.client.0.smithi073.stdout:5/112: readlink d4/de/d14/l25 0 2024-04-26T11:23:59.266 INFO:tasks.workunit.client.0.smithi073.stdout:6/43: rename d0/c6 to d0/dc/cf 0 2024-04-26T11:23:59.267 INFO:tasks.workunit.client.0.smithi073.stdout:3/74: write d0/d11/f18 [976056,26466] 0 2024-04-26T11:23:59.268 INFO:tasks.workunit.client.0.smithi073.stdout:9/91: dwrite d0/fa [0,4194304] 0 2024-04-26T11:23:59.269 INFO:tasks.workunit.client.0.smithi073.stdout:5/113: write d4/de/d14/f16 [2907215,113592] 0 2024-04-26T11:23:59.269 INFO:tasks.workunit.client.0.smithi073.stdout:4/94: dwrite d8/d15/f18 [0,4194304] 0 2024-04-26T11:23:59.270 INFO:tasks.workunit.client.0.smithi073.stdout:9/92: dread - d0/d13/f1c zero size 2024-04-26T11:23:59.270 INFO:tasks.workunit.client.0.smithi073.stdout:3/75: write d0/d11/f12 [40018,81510] 0 2024-04-26T11:23:59.271 INFO:tasks.workunit.client.0.smithi073.stdout:2/107: truncate f5 314898 0 2024-04-26T11:23:59.272 INFO:tasks.workunit.client.0.smithi073.stdout:5/114: symlink d4/de/d14/l28 0 2024-04-26T11:23:59.273 INFO:tasks.workunit.client.0.smithi073.stdout:4/95: unlink d8/l12 0 2024-04-26T11:23:59.275 INFO:tasks.workunit.client.0.smithi073.stdout:8/86: dwrite d1/f18 [0,4194304] 0 2024-04-26T11:23:59.275 INFO:tasks.workunit.client.0.smithi073.stdout:5/115: dread - d4/f20 zero size 2024-04-26T11:23:59.275 INFO:tasks.workunit.client.0.smithi073.stdout:9/93: chown d0/d13/l6 769075766 1 2024-04-26T11:23:59.277 INFO:tasks.workunit.client.0.smithi073.stdout:9/94: chown d0/d13/l17 7690 1 2024-04-26T11:23:59.277 INFO:tasks.workunit.client.0.smithi073.stdout:1/147: dwrite d1/d6/fb [0,4194304] 0 2024-04-26T11:23:59.278 INFO:tasks.workunit.client.0.smithi073.stdout:6/44: dread d0/f9 [0,4194304] 0 2024-04-26T11:23:59.278 INFO:tasks.workunit.client.0.smithi073.stdout:8/87: creat d1/d4/d8/f22 x:0 0 0 2024-04-26T11:23:59.278 INFO:tasks.workunit.client.0.smithi073.stdout:0/66: dwrite d2/f12 [0,4194304] 0 2024-04-26T11:23:59.278 INFO:tasks.workunit.client.0.smithi073.stdout:1/148: stat d1/df/f1c 0 2024-04-26T11:23:59.279 INFO:tasks.workunit.client.0.smithi073.stdout:9/95: creat d0/d13/f20 x:0 0 0 2024-04-26T11:23:59.279 INFO:tasks.workunit.client.0.smithi073.stdout:5/116: mknod d4/de/d23/c29 0 2024-04-26T11:23:59.280 INFO:tasks.workunit.client.0.smithi073.stdout:0/67: chown d2/l5 45562 1 2024-04-26T11:23:59.280 INFO:tasks.workunit.client.0.smithi073.stdout:8/88: rmdir d1/d4/d15 39 2024-04-26T11:23:59.280 INFO:tasks.workunit.client.0.smithi073.stdout:1/149: creat d1/df/f35 x:0 0 0 2024-04-26T11:23:59.281 INFO:tasks.workunit.client.0.smithi073.stdout:5/117: creat d4/de/d14/f2a x:0 0 0 2024-04-26T11:23:59.281 INFO:tasks.workunit.client.0.smithi073.stdout:2/108: dread dd/d1c/f22 [0,4194304] 0 2024-04-26T11:23:59.281 INFO:tasks.workunit.client.0.smithi073.stdout:0/68: creat d2/f1c x:0 0 0 2024-04-26T11:23:59.282 INFO:tasks.workunit.client.0.smithi073.stdout:1/150: write d1/df/d12/f2a [891301,2318] 0 2024-04-26T11:23:59.283 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:23:59.284 INFO:tasks.workunit.client.0.smithi073.stdout:1/151: write d1/f2b [614807,14498] 0 2024-04-26T11:23:59.284 INFO:tasks.workunit.client.0.smithi073.stdout:8/89: symlink d1/d4/d8/l23 0 2024-04-26T11:23:59.286 INFO:tasks.workunit.client.0.smithi073.stdout:7/61: fdatasync f0 0 2024-04-26T11:23:59.286 INFO:tasks.workunit.client.0.smithi073.stdout:4/96: dwrite f7 [0,4194304] 0 2024-04-26T11:23:59.286 INFO:tasks.workunit.client.0.smithi073.stdout:2/109: creat dd/d1c/f23 x:0 0 0 2024-04-26T11:23:59.286 INFO:tasks.workunit.client.0.smithi073.stdout:6/45: dread d0/f9 [0,4194304] 0 2024-04-26T11:23:59.286 INFO:tasks.workunit.client.0.smithi073.stdout:9/96: creat d0/f21 x:0 0 0 2024-04-26T11:23:59.286 INFO:tasks.workunit.client.0.smithi073.stdout:8/90: unlink d1/f16 0 2024-04-26T11:23:59.287 INFO:tasks.workunit.client.0.smithi073.stdout:0/69: rename d2/f12 to d2/f1d 0 2024-04-26T11:23:59.287 INFO:tasks.workunit.client.0.smithi073.stdout:2/110: truncate dd/d1c/f23 397420 0 2024-04-26T11:23:59.287 INFO:tasks.workunit.client.0.smithi073.stdout:2/111: stat c1 0 2024-04-26T11:23:59.288 INFO:tasks.workunit.client.0.smithi073.stdout:3/76: truncate d0/d2/db/fe 2668105 0 2024-04-26T11:23:59.288 INFO:tasks.workunit.client.0.smithi073.stdout:9/97: creat d0/d13/f22 x:0 0 0 2024-04-26T11:23:59.288 INFO:tasks.workunit.client.0.smithi073.stdout:7/62: mknod d1/d8/c13 0 2024-04-26T11:23:59.288 INFO:tasks.workunit.client.0.smithi073.stdout:4/97: rename d8/d14/f16 to d8/d1a/d1b/d1d/f21 0 2024-04-26T11:23:59.292 INFO:tasks.workunit.client.0.smithi073.stdout:9/98: stat d0 0 2024-04-26T11:23:59.292 INFO:tasks.workunit.client.0.smithi073.stdout:1/152: link d1/df/f1c d1/df/f36 0 2024-04-26T11:23:59.293 INFO:tasks.workunit.client.0.smithi073.stdout:9/99: chown d0/l3 298846278 1 2024-04-26T11:23:59.293 INFO:tasks.workunit.client.0.smithi073.stdout:8/91: fsync d1/d4/d8/f22 0 2024-04-26T11:23:59.293 INFO:tasks.workunit.client.0.smithi073.stdout:7/63: creat d1/d11/f14 x:0 0 0 2024-04-26T11:23:59.293 INFO:tasks.workunit.client.0.smithi073.stdout:2/112: symlink dd/d1c/d1d/d17/l24 0 2024-04-26T11:23:59.296 INFO:tasks.workunit.client.0.smithi073.stdout:8/92: fsync d1/f17 0 2024-04-26T11:23:59.296 INFO:tasks.workunit.client.0.smithi073.stdout:9/100: chown d0/d13/ld 45720 1 2024-04-26T11:23:59.296 INFO:tasks.workunit.client.0.smithi073.stdout:1/153: write d1/df/f35 [309397,92955] 0 2024-04-26T11:23:59.297 INFO:tasks.workunit.client.0.smithi073.stdout:2/113: chown f7 522887 1 2024-04-26T11:23:59.297 INFO:tasks.workunit.client.0.smithi073.stdout:7/64: read d1/d8/ff [2512993,6105] 0 2024-04-26T11:23:59.297 INFO:tasks.workunit.client.0.smithi073.stdout:4/98: truncate d8/d1a/d1b/d1d/f21 1096621 0 2024-04-26T11:23:59.298 INFO:tasks.workunit.client.0.smithi073.stdout:5/118: dread d4/d8/d9/f12 [0,4194304] 0 2024-04-26T11:23:59.299 INFO:tasks.workunit.client.0.smithi073.stdout:8/93: write d1/d4/d15/f1f [2136,71709] 0 2024-04-26T11:23:59.299 INFO:tasks.workunit.client.0.smithi073.stdout:3/77: rename d0/d2 to d0/d11/d19 0 2024-04-26T11:23:59.300 INFO:tasks.workunit.client.0.smithi073.stdout:4/99: read - d8/d15/f17 zero size 2024-04-26T11:23:59.300 INFO:tasks.workunit.client.0.smithi073.stdout:9/101: truncate d0/f10 661929 0 2024-04-26T11:23:59.300 INFO:tasks.workunit.client.0.smithi073.stdout:0/70: dwrite d2/f15 [0,4194304] 0 2024-04-26T11:23:59.300 INFO:tasks.workunit.client.0.smithi073.stdout:4/100: readlink l4 0 2024-04-26T11:23:59.302 INFO:tasks.workunit.client.0.smithi073.stdout:4/101: fdatasync d8/f10 0 2024-04-26T11:23:59.302 INFO:tasks.workunit.client.0.smithi073.stdout:8/94: read - d1/f17 zero size 2024-04-26T11:23:59.302 INFO:tasks.workunit.client.0.smithi073.stdout:9/102: fsync d0/fa 0 2024-04-26T11:23:59.304 INFO:tasks.workunit.client.0.smithi073.stdout:4/102: stat d8/f13 0 2024-04-26T11:23:59.305 INFO:tasks.workunit.client.0.smithi073.stdout:3/78: creat d0/d11/d19/db/f1a x:0 0 0 2024-04-26T11:23:59.306 INFO:tasks.workunit.client.0.smithi073.stdout:2/114: stat fb 0 2024-04-26T11:23:59.306 INFO:tasks.workunit.client.0.smithi073.stdout:5/119: getdents d4/d8/d9 0 2024-04-26T11:23:59.307 INFO:tasks.workunit.client.0.smithi073.stdout:4/103: chown f7 13266 1 2024-04-26T11:23:59.307 INFO:tasks.workunit.client.0.smithi073.stdout:8/95: write d1/f17 [948814,97368] 0 2024-04-26T11:23:59.307 INFO:tasks.workunit.client.0.smithi073.stdout:6/46: dwrite d0/f9 [0,4194304] 0 2024-04-26T11:23:59.308 INFO:tasks.workunit.client.0.smithi073.stdout:7/65: dread d1/d11/f9 [0,4194304] 0 2024-04-26T11:23:59.308 INFO:tasks.workunit.client.0.smithi073.stdout:8/96: write d1/d4/d8/f22 [45785,44110] 0 2024-04-26T11:23:59.309 INFO:tasks.workunit.client.0.smithi073.stdout:9/103: rename d0/d13/ff to d0/d13/db/f23 0 2024-04-26T11:23:59.309 INFO:tasks.workunit.client.0.smithi073.stdout:1/154: dwrite d1/f2b [0,4194304] 0 2024-04-26T11:23:59.311 INFO:tasks.workunit.client.0.smithi073.stdout:0/71: truncate d2/fd 2465028 0 2024-04-26T11:23:59.311 INFO:tasks.workunit.client.0.smithi073.stdout:2/115: sync 2024-04-26T11:23:59.311 INFO:tasks.workunit.client.0.smithi073.stdout:6/47: rename d0/ca to d0/c10 0 2024-04-26T11:23:59.312 INFO:tasks.workunit.client.0.smithi073.stdout:4/104: rename f3 to d8/d1f/f22 0 2024-04-26T11:23:59.313 INFO:tasks.workunit.client.0.smithi073.stdout:9/104: creat d0/d1a/f24 x:0 0 0 2024-04-26T11:23:59.313 INFO:tasks.workunit.client.0.smithi073.stdout:0/72: creat d2/f1e x:0 0 0 2024-04-26T11:23:59.313 INFO:tasks.workunit.client.0.smithi073.stdout:5/120: rename c3 to d4/d8/c2b 0 2024-04-26T11:23:59.314 INFO:tasks.workunit.client.0.smithi073.stdout:1/155: mkdir d1/d8/d2e/d37 0 2024-04-26T11:23:59.314 INFO:tasks.workunit.client.0.smithi073.stdout:2/116: chown dd/d1c/d1d/f1e 26 1 2024-04-26T11:23:59.314 INFO:tasks.workunit.client.0.smithi073.stdout:4/105: read d8/d1f/f22 [6324982,15042] 0 2024-04-26T11:23:59.314 INFO:tasks.workunit.client.0.smithi073.stdout:0/73: mkdir d2/d1f 0 2024-04-26T11:23:59.315 INFO:tasks.workunit.client.0.smithi073.stdout:9/105: chown d0/d1a/f1d 50593 1 2024-04-26T11:23:59.315 INFO:tasks.workunit.client.0.smithi073.stdout:5/121: read - d4/d8/d9/f21 zero size 2024-04-26T11:23:59.315 INFO:tasks.workunit.client.0.smithi073.stdout:1/156: chown d1/df/f21 228413327 1 2024-04-26T11:23:59.316 INFO:tasks.workunit.client.0.smithi073.stdout:2/117: truncate f5 37758 0 2024-04-26T11:23:59.316 INFO:tasks.workunit.client.0.smithi073.stdout:2/118: sync 2024-04-26T11:23:59.316 INFO:tasks.workunit.client.0.smithi073.stdout:4/106: write d8/f13 [454686,53096] 0 2024-04-26T11:23:59.317 INFO:tasks.workunit.client.0.smithi073.stdout:0/74: chown d2/f11 69397278 1 2024-04-26T11:23:59.318 INFO:tasks.workunit.client.0.smithi073.stdout:2/119: chown dd/f1a 2459880 1 2024-04-26T11:23:59.320 INFO:tasks.workunit.client.0.smithi073.stdout:8/97: dwrite d1/f6 [4194304,4194304] 0 2024-04-26T11:23:59.322 INFO:tasks.workunit.client.0.smithi073.stdout:2/120: rename dd/d1c/f23 to dd/d1c/f25 0 2024-04-26T11:23:59.323 INFO:tasks.workunit.client.0.smithi073.stdout:0/75: rename d2/l6 to d2/l20 0 2024-04-26T11:23:59.323 INFO:tasks.workunit.client.0.smithi073.stdout:7/66: dwrite d1/f5 [0,4194304] 0 2024-04-26T11:23:59.324 INFO:tasks.workunit.client.0.smithi073.stdout:8/98: chown d1/f6 158466 1 2024-04-26T11:23:59.325 INFO:tasks.workunit.client.0.smithi073.stdout:3/79: dwrite d0/d11/d19/db/fe [0,4194304] 0 2024-04-26T11:23:59.325 INFO:tasks.workunit.client.0.smithi073.stdout:6/48: dread d0/f4 [0,4194304] 0 2024-04-26T11:23:59.326 INFO:tasks.workunit.client.0.smithi073.stdout:0/76: rename d2/f1e to d2/f21 0 2024-04-26T11:23:59.327 INFO:tasks.workunit.client.0.smithi073.stdout:2/121: symlink dd/d1c/l26 0 2024-04-26T11:23:59.328 INFO:tasks.workunit.client.0.smithi073.stdout:7/67: link d1/lb d1/d11/d10/l15 0 2024-04-26T11:23:59.328 INFO:tasks.workunit.client.0.smithi073.stdout:8/99: rename d1/d4/d8/c14 to d1/d20/c24 0 2024-04-26T11:23:59.329 INFO:tasks.workunit.client.0.smithi073.stdout:2/122: mkdir dd/d27 0 2024-04-26T11:23:59.329 INFO:tasks.workunit.client.0.smithi073.stdout:6/49: mkdir d0/dc/d11 0 2024-04-26T11:23:59.330 INFO:tasks.workunit.client.0.smithi073.stdout:1/157: dwrite d1/d6/fa [0,4194304] 0 2024-04-26T11:23:59.331 INFO:tasks.workunit.client.0.smithi073.stdout:6/50: fdatasync d0/f4 0 2024-04-26T11:23:59.331 INFO:tasks.workunit.client.0.smithi073.stdout:9/106: dwrite d0/d13/f1f [0,4194304] 0 2024-04-26T11:23:59.331 INFO:tasks.workunit.client.0.smithi073.stdout:8/100: symlink d1/d4/d8/l25 0 2024-04-26T11:23:59.332 INFO:tasks.workunit.client.0.smithi073.stdout:1/158: read - d1/d16/f20 zero size 2024-04-26T11:23:59.333 INFO:tasks.workunit.client.0.smithi073.stdout:8/101: readlink d1/l10 0 2024-04-26T11:23:59.333 INFO:tasks.workunit.client.0.smithi073.stdout:3/80: getdents d0 0 2024-04-26T11:23:59.334 INFO:tasks.workunit.client.0.smithi073.stdout:4/107: dwrite d8/d1a/d1b/d1d/f21 [0,4194304] 0 2024-04-26T11:23:59.335 INFO:tasks.workunit.client.0.smithi073.stdout:9/107: mkdir d0/d13/d25 0 2024-04-26T11:23:59.336 INFO:tasks.workunit.client.0.smithi073.stdout:1/159: stat d1/c5 0 2024-04-26T11:23:59.337 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:59.332+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:59.338 INFO:tasks.workunit.client.0.smithi073.stdout:5/122: truncate d4/de/d14/f16 1090814 0 2024-04-26T11:23:59.338 INFO:tasks.workunit.client.0.smithi073.stdout:4/108: dread - d8/d15/f17 zero size 2024-04-26T11:23:59.339 INFO:tasks.workunit.client.0.smithi073.stdout:5/123: chown d4/d8/d9/f12 18477616 1 2024-04-26T11:23:59.339 INFO:tasks.workunit.client.0.smithi073.stdout:7/68: dread d1/d11/f9 [0,4194304] 0 2024-04-26T11:23:59.339 INFO:tasks.workunit.client.0.smithi073.stdout:9/108: symlink d0/l26 0 2024-04-26T11:23:59.340 INFO:tasks.workunit.client.0.smithi073.stdout:9/109: unlink d0/d13/l6 0 2024-04-26T11:23:59.342 INFO:tasks.workunit.client.0.smithi073.stdout:1/160: read d1/d6/fb [2350713,94931] 0 2024-04-26T11:23:59.342 INFO:tasks.workunit.client.0.smithi073.stdout:1/161: sync 2024-04-26T11:23:59.343 INFO:tasks.workunit.client.0.smithi073.stdout:7/69: write d1/d11/fd [3431541,90324] 0 2024-04-26T11:23:59.344 INFO:tasks.workunit.client.0.smithi073.stdout:2/123: dwrite dd/de/f18 [0,4194304] 0 2024-04-26T11:23:59.344 INFO:tasks.workunit.client.0.smithi073.stdout:6/51: dwrite d0/f9 [4194304,4194304] 0 2024-04-26T11:23:59.345 INFO:tasks.workunit.client.0.smithi073.stdout:9/110: rename d0/l26 to d0/d13/d25/l27 0 2024-04-26T11:23:59.345 INFO:tasks.workunit.client.0.smithi073.stdout:1/162: symlink d1/df/d34/l38 0 2024-04-26T11:23:59.346 INFO:tasks.workunit.client.0.smithi073.stdout:7/70: write d1/f5 [3894788,43535] 0 2024-04-26T11:23:59.348 INFO:tasks.workunit.client.0.smithi073.stdout:6/52: creat d0/dc/d11/f12 x:0 0 0 2024-04-26T11:23:59.348 INFO:tasks.workunit.client.0.smithi073.stdout:3/81: dwrite d0/d11/d19/f6 [0,4194304] 0 2024-04-26T11:23:59.348 INFO:tasks.workunit.client.0.smithi073.stdout:7/71: creat d1/d11/d10/f16 x:0 0 0 2024-04-26T11:23:59.349 INFO:tasks.workunit.client.0.smithi073.stdout:6/53: symlink d0/dc/l13 0 2024-04-26T11:23:59.349 INFO:tasks.workunit.client.0.smithi073.stdout:1/163: getdents d1/d8 0 2024-04-26T11:23:59.349 INFO:tasks.workunit.client.0.smithi073.stdout:4/109: dwrite d8/d15/f18 [0,4194304] 0 2024-04-26T11:23:59.349 INFO:tasks.workunit.client.0.smithi073.stdout:6/54: write d0/f4 [4702862,120808] 0 2024-04-26T11:23:59.350 INFO:tasks.workunit.client.0.smithi073.stdout:3/82: link d0/lf d0/d11/d19/l1b 0 2024-04-26T11:23:59.350 INFO:tasks.workunit.client.0.smithi073.stdout:4/110: mkdir d8/d1f/d23 0 2024-04-26T11:23:59.350 INFO:tasks.workunit.client.0.smithi073.stdout:6/55: read d0/f4 [3715151,24798] 0 2024-04-26T11:23:59.351 INFO:tasks.workunit.client.0.smithi073.stdout:4/111: stat d8/d15/f18 0 2024-04-26T11:23:59.351 INFO:tasks.workunit.client.0.smithi073.stdout:1/164: mknod d1/d8/d2e/d37/c39 0 2024-04-26T11:23:59.351 INFO:tasks.workunit.client.0.smithi073.stdout:3/83: chown d0/d11/d19/db/f15 38 1 2024-04-26T11:23:59.352 INFO:tasks.workunit.client.0.smithi073.stdout:3/84: rmdir d0 39 2024-04-26T11:23:59.354 INFO:tasks.workunit.client.0.smithi073.stdout:3/85: rename d0/d11/c14 to d0/c1c 0 2024-04-26T11:23:59.354 INFO:tasks.workunit.client.0.smithi073.stdout:3/86: mkdir d0/d11/d19/d1d 0 2024-04-26T11:23:59.355 INFO:tasks.workunit.client.0.smithi073.stdout:8/102: rmdir d1/d4/d8 39 2024-04-26T11:23:59.356 INFO:tasks.workunit.client.0.smithi073.stdout:3/87: mkdir d0/d11/d19/d1d/d1e 0 2024-04-26T11:23:59.357 INFO:tasks.workunit.client.0.smithi073.stdout:8/103: creat d1/f26 x:0 0 0 2024-04-26T11:23:59.358 INFO:tasks.workunit.client.0.smithi073.stdout:1/165: dread d1/f1a [0,4194304] 0 2024-04-26T11:23:59.360 INFO:tasks.workunit.client.0.smithi073.stdout:8/104: symlink d1/l27 0 2024-04-26T11:23:59.360 INFO:tasks.workunit.client.0.smithi073.stdout:1/166: creat d1/df/d12/f3a x:0 0 0 2024-04-26T11:23:59.360 INFO:tasks.workunit.client.0.smithi073.stdout:9/111: rmdir d0 39 2024-04-26T11:23:59.362 INFO:tasks.workunit.client.0.smithi073.stdout:8/105: write d1/d4/d15/f1d [128240,103984] 0 2024-04-26T11:23:59.362 INFO:tasks.workunit.client.0.smithi073.stdout:9/112: chown d0/l3 105812403 1 2024-04-26T11:23:59.363 INFO:tasks.workunit.client.0.smithi073.stdout:1/167: chown d1/df/d12/f2c 773994512 1 2024-04-26T11:23:59.363 INFO:tasks.workunit.client.0.smithi073.stdout:7/72: truncate d1/d11/fd 806551 0 2024-04-26T11:23:59.364 INFO:tasks.workunit.client.0.smithi073.stdout:0/77: dwrite d2/fd [0,4194304] 0 2024-04-26T11:23:59.364 INFO:tasks.workunit.client.0.smithi073.stdout:3/88: dread d0/d11/d19/db/fe [0,4194304] 0 2024-04-26T11:23:59.364 INFO:tasks.workunit.client.0.smithi073.stdout:1/168: write d1/df/d12/f2a [798411,18620] 0 2024-04-26T11:23:59.366 INFO:tasks.workunit.client.0.smithi073.stdout:5/124: write d4/de/d14/f16 [1733615,45230] 0 2024-04-26T11:23:59.366 INFO:tasks.workunit.client.0.smithi073.stdout:7/73: mknod d1/d8/c17 0 2024-04-26T11:23:59.366 INFO:tasks.workunit.client.0.smithi073.stdout:9/113: rename d0/d13/c14 to d0/d13/db/c28 0 2024-04-26T11:23:59.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/78: mkdir d2/d22 0 2024-04-26T11:23:59.366 INFO:tasks.workunit.client.0.smithi073.stdout:2/124: sync 2024-04-26T11:23:59.367 INFO:tasks.workunit.client.0.smithi073.stdout:3/89: creat d0/d11/f1f x:0 0 0 2024-04-26T11:23:59.368 INFO:tasks.workunit.client.0.smithi073.stdout:4/112: sync 2024-04-26T11:23:59.368 INFO:tasks.workunit.client.0.smithi073.stdout:0/79: readlink d2/l5 0 2024-04-26T11:23:59.368 INFO:tasks.workunit.client.0.smithi073.stdout:6/56: fdatasync d0/f4 0 2024-04-26T11:23:59.368 INFO:tasks.workunit.client.0.smithi073.stdout:5/125: dread - d4/de/d15/f19 zero size 2024-04-26T11:23:59.368 INFO:tasks.workunit.client.0.smithi073.stdout:8/106: dread d1/f18 [0,4194304] 0 2024-04-26T11:23:59.368 INFO:tasks.workunit.client.0.smithi073.stdout:9/114: readlink d0/d13/d25/l27 0 2024-04-26T11:23:59.368 INFO:tasks.workunit.client.0.smithi073.stdout:0/80: fsync d2/f21 0 2024-04-26T11:23:59.369 INFO:tasks.workunit.client.0.smithi073.stdout:9/115: chown d0/d13/db 204 1 2024-04-26T11:23:59.369 INFO:tasks.workunit.client.0.smithi073.stdout:6/57: write d0/dc/d11/f12 [403446,48096] 0 2024-04-26T11:23:59.369 INFO:tasks.workunit.client.0.smithi073.stdout:0/81: truncate d2/f1d 4446080 0 2024-04-26T11:23:59.371 INFO:tasks.workunit.client.0.smithi073.stdout:9/116: mknod d0/d1a/c29 0 2024-04-26T11:23:59.371 INFO:tasks.workunit.client.0.smithi073.stdout:6/58: creat d0/dc/d11/f14 x:0 0 0 2024-04-26T11:23:59.372 INFO:tasks.workunit.client.0.smithi073.stdout:4/113: getdents d8 0 2024-04-26T11:23:59.372 INFO:tasks.workunit.client.0.smithi073.stdout:2/125: getdents dd/d1c 0 2024-04-26T11:23:59.372 INFO:tasks.workunit.client.0.smithi073.stdout:8/107: symlink d1/d4/d8/l28 0 2024-04-26T11:23:59.373 INFO:tasks.workunit.client.0.smithi073.stdout:4/114: fdatasync d8/fe 0 2024-04-26T11:23:59.374 INFO:tasks.workunit.client.0.smithi073.stdout:2/126: creat dd/de/f28 x:0 0 0 2024-04-26T11:23:59.374 INFO:tasks.workunit.client.0.smithi073.stdout:6/59: fdatasync d0/dc/d11/f12 0 2024-04-26T11:23:59.374 INFO:tasks.workunit.client.0.smithi073.stdout:4/115: chown d8/cd 31373 1 2024-04-26T11:23:59.376 INFO:tasks.workunit.client.0.smithi073.stdout:4/116: write d8/d15/f17 [792273,40665] 0 2024-04-26T11:23:59.376 INFO:tasks.workunit.client.0.smithi073.stdout:3/90: dwrite d0/d11/f12 [0,4194304] 0 2024-04-26T11:23:59.377 INFO:tasks.workunit.client.0.smithi073.stdout:2/127: write dd/d1c/d1d/f1e [1413304,42226] 0 2024-04-26T11:23:59.377 INFO:tasks.workunit.client.0.smithi073.stdout:5/126: dwrite f2 [0,4194304] 0 2024-04-26T11:23:59.379 INFO:tasks.workunit.client.0.smithi073.stdout:4/117: write d8/f10 [439224,98024] 0 2024-04-26T11:23:59.380 INFO:tasks.workunit.client.0.smithi073.stdout:7/74: write d1/f5 [1256222,123179] 0 2024-04-26T11:23:59.380 INFO:tasks.workunit.client.0.smithi073.stdout:5/127: write d4/de/d14/f2a [803428,61810] 0 2024-04-26T11:23:59.381 INFO:tasks.workunit.client.0.smithi073.stdout:9/117: dread d0/d13/db/f23 [0,4194304] 0 2024-04-26T11:23:59.381 INFO:tasks.workunit.client.0.smithi073.stdout:3/91: creat d0/d11/d19/db/f20 x:0 0 0 2024-04-26T11:23:59.382 INFO:tasks.workunit.client.0.smithi073.stdout:0/82: rmdir d2 39 2024-04-26T11:23:59.382 INFO:tasks.workunit.client.0.smithi073.stdout:1/169: truncate d1/d8/f18 3106346 0 2024-04-26T11:23:59.383 INFO:tasks.workunit.client.0.smithi073.stdout:4/118: write d8/d15/f18 [3006769,37718] 0 2024-04-26T11:23:59.384 INFO:tasks.workunit.client.0.smithi073.stdout:7/75: write d1/d8/ff [2064192,26451] 0 2024-04-26T11:23:59.384 INFO:tasks.workunit.client.0.smithi073.stdout:1/170: chown d1/f1a 965 1 2024-04-26T11:23:59.385 INFO:tasks.workunit.client.0.smithi073.stdout:9/118: unlink d0/d13/db/l19 0 2024-04-26T11:23:59.385 INFO:tasks.workunit.client.0.smithi073.stdout:8/108: dwrite d1/d4/d15/f1d [0,4194304] 0 2024-04-26T11:23:59.386 INFO:tasks.workunit.client.0.smithi073.stdout:6/60: dread d0/f2 [0,4194304] 0 2024-04-26T11:23:59.386 INFO:tasks.workunit.client.0.smithi073.stdout:4/119: mkdir d8/d1a/d1b/d24 0 2024-04-26T11:23:59.387 INFO:tasks.workunit.client.0.smithi073.stdout:6/61: fdatasync d0/f2 0 2024-04-26T11:23:59.388 INFO:tasks.workunit.client.0.smithi073.stdout:6/62: readlink d0/dc/l13 0 2024-04-26T11:23:59.389 INFO:tasks.workunit.client.0.smithi073.stdout:1/171: fdatasync d1/d8/fd 0 2024-04-26T11:23:59.389 INFO:tasks.workunit.client.0.smithi073.stdout:4/120: mkdir d8/d1f/d25 0 2024-04-26T11:23:59.389 INFO:tasks.workunit.client.0.smithi073.stdout:7/76: rename d1/d11/d10/l15 to d1/d8/l18 0 2024-04-26T11:23:59.391 INFO:tasks.workunit.client.0.smithi073.stdout:2/128: dwrite dd/d1c/f25 [0,4194304] 0 2024-04-26T11:23:59.391 INFO:tasks.workunit.client.0.smithi073.stdout:6/63: rename d0/dc/d11 to d0/d15 0 2024-04-26T11:23:59.392 INFO:tasks.workunit.client.0.smithi073.stdout:1/172: dread - d1/df/f1b zero size 2024-04-26T11:23:59.394 INFO:tasks.workunit.client.0.smithi073.stdout:4/121: creat d8/d1a/d1b/f26 x:0 0 0 2024-04-26T11:23:59.394 INFO:tasks.workunit.client.0.smithi073.stdout:2/129: mkdir dd/de/d29 0 2024-04-26T11:23:59.396 INFO:tasks.workunit.client.0.smithi073.stdout:6/64: creat d0/f16 x:0 0 0 2024-04-26T11:23:59.396 INFO:tasks.workunit.client.0.smithi073.stdout:0/83: truncate d2/f15 1988924 0 2024-04-26T11:23:59.396 INFO:tasks.workunit.client.0.smithi073.stdout:1/173: mknod d1/d8/d2e/c3b 0 2024-04-26T11:23:59.397 INFO:tasks.workunit.client.0.smithi073.stdout:5/128: dread d4/f1f [0,4194304] 0 2024-04-26T11:23:59.397 INFO:tasks.workunit.client.0.smithi073.stdout:3/92: dwrite d0/d11/d19/db/f20 [0,4194304] 0 2024-04-26T11:23:59.400 INFO:tasks.workunit.client.0.smithi073.stdout:9/119: dwrite d0/f21 [0,4194304] 0 2024-04-26T11:23:59.401 INFO:tasks.workunit.client.0.smithi073.stdout:8/109: dwrite d1/fa [0,4194304] 0 2024-04-26T11:23:59.401 INFO:tasks.workunit.client.0.smithi073.stdout:5/129: truncate d4/de/d15/f19 329836 0 2024-04-26T11:23:59.402 INFO:tasks.workunit.client.0.smithi073.stdout:5/130: fdatasync d4/f1d 0 2024-04-26T11:23:59.403 INFO:tasks.workunit.client.0.smithi073.stdout:9/120: dread - d0/d1a/f1d zero size 2024-04-26T11:23:59.403 INFO:tasks.workunit.client.0.smithi073.stdout:7/77: dwrite d1/d11/f9 [4194304,4194304] 0 2024-04-26T11:23:59.404 INFO:tasks.workunit.client.0.smithi073.stdout:5/131: chown d4/de/d14/f16 121844 1 2024-04-26T11:23:59.406 INFO:tasks.workunit.client.0.smithi073.stdout:2/130: mkdir dd/de/d2a 0 2024-04-26T11:23:59.407 INFO:tasks.workunit.client.0.smithi073.stdout:3/93: dwrite d0/d11/f18 [0,4194304] 0 2024-04-26T11:23:59.410 INFO:tasks.workunit.client.0.smithi073.stdout:6/65: unlink d0/d15/f12 0 2024-04-26T11:23:59.410 INFO:tasks.workunit.client.0.smithi073.stdout:1/174: rmdir d1/d8 39 2024-04-26T11:23:59.411 INFO:tasks.workunit.client.0.smithi073.stdout:3/94: rmdir d0/d11 39 2024-04-26T11:23:59.411 INFO:tasks.workunit.client.0.smithi073.stdout:0/84: symlink d2/d22/l23 0 2024-04-26T11:23:59.412 INFO:tasks.workunit.client.0.smithi073.stdout:4/122: creat d8/d15/d1c/f27 x:0 0 0 2024-04-26T11:23:59.412 INFO:tasks.workunit.client.0.smithi073.stdout:9/121: mknod d0/c2a 0 2024-04-26T11:23:59.412 INFO:tasks.workunit.client.0.smithi073.stdout:9/122: chown d0/f10 3291 1 2024-04-26T11:23:59.412 INFO:tasks.workunit.client.0.smithi073.stdout:2/131: truncate dd/d1c/d1d/f15 1154212 0 2024-04-26T11:23:59.413 INFO:tasks.workunit.client.0.smithi073.stdout:7/78: creat d1/f19 x:0 0 0 2024-04-26T11:23:59.413 INFO:tasks.workunit.client.0.smithi073.stdout:5/132: creat d4/de/f2c x:0 0 0 2024-04-26T11:23:59.413 INFO:tasks.workunit.client.0.smithi073.stdout:1/175: mkdir d1/d8/d2e/d3c 0 2024-04-26T11:23:59.414 INFO:tasks.workunit.client.0.smithi073.stdout:3/95: dread - d0/d11/d19/db/f1a zero size 2024-04-26T11:23:59.415 INFO:tasks.workunit.client.0.smithi073.stdout:7/79: rmdir d1/d11 39 2024-04-26T11:23:59.415 INFO:tasks.workunit.client.0.smithi073.stdout:4/123: symlink d8/d1f/d25/l28 0 2024-04-26T11:23:59.416 INFO:tasks.workunit.client.0.smithi073.stdout:8/110: dwrite d1/d4/f12 [0,4194304] 0 2024-04-26T11:23:59.416 INFO:tasks.workunit.client.0.smithi073.stdout:1/176: mknod d1/d16/c3d 0 2024-04-26T11:23:59.416 INFO:tasks.workunit.client.0.smithi073.stdout:9/123: rename d0/d1a/f1d to d0/d13/db/f2b 0 2024-04-26T11:23:59.417 INFO:tasks.workunit.client.0.smithi073.stdout:2/132: mkdir dd/d27/d2b 0 2024-04-26T11:23:59.417 INFO:tasks.workunit.client.0.smithi073.stdout:5/133: symlink d4/de/l2d 0 2024-04-26T11:23:59.417 INFO:tasks.workunit.client.0.smithi073.stdout:7/80: mknod d1/d8/c1a 0 2024-04-26T11:23:59.420 INFO:tasks.workunit.client.0.smithi073.stdout:7/81: mkdir d1/d8/d1b 0 2024-04-26T11:23:59.420 INFO:tasks.workunit.client.0.smithi073.stdout:1/177: fsync d1/d8/f18 0 2024-04-26T11:23:59.421 INFO:tasks.workunit.client.0.smithi073.stdout:6/66: dwrite d0/f2 [0,4194304] 0 2024-04-26T11:23:59.422 INFO:tasks.workunit.client.0.smithi073.stdout:6/67: symlink d0/d15/l17 0 2024-04-26T11:23:59.423 INFO:tasks.workunit.client.0.smithi073.stdout:0/85: dwrite d2/fd [0,4194304] 0 2024-04-26T11:23:59.424 INFO:tasks.workunit.client.0.smithi073.stdout:6/68: fdatasync d0/f9 0 2024-04-26T11:23:59.424 INFO:tasks.workunit.client.0.smithi073.stdout:7/82: rename d1/fe to d1/d11/f1c 0 2024-04-26T11:23:59.424 INFO:tasks.workunit.client.0.smithi073.stdout:4/124: dread f7 [0,4194304] 0 2024-04-26T11:23:59.425 INFO:tasks.workunit.client.0.smithi073.stdout:8/111: read d1/f17 [327057,52482] 0 2024-04-26T11:23:59.426 INFO:tasks.workunit.client.0.smithi073.stdout:7/83: dread - d1/d11/d10/f16 zero size 2024-04-26T11:23:59.426 INFO:tasks.workunit.client.0.smithi073.stdout:4/125: mknod d8/c29 0 2024-04-26T11:23:59.427 INFO:tasks.workunit.client.0.smithi073.stdout:9/124: dwrite d0/f21 [0,4194304] 0 2024-04-26T11:23:59.427 INFO:tasks.workunit.client.0.smithi073.stdout:0/86: getdents d2/d1f 0 2024-04-26T11:23:59.428 INFO:tasks.workunit.client.0.smithi073.stdout:5/134: dwrite d4/de/f13 [0,4194304] 0 2024-04-26T11:23:59.428 INFO:tasks.workunit.client.0.smithi073.stdout:9/125: chown d0 13075477 1 2024-04-26T11:23:59.428 INFO:tasks.workunit.client.0.smithi073.stdout:0/87: readlink d2/lc 0 2024-04-26T11:23:59.428 INFO:tasks.workunit.client.0.smithi073.stdout:7/84: write d1/f19 [962904,87533] 0 2024-04-26T11:23:59.430 INFO:tasks.workunit.client.0.smithi073.stdout:9/126: mkdir d0/d13/d25/d2c 0 2024-04-26T11:23:59.430 INFO:tasks.workunit.client.0.smithi073.stdout:4/126: link d8/fe d8/d14/f2a 0 2024-04-26T11:23:59.431 INFO:tasks.workunit.client.0.smithi073.stdout:0/88: rename d2/fd to d2/f24 0 2024-04-26T11:23:59.431 INFO:tasks.workunit.client.0.smithi073.stdout:7/85: mknod d1/d11/c1d 0 2024-04-26T11:23:59.432 INFO:tasks.workunit.client.0.smithi073.stdout:4/127: creat d8/d1a/f2b x:0 0 0 2024-04-26T11:23:59.432 INFO:tasks.workunit.client.0.smithi073.stdout:9/127: rename d0/d13/db to d0/d13/db/d2d 22 2024-04-26T11:23:59.433 INFO:tasks.workunit.client.0.smithi073.stdout:1/178: dwrite d1/df/d12/f2f [4194304,4194304] 0 2024-04-26T11:23:59.433 INFO:tasks.workunit.client.0.smithi073.stdout:0/89: truncate d2/f1c 41366 0 2024-04-26T11:23:59.433 INFO:tasks.workunit.client.0.smithi073.stdout:9/128: write d0/f21 [3455033,35603] 0 2024-04-26T11:23:59.433 INFO:tasks.workunit.client.0.smithi073.stdout:7/86: creat d1/d8/d1b/f1e x:0 0 0 2024-04-26T11:23:59.434 INFO:tasks.workunit.client.0.smithi073.stdout:6/69: dwrite d0/f9 [4194304,4194304] 0 2024-04-26T11:23:59.434 INFO:tasks.workunit.client.0.smithi073.stdout:9/129: fsync d0/f10 0 2024-04-26T11:23:59.434 INFO:tasks.workunit.client.0.smithi073.stdout:9/130: dread - d0/d13/f18 zero size 2024-04-26T11:23:59.434 INFO:tasks.workunit.client.0.smithi073.stdout:6/70: write d0/f16 [591973,120603] 0 2024-04-26T11:23:59.435 INFO:tasks.workunit.client.0.smithi073.stdout:9/131: stat d0/fa 0 2024-04-26T11:23:59.435 INFO:tasks.workunit.client.0.smithi073.stdout:6/71: truncate d0/f16 1566772 0 2024-04-26T11:23:59.437 INFO:tasks.workunit.client.0.smithi073.stdout:4/128: creat d8/d1a/d1b/d1d/f2c x:0 0 0 2024-04-26T11:23:59.438 INFO:tasks.workunit.client.0.smithi073.stdout:5/135: dwrite d4/de/f10 [0,4194304] 0 2024-04-26T11:23:59.438 INFO:tasks.workunit.client.0.smithi073.stdout:0/90: creat d2/f25 x:0 0 0 2024-04-26T11:23:59.438 INFO:tasks.workunit.client.0.smithi073.stdout:7/87: mkdir d1/d8/d1f 0 2024-04-26T11:23:59.438 INFO:tasks.workunit.client.0.smithi073.stdout:9/132: rmdir d0/d13/d25 39 2024-04-26T11:23:59.438 INFO:tasks.workunit.client.0.smithi073.stdout:1/179: getdents d1/d8/d2e/d3c 0 2024-04-26T11:23:59.438 INFO:tasks.workunit.client.0.smithi073.stdout:7/88: fsync d1/d11/f9 0 2024-04-26T11:23:59.439 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:59.432+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:59.439 INFO:tasks.workunit.client.0.smithi073.stdout:5/136: symlink d4/l2e 0 2024-04-26T11:23:59.439 INFO:tasks.workunit.client.0.smithi073.stdout:1/180: fdatasync d1/df/d12/f2c 0 2024-04-26T11:23:59.439 INFO:tasks.workunit.client.0.smithi073.stdout:7/89: symlink d1/d11/l20 0 2024-04-26T11:23:59.439 INFO:tasks.workunit.client.0.smithi073.stdout:7/90: chown d1/d8/d1b 112786 1 2024-04-26T11:23:59.440 INFO:tasks.workunit.client.0.smithi073.stdout:7/91: read d1/d11/f9 [7279062,76670] 0 2024-04-26T11:23:59.440 INFO:tasks.workunit.client.0.smithi073.stdout:6/72: dread d0/f9 [0,4194304] 0 2024-04-26T11:23:59.440 INFO:tasks.workunit.client.0.smithi073.stdout:1/181: creat d1/d8/d2e/d3c/f3e x:0 0 0 2024-04-26T11:23:59.441 INFO:tasks.workunit.client.0.smithi073.stdout:7/92: mknod d1/d8/d1b/c21 0 2024-04-26T11:23:59.441 INFO:tasks.workunit.client.0.smithi073.stdout:5/137: link d4/de/d15/l17 d4/de/d14/l2f 0 2024-04-26T11:23:59.442 INFO:tasks.workunit.client.0.smithi073.stdout:7/93: creat d1/f22 x:0 0 0 2024-04-26T11:23:59.443 INFO:tasks.workunit.client.0.smithi073.stdout:9/133: dread d0/d13/db/f23 [0,4194304] 0 2024-04-26T11:23:59.446 INFO:tasks.workunit.client.0.smithi073.stdout:0/91: dwrite d2/f24 [0,4194304] 0 2024-04-26T11:23:59.450 INFO:tasks.workunit.client.0.smithi073.stdout:5/138: dwrite d4/d8/d9/f1b [0,4194304] 0 2024-04-26T11:23:59.452 INFO:tasks.workunit.client.0.smithi073.stdout:0/92: dread d2/f24 [0,4194304] 0 2024-04-26T11:23:59.453 INFO:tasks.workunit.client.0.smithi073.stdout:9/134: dwrite d0/d1a/f24 [0,4194304] 0 2024-04-26T11:23:59.454 INFO:tasks.workunit.client.0.smithi073.stdout:0/93: write d2/f1d [1968678,87824] 0 2024-04-26T11:23:59.454 INFO:tasks.workunit.client.0.smithi073.stdout:9/135: write d0/f10 [964689,18350] 0 2024-04-26T11:23:59.455 INFO:tasks.workunit.client.0.smithi073.stdout:0/94: chown d2/d22/l23 80153726 1 2024-04-26T11:23:59.457 INFO:tasks.workunit.client.0.smithi073.stdout:6/73: read d0/f16 [749964,20539] 0 2024-04-26T11:23:59.458 INFO:tasks.workunit.client.0.smithi073.stdout:7/94: dread d1/f5 [0,4194304] 0 2024-04-26T11:23:59.459 INFO:tasks.workunit.client.0.smithi073.stdout:5/139: dwrite d4/d8/d9/f12 [0,4194304] 0 2024-04-26T11:23:59.460 INFO:tasks.workunit.client.0.smithi073.stdout:7/95: write d1/d11/f14 [85137,122862] 0 2024-04-26T11:23:59.460 INFO:tasks.workunit.client.0.smithi073.stdout:6/74: symlink d0/l18 0 2024-04-26T11:23:59.461 INFO:tasks.workunit.client.0.smithi073.stdout:7/96: creat d1/d8/d1f/f23 x:0 0 0 2024-04-26T11:23:59.462 INFO:tasks.workunit.client.0.smithi073.stdout:7/97: chown d1/d11/d10/f16 0 1 2024-04-26T11:23:59.463 INFO:tasks.workunit.client.0.smithi073.stdout:9/136: dwrite d0/d13/db/f23 [0,4194304] 0 2024-04-26T11:23:59.463 INFO:tasks.workunit.client.0.smithi073.stdout:7/98: mkdir d1/d11/d24 0 2024-04-26T11:23:59.464 INFO:tasks.workunit.client.0.smithi073.stdout:9/137: unlink d0/f21 0 2024-04-26T11:23:59.464 INFO:tasks.workunit.client.0.smithi073.stdout:7/99: mknod d1/c25 0 2024-04-26T11:23:59.465 INFO:tasks.workunit.client.0.smithi073.stdout:9/138: write d0/fa [1836940,55453] 0 2024-04-26T11:23:59.466 INFO:tasks.workunit.client.0.smithi073.stdout:6/75: dwrite d0/f9 [4194304,4194304] 0 2024-04-26T11:23:59.468 INFO:tasks.workunit.client.0.smithi073.stdout:9/139: mkdir d0/d13/db/d2e 0 2024-04-26T11:23:59.469 INFO:tasks.workunit.client.0.smithi073.stdout:7/100: mkdir d1/d11/d24/d26 0 2024-04-26T11:23:59.469 INFO:tasks.workunit.client.0.smithi073.stdout:3/96: sync 2024-04-26T11:23:59.469 INFO:tasks.workunit.client.0.smithi073.stdout:3/97: stat d0/d11/f12 0 2024-04-26T11:23:59.469 INFO:tasks.workunit.client.0.smithi073.stdout:7/101: symlink d1/d8/d1b/l27 0 2024-04-26T11:23:59.469 INFO:tasks.workunit.client.0.smithi073.stdout:7/102: readlink d1/d8/d1b/l27 0 2024-04-26T11:23:59.471 INFO:tasks.workunit.client.0.smithi073.stdout:3/98: creat d0/d11/d19/f21 x:0 0 0 2024-04-26T11:23:59.471 INFO:tasks.workunit.client.0.smithi073.stdout:6/76: getdents d0/dc 0 2024-04-26T11:23:59.471 INFO:tasks.workunit.client.0.smithi073.stdout:7/103: creat d1/d8/d1f/f28 x:0 0 0 2024-04-26T11:23:59.472 INFO:tasks.workunit.client.0.smithi073.stdout:7/104: mkdir d1/d11/d24/d29 0 2024-04-26T11:23:59.472 INFO:tasks.workunit.client.0.smithi073.stdout:3/99: mknod d0/d11/d19/d1d/d1e/c22 0 2024-04-26T11:23:59.473 INFO:tasks.workunit.client.0.smithi073.stdout:7/105: symlink d1/d8/d1b/l2a 0 2024-04-26T11:23:59.475 INFO:tasks.workunit.client.0.smithi073.stdout:7/106: symlink d1/d8/d1b/l2b 0 2024-04-26T11:23:59.475 INFO:tasks.workunit.client.0.smithi073.stdout:9/140: fdatasync d0/f10 0 2024-04-26T11:23:59.475 INFO:tasks.workunit.client.0.smithi073.stdout:7/107: dread - d1/d11/d10/f16 zero size 2024-04-26T11:23:59.478 INFO:tasks.workunit.client.0.smithi073.stdout:6/77: dwrite d0/f4 [0,4194304] 0 2024-04-26T11:23:59.478 INFO:tasks.workunit.client.0.smithi073.stdout:3/100: dread d0/d11/d19/db/f20 [0,4194304] 0 2024-04-26T11:23:59.479 INFO:tasks.workunit.client.0.smithi073.stdout:6/78: write d0/d15/f14 [799088,35024] 0 2024-04-26T11:23:59.479 INFO:tasks.workunit.client.0.smithi073.stdout:3/101: dread - d0/d11/f1f zero size 2024-04-26T11:23:59.480 INFO:tasks.workunit.client.0.smithi073.stdout:6/79: chown d0/dc/cf 1 1 2024-04-26T11:23:59.480 INFO:tasks.workunit.client.0.smithi073.stdout:3/102: rmdir d0/d11/d19/d1d/d1e 39 2024-04-26T11:23:59.481 INFO:tasks.workunit.client.0.smithi073.stdout:7/108: dread d1/d11/f9 [0,4194304] 0 2024-04-26T11:23:59.482 INFO:tasks.workunit.client.0.smithi073.stdout:1/182: dread d1/df/f35 [0,4194304] 0 2024-04-26T11:23:59.482 INFO:tasks.workunit.client.0.smithi073.stdout:9/141: dwrite d0/d1a/f24 [0,4194304] 0 2024-04-26T11:23:59.483 INFO:tasks.workunit.client.0.smithi073.stdout:7/109: write f0 [1031187,98193] 0 2024-04-26T11:23:59.483 INFO:tasks.workunit.client.0.smithi073.stdout:9/142: fsync d0/f10 0 2024-04-26T11:23:59.485 INFO:tasks.workunit.client.0.smithi073.stdout:1/183: symlink d1/d6/l3f 0 2024-04-26T11:23:59.485 INFO:tasks.workunit.client.0.smithi073.stdout:9/143: truncate d0/d13/f20 491302 0 2024-04-26T11:23:59.485 INFO:tasks.workunit.client.0.smithi073.stdout:3/103: mkdir d0/d11/d23 0 2024-04-26T11:23:59.485 INFO:tasks.workunit.client.0.smithi073.stdout:7/110: creat d1/d11/d24/d26/f2c x:0 0 0 2024-04-26T11:23:59.486 INFO:tasks.workunit.client.0.smithi073.stdout:3/104: read d0/fa [665974,116867] 0 2024-04-26T11:23:59.486 INFO:tasks.workunit.client.0.smithi073.stdout:1/184: write d1/df/d12/f2c [615448,66512] 0 2024-04-26T11:23:59.488 INFO:tasks.workunit.client.0.smithi073.stdout:9/144: truncate d0/d13/f1c 179351 0 2024-04-26T11:23:59.488 INFO:tasks.workunit.client.0.smithi073.stdout:7/111: rename d1/d11/f9 to d1/d11/d24/d26/f2d 0 2024-04-26T11:23:59.488 INFO:tasks.workunit.client.0.smithi073.stdout:9/145: read d0/fa [1861655,108764] 0 2024-04-26T11:23:59.488 INFO:tasks.workunit.client.0.smithi073.stdout:6/80: dwrite d0/f9 [0,4194304] 0 2024-04-26T11:23:59.490 INFO:tasks.workunit.client.0.smithi073.stdout:9/146: readlink d0/d13/db/le 0 2024-04-26T11:23:59.490 INFO:tasks.workunit.client.0.smithi073.stdout:9/147: write d0/d13/f22 [904029,66257] 0 2024-04-26T11:23:59.490 INFO:tasks.workunit.client.0.smithi073.stdout:6/81: unlink d0/dc/ld 0 2024-04-26T11:23:59.490 INFO:tasks.workunit.client.0.smithi073.stdout:9/148: dread d0/d13/f1c [0,4194304] 0 2024-04-26T11:23:59.491 INFO:tasks.workunit.client.0.smithi073.stdout:3/105: mknod d0/d11/d19/d1d/d1e/c24 0 2024-04-26T11:23:59.492 INFO:tasks.workunit.client.0.smithi073.stdout:6/82: read d0/d15/f14 [419527,99622] 0 2024-04-26T11:23:59.494 INFO:tasks.workunit.client.0.smithi073.stdout:1/185: dwrite d1/df/f1b [0,4194304] 0 2024-04-26T11:23:59.494 INFO:tasks.workunit.client.0.smithi073.stdout:1/186: readlink d1/l24 0 2024-04-26T11:23:59.494 INFO:tasks.workunit.client.0.smithi073.stdout:7/112: dwrite d1/d8/d1f/f23 [0,4194304] 0 2024-04-26T11:23:59.495 INFO:tasks.workunit.client.0.smithi073.stdout:7/113: chown f0 6770 1 2024-04-26T11:23:59.495 INFO:tasks.workunit.client.0.smithi073.stdout:1/187: rename d1/df/d12 to d1/df/d40 0 2024-04-26T11:23:59.495 INFO:tasks.workunit.client.0.smithi073.stdout:9/149: dread d0/d13/db/f23 [0,4194304] 0 2024-04-26T11:23:59.495 INFO:tasks.workunit.client.0.smithi073.stdout:7/114: write d1/d8/d1f/f28 [35660,53195] 0 2024-04-26T11:23:59.496 INFO:tasks.workunit.client.0.smithi073.stdout:9/150: chown d0/d13/db/d2e 57010 1 2024-04-26T11:23:59.496 INFO:tasks.workunit.client.0.smithi073.stdout:9/151: chown d0/d13/f18 0 1 2024-04-26T11:23:59.497 INFO:tasks.workunit.client.0.smithi073.stdout:9/152: mkdir d0/d1a/d2f 0 2024-04-26T11:23:59.497 INFO:tasks.workunit.client.0.smithi073.stdout:7/115: link d1/c12 d1/d8/d1b/c2e 0 2024-04-26T11:23:59.498 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:23:59.498 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:23:59.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:23:59.498 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:23:59.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.498 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3873410~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.498 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:23:59.498 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.082133689, 2024-04-26T11:23:59.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.049732789999999999, 2024-04-26T11:23:59.498 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.498 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410916+0000", 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410925+0000", 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1030000000000002e-06 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410943+0000", 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8139999999999999e-05 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410957+0000", 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3939e-05 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.453976+0000", 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043019730999999999 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.454179+0000", 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000202964 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460360+0000", 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061803910000000004 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460473+0000", 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113402 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460650+0000", 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177236 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.502 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3874807~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0820828130000004, 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.049989594999999998, 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410967+0000", 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410985+0000", 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7580000000000001e-05 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411007+0000", 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1752000000000001e-05 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411021+0000", 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749999999999999e-05 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455415+0000", 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044393763000000003 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455544+0000", 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012836299999999999 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460672+0000", 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051280620000000001 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460775+0000", 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010309 2024-04-26T11:23:59.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460958+0000", 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018335500000000001 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3876210~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0820169450000003, 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050240140000000003, 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.510 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411033+0000", 2024-04-26T11:23:59.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411042+0000", 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7930000000000003e-06 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411064+0000", 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1869999999999999e-05 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411077+0000", 2024-04-26T11:23:59.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.456448+0000", 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.045371178999999998 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.456668+0000", 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022021899999999999 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460979+0000", 2024-04-26T11:23:59.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043111490000000002 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461088+0000", 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010888 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461274+0000", 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018618000000000001 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3877613~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0819630230000001, 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.052990624, 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411087+0000", 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411105+0000", 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7580000000000001e-05 2024-04-26T11:23:59.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411124+0000", 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9108999999999999e-05 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411139+0000", 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4676e-05 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.458214+0000", 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.047075327 2024-04-26T11:23:59.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.458359+0000", 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537299999999999 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.463839+0000", 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054799050000000002 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.463918+0000", 2024-04-26T11:23:59.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8887999999999994e-05 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464079+0000", 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160719 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3879013~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0818993539999999, 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053236793999999997, 2024-04-26T11:23:59.519 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411151+0000", 2024-04-26T11:23:59.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411160+0000", 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9760000000000001e-06 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411180+0000", 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9902999999999999e-05 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411196+0000", 2024-04-26T11:23:59.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6129000000000001e-05 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459318+0000", 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048122047000000001 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459507+0000", 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189598 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464107+0000", 2024-04-26T11:23:59.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045994979999999996 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464199+0000", 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2083999999999995e-05 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464389+0000", 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189662 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3880419~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0818427929999999, 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.055882977, 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:23:59.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411207+0000", 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411215+0000", 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000007e-06 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411234+0000", 2024-04-26T11:23:59.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8563000000000002e-05 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411248+0000", 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4499e-05 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461384+0000", 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050136067999999999 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461534+0000", 2024-04-26T11:23:59.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014934400000000001 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.466771+0000", 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052373610000000003 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.466900+0000", 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012929200000000001 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467091+0000", 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000191153 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3881822~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0817905139999997, 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.057533475000000001, 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411260+0000", 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411279+0000", 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9055999999999998e-05 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411300+0000", 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1556000000000002e-05 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411315+0000", 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4307e-05 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.462268+0000", 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050953713999999997 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.462480+0000", 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021157500000000001 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468480+0000", 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059997169999999999 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468609+0000", 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012991700000000001 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468794+0000", 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000184766 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3883227~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0817242089999999, 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.060065495000000003, 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411326+0000", 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411334+0000", 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7570000000000004e-06 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411351+0000", 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7523000000000001e-05 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411367+0000", 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5909e-05 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464493+0000", 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053126200999999998 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464716+0000", 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000222244 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471192+0000", 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064765689999999997 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471299+0000", 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010697200000000001 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471393+0000", 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3399999999999993e-05 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3884626~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0816720269999998, 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.060192189, 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411378+0000", 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411394+0000", 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6047000000000001e-05 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411413+0000", 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9159000000000001e-05 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411428+0000", 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4543e-05 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465657+0000", 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.054228982000000002 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465838+0000", 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000180719 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471407+0000", 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055695709999999997 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471487+0000", 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9555999999999995e-05 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471571+0000", 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4635000000000005e-05 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.541 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 3886023~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0816110410000004, 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064564381000000004, 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411439+0000", 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411449+0000", 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0056e-05 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411467+0000", 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7367000000000002e-05 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411484+0000", 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6949e-05 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467227+0000", 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.055743085999999997 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467347+0000", 2024-04-26T11:23:59.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012048999999999999 2024-04-26T11:23:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.475804+0000", 2024-04-26T11:23:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084571980000000008 2024-04-26T11:23:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.475897+0000", 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2601000000000003e-05 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476005+0000", 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010764099999999999 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 3887426~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0815559600000002, 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064774331000000004, 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411494+0000", 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411509+0000", 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4463e-05 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411526+0000", 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7226000000000001e-05 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411540+0000", 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4063000000000001e-05 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468882+0000", 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.057341548999999999 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.469023+0000", 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141357 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476029+0000", 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070060829999999998 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476132+0000", 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103045 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476270+0000", 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013762099999999999 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:8088 4.5 4:a3b551eb:::100000024d3.00000000:head [write 0~479] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0727539330000004, 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.056313184000000002, 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:59.551 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 8088 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420295+0000", 2024-04-26T11:23:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999971 2024-04-26T11:23:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420310+0000", 2024-04-26T11:23:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.554e-05 2024-04-26T11:23:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.555 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:59.552+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420344+0000", 2024-04-26T11:23:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4195e-05 2024-04-26T11:23:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420365+0000", 2024-04-26T11:23:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0726000000000001e-05 2024-04-26T11:23:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468869+0000", 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048503444 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.469179+0000", 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030999599999999999 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476290+0000", 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071110239999999996 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476425+0000", 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013510200000000001 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476611+0000", 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018590699999999999 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 3985361~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0378570030000001, 2024-04-26T11:23:59.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048391816999999997, 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455192+0000", 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455205+0000", 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2816000000000001e-05 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455231+0000", 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455247+0000", 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6446000000000001e-05 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.495318+0000", 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.040070460000000002 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.495514+0000", 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019605800000000001 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503340+0000", 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078268000000000001 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503478+0000", 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137847 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503586+0000", 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0001078 2024-04-26T11:23:59.562 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 3986766~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0377752349999998, 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048511780999999997, 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:23:59.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455275+0000", 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455295+0000", 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9556999999999999e-05 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455309+0000", 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4129e-05 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455318+0000", 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9099999999999994e-06 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.497677+0000", 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042359494999999997 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.497779+0000", 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101652 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503601+0000", 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058225500000000001 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503667+0000", 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6165000000000001e-05 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503788+0000", 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012043 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 4002753~2766 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:23:59.567 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0331949949999997, 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.051229524999999998, 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459855+0000", 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459863+0000", 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1429999999999998e-06 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459873+0000", 2024-04-26T11:23:59.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459885+0000", 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.253e-05 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.501870+0000", 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041984759000000003 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.502112+0000", 2024-04-26T11:23:59.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241387 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510903+0000", 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087910309999999995 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510975+0000", 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2683999999999997e-05 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511086+0000", 2024-04-26T11:23:59.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110534 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 4005519~5851 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0331588890000001, 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.051351761000000003, 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459920+0000", 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8198999999999999e-05 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459931+0000", 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0896e-05 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459939+0000", 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8040000000000002e-06 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503910+0000", 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043971057000000001 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.504155+0000", 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024487100000000002 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511096+0000", 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069414660000000003 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511153+0000", 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7126999999999997e-05 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511244+0000", 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1044000000000004e-05 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 4011370~3881 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:23:59.576 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0331043769999999, 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053603985999999999, 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459946+0000", 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459963+0000", 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7090000000000001e-05 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459985+0000", 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1889e-05 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459998+0000", 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.344e-05 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.505665+0000", 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.045666292999999997 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.505878+0000", 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021291999999999999 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513229+0000", 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073514380000000001 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513355+0000", 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012582000000000001 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513551+0000", 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019610600000000001 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.580 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 4015251~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0323146059999999, 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053137220999999998, 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460735+0000", 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460752+0000", 2024-04-26T11:23:59.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7016000000000001e-05 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460797+0000", 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5136000000000003e-05 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460813+0000", 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6138999999999999e-05 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.508005+0000", 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0471923 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.508158+0000", 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152096 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513572+0000", 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054148490000000002 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513680+0000", 2024-04-26T11:23:59.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107243 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513874+0000", 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019425200000000001 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 4017160~11347 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0288572079999998, 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053850265000000001, 2024-04-26T11:23:59.585 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.586 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464192+0000", 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464228+0000", 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6162999999999999e-05 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464256+0000", 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7665999999999999e-05 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464276+0000", 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0403000000000001e-05 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.509181+0000", 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044904685999999999 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.509391+0000", 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021012299999999999 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.517888+0000", 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084974600000000001 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.517941+0000", 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2484000000000001e-05 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518044+0000", 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103424 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.589 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:8119 4.5 4:a024dd33:::100000024f3.00000000:head [write 0~1435] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 5.0273699450000002, 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.052532417999999997, 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 8119 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.590 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465679+0000", 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465695+0000", 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5287000000000001e-05 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465725+0000", 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0284999999999999e-05 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465744+0000", 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9414000000000001e-05 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510010+0000", 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044265697999999999 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510296+0000", 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000286323 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518060+0000", 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077638289999999999 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518111+0000", 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1144999999999999e-05 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518214+0000", 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102564 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:23:59.594 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:23:59.595 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:23:59.614 INFO:tasks.workunit.client.0.smithi073.stdout:9/153: symlink d0/d13/db/d2e/l30 0 2024-04-26T11:23:59.614 INFO:tasks.workunit.client.0.smithi073.stdout:9/154: symlink d0/d13/l31 0 2024-04-26T11:23:59.614 INFO:tasks.workunit.client.0.smithi073.stdout:9/155: fdatasync d0/d13/f1f 0 2024-04-26T11:23:59.614 INFO:tasks.workunit.client.0.smithi073.stdout:2/133: getdents dd/d27 0 2024-04-26T11:23:59.614 INFO:tasks.workunit.client.0.smithi073.stdout:0/95: fsync d2/f13 0 2024-04-26T11:23:59.614 INFO:tasks.workunit.client.0.smithi073.stdout:1/188: dwrite d1/df/f35 [0,4194304] 0 2024-04-26T11:23:59.614 INFO:tasks.workunit.client.0.smithi073.stdout:1/189: mkdir d1/d8/d2e/d3c/d41 0 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:0/96: write d2/f24 [383604,74874] 0 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:1/190: chown d1/c27 17503 1 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:1/191: write d1/f1a [1712758,65936] 0 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:2/134: dwrite dd/d1c/f25 [0,4194304] 0 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:8/112: truncate d1/d4/d8/f22 38362 0 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:0/97: rmdir d2 39 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:1/192: chown d1/df/d40/f2f 18603124 1 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:8/113: rename d1/d4/d8/f13 to d1/d21/f29 0 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:1/193: mknod d1/df/d40/c42 0 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:1/194: creat d1/df/d34/f43 x:0 0 0 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:8/114: rename d1/d20 to d1/d21/d2a 0 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:0/98: creat d2/d1f/f26 x:0 0 0 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:8/115: stat d1/d4/f12 0 2024-04-26T11:23:59.615 INFO:tasks.workunit.client.0.smithi073.stdout:1/195: mkdir d1/df/d40/d44 0 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:0/99: write d2/d1f/f26 [705955,45489] 0 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:8/116: write d1/f6 [234271,64161] 0 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:2/135: dread dd/d1c/f25 [0,4194304] 0 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:1/196: chown d1/d8/d2e/c3b 40447417 1 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:0/100: chown d2/c1b 339 1 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:1/197: chown d1/d8/d2e/d37 925 1 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:9/156: dwrite d0/d1a/f24 [4194304,4194304] 0 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:1/198: chown d1/f3 141284762 1 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:0/101: symlink d2/l27 0 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:5/140: sync 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:4/129: sync 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:2/136: creat dd/d27/d2b/f2c x:0 0 0 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:1/199: unlink d1/df/f21 0 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:5/141: fsync d4/de/d14/f1a 0 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:0/102: creat d2/d1f/f28 x:0 0 0 2024-04-26T11:23:59.616 INFO:tasks.workunit.client.0.smithi073.stdout:4/130: fsync d8/d1a/d1b/d1d/f2c 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:1/200: creat d1/d8/d2e/f45 x:0 0 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:5/142: fsync d4/de/d14/f2a 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:1/201: mknod d1/df/d34/c46 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:5/143: getdents d4/d8 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:1/202: chown d1/df/f23 8308782 1 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:5/144: unlink d4/d8/c24 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:8/117: dwrite d1/f6 [4194304,4194304] 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:8/118: write d1/fa [3849614,92687] 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:5/145: chown d4/de/d14/c26 6733782 1 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:4/131: dread d8/f10 [0,4194304] 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:9/157: dwrite d0/d13/f22 [0,4194304] 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:5/146: write d4/de/f2c [350186,14383] 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:9/158: readlink d0/l16 0 2024-04-26T11:23:59.617 INFO:tasks.workunit.client.0.smithi073.stdout:5/147: chown d4/de/d23/c29 16 1 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:1/203: mkdir d1/d8/d2e/d3c/d41/d47 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:8/119: rename d1/d4/d15/f1d to d1/d21/d2a/f2b 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:4/132: creat d8/d1a/d1b/d24/f2d x:0 0 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:8/120: mkdir d1/d21/d2c 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:8/121: fsync d1/f18 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:8/122: chown d1/d4/d8/f22 5 1 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:7/116: unlink d1/d11/d24/d26/f2d 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:6/83: getdents d0/dc 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:3/106: write d0/fa [2568821,65275] 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:9/159: rmdir d0 39 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:5/148: dwrite d4/de/f13 [4194304,4194304] 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:8/123: symlink d1/d21/d2a/l2d 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:2/137: write f6 [2893911,65755] 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:1/204: dwrite d1/d8/f2d [0,4194304] 0 2024-04-26T11:23:59.618 INFO:tasks.workunit.client.0.smithi073.stdout:2/138: creat dd/d27/d2b/f2d x:0 0 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:4/133: dwrite d8/f13 [0,4194304] 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:9/160: creat d0/d13/f32 x:0 0 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:3/107: sync 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:2/139: write dd/f1b [108778,27615] 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:1/205: link d1/d8/d2e/c3b d1/d8/d2e/d3c/d41/d47/c48 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:2/140: rename dd/l16 to dd/l2e 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:8/124: dread d1/f18 [0,4194304] 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:3/108: readlink d0/lf 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:7/117: dwrite d1/d8/d1f/f23 [0,4194304] 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:9/161: rename d0/fa to d0/d13/d25/d2c/f33 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:1/206: write d1/df/d40/f2a [893454,11277] 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:8/125: creat d1/d4/d8/f2e x:0 0 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:6/84: dwrite d0/d15/f14 [0,4194304] 0 2024-04-26T11:23:59.619 INFO:tasks.workunit.client.0.smithi073.stdout:9/162: unlink d0/l3 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:8/126: rename d1/fa to d1/f2f 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:9/163: unlink d0/d1a/f24 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:1/207: symlink d1/l49 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:2/141: truncate dd/de/ff 1799177 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:5/149: truncate d4/de/f2c 290855 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:3/109: getdents d0/d11/d19/d1d 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:5/150: write d4/de/f13 [8386253,120536] 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:8/127: creat d1/d4/d8/f30 x:0 0 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:9/164: creat d0/d13/db/d2e/f34 x:0 0 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:4/134: dread d8/d1a/d1b/d1d/f21 [0,4194304] 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:3/110: creat d0/d11/d19/f25 x:0 0 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:5/151: dread - d4/de/d14/f1c zero size 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:4/135: chown d8/d1a/d1b/d1d/f2c 253026641 1 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:8/128: symlink d1/d21/d2a/l31 0 2024-04-26T11:23:59.620 INFO:tasks.workunit.client.0.smithi073.stdout:4/136: sync 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:7/118: dwrite d1/d8/ff [0,4194304] 0 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:7/119: chown d1/d8/d1f/f28 264658 1 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:0/103: dread d2/ff [0,4194304] 0 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:7/120: chown d1/d11/d24 57551 1 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:1/208: dwrite d1/d16/f20 [0,4194304] 0 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:4/137: creat d8/f2e x:0 0 0 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:8/129: mknod d1/d4/c32 0 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:2/142: write dd/d1c/d1d/f15 [11163,52310] 0 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:5/152: link d4/de/d14/f16 d4/d8/f30 0 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:7/121: creat d1/d11/d10/f2f x:0 0 0 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:3/111: rename d0/d11/d19/d1d/d1e to d0/d26 0 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:0/104: write d2/d1f/f26 [407330,120893] 0 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:9/165: dwrite d0/f10 [0,4194304] 0 2024-04-26T11:23:59.621 INFO:tasks.workunit.client.0.smithi073.stdout:4/138: getdents d8/d15/d1c 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:8/130: dread d1/f6 [4194304,4194304] 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:1/209: getdents d1/d8/d2e/d37 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:5/153: rename d4/de/f13 to d4/de/d14/f31 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:9/166: mknod d0/d1a/c35 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:7/122: mknod d1/d11/d24/d29/c30 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:8/131: write d1/f2f [3466018,37808] 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:3/112: dread d0/d11/f12 [0,4194304] 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:2/143: getdents dd/de 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:7/123: dread d1/f5 [0,4194304] 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:0/105: rename d2/l4 to d2/d1f/l29 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:5/154: mknod d4/d8/c32 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:1/210: symlink d1/df/l4a 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:2/144: symlink dd/d1c/d1d/d17/l2f 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:9/167: write d0/d13/db/f23 [3289320,24791] 0 2024-04-26T11:23:59.622 INFO:tasks.workunit.client.0.smithi073.stdout:8/132: fdatasync d1/f17 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:4/139: getdents d8/d1a/d1b/d1d 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:8/133: readlink d1/d21/d2a/l31 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:4/140: rename d8 to d8/d1f/d25/d2f 22 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:6/85: dread d0/f16 [0,4194304] 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:1/211: mknod d1/d6/c4b 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:5/155: mkdir d4/de/d15/d33 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:2/145: readlink dd/l2e 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:9/168: creat d0/d1a/f36 x:0 0 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:4/141: creat d8/d14/f30 x:0 0 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:6/86: mkdir d0/d19 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:3/113: creat d0/d11/d19/f27 x:0 0 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:1/212: symlink d1/df/l4c 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:5/156: creat d4/de/d15/f34 x:0 0 0 2024-04-26T11:23:59.623 INFO:tasks.workunit.client.0.smithi073.stdout:7/124: getdents d1 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:5/157: readlink d4/de/l2d 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:4/142: mknod d8/d1f/d25/c31 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:2/146: dread fb [0,4194304] 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:9/169: chown d0/d13/db/c28 0 1 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:1/213: symlink d1/d8/d2e/l4d 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:7/125: write d1/d8/ff [286812,14749] 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:5/158: chown d4/f1f 7 1 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:4/143: fdatasync d8/fe 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:3/114: rename d0/d11/f12 to d0/d11/d19/f28 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:0/106: dwrite d2/f15 [0,4194304] 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:9/170: write d0/d13/f32 [937206,47523] 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:0/107: write d2/f17 [246932,114197] 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:8/134: dwrite d1/f17 [0,4194304] 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:9/171: write d0/d13/db/d2e/f34 [976344,55349] 0 2024-04-26T11:23:59.624 INFO:tasks.workunit.client.0.smithi073.stdout:1/214: dread d1/d8/fd [0,4194304] 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:2/147: rename dd/d27/d2b to dd/d1c/d1d/d30 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:8/135: mknod d1/d21/c33 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:4/144: creat d8/d1f/d23/f32 x:0 0 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:3/115: link d0/d11/d19/f27 d0/d26/f29 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:2/148: write f6 [481671,11331] 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:5/159: dwrite f2 [4194304,4194304] 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:3/116: chown d0/d26/c24 387820 1 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:4/145: mknod d8/d1f/d25/c33 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:5/160: creat d4/d8/f35 x:0 0 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:9/172: dwrite d0/d13/db/f23 [0,4194304] 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:5/161: creat d4/de/d23/f36 x:0 0 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:0/108: dwrite d2/fb [0,4194304] 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:9/173: readlink d0/d13/l31 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:1/215: read d1/f3 [551238,26189] 0 2024-04-26T11:23:59.625 INFO:tasks.workunit.client.0.smithi073.stdout:8/136: dwrite d1/f26 [0,4194304] 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:0/109: creat d2/d22/f2a x:0 0 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:9/174: rename d0/d13/l31 to d0/d1a/l37 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:8/137: write d1/f17 [1648635,24950] 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:8/138: dread - d1/d4/d8/f2e zero size 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:1/216: link d1/df/d40/f28 d1/df/d40/d44/f4e 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:0/110: truncate d2/f1d 5256850 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:0/111: readlink d2/l10 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:9/175: read d0/d13/db/d2e/f34 [551086,52030] 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:4/146: dwrite d8/f2e [0,4194304] 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:1/217: truncate d1/df/d40/d44/f4e 4540724 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:3/117: dwrite d0/d11/d19/f6 [0,4194304] 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:9/176: chown d0/d13/db/d2e/l30 35 1 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:1/218: mkdir d1/d16/d4f 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:9/177: creat d0/d13/db/d2e/f38 x:0 0 0 2024-04-26T11:23:59.626 INFO:tasks.workunit.client.0.smithi073.stdout:9/178: unlink d0/c2a 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:1/219: symlink d1/d8/d2e/l50 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:7/126: truncate d1/d11/f1c 1281565 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:1/220: rmdir d1/d6 39 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:9/179: mknod d0/d13/c39 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:9/180: dread - d0/d1a/f36 zero size 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:3/118: dread d0/d11/f18 [0,4194304] 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:8/139: dwrite d1/d4/d15/f1f [0,4194304] 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:7/127: rename d1/lb to d1/d11/d10/l31 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:2/149: dwrite f5 [0,4194304] 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:8/140: write d1/d4/d15/f1f [2726971,103607] 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:2/150: write dd/d1c/d1d/f15 [1959508,19462] 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:8/141: creat d1/d21/d2a/f34 x:0 0 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:9/181: link d0/d13/db/f23 d0/d13/d25/d2c/f3a 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:3/119: getdents d0/d26 0 2024-04-26T11:23:59.627 INFO:tasks.workunit.client.0.smithi073.stdout:2/151: chown dd/d1c 41235 1 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:8/142: chown d1/f6 1644984 1 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:9/182: write d0/d13/db/d2e/f38 [575836,80064] 0 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:3/120: dread - d0/d11/d19/f21 zero size 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:8/143: write d1/d4/d15/f1f [1866541,64707] 0 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:9/183: mkdir d0/d13/db/d2e/d3b 0 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:3/121: dread - d0/d11/d19/fc zero size 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:9/184: mkdir d0/d3c 0 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:7/128: rmdir d1/d11/d10 39 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:1/221: write d1/df/f1c [375118,4040] 0 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:7/129: dread - d1/f22 zero size 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:1/222: mkdir d1/d51 0 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:7/130: dread - d1/f22 zero size 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:7/131: symlink d1/d11/l32 0 2024-04-26T11:23:59.628 INFO:tasks.workunit.client.0.smithi073.stdout:7/132: dread - d1/d11/d24/d26/f2c zero size 2024-04-26T11:23:59.631 INFO:tasks.workunit.client.0.smithi073.stdout:7/133: truncate f0 2248879 0 2024-04-26T11:23:59.631 INFO:tasks.workunit.client.0.smithi073.stdout:7/134: rename d1/d8 to d1/d33 0 2024-04-26T11:23:59.631 INFO:tasks.workunit.client.0.smithi073.stdout:8/144: dwrite d1/d4/d15/f1f [4194304,4194304] 0 2024-04-26T11:23:59.631 INFO:tasks.workunit.client.0.smithi073.stdout:8/145: symlink d1/l35 0 2024-04-26T11:23:59.631 INFO:tasks.workunit.client.0.smithi073.stdout:8/146: stat d1/l10 0 2024-04-26T11:23:59.631 INFO:tasks.workunit.client.0.smithi073.stdout:7/135: truncate d1/d11/d10/f16 690242 0 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:7/136: chown d1/d33/d1f 1 1 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/147: chown d1/d4/c1a 2187 1 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/148: creat d1/d4/d8/f36 x:0 0 0 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/149: mkdir d1/d4/d37 0 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/150: read d1/f17 [366803,109835] 0 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/151: chown d1/d4/d8/cf 0 1 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/152: dread d1/d21/d2a/f2b [0,4194304] 0 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:6/87: sync 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/153: rmdir d1/d4/d15 39 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/154: symlink d1/d4/d37/l38 0 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/155: stat d1/f17 0 2024-04-26T11:23:59.632 INFO:tasks.workunit.client.0.smithi073.stdout:3/122: truncate d0/f7 3578869 0 2024-04-26T11:23:59.633 INFO:tasks.workunit.client.0.smithi073.stdout:3/123: write d0/d11/f1f [606429,6540] 0 2024-04-26T11:23:59.633 INFO:tasks.workunit.client.0.smithi073.stdout:3/124: creat d0/d26/f2a x:0 0 0 2024-04-26T11:23:59.633 INFO:tasks.workunit.client.0.smithi073.stdout:1/223: truncate d1/f2b 1056703 0 2024-04-26T11:23:59.633 INFO:tasks.workunit.client.0.smithi073.stdout:8/156: dread d1/f6 [4194304,4194304] 0 2024-04-26T11:23:59.633 INFO:tasks.workunit.client.0.smithi073.stdout:1/224: chown d1/d8/d2e/d3c/d41/d47 54417919 1 2024-04-26T11:23:59.633 INFO:tasks.workunit.client.0.smithi073.stdout:8/157: creat d1/d21/d2a/f39 x:0 0 0 2024-04-26T11:23:59.633 INFO:tasks.workunit.client.0.smithi073.stdout:3/125: write d0/d11/d19/db/fe [4103837,100772] 0 2024-04-26T11:23:59.633 INFO:tasks.workunit.client.0.smithi073.stdout:1/225: mknod d1/d8/d2e/d3c/d41/c52 0 2024-04-26T11:23:59.633 INFO:tasks.workunit.client.0.smithi073.stdout:8/158: mknod d1/d4/c3a 0 2024-04-26T11:23:59.634 INFO:tasks.workunit.client.0.smithi073.stdout:5/162: dread d4/f1d [0,4194304] 0 2024-04-26T11:23:59.635 INFO:tasks.workunit.client.0.smithi073.stdout:8/159: creat d1/d21/d2c/f3b x:0 0 0 2024-04-26T11:23:59.636 INFO:tasks.workunit.client.0.smithi073.stdout:5/163: truncate d4/de/d14/f1c 740097 0 2024-04-26T11:23:59.637 INFO:tasks.workunit.client.0.smithi073.stdout:8/160: rename d1/d4/c3a to d1/d4/c3c 0 2024-04-26T11:23:59.637 INFO:tasks.workunit.client.0.smithi073.stdout:5/164: symlink d4/l37 0 2024-04-26T11:23:59.637 INFO:tasks.workunit.client.0.smithi073.stdout:1/226: dread d1/d6/f25 [0,4194304] 0 2024-04-26T11:23:59.638 INFO:tasks.workunit.client.0.smithi073.stdout:3/126: dwrite d0/d11/f18 [0,4194304] 0 2024-04-26T11:23:59.638 INFO:tasks.workunit.client.0.smithi073.stdout:5/165: dread - d4/de/d15/f34 zero size 2024-04-26T11:23:59.638 INFO:tasks.workunit.client.0.smithi073.stdout:6/88: dwrite d0/f16 [0,4194304] 0 2024-04-26T11:23:59.642 INFO:tasks.workunit.client.0.smithi073.stdout:6/89: dread d0/f4 [0,4194304] 0 2024-04-26T11:23:59.642 INFO:tasks.workunit.client.0.smithi073.stdout:2/152: sync 2024-04-26T11:23:59.642 INFO:tasks.workunit.client.0.smithi073.stdout:4/147: sync 2024-04-26T11:23:59.642 INFO:tasks.workunit.client.0.smithi073.stdout:9/185: sync 2024-04-26T11:23:59.642 INFO:tasks.workunit.client.0.smithi073.stdout:6/90: read d0/f4 [3198803,52916] 0 2024-04-26T11:23:59.644 INFO:tasks.workunit.client.0.smithi073.stdout:5/166: unlink d4/de/d15/l22 0 2024-04-26T11:23:59.644 INFO:tasks.workunit.client.0.smithi073.stdout:3/127: rename d0/c1 to d0/d26/c2b 0 2024-04-26T11:23:59.644 INFO:tasks.workunit.client.0.smithi073.stdout:2/153: creat dd/d27/f31 x:0 0 0 2024-04-26T11:23:59.644 INFO:tasks.workunit.client.0.smithi073.stdout:5/167: fsync d4/d8/d9/f21 0 2024-04-26T11:23:59.645 INFO:tasks.workunit.client.0.smithi073.stdout:5/168: readlink d4/de/d14/l25 0 2024-04-26T11:23:59.645 INFO:tasks.workunit.client.0.smithi073.stdout:4/148: mkdir d8/d1f/d34 0 2024-04-26T11:23:59.646 INFO:tasks.workunit.client.0.smithi073.stdout:9/186: dread d0/d13/db/d2e/f38 [0,4194304] 0 2024-04-26T11:23:59.646 INFO:tasks.workunit.client.0.smithi073.stdout:2/154: unlink dd/d1c/d1d/l19 0 2024-04-26T11:23:59.646 INFO:tasks.workunit.client.0.smithi073.stdout:8/161: getdents d1 0 2024-04-26T11:23:59.647 INFO:tasks.workunit.client.0.smithi073.stdout:9/187: readlink d0/d1a/l37 0 2024-04-26T11:23:59.647 INFO:tasks.workunit.client.0.smithi073.stdout:6/91: getdents d0/d15 0 2024-04-26T11:23:59.648 INFO:tasks.workunit.client.0.smithi073.stdout:5/169: getdents d4/d8 0 2024-04-26T11:23:59.648 INFO:tasks.workunit.client.0.smithi073.stdout:5/170: fdatasync d4/f1d 0 2024-04-26T11:23:59.648 INFO:tasks.workunit.client.0.smithi073.stdout:2/155: rename dd/d1c/c21 to dd/de/d2a/c32 0 2024-04-26T11:23:59.648 INFO:tasks.workunit.client.0.smithi073.stdout:0/112: dread d2/f11 [0,4194304] 0 2024-04-26T11:23:59.649 INFO:tasks.workunit.client.0.smithi073.stdout:8/162: rename d1 to d1/d4/d37/d3d 22 2024-04-26T11:23:59.649 INFO:tasks.workunit.client.0.smithi073.stdout:9/188: symlink d0/d13/db/d2e/l3d 0 2024-04-26T11:23:59.649 INFO:tasks.workunit.client.0.smithi073.stdout:6/92: write d0/f9 [3414488,119950] 0 2024-04-26T11:23:59.649 INFO:tasks.workunit.client.0.smithi073.stdout:5/171: chown d4/d8/ld 44768336 1 2024-04-26T11:23:59.650 INFO:tasks.workunit.client.0.smithi073.stdout:0/113: creat d2/d1f/f2b x:0 0 0 2024-04-26T11:23:59.651 INFO:tasks.workunit.client.0.smithi073.stdout:7/137: dwrite d1/d11/f1c [0,4194304] 0 2024-04-26T11:23:59.651 INFO:tasks.workunit.client.0.smithi073.stdout:8/163: mknod d1/d4/d15/c3e 0 2024-04-26T11:23:59.651 INFO:tasks.workunit.client.0.smithi073.stdout:0/114: read - d2/d1f/f28 zero size 2024-04-26T11:23:59.652 INFO:tasks.workunit.client.0.smithi073.stdout:8/164: write d1/d4/f12 [2265704,77799] 0 2024-04-26T11:23:59.653 INFO:tasks.workunit.client.0.smithi073.stdout:0/115: write d2/f17 [1364873,18689] 0 2024-04-26T11:23:59.653 INFO:tasks.workunit.client.0.smithi073.stdout:7/138: rename d1/d33/d1f to d1/d33/d1f/d34 22 2024-04-26T11:23:59.655 INFO:tasks.workunit.client.0.smithi073.stdout:3/128: truncate d0/d11/d19/db/fe 3382380 0 2024-04-26T11:23:59.655 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:59.652+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:59.655 INFO:tasks.workunit.client.0.smithi073.stdout:5/172: mknod d4/de/d14/c38 0 2024-04-26T11:23:59.656 INFO:tasks.workunit.client.0.smithi073.stdout:8/165: rename d1/l35 to d1/d4/d15/l3f 0 2024-04-26T11:23:59.656 INFO:tasks.workunit.client.0.smithi073.stdout:0/116: write d2/f25 [1021719,62306] 0 2024-04-26T11:23:59.656 INFO:tasks.workunit.client.0.smithi073.stdout:7/139: write d1/f22 [816298,82569] 0 2024-04-26T11:23:59.656 INFO:tasks.workunit.client.0.smithi073.stdout:4/149: dwrite d8/d1a/d1b/f26 [0,4194304] 0 2024-04-26T11:23:59.657 INFO:tasks.workunit.client.0.smithi073.stdout:9/189: dread d0/d13/d25/d2c/f3a [0,4194304] 0 2024-04-26T11:23:59.658 INFO:tasks.workunit.client.0.smithi073.stdout:2/156: dwrite dd/de/ff [0,4194304] 0 2024-04-26T11:23:59.659 INFO:tasks.workunit.client.0.smithi073.stdout:6/93: dwrite d0/f9 [0,4194304] 0 2024-04-26T11:23:59.659 INFO:tasks.workunit.client.0.smithi073.stdout:0/117: readlink d2/l20 0 2024-04-26T11:23:59.660 INFO:tasks.workunit.client.0.smithi073.stdout:3/129: mkdir d0/d26/d2c 0 2024-04-26T11:23:59.660 INFO:tasks.workunit.client.0.smithi073.stdout:8/166: creat d1/d4/d37/f40 x:0 0 0 2024-04-26T11:23:59.660 INFO:tasks.workunit.client.0.smithi073.stdout:4/150: mknod d8/d1a/d1b/d1d/c35 0 2024-04-26T11:23:59.662 INFO:tasks.workunit.client.0.smithi073.stdout:9/190: dread d0/d13/f22 [0,4194304] 0 2024-04-26T11:23:59.663 INFO:tasks.workunit.client.0.smithi073.stdout:0/118: creat d2/d1f/f2c x:0 0 0 2024-04-26T11:23:59.663 INFO:tasks.workunit.client.0.smithi073.stdout:7/140: mknod d1/d11/c35 0 2024-04-26T11:23:59.663 INFO:tasks.workunit.client.0.smithi073.stdout:8/167: mknod d1/d21/c41 0 2024-04-26T11:23:59.663 INFO:tasks.workunit.client.0.smithi073.stdout:4/151: creat d8/d1a/d1b/f36 x:0 0 0 2024-04-26T11:23:59.664 INFO:tasks.workunit.client.0.smithi073.stdout:3/130: mkdir d0/d2d 0 2024-04-26T11:23:59.664 INFO:tasks.workunit.client.0.smithi073.stdout:0/119: rename d2/c7 to d2/c2d 0 2024-04-26T11:23:59.664 INFO:tasks.workunit.client.0.smithi073.stdout:7/141: dread - d1/d33/d1b/f1e zero size 2024-04-26T11:23:59.665 INFO:tasks.workunit.client.0.smithi073.stdout:6/94: dwrite d0/d15/f14 [0,4194304] 0 2024-04-26T11:23:59.666 INFO:tasks.workunit.client.0.smithi073.stdout:9/191: link d0/d13/f1c d0/d1a/d2f/f3e 0 2024-04-26T11:23:59.669 INFO:tasks.workunit.client.0.smithi073.stdout:0/120: symlink d2/l2e 0 2024-04-26T11:23:59.670 INFO:tasks.workunit.client.0.smithi073.stdout:6/95: write d0/d15/f14 [1040313,53522] 0 2024-04-26T11:23:59.670 INFO:tasks.workunit.client.0.smithi073.stdout:3/131: creat d0/f2e x:0 0 0 2024-04-26T11:23:59.670 INFO:tasks.workunit.client.0.smithi073.stdout:7/142: rename d1/d11/d10/f16 to d1/d11/f36 0 2024-04-26T11:23:59.671 INFO:tasks.workunit.client.0.smithi073.stdout:3/132: chown d0/d11 68914 1 2024-04-26T11:23:59.671 INFO:tasks.workunit.client.0.smithi073.stdout:0/121: creat d2/d22/f2f x:0 0 0 2024-04-26T11:23:59.671 INFO:tasks.workunit.client.0.smithi073.stdout:9/192: link d0/d13/db/d2e/f34 d0/f3f 0 2024-04-26T11:23:59.672 INFO:tasks.workunit.client.0.smithi073.stdout:6/96: mkdir d0/d1a 0 2024-04-26T11:23:59.672 INFO:tasks.workunit.client.0.smithi073.stdout:7/143: chown d1/d11/f14 127006715 1 2024-04-26T11:23:59.672 INFO:tasks.workunit.client.0.smithi073.stdout:0/122: read - d2/f21 zero size 2024-04-26T11:23:59.672 INFO:tasks.workunit.client.0.smithi073.stdout:3/133: unlink d0/d11/f1f 0 2024-04-26T11:23:59.673 INFO:tasks.workunit.client.0.smithi073.stdout:7/144: write d1/d11/f14 [1121834,15903] 0 2024-04-26T11:23:59.674 INFO:tasks.workunit.client.0.smithi073.stdout:6/97: creat d0/dc/f1b x:0 0 0 2024-04-26T11:23:59.674 INFO:tasks.workunit.client.0.smithi073.stdout:9/193: creat d0/f40 x:0 0 0 2024-04-26T11:23:59.674 INFO:tasks.workunit.client.0.smithi073.stdout:4/152: dwrite d8/d15/f18 [0,4194304] 0 2024-04-26T11:23:59.674 INFO:tasks.workunit.client.0.smithi073.stdout:8/168: dwrite d1/f18 [4194304,4194304] 0 2024-04-26T11:23:59.678 INFO:tasks.workunit.client.0.smithi073.stdout:7/145: mknod d1/d11/d24/d26/c37 0 2024-04-26T11:23:59.678 INFO:tasks.workunit.client.0.smithi073.stdout:8/169: creat d1/d4/d8/f42 x:0 0 0 2024-04-26T11:23:59.678 INFO:tasks.workunit.client.0.smithi073.stdout:6/98: getdents d0/d19 0 2024-04-26T11:23:59.679 INFO:tasks.workunit.client.0.smithi073.stdout:8/170: fdatasync d1/d4/d8/f36 0 2024-04-26T11:23:59.680 INFO:tasks.workunit.client.0.smithi073.stdout:6/99: mkdir d0/dc/d1c 0 2024-04-26T11:23:59.681 INFO:tasks.workunit.client.0.smithi073.stdout:0/123: dwrite d2/f25 [0,4194304] 0 2024-04-26T11:23:59.681 INFO:tasks.workunit.client.0.smithi073.stdout:1/227: dread d1/d8/f18 [0,4194304] 0 2024-04-26T11:23:59.681 INFO:tasks.workunit.client.0.smithi073.stdout:6/100: stat d0/dc/f1b 0 2024-04-26T11:23:59.683 INFO:tasks.workunit.client.0.smithi073.stdout:1/228: mkdir d1/df/d53 0 2024-04-26T11:23:59.684 INFO:tasks.workunit.client.0.smithi073.stdout:6/101: getdents d0/d19 0 2024-04-26T11:23:59.685 INFO:tasks.workunit.client.0.smithi073.stdout:1/229: chown d1/d8/d2e/d37 2 1 2024-04-26T11:23:59.685 INFO:tasks.workunit.client.0.smithi073.stdout:6/102: chown d0/dc/d1c 1422225 1 2024-04-26T11:23:59.685 INFO:tasks.workunit.client.0.smithi073.stdout:0/124: link d2/l20 d2/d1f/l30 0 2024-04-26T11:23:59.685 INFO:tasks.workunit.client.0.smithi073.stdout:1/230: chown d1/d8/fd 25801 1 2024-04-26T11:23:59.686 INFO:tasks.workunit.client.0.smithi073.stdout:9/194: dwrite d0/d13/d25/d2c/f3a [0,4194304] 0 2024-04-26T11:23:59.686 INFO:tasks.workunit.client.0.smithi073.stdout:0/125: write d2/f1c [470085,120340] 0 2024-04-26T11:23:59.687 INFO:tasks.workunit.client.0.smithi073.stdout:8/171: dwrite d1/f26 [0,4194304] 0 2024-04-26T11:23:59.687 INFO:tasks.workunit.client.0.smithi073.stdout:8/172: fsync d1/d4/d8/f36 0 2024-04-26T11:23:59.689 INFO:tasks.workunit.client.0.smithi073.stdout:1/231: mkdir d1/df/d40/d54 0 2024-04-26T11:23:59.689 INFO:tasks.workunit.client.0.smithi073.stdout:6/103: rmdir d0/dc/d1c 0 2024-04-26T11:23:59.689 INFO:tasks.workunit.client.0.smithi073.stdout:8/173: dread - d1/d4/d8/f36 zero size 2024-04-26T11:23:59.689 INFO:tasks.workunit.client.0.smithi073.stdout:9/195: creat d0/d1a/d2f/f41 x:0 0 0 2024-04-26T11:23:59.690 INFO:tasks.workunit.client.0.smithi073.stdout:6/104: fsync d0/f9 0 2024-04-26T11:23:59.691 INFO:tasks.workunit.client.0.smithi073.stdout:6/105: mkdir d0/dc/d1d 0 2024-04-26T11:23:59.691 INFO:tasks.workunit.client.0.smithi073.stdout:9/196: rmdir d0/d13/d25/d2c 39 2024-04-26T11:23:59.691 INFO:tasks.workunit.client.0.smithi073.stdout:8/174: creat d1/d21/d2a/f43 x:0 0 0 2024-04-26T11:23:59.692 INFO:tasks.workunit.client.0.smithi073.stdout:8/175: dread - d1/d4/d8/f42 zero size 2024-04-26T11:23:59.692 INFO:tasks.workunit.client.0.smithi073.stdout:6/106: getdents d0/d1a 0 2024-04-26T11:23:59.692 INFO:tasks.workunit.client.0.smithi073.stdout:9/197: rename d0/d1a/c29 to d0/d1a/c42 0 2024-04-26T11:23:59.692 INFO:tasks.workunit.client.0.smithi073.stdout:9/198: fsync d0/f10 0 2024-04-26T11:23:59.692 INFO:tasks.workunit.client.0.smithi073.stdout:7/146: truncate f0 1100732 0 2024-04-26T11:23:59.695 INFO:tasks.workunit.client.0.smithi073.stdout:8/176: getdents d1/d21 0 2024-04-26T11:23:59.695 INFO:tasks.workunit.client.0.smithi073.stdout:8/177: fdatasync d1/f18 0 2024-04-26T11:23:59.695 INFO:tasks.workunit.client.0.smithi073.stdout:7/147: mknod d1/c38 0 2024-04-26T11:23:59.696 INFO:tasks.workunit.client.0.smithi073.stdout:9/199: write d0/d13/db/d2e/f38 [1660375,127095] 0 2024-04-26T11:23:59.696 INFO:tasks.workunit.client.0.smithi073.stdout:7/148: fdatasync d1/d33/ff 0 2024-04-26T11:23:59.696 INFO:tasks.workunit.client.0.smithi073.stdout:8/178: truncate d1/d21/f29 930751 0 2024-04-26T11:23:59.699 INFO:tasks.workunit.client.0.smithi073.stdout:8/179: rename d1/d4/c5 to d1/c44 0 2024-04-26T11:23:59.700 INFO:tasks.workunit.client.0.smithi073.stdout:7/149: chown d1/d11/d24/d26/f2c 5596 1 2024-04-26T11:23:59.700 INFO:tasks.workunit.client.0.smithi073.stdout:8/180: dread - d1/d4/d37/f40 zero size 2024-04-26T11:23:59.701 INFO:tasks.workunit.client.0.smithi073.stdout:6/107: dwrite d0/d15/f14 [4194304,4194304] 0 2024-04-26T11:23:59.701 INFO:tasks.workunit.client.0.smithi073.stdout:3/134: dwrite d0/d11/d19/db/fe [0,4194304] 0 2024-04-26T11:23:59.702 INFO:tasks.workunit.client.0.smithi073.stdout:8/181: dread - d1/d4/d37/f40 zero size 2024-04-26T11:23:59.702 INFO:tasks.workunit.client.0.smithi073.stdout:7/150: creat d1/d33/d1b/f39 x:0 0 0 2024-04-26T11:23:59.704 INFO:tasks.workunit.client.0.smithi073.stdout:6/108: dread d0/f4 [4194304,4194304] 0 2024-04-26T11:23:59.704 INFO:tasks.workunit.client.0.smithi073.stdout:6/109: fsync d0/f9 0 2024-04-26T11:23:59.705 INFO:tasks.workunit.client.0.smithi073.stdout:8/182: symlink d1/d21/l45 0 2024-04-26T11:23:59.705 INFO:tasks.workunit.client.0.smithi073.stdout:3/135: symlink d0/d26/d2c/l2f 0 2024-04-26T11:23:59.705 INFO:tasks.workunit.client.0.smithi073.stdout:7/151: rename d1/d11/d24/d29/c30 to d1/d11/d10/c3a 0 2024-04-26T11:23:59.706 INFO:tasks.workunit.client.0.smithi073.stdout:3/136: chown d0/d11/d19/f25 5 1 2024-04-26T11:23:59.706 INFO:tasks.workunit.client.0.smithi073.stdout:7/152: chown d1/d11/f14 7372 1 2024-04-26T11:23:59.707 INFO:tasks.workunit.client.0.smithi073.stdout:3/137: write d0/d11/f13 [696629,77017] 0 2024-04-26T11:23:59.707 INFO:tasks.workunit.client.0.smithi073.stdout:9/200: dwrite d0/d1a/d2f/f3e [0,4194304] 0 2024-04-26T11:23:59.709 INFO:tasks.workunit.client.0.smithi073.stdout:7/153: fsync d1/d33/d1b/f39 0 2024-04-26T11:23:59.710 INFO:tasks.workunit.client.0.smithi073.stdout:5/173: sync 2024-04-26T11:23:59.710 INFO:tasks.workunit.client.0.smithi073.stdout:7/154: write d1/d33/d1f/f28 [1127935,65397] 0 2024-04-26T11:23:59.711 INFO:tasks.workunit.client.0.smithi073.stdout:4/153: dread d8/d1f/f22 [0,4194304] 0 2024-04-26T11:23:59.714 INFO:tasks.workunit.client.0.smithi073.stdout:5/174: symlink d4/de/d15/d33/l39 0 2024-04-26T11:23:59.715 INFO:tasks.workunit.client.0.smithi073.stdout:6/110: dwrite d0/d15/f14 [0,4194304] 0 2024-04-26T11:23:59.715 INFO:tasks.workunit.client.0.smithi073.stdout:7/155: truncate d1/d33/ff 669725 0 2024-04-26T11:23:59.715 INFO:tasks.workunit.client.0.smithi073.stdout:2/157: dread f6 [0,4194304] 0 2024-04-26T11:23:59.715 INFO:tasks.workunit.client.0.smithi073.stdout:2/158: mknod dd/c33 0 2024-04-26T11:23:59.715 INFO:tasks.workunit.client.0.smithi073.stdout:6/111: symlink d0/dc/d1d/l1e 0 2024-04-26T11:23:59.716 INFO:tasks.workunit.client.0.smithi073.stdout:2/159: truncate dd/d27/f31 5743 0 2024-04-26T11:23:59.717 INFO:tasks.workunit.client.0.smithi073.stdout:2/160: dread - dd/de/f28 zero size 2024-04-26T11:23:59.718 INFO:tasks.workunit.client.0.smithi073.stdout:0/126: dread d2/f1d [0,4194304] 0 2024-04-26T11:23:59.718 INFO:tasks.workunit.client.0.smithi073.stdout:7/156: dread d1/d11/f1c [0,4194304] 0 2024-04-26T11:23:59.719 INFO:tasks.workunit.client.0.smithi073.stdout:4/154: dwrite d8/f10 [0,4194304] 0 2024-04-26T11:23:59.719 INFO:tasks.workunit.client.0.smithi073.stdout:7/157: chown d1/d33/d1b/f39 245252 1 2024-04-26T11:23:59.719 INFO:tasks.workunit.client.0.smithi073.stdout:4/155: fdatasync d8/d1a/d1b/f36 0 2024-04-26T11:23:59.723 INFO:tasks.workunit.client.0.smithi073.stdout:0/127: creat d2/f31 x:0 0 0 2024-04-26T11:23:59.723 INFO:tasks.workunit.client.0.smithi073.stdout:6/112: dwrite d0/dc/f1b [0,4194304] 0 2024-04-26T11:23:59.723 INFO:tasks.workunit.client.0.smithi073.stdout:3/138: write d0/f7 [1260261,114869] 0 2024-04-26T11:23:59.726 INFO:tasks.workunit.client.0.smithi073.stdout:1/232: dread d1/df/d40/d44/f4e [0,4194304] 0 2024-04-26T11:23:59.726 INFO:tasks.workunit.client.0.smithi073.stdout:9/201: fsync d0/d13/f1c 0 2024-04-26T11:23:59.726 INFO:tasks.workunit.client.0.smithi073.stdout:1/233: write d1/d8/d2e/d3c/f3e [570642,123816] 0 2024-04-26T11:23:59.726 INFO:tasks.workunit.client.0.smithi073.stdout:1/234: stat d1/d6/f25 0 2024-04-26T11:23:59.728 INFO:tasks.workunit.client.0.smithi073.stdout:5/175: getdents d4/de/d15/d33 0 2024-04-26T11:23:59.729 INFO:tasks.workunit.client.0.smithi073.stdout:8/183: sync 2024-04-26T11:23:59.730 INFO:tasks.workunit.client.0.smithi073.stdout:2/161: mknod dd/de/d29/c34 0 2024-04-26T11:23:59.730 INFO:tasks.workunit.client.0.smithi073.stdout:1/235: unlink d1/f3 0 2024-04-26T11:23:59.730 INFO:tasks.workunit.client.0.smithi073.stdout:4/156: mkdir d8/d1f/d34/d37 0 2024-04-26T11:23:59.730 INFO:tasks.workunit.client.0.smithi073.stdout:5/176: symlink d4/de/d23/l3a 0 2024-04-26T11:23:59.731 INFO:tasks.workunit.client.0.smithi073.stdout:7/158: dread d1/d11/fd [0,4194304] 0 2024-04-26T11:23:59.731 INFO:tasks.workunit.client.0.smithi073.stdout:3/139: dwrite d0/d11/d19/db/f15 [0,4194304] 0 2024-04-26T11:23:59.732 INFO:tasks.workunit.client.0.smithi073.stdout:7/159: readlink d1/d11/l32 0 2024-04-26T11:23:59.732 INFO:tasks.workunit.client.0.smithi073.stdout:9/202: creat d0/d3c/f43 x:0 0 0 2024-04-26T11:23:59.735 INFO:tasks.workunit.client.0.smithi073.stdout:5/177: mkdir d4/de/d23/d3b 0 2024-04-26T11:23:59.735 INFO:tasks.workunit.client.0.smithi073.stdout:1/236: fdatasync d1/d6/f25 0 2024-04-26T11:23:59.735 INFO:tasks.workunit.client.0.smithi073.stdout:8/184: chown d1/c44 1298 1 2024-04-26T11:23:59.735 INFO:tasks.workunit.client.0.smithi073.stdout:9/203: read - d0/d1a/f36 zero size 2024-04-26T11:23:59.735 INFO:tasks.workunit.client.0.smithi073.stdout:5/178: read d4/f1d [836876,24562] 0 2024-04-26T11:23:59.735 INFO:tasks.workunit.client.0.smithi073.stdout:7/160: creat d1/d33/d1f/f3b x:0 0 0 2024-04-26T11:23:59.735 INFO:tasks.workunit.client.0.smithi073.stdout:0/128: dread d2/f17 [0,4194304] 0 2024-04-26T11:23:59.735 INFO:tasks.workunit.client.0.smithi073.stdout:3/140: mknod d0/d2d/c30 0 2024-04-26T11:23:59.736 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:23:59.736 INFO:tasks.workunit.client.0.smithi073.stdout:1/237: mkdir d1/d16/d4f/d55 0 2024-04-26T11:23:59.736 INFO:tasks.workunit.client.0.smithi073.stdout:9/204: mknod d0/d13/d25/c44 0 2024-04-26T11:23:59.736 INFO:tasks.workunit.client.0.smithi073.stdout:8/185: write d1/d21/d2a/f2b [857698,90498] 0 2024-04-26T11:23:59.736 INFO:tasks.workunit.client.0.smithi073.stdout:0/129: creat d2/d1f/f32 x:0 0 0 2024-04-26T11:23:59.737 INFO:tasks.workunit.client.0.smithi073.stdout:1/238: symlink d1/d51/l56 0 2024-04-26T11:23:59.737 INFO:tasks.workunit.client.0.smithi073.stdout:8/186: mknod d1/d4/d37/c46 0 2024-04-26T11:23:59.737 INFO:tasks.workunit.client.0.smithi073.stdout:9/205: mknod d0/c45 0 2024-04-26T11:23:59.737 INFO:tasks.workunit.client.0.smithi073.stdout:3/141: getdents d0/d11/d19 0 2024-04-26T11:23:59.738 INFO:tasks.workunit.client.0.smithi073.stdout:7/161: getdents d1/d11/d24/d26 0 2024-04-26T11:23:59.738 INFO:tasks.workunit.client.0.smithi073.stdout:1/239: mkdir d1/d8/d57 0 2024-04-26T11:23:59.739 INFO:tasks.workunit.client.0.smithi073.stdout:7/162: chown d1/d11/l20 413015733 1 2024-04-26T11:23:59.740 INFO:tasks.workunit.client.0.smithi073.stdout:2/162: dwrite f6 [0,4194304] 0 2024-04-26T11:23:59.740 INFO:tasks.workunit.client.0.smithi073.stdout:3/142: mknod d0/c31 0 2024-04-26T11:23:59.741 INFO:tasks.workunit.client.0.smithi073.stdout:2/163: chown dd/d1c/d1d/d30 419 1 2024-04-26T11:23:59.743 INFO:tasks.workunit.client.0.smithi073.stdout:7/163: mkdir d1/d33/d1f/d3c 0 2024-04-26T11:23:59.743 INFO:tasks.workunit.client.0.smithi073.stdout:1/240: write d1/d8/d2e/f45 [314925,15531] 0 2024-04-26T11:23:59.744 INFO:tasks.workunit.client.0.smithi073.stdout:2/164: rename dd/d1c/d1d/f1e to dd/d1c/d1d/f35 0 2024-04-26T11:23:59.744 INFO:tasks.workunit.client.0.smithi073.stdout:0/130: dwrite d2/d1f/f28 [0,4194304] 0 2024-04-26T11:23:59.745 INFO:tasks.workunit.client.0.smithi073.stdout:7/164: chown d1/d33/d1b/f1e 790164 1 2024-04-26T11:23:59.747 INFO:tasks.workunit.client.0.smithi073.stdout:8/187: dwrite d1/f17 [0,4194304] 0 2024-04-26T11:23:59.747 INFO:tasks.workunit.client.0.smithi073.stdout:9/206: dwrite d0/d13/f20 [0,4194304] 0 2024-04-26T11:23:59.749 INFO:tasks.workunit.client.0.smithi073.stdout:0/131: rename d2/f24 to d2/d22/f33 0 2024-04-26T11:23:59.749 INFO:tasks.workunit.client.0.smithi073.stdout:7/165: mkdir d1/d11/d24/d26/d3d 0 2024-04-26T11:23:59.750 INFO:tasks.workunit.client.0.smithi073.stdout:0/132: fsync d2/d22/f2f 0 2024-04-26T11:23:59.750 INFO:tasks.workunit.client.0.smithi073.stdout:1/241: link d1/d8/d2e/l50 d1/df/d53/l58 0 2024-04-26T11:23:59.750 INFO:tasks.workunit.client.0.smithi073.stdout:2/165: getdents dd/d27 0 2024-04-26T11:23:59.751 INFO:tasks.workunit.client.0.smithi073.stdout:7/166: symlink d1/d33/d1f/d3c/l3e 0 2024-04-26T11:23:59.751 INFO:tasks.workunit.client.0.smithi073.stdout:6/113: fdatasync d0/dc/f1b 0 2024-04-26T11:23:59.752 INFO:tasks.workunit.client.0.smithi073.stdout:2/166: rename dd/f1b to dd/d1c/d1d/f36 0 2024-04-26T11:23:59.753 INFO:tasks.workunit.client.0.smithi073.stdout:6/114: symlink d0/d19/l1f 0 2024-04-26T11:23:59.754 INFO:tasks.workunit.client.0.smithi073.stdout:2/167: symlink dd/l37 0 2024-04-26T11:23:59.754 INFO:tasks.workunit.client.0.smithi073.stdout:1/242: rename d1/d8/d2e/f45 to d1/df/d53/f59 0 2024-04-26T11:23:59.755 INFO:tasks.workunit.client.0.smithi073.stdout:9/207: dwrite d0/d1a/f36 [0,4194304] 0 2024-04-26T11:23:59.756 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:59.750+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:59.757 INFO:tasks.workunit.client.0.smithi073.stdout:6/115: mkdir d0/d19/d20 0 2024-04-26T11:23:59.758 INFO:tasks.workunit.client.0.smithi073.stdout:1/243: read d1/d6/f29 [1828798,78921] 0 2024-04-26T11:23:59.758 INFO:tasks.workunit.client.0.smithi073.stdout:9/208: fdatasync d0/d13/db/d2e/f34 0 2024-04-26T11:23:59.759 INFO:tasks.workunit.client.0.smithi073.stdout:6/116: creat d0/d19/f21 x:0 0 0 2024-04-26T11:23:59.760 INFO:tasks.workunit.client.0.smithi073.stdout:6/117: fdatasync d0/f9 0 2024-04-26T11:23:59.760 INFO:tasks.workunit.client.0.smithi073.stdout:8/188: truncate d1/f26 2753925 0 2024-04-26T11:23:59.760 INFO:tasks.workunit.client.0.smithi073.stdout:9/209: mkdir d0/d13/db/d2e/d46 0 2024-04-26T11:23:59.760 INFO:tasks.workunit.client.0.smithi073.stdout:6/118: creat d0/d19/d20/f22 x:0 0 0 2024-04-26T11:23:59.761 INFO:tasks.workunit.client.0.smithi073.stdout:6/119: stat d0/f2 0 2024-04-26T11:23:59.761 INFO:tasks.workunit.client.0.smithi073.stdout:9/210: symlink d0/d1a/d2f/l47 0 2024-04-26T11:23:59.761 INFO:tasks.workunit.client.0.smithi073.stdout:3/143: dread d0/d11/f13 [0,4194304] 0 2024-04-26T11:23:59.762 INFO:tasks.workunit.client.0.smithi073.stdout:6/120: symlink d0/d15/l23 0 2024-04-26T11:23:59.762 INFO:tasks.workunit.client.0.smithi073.stdout:8/189: chown d1/d4/d37 17012 1 2024-04-26T11:23:59.763 INFO:tasks.workunit.client.0.smithi073.stdout:7/167: getdents d1/d33/d1f/d3c 0 2024-04-26T11:23:59.763 INFO:tasks.workunit.client.0.smithi073.stdout:9/211: mknod d0/d13/d25/c48 0 2024-04-26T11:23:59.763 INFO:tasks.workunit.client.0.smithi073.stdout:3/144: symlink d0/d11/d19/l32 0 2024-04-26T11:23:59.763 INFO:tasks.workunit.client.0.smithi073.stdout:8/190: mknod d1/d4/d15/c47 0 2024-04-26T11:23:59.763 INFO:tasks.workunit.client.0.smithi073.stdout:7/168: creat d1/d11/d24/d29/f3f x:0 0 0 2024-04-26T11:23:59.763 INFO:tasks.workunit.client.0.smithi073.stdout:8/191: read - d1/d21/d2a/f43 zero size 2024-04-26T11:23:59.764 INFO:tasks.workunit.client.0.smithi073.stdout:8/192: creat d1/d4/d37/f48 x:0 0 0 2024-04-26T11:23:59.764 INFO:tasks.workunit.client.0.smithi073.stdout:7/169: fdatasync d1/d33/ff 0 2024-04-26T11:23:59.764 INFO:tasks.workunit.client.0.smithi073.stdout:8/193: chown d1/d4/d8/f36 7 1 2024-04-26T11:23:59.764 INFO:tasks.workunit.client.0.smithi073.stdout:8/194: stat d1/c44 0 2024-04-26T11:23:59.765 INFO:tasks.workunit.client.0.smithi073.stdout:7/170: rename d1/d33/d1b/f39 to d1/d33/d1f/f40 0 2024-04-26T11:23:59.765 INFO:tasks.workunit.client.0.smithi073.stdout:8/195: write d1/d4/d8/f36 [760464,102982] 0 2024-04-26T11:23:59.765 INFO:tasks.workunit.client.0.smithi073.stdout:7/171: mkdir d1/d11/d24/d26/d3d/d41 0 2024-04-26T11:23:59.766 INFO:tasks.workunit.client.0.smithi073.stdout:8/196: write d1/d21/d2a/f39 [700792,125665] 0 2024-04-26T11:23:59.766 INFO:tasks.workunit.client.0.smithi073.stdout:8/197: chown d1/f17 198 1 2024-04-26T11:23:59.766 INFO:tasks.workunit.client.0.smithi073.stdout:7/172: getdents d1/d11/d10 0 2024-04-26T11:23:59.767 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:11138 4.1b 4:dbd5cc59:::1000000316b.00000000:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.751771+0000", 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.015306706999999999, 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015336944999999999, 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:59.768 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 11138 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.751771+0000", 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.751771+0000", 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:59.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.751770+0000", 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.757662+0000", 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058920480000000004 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.757674+0000", 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1348e-05 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.757681+0000", 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2729999999999997e-06 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.757717+0000", 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6406999999999999e-05 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.757774+0000", 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6280999999999999e-05 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.771 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:693 3.2 3:4272d415:::200.0000000b:head [write 2415438~3994 [fadvise_dontneed] in=3994b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.758458+0000", 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0086200789999999992, 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087234760000000008, 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758458+0000", 2024-04-26T11:23:59.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758458+0000", 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758457+0000", 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758464+0000", 2024-04-26T11:23:59.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.503e-06 2024-04-26T11:23:59.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:59.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758473+0000", 2024-04-26T11:23:59.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3459999999999994e-06 2024-04-26T11:23:59.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758494+0000", 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1596000000000001e-05 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.759173+0000", 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00067875300000000004 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.759253+0000", 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0290999999999994e-05 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:59.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.759400+0000", 2024-04-26T11:23:59.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000146145 2024-04-26T11:23:59.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:59.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.762923+0000", 2024-04-26T11:23:59.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0035230130000000002 2024-04-26T11:23:59.776 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.776 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:59.776 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.777 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:694 3.2 3:4272d415:::200.0000000b:head [write 2419432~2606 [fadvise_dontneed] in=2606b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-26T11:23:59.777 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.758508+0000", 2024-04-26T11:23:59.777 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0085700789999999995, 2024-04-26T11:23:59.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087217170000000004, 2024-04-26T11:23:59.777 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758508+0000", 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758508+0000", 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758507+0000", 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758512+0000", 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1170000000000003e-06 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758519+0000", 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9750000000000001e-06 2024-04-26T11:23:59.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.758525+0000", 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4189999999999999e-06 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.760231+0000", 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017058900000000001 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.760315+0000", 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3560000000000006e-05 2024-04-26T11:23:59.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.760453+0000", 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013812699999999999 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.763417+0000", 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002963762 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.781 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:695 3.2 3:4272d415:::200.0000000b:head [write 2422038~15203 [fadvise_dontneed] in=15203b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.761306+0000", 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0057713720000000003, 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059635529999999999, 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.761306+0000", 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.761306+0000", 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.761305+0000", 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.761321+0000", 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5310000000000001e-05 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.761331+0000", 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0169e-05 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.761345+0000", 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3692e-05 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.761387+0000", 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2245e-05 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.761488+0000", 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010082299999999999 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.761613+0000", 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012527 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:696 3.2 3:4272d415:::200.0000000b:head [write 2437241~29898 [fadvise_dontneed] in=29898b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-26T11:23:59.785 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.763391+0000", 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0036861889999999999, 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039177919999999998, 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.763391+0000", 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.763391+0000", 2024-04-26T11:23:59.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.763391+0000", 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.763466+0000", 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4892000000000001e-05 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:59.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.763486+0000", 2024-04-26T11:23:59.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0066999999999999e-05 2024-04-26T11:23:59.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.763493+0000", 2024-04-26T11:23:59.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4970000000000004e-06 2024-04-26T11:23:59.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.763523+0000", 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9476999999999999e-05 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.763566+0000", 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3755999999999999e-05 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.763634+0000", 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7458000000000004e-05 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:59.789 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:697 3.2 3.a82b4e42 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.764388+0000", 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.002689566, 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002956406, 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "queued for pg", 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764388+0000", 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.791 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:59.791 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764388+0000", 2024-04-26T11:23:59.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764387+0000", 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764396+0000", 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9970000000000004e-06 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764404+0000", 2024-04-26T11:23:59.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.994e-06 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764411+0000", 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2210000000000002e-06 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:695 3.2 e63/32)", 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.764606+0000", 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0024718729999999999, 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002765015, 2024-04-26T11:23:59.793 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "queued for pg", 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764606+0000", 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764606+0000", 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:59.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764605+0000", 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764608+0000", 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1240000000000001e-06 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764616+0000", 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6620000000000005e-06 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.764620+0000", 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.692e-06 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_repop_reply(mds.0.3:696 3.2 e63/32)", 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.765352+0000", 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0017261399999999999, 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020700459999999999, 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "queued for pg", 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:59.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:59.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.765352+0000", 2024-04-26T11:23:59.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:59.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.765352+0000", 2024-04-26T11:23:59.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:59.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.765351+0000", 2024-04-26T11:23:59.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.765354+0000", 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4400000000000001e-06 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.765362+0000", 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4880000000000001e-06 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.765366+0000", 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3950000000000003e-06 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:11146 4.14 4:2b60b679:::1000000324d.00000000:head [write 700792~125665 in=125665b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.767002+0000", 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.6062000000000005e-05, 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000455974, 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:23:59.800 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 11146 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.767002+0000", 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.767002+0000", 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.767000+0000", 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.767119+0000", 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000119082 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.767133+0000", 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4008e-05 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.767141+0000", 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.52e-06 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.767179+0000", 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7837999999999999e-05 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.767273+0000", 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4197000000000006e-05 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:23:59.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:23:59.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:23:59.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.767347+0000", 2024-04-26T11:23:59.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4212e-05 2024-04-26T11:23:59.804 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.804 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:23:59.804 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.804 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:23:59.804 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-26T11:23:59.804 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 9 2024-04-26T11:23:59.804 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:23:59.804 INFO:tasks.workunit.client.0.smithi073.stdout:8/198: fdatasync d1/d21/d2a/f2b 0 2024-04-26T11:23:59.810 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:23:59.815 INFO:tasks.workunit.client.0.smithi073.stdout:7/173: rename d1/f22 to d1/d33/d1f/d3c/f42 0 2024-04-26T11:23:59.815 INFO:tasks.workunit.client.0.smithi073.stdout:8/199: rmdir d1/d21 39 2024-04-26T11:23:59.815 INFO:tasks.workunit.client.0.smithi073.stdout:8/200: readlink d1/d4/d8/l28 0 2024-04-26T11:23:59.815 INFO:tasks.workunit.client.0.smithi073.stdout:8/201: fdatasync d1/d4/d8/f30 0 2024-04-26T11:23:59.815 INFO:tasks.workunit.client.0.smithi073.stdout:8/202: read - d1/d21/d2a/f43 zero size 2024-04-26T11:23:59.815 INFO:tasks.workunit.client.0.smithi073.stdout:8/203: chown d1/d21/f29 698 1 2024-04-26T11:23:59.815 INFO:tasks.workunit.client.0.smithi073.stdout:9/212: write d0/f3f [906272,83376] 0 2024-04-26T11:23:59.815 INFO:tasks.workunit.client.0.smithi073.stdout:1/244: truncate d1/d8/f2d 2830792 0 2024-04-26T11:23:59.815 INFO:tasks.workunit.client.0.smithi073.stdout:3/145: write d0/d11/d19/db/fe [5034328,45789] 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:3/146: write d0/d11/d19/f28 [2911873,13968] 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:8/204: dwrite d1/d21/d2a/f39 [0,4194304] 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:8/205: stat d1/d21 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:1/245: dread d1/d16/f20 [0,4194304] 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:9/213: dwrite d0/d13/db/f2b [0,4194304] 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:9/214: write d0/d1a/d2f/f3e [457380,10395] 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:7/174: rmdir d1/d33/d1b 39 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:1/246: mkdir d1/d16/d4f/d55/d5a 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:9/215: creat d0/d13/db/d2e/d46/f49 x:0 0 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:8/206: getdents d1/d4/d15 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:1/247: fdatasync d1/df/f23 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:8/207: dread - d1/d21/d2a/f43 zero size 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:9/216: mknod d0/d13/d25/d2c/c4a 0 2024-04-26T11:23:59.816 INFO:tasks.workunit.client.0.smithi073.stdout:8/208: chown d1/d21/l45 3382551 1 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:1/248: link d1/df/c26 d1/d6/c5b 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:8/209: symlink d1/d4/l49 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:1/249: write d1/d6/fb [3663197,84913] 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:1/250: stat d1/d51 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:8/210: mknod d1/d4/d8/c4a 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:8/211: dread - d1/d4/d37/f40 zero size 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:1/251: creat d1/d8/d2e/d37/f5c x:0 0 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:1/252: mkdir d1/d8/d5d 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:8/212: truncate d1/d4/d8/f30 167009 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:8/213: unlink c0 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:1/253: creat d1/df/f5e x:0 0 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/217: dwrite d0/d1a/d2f/f41 [0,4194304] 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/218: chown d0/d13/db/d2e 1 1 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/219: creat d0/d13/db/f4b x:0 0 0 2024-04-26T11:23:59.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/220: chown d0/d13/db/d2e 0 1 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:9/221: fsync d0/d1a/d2f/f3e 0 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:7/175: dwrite d1/f5 [0,4194304] 0 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:7/176: read - d1/d33/d1b/f1e zero size 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:1/254: write d1/f2b [302090,28204] 0 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:9/222: rmdir d0 39 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:7/177: write d1/f19 [1629836,19083] 0 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:1/255: creat d1/df/d40/d54/f5f x:0 0 0 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:9/223: mknod d0/d13/d25/d2c/c4c 0 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:7/178: symlink d1/d11/l43 0 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:7/179: read d1/d33/ff [584381,122113] 0 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:7/180: write d1/d33/d1b/f1e [587538,76381] 0 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:7/181: write d1/d11/d10/f2f [424370,90969] 0 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:1/256: dread d1/d8/f18 [0,4194304] 0 2024-04-26T11:23:59.818 INFO:tasks.workunit.client.0.smithi073.stdout:7/182: creat d1/f44 x:0 0 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:1/257: fsync d1/df/d34/f43 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:1/258: getdents d1/d16/d4f 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:1/259: creat d1/d8/d5d/f60 x:0 0 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:9/224: dwrite d0/d13/f22 [0,4194304] 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:1/260: mkdir d1/d16/d61 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:7/183: dwrite d1/d11/d24/d26/f2c [0,4194304] 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:7/184: write d1/f5 [4403318,117932] 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:9/225: dread d0/d13/f20 [0,4194304] 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:9/226: creat d0/d13/db/d2e/d3b/f4d x:0 0 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:7/185: write d1/d33/d1f/d3c/f42 [1507668,21591] 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:7/186: truncate d1/f44 260373 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:7/187: chown d1/c25 1769209 1 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:7/188: mknod d1/d11/d24/c45 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:7/189: readlink d1/d33/d1f/d3c/l3e 0 2024-04-26T11:23:59.819 INFO:tasks.workunit.client.0.smithi073.stdout:9/227: dwrite d0/d13/f18 [0,4194304] 0 2024-04-26T11:23:59.821 INFO:tasks.workunit.client.0.smithi073.stdout:9/228: chown d0/d13/l4 1748826975 1 2024-04-26T11:23:59.821 INFO:tasks.workunit.client.0.smithi073.stdout:9/229: fsync d0/d13/d25/d2c/f3a 0 2024-04-26T11:23:59.821 INFO:tasks.workunit.client.0.smithi073.stdout:1/261: dread d1/d8/f2d [0,4194304] 0 2024-04-26T11:23:59.821 INFO:tasks.workunit.client.0.smithi073.stdout:9/230: truncate d0/d13/db/f4b 340482 0 2024-04-26T11:23:59.821 INFO:tasks.workunit.client.0.smithi073.stdout:1/262: mkdir d1/d6/d62 0 2024-04-26T11:23:59.821 INFO:tasks.workunit.client.0.smithi073.stdout:9/231: mkdir d0/d1a/d4e 0 2024-04-26T11:23:59.821 INFO:tasks.workunit.client.0.smithi073.stdout:7/190: dread d1/d33/d1b/f1e [0,4194304] 0 2024-04-26T11:23:59.821 INFO:tasks.workunit.client.0.smithi073.stdout:1/263: symlink d1/df/l63 0 2024-04-26T11:23:59.821 INFO:tasks.workunit.client.0.smithi073.stdout:7/191: mkdir d1/d46 0 2024-04-26T11:23:59.821 INFO:tasks.workunit.client.0.smithi073.stdout:9/232: mknod d0/d13/db/d2e/d46/c4f 0 2024-04-26T11:23:59.821 INFO:tasks.workunit.client.0.smithi073.stdout:9/233: unlink d0/d13/d25/c48 0 2024-04-26T11:23:59.822 INFO:tasks.workunit.client.0.smithi073.stdout:7/192: write d1/d33/ff [637393,113878] 0 2024-04-26T11:23:59.823 INFO:tasks.workunit.client.0.smithi073.stdout:1/264: dwrite d1/d6/fb [4194304,4194304] 0 2024-04-26T11:23:59.825 INFO:tasks.workunit.client.0.smithi073.stdout:1/265: creat d1/d16/d4f/d55/f64 x:0 0 0 2024-04-26T11:23:59.827 INFO:tasks.workunit.client.0.smithi073.stdout:1/266: getdents d1/df/d40 0 2024-04-26T11:23:59.832 INFO:tasks.workunit.client.0.smithi073.stdout:1/267: fdatasync d1/d8/fd 0 2024-04-26T11:23:59.833 INFO:tasks.workunit.client.0.smithi073.stdout:1/268: unlink d1/df/d34/l38 0 2024-04-26T11:23:59.838 INFO:tasks.workunit.client.0.smithi073.stdout:4/157: sync 2024-04-26T11:23:59.838 INFO:tasks.workunit.client.0.smithi073.stdout:4/158: chown d8/fe 1805547 1 2024-04-26T11:23:59.841 INFO:tasks.workunit.client.0.smithi073.stdout:1/269: dwrite d1/d8/f2d [0,4194304] 0 2024-04-26T11:23:59.842 INFO:tasks.workunit.client.0.smithi073.stdout:1/270: truncate d1/df/f23 378130 0 2024-04-26T11:23:59.844 INFO:tasks.workunit.client.0.smithi073.stdout:4/159: dwrite d8/d14/f30 [0,4194304] 0 2024-04-26T11:23:59.846 INFO:tasks.workunit.client.0.smithi073.stdout:4/160: link d8/d1f/d25/c33 d8/d1a/c38 0 2024-04-26T11:23:59.847 INFO:tasks.workunit.client.0.smithi073.stdout:4/161: unlink d8/cd 0 2024-04-26T11:23:59.847 INFO:tasks.workunit.client.0.smithi073.stdout:4/162: mknod d8/d15/d1c/c39 0 2024-04-26T11:23:59.847 INFO:tasks.workunit.client.0.smithi073.stdout:1/271: dwrite d1/df/f5e [0,4194304] 0 2024-04-26T11:23:59.849 INFO:tasks.workunit.client.0.smithi073.stdout:4/163: symlink d8/d1a/d1b/l3a 0 2024-04-26T11:23:59.850 INFO:tasks.workunit.client.0.smithi073.stdout:1/272: rename d1/d16/f20 to d1/d8/d57/f65 0 2024-04-26T11:23:59.850 INFO:tasks.workunit.client.0.smithi073.stdout:4/164: rename d8/d1a/d1b/d1d/c35 to d8/d1f/d23/c3b 0 2024-04-26T11:23:59.850 INFO:tasks.workunit.client.0.smithi073.stdout:4/165: mknod d8/d15/c3c 0 2024-04-26T11:23:59.851 INFO:tasks.workunit.client.0.smithi073.stdout:4/166: stat d8/d14/f2a 0 2024-04-26T11:23:59.851 INFO:tasks.workunit.client.0.smithi073.stdout:4/167: link d8/f13 d8/d1a/d1b/d24/f3d 0 2024-04-26T11:23:59.851 INFO:tasks.workunit.client.0.smithi073.stdout:4/168: dread - d8/d1a/d1b/d1d/f2c zero size 2024-04-26T11:23:59.852 INFO:tasks.workunit.client.0.smithi073.stdout:4/169: read d8/f10 [3976625,108462] 0 2024-04-26T11:23:59.852 INFO:tasks.workunit.client.0.smithi073.stdout:4/170: creat d8/d15/f3e x:0 0 0 2024-04-26T11:23:59.853 INFO:tasks.workunit.client.0.smithi073.stdout:4/171: write d8/d1a/d1b/d24/f3d [98473,69312] 0 2024-04-26T11:23:59.853 INFO:tasks.workunit.client.0.smithi073.stdout:4/172: creat d8/d15/f3f x:0 0 0 2024-04-26T11:23:59.856 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:23:59.854+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:23:59.859 INFO:tasks.workunit.client.0.smithi073.stdout:4/173: dwrite d8/d1a/d1b/d24/f3d [0,4194304] 0 2024-04-26T11:23:59.861 INFO:tasks.workunit.client.0.smithi073.stdout:4/174: creat d8/d1a/d1b/d1d/f40 x:0 0 0 2024-04-26T11:23:59.861 INFO:tasks.workunit.client.0.smithi073.stdout:1/273: dread d1/f13 [0,4194304] 0 2024-04-26T11:23:59.861 INFO:tasks.workunit.client.0.smithi073.stdout:4/175: mkdir d8/d1a/d1b/d41 0 2024-04-26T11:23:59.861 INFO:tasks.workunit.client.0.smithi073.stdout:1/274: rename d1/c5 to d1/d16/d4f/d55/c66 0 2024-04-26T11:23:59.862 INFO:tasks.workunit.client.0.smithi073.stdout:1/275: creat d1/d51/f67 x:0 0 0 2024-04-26T11:23:59.862 INFO:tasks.workunit.client.0.smithi073.stdout:1/276: mkdir d1/d16/d68 0 2024-04-26T11:23:59.864 INFO:tasks.workunit.client.0.smithi073.stdout:1/277: read d1/df/f1c [197430,27084] 0 2024-04-26T11:23:59.864 INFO:tasks.workunit.client.0.smithi073.stdout:1/278: stat d1/d16/d4f/d55 0 2024-04-26T11:23:59.864 INFO:tasks.workunit.client.0.smithi073.stdout:1/279: symlink d1/d8/l69 0 2024-04-26T11:23:59.867 INFO:tasks.workunit.client.0.smithi073.stdout:4/176: dwrite d8/d1a/d1b/d1d/f21 [0,4194304] 0 2024-04-26T11:23:59.867 INFO:tasks.workunit.client.0.smithi073.stdout:4/177: fsync d8/d15/f17 0 2024-04-26T11:23:59.868 INFO:tasks.workunit.client.0.smithi073.stdout:4/178: write d8/f2e [2729686,97582] 0 2024-04-26T11:23:59.869 INFO:tasks.workunit.client.0.smithi073.stdout:4/179: chown d8/c29 28 1 2024-04-26T11:23:59.869 INFO:tasks.workunit.client.0.smithi073.stdout:4/180: dread - d8/d15/f3e zero size 2024-04-26T11:23:59.869 INFO:tasks.workunit.client.0.smithi073.stdout:4/181: readlink d8/d1a/d1b/l3a 0 2024-04-26T11:23:59.884 INFO:tasks.workunit.client.0.smithi073.stdout:1/280: dread d1/df/f1b [0,4194304] 0 2024-04-26T11:23:59.888 INFO:tasks.workunit.client.0.smithi073.stdout:1/281: write d1/d8/f18 [2671677,115468] 0 2024-04-26T11:23:59.889 INFO:tasks.workunit.client.0.smithi073.stdout:1/282: write d1/df/d40/f28 [2558424,67146] 0 2024-04-26T11:23:59.890 INFO:tasks.workunit.client.0.smithi073.stdout:4/182: dread f7 [0,4194304] 0 2024-04-26T11:23:59.890 INFO:tasks.workunit.client.0.smithi073.stdout:1/283: mkdir d1/d16/d6a 0 2024-04-26T11:23:59.890 INFO:tasks.workunit.client.0.smithi073.stdout:4/183: creat d8/d1f/d34/f42 x:0 0 0 2024-04-26T11:23:59.891 INFO:tasks.workunit.client.0.smithi073.stdout:1/284: symlink d1/d16/d61/l6b 0 2024-04-26T11:23:59.891 INFO:tasks.workunit.client.0.smithi073.stdout:1/285: mknod d1/df/c6c 0 2024-04-26T11:23:59.891 INFO:tasks.workunit.client.0.smithi073.stdout:4/184: creat d8/d1a/d1b/d24/f43 x:0 0 0 2024-04-26T11:23:59.892 INFO:tasks.workunit.client.0.smithi073.stdout:1/286: read - d1/d51/f67 zero size 2024-04-26T11:23:59.892 INFO:tasks.workunit.client.0.smithi073.stdout:4/185: read - d8/d15/d1c/f27 zero size 2024-04-26T11:23:59.892 INFO:tasks.workunit.client.0.smithi073.stdout:4/186: readlink d8/d1a/d1b/l3a 0 2024-04-26T11:23:59.892 INFO:tasks.workunit.client.0.smithi073.stdout:4/187: creat d8/f44 x:0 0 0 2024-04-26T11:23:59.893 INFO:tasks.workunit.client.0.smithi073.stdout:1/287: link d1/d6/fb d1/d8/d57/f6d 0 2024-04-26T11:23:59.893 INFO:tasks.workunit.client.0.smithi073.stdout:4/188: creat d8/d1f/d23/f45 x:0 0 0 2024-04-26T11:23:59.893 INFO:tasks.workunit.client.0.smithi073.stdout:1/288: rename d1/d8/d2e/d3c/d41 to d1/d6/d6e 0 2024-04-26T11:23:59.893 INFO:tasks.workunit.client.0.smithi073.stdout:4/189: mkdir d8/d1a/d1b/d46 0 2024-04-26T11:23:59.894 INFO:tasks.workunit.client.0.smithi073.stdout:1/289: symlink d1/df/d34/l6f 0 2024-04-26T11:23:59.894 INFO:tasks.workunit.client.0.smithi073.stdout:4/190: mknod d8/d1f/d34/d37/c47 0 2024-04-26T11:23:59.896 INFO:tasks.workunit.client.0.smithi073.stdout:1/290: chown d1/d6/fb 5038 1 2024-04-26T11:23:59.896 INFO:tasks.workunit.client.0.smithi073.stdout:5/179: sync 2024-04-26T11:23:59.896 INFO:tasks.workunit.client.0.smithi073.stdout:6/121: sync 2024-04-26T11:23:59.897 INFO:tasks.workunit.client.0.smithi073.stdout:8/214: sync 2024-04-26T11:23:59.897 INFO:tasks.workunit.client.0.smithi073.stdout:7/193: sync 2024-04-26T11:23:59.897 INFO:tasks.workunit.client.0.smithi073.stdout:0/133: sync 2024-04-26T11:23:59.897 INFO:tasks.workunit.client.0.smithi073.stdout:2/168: sync 2024-04-26T11:23:59.897 INFO:tasks.workunit.client.0.smithi073.stdout:9/234: sync 2024-04-26T11:23:59.897 INFO:tasks.workunit.client.0.smithi073.stdout:3/147: sync 2024-04-26T11:23:59.897 INFO:tasks.workunit.client.0.smithi073.stdout:4/191: rename d8/f44 to d8/d1a/d1b/d41/f48 0 2024-04-26T11:23:59.898 INFO:tasks.workunit.client.0.smithi073.stdout:5/180: fdatasync d4/d8/d9/f1b 0 2024-04-26T11:23:59.898 INFO:tasks.workunit.client.0.smithi073.stdout:6/122: rmdir d0/d19 39 2024-04-26T11:23:59.898 INFO:tasks.workunit.client.0.smithi073.stdout:0/134: symlink d2/l34 0 2024-04-26T11:23:59.898 INFO:tasks.workunit.client.0.smithi073.stdout:6/123: stat d0 0 2024-04-26T11:23:59.898 INFO:tasks.workunit.client.0.smithi073.stdout:8/215: creat d1/d4/d37/f4b x:0 0 0 2024-04-26T11:23:59.898 INFO:tasks.workunit.client.0.smithi073.stdout:1/291: rename d1/d6/f25 to d1/d8/d5d/f70 0 2024-04-26T11:23:59.898 INFO:tasks.workunit.client.0.smithi073.stdout:6/124: stat d0/f4 0 2024-04-26T11:23:59.898 INFO:tasks.workunit.client.0.smithi073.stdout:9/235: symlink d0/d13/l50 0 2024-04-26T11:23:59.898 INFO:tasks.workunit.client.0.smithi073.stdout:4/192: mkdir d8/d15/d1c/d49 0 2024-04-26T11:23:59.898 INFO:tasks.workunit.client.0.smithi073.stdout:5/181: symlink d4/de/d15/l3c 0 2024-04-26T11:23:59.900 INFO:tasks.workunit.client.0.smithi073.stdout:0/135: write d2/f1c [1101396,58781] 0 2024-04-26T11:23:59.900 INFO:tasks.workunit.client.0.smithi073.stdout:8/216: mkdir d1/d4/d4c 0 2024-04-26T11:23:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:4/193: stat d8/d1f/f22 0 2024-04-26T11:23:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:1/292: creat d1/d16/d6a/f71 x:0 0 0 2024-04-26T11:23:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:6/125: mknod d0/d19/c24 0 2024-04-26T11:23:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:4/194: readlink d8/d1a/d1b/l3a 0 2024-04-26T11:23:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:9/236: mkdir d0/d13/db/d2e/d51 0 2024-04-26T11:23:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:4/195: stat d8/d1a 0 2024-04-26T11:23:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:8/217: creat d1/d4/d15/f4d x:0 0 0 2024-04-26T11:23:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:9/237: mknod d0/d13/db/d2e/d51/c52 0 2024-04-26T11:23:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:4/196: truncate d8/d1f/d23/f32 383232 0 2024-04-26T11:23:59.901 INFO:tasks.workunit.client.0.smithi073.stdout:9/238: chown d0/f8 49254 1 2024-04-26T11:23:59.902 INFO:tasks.workunit.client.0.smithi073.stdout:8/218: read d1/d4/d8/f22 [7708,55129] 0 2024-04-26T11:23:59.902 INFO:tasks.workunit.client.0.smithi073.stdout:4/197: dread - d8/d1a/d1b/d41/f48 zero size 2024-04-26T11:23:59.902 INFO:tasks.workunit.client.0.smithi073.stdout:9/239: write d0/d13/db/f4b [1360478,101955] 0 2024-04-26T11:23:59.902 INFO:tasks.workunit.client.0.smithi073.stdout:3/148: dread d0/d11/f18 [0,4194304] 0 2024-04-26T11:23:59.903 INFO:tasks.workunit.client.0.smithi073.stdout:8/219: dread - d1/d21/d2c/f3b zero size 2024-04-26T11:23:59.903 INFO:tasks.workunit.client.0.smithi073.stdout:4/198: write d8/d15/f3f [369165,110156] 0 2024-04-26T11:23:59.903 INFO:tasks.workunit.client.0.smithi073.stdout:3/149: mkdir d0/d26/d2c/d33 0 2024-04-26T11:23:59.903 INFO:tasks.workunit.client.0.smithi073.stdout:0/136: rmdir d2 39 2024-04-26T11:23:59.904 INFO:tasks.workunit.client.0.smithi073.stdout:9/240: creat d0/d13/d25/d2c/f53 x:0 0 0 2024-04-26T11:23:59.905 INFO:tasks.workunit.client.0.smithi073.stdout:8/220: write d1/d21/f29 [1560558,70166] 0 2024-04-26T11:23:59.905 INFO:tasks.workunit.client.0.smithi073.stdout:5/182: dwrite d4/d8/d9/f1b [0,4194304] 0 2024-04-26T11:23:59.905 INFO:tasks.workunit.client.0.smithi073.stdout:9/241: readlink d0/d13/l4 0 2024-04-26T11:23:59.905 INFO:tasks.workunit.client.0.smithi073.stdout:0/137: fdatasync d2/d1f/f2b 0 2024-04-26T11:23:59.905 INFO:tasks.workunit.client.0.smithi073.stdout:6/126: dwrite d0/f9 [0,4194304] 0 2024-04-26T11:23:59.906 INFO:tasks.workunit.client.0.smithi073.stdout:0/138: chown d2/f11 6807681 1 2024-04-26T11:23:59.907 INFO:tasks.workunit.client.0.smithi073.stdout:4/199: dread d8/d1a/d1b/d1d/f21 [0,4194304] 0 2024-04-26T11:23:59.908 INFO:tasks.workunit.client.0.smithi073.stdout:1/293: truncate d1/d6/fa 2929910 0 2024-04-26T11:23:59.909 INFO:tasks.workunit.client.0.smithi073.stdout:9/242: mknod d0/d1a/d4e/c54 0 2024-04-26T11:23:59.909 INFO:tasks.workunit.client.0.smithi073.stdout:6/127: unlink d0/lb 0 2024-04-26T11:23:59.910 INFO:tasks.workunit.client.0.smithi073.stdout:0/139: getdents d2/d1f 0 2024-04-26T11:23:59.910 INFO:tasks.workunit.client.0.smithi073.stdout:1/294: creat d1/d16/d6a/f72 x:0 0 0 2024-04-26T11:23:59.910 INFO:tasks.workunit.client.0.smithi073.stdout:9/243: symlink d0/d13/l55 0 2024-04-26T11:23:59.911 INFO:tasks.workunit.client.0.smithi073.stdout:3/150: dwrite d0/d11/d19/fc [0,4194304] 0 2024-04-26T11:23:59.911 INFO:tasks.workunit.client.0.smithi073.stdout:0/140: creat d2/d22/f35 x:0 0 0 2024-04-26T11:23:59.911 INFO:tasks.workunit.client.0.smithi073.stdout:3/151: readlink d0/l10 0 2024-04-26T11:23:59.912 INFO:tasks.workunit.client.0.smithi073.stdout:6/128: truncate d0/d19/d20/f22 600470 0 2024-04-26T11:23:59.912 INFO:tasks.workunit.client.0.smithi073.stdout:0/141: symlink d2/l36 0 2024-04-26T11:23:59.912 INFO:tasks.workunit.client.0.smithi073.stdout:6/129: stat d0/d19/c24 0 2024-04-26T11:23:59.913 INFO:tasks.workunit.client.0.smithi073.stdout:5/183: read d4/de/d14/f2a [537143,129192] 0 2024-04-26T11:23:59.913 INFO:tasks.workunit.client.0.smithi073.stdout:0/142: mkdir d2/d37 0 2024-04-26T11:23:59.914 INFO:tasks.workunit.client.0.smithi073.stdout:0/143: read d2/f11 [1057175,4585] 0 2024-04-26T11:23:59.914 INFO:tasks.workunit.client.0.smithi073.stdout:8/221: read d1/f18 [3286526,125166] 0 2024-04-26T11:23:59.914 INFO:tasks.workunit.client.0.smithi073.stdout:5/184: mknod d4/de/c3d 0 2024-04-26T11:23:59.915 INFO:tasks.workunit.client.0.smithi073.stdout:0/144: mknod d2/d22/c38 0 2024-04-26T11:23:59.916 INFO:tasks.workunit.client.0.smithi073.stdout:0/145: fsync d2/f31 0 2024-04-26T11:23:59.916 INFO:tasks.workunit.client.0.smithi073.stdout:5/185: creat d4/d8/f3e x:0 0 0 2024-04-26T11:23:59.916 INFO:tasks.workunit.client.0.smithi073.stdout:8/222: write d1/d21/d2a/f2b [4028898,124271] 0 2024-04-26T11:23:59.917 INFO:tasks.workunit.client.0.smithi073.stdout:0/146: creat d2/d22/f39 x:0 0 0 2024-04-26T11:23:59.918 INFO:tasks.workunit.client.0.smithi073.stdout:5/186: creat d4/de/d14/f3f x:0 0 0 2024-04-26T11:23:59.918 INFO:tasks.workunit.client.0.smithi073.stdout:1/295: dwrite d1/df/f5e [0,4194304] 0 2024-04-26T11:23:59.919 INFO:tasks.workunit.client.0.smithi073.stdout:9/244: dwrite d0/f3f [0,4194304] 0 2024-04-26T11:23:59.919 INFO:tasks.workunit.client.0.smithi073.stdout:6/130: dread d0/f4 [0,4194304] 0 2024-04-26T11:23:59.920 INFO:tasks.workunit.client.0.smithi073.stdout:6/131: write d0/f9 [5452189,13846] 0 2024-04-26T11:23:59.920 INFO:tasks.workunit.client.0.smithi073.stdout:2/169: sync 2024-04-26T11:23:59.920 INFO:tasks.workunit.client.0.smithi073.stdout:7/194: sync 2024-04-26T11:23:59.920 INFO:tasks.workunit.client.0.smithi073.stdout:9/245: symlink d0/d13/db/l56 0 2024-04-26T11:23:59.921 INFO:tasks.workunit.client.0.smithi073.stdout:9/246: fsync d0/d13/f22 0 2024-04-26T11:23:59.921 INFO:tasks.workunit.client.0.smithi073.stdout:2/170: stat dd/d1c/d1d/d17 0 2024-04-26T11:23:59.921 INFO:tasks.workunit.client.0.smithi073.stdout:5/187: rename d4/d8/f3e to d4/de/d15/d33/f40 0 2024-04-26T11:23:59.921 INFO:tasks.workunit.client.0.smithi073.stdout:4/200: dread d8/d15/f17 [0,4194304] 0 2024-04-26T11:23:59.921 INFO:tasks.workunit.client.0.smithi073.stdout:1/296: rename d1/df to d1/d73 0 2024-04-26T11:23:59.921 INFO:tasks.workunit.client.0.smithi073.stdout:6/132: unlink d0/dc/ce 0 2024-04-26T11:23:59.922 INFO:tasks.workunit.client.0.smithi073.stdout:5/188: dread - d4/de/d15/f34 zero size 2024-04-26T11:23:59.922 INFO:tasks.workunit.client.0.smithi073.stdout:6/133: creat d0/d19/d20/f25 x:0 0 0 2024-04-26T11:23:59.922 INFO:tasks.workunit.client.0.smithi073.stdout:2/171: write dd/d1c/d1d/f36 [1261983,44835] 0 2024-04-26T11:23:59.923 INFO:tasks.workunit.client.0.smithi073.stdout:7/195: creat d1/d11/d24/d26/d3d/d41/f47 x:0 0 0 2024-04-26T11:23:59.923 INFO:tasks.workunit.client.0.smithi073.stdout:1/297: write d1/d73/d40/d54/f5f [170873,109354] 0 2024-04-26T11:23:59.923 INFO:tasks.workunit.client.0.smithi073.stdout:8/223: fdatasync d1/d21/d2a/f2b 0 2024-04-26T11:23:59.923 INFO:tasks.workunit.client.0.smithi073.stdout:4/201: dread - d8/d1a/d1b/d24/f2d zero size 2024-04-26T11:23:59.924 INFO:tasks.workunit.client.0.smithi073.stdout:5/189: link d4/l37 d4/de/d23/l41 0 2024-04-26T11:23:59.924 INFO:tasks.workunit.client.0.smithi073.stdout:2/172: fdatasync dd/de/f11 0 2024-04-26T11:23:59.924 INFO:tasks.workunit.client.0.smithi073.stdout:6/134: mkdir d0/d1a/d26 0 2024-04-26T11:23:59.924 INFO:tasks.workunit.client.0.smithi073.stdout:5/190: dread - d4/d8/d9/f21 zero size 2024-04-26T11:23:59.925 INFO:tasks.workunit.client.0.smithi073.stdout:7/196: link d1/d33/ff d1/d46/f48 0 2024-04-26T11:23:59.925 INFO:tasks.workunit.client.0.smithi073.stdout:2/173: mkdir dd/de/d38 0 2024-04-26T11:23:59.926 INFO:tasks.workunit.client.0.smithi073.stdout:1/298: write d1/d8/d5d/f70 [873132,83490] 0 2024-04-26T11:23:59.926 INFO:tasks.workunit.client.0.smithi073.stdout:2/174: readlink la 0 2024-04-26T11:23:59.926 INFO:tasks.workunit.client.0.smithi073.stdout:6/135: read d0/d15/f14 [3631593,25887] 0 2024-04-26T11:23:59.927 INFO:tasks.workunit.client.0.smithi073.stdout:5/191: chown d4/l2e 25251 1 2024-04-26T11:23:59.927 INFO:tasks.workunit.client.0.smithi073.stdout:2/175: mknod dd/d1c/d1d/d30/c39 0 2024-04-26T11:23:59.928 INFO:tasks.workunit.client.0.smithi073.stdout:7/197: link d1/d33/ff d1/d11/d24/d29/f49 0 2024-04-26T11:23:59.928 INFO:tasks.workunit.client.0.smithi073.stdout:6/136: mkdir d0/d1a/d26/d27 0 2024-04-26T11:23:59.929 INFO:tasks.workunit.client.0.smithi073.stdout:9/247: dwrite d0/f10 [0,4194304] 0 2024-04-26T11:23:59.930 INFO:tasks.workunit.client.0.smithi073.stdout:6/137: chown d0/f2 76 1 2024-04-26T11:23:59.931 INFO:tasks.workunit.client.0.smithi073.stdout:7/198: unlink d1/d11/f14 0 2024-04-26T11:23:59.931 INFO:tasks.workunit.client.0.smithi073.stdout:2/176: write dd/d1c/d1d/f36 [1733772,49883] 0 2024-04-26T11:23:59.931 INFO:tasks.workunit.client.0.smithi073.stdout:8/224: dread d1/f17 [0,4194304] 0 2024-04-26T11:23:59.931 INFO:tasks.workunit.client.0.smithi073.stdout:3/152: dread d0/fa [0,4194304] 0 2024-04-26T11:23:59.931 INFO:tasks.workunit.client.0.smithi073.stdout:1/299: dread d1/d73/d53/f59 [0,4194304] 0 2024-04-26T11:23:59.931 INFO:tasks.workunit.client.0.smithi073.stdout:5/192: truncate d4/de/d15/d33/f40 400045 0 2024-04-26T11:23:59.931 INFO:tasks.workunit.client.0.smithi073.stdout:6/138: stat d0/d19/l1f 0 2024-04-26T11:23:59.931 INFO:tasks.workunit.client.0.smithi073.stdout:4/202: dread d8/d14/f30 [0,4194304] 0 2024-04-26T11:23:59.933 INFO:tasks.workunit.client.0.smithi073.stdout:1/300: mknod d1/d8/d2e/d37/c74 0 2024-04-26T11:23:59.933 INFO:tasks.workunit.client.0.smithi073.stdout:5/193: unlink d4/d8/d9/f12 0 2024-04-26T11:23:59.933 INFO:tasks.workunit.client.0.smithi073.stdout:7/199: mknod d1/d33/d1f/c4a 0 2024-04-26T11:23:59.933 INFO:tasks.workunit.client.0.smithi073.stdout:3/153: dread - d0/d11/d19/f27 zero size 2024-04-26T11:23:59.933 INFO:tasks.workunit.client.0.smithi073.stdout:4/203: rename d8/d15/f18 to d8/d1a/d1b/d24/f4a 0 2024-04-26T11:23:59.933 INFO:tasks.workunit.client.0.smithi073.stdout:3/154: sync 2024-04-26T11:23:59.933 INFO:tasks.workunit.client.0.smithi073.stdout:9/248: link d0/d1a/d2f/l47 d0/d13/db/d2e/d3b/l57 0 2024-04-26T11:23:59.934 INFO:tasks.workunit.client.0.smithi073.stdout:5/194: mkdir d4/d8/d9/d42 0 2024-04-26T11:23:59.935 INFO:tasks.workunit.client.0.smithi073.stdout:5/195: readlink d4/l27 0 2024-04-26T11:23:59.935 INFO:tasks.workunit.client.0.smithi073.stdout:7/200: mkdir d1/d11/d24/d26/d4b 0 2024-04-26T11:23:59.935 INFO:tasks.workunit.client.0.smithi073.stdout:7/201: sync 2024-04-26T11:23:59.935 INFO:tasks.workunit.client.0.smithi073.stdout:3/155: write d0/d11/d19/f17 [885513,2568] 0 2024-04-26T11:23:59.935 INFO:tasks.workunit.client.0.smithi073.stdout:5/196: mknod d4/d8/c43 0 2024-04-26T11:23:59.935 INFO:tasks.workunit.client.0.smithi073.stdout:4/204: link d8/d15/c3c d8/d1a/d1b/d46/c4b 0 2024-04-26T11:23:59.936 INFO:tasks.workunit.client.0.smithi073.stdout:3/156: write d0/d11/d19/fc [1699969,74145] 0 2024-04-26T11:23:59.936 INFO:tasks.workunit.client.0.smithi073.stdout:9/249: write d0/d13/d25/d2c/f3a [3568601,117271] 0 2024-04-26T11:23:59.936 INFO:tasks.workunit.client.0.smithi073.stdout:3/157: fsync d0/d26/f2a 0 2024-04-26T11:23:59.936 INFO:tasks.workunit.client.0.smithi073.stdout:0/147: truncate d2/f1d 2035684 0 2024-04-26T11:23:59.937 INFO:tasks.workunit.client.0.smithi073.stdout:0/148: rmdir d2/d22 39 2024-04-26T11:23:59.937 INFO:tasks.workunit.client.0.smithi073.stdout:3/158: chown d0/d11/d19/c8 42 1 2024-04-26T11:23:59.938 INFO:tasks.workunit.client.0.smithi073.stdout:6/139: read d0/d19/d20/f22 [47599,77441] 0 2024-04-26T11:23:59.938 INFO:tasks.workunit.client.0.smithi073.stdout:9/250: getdents d0/d13/db/d2e/d51 0 2024-04-26T11:23:59.942 INFO:tasks.workunit.client.0.smithi073.stdout:9/251: rename d0/d1a/c1e to d0/d13/db/d2e/d51/c58 0 2024-04-26T11:23:59.943 INFO:tasks.workunit.client.0.smithi073.stdout:7/202: dwrite d1/f19 [0,4194304] 0 2024-04-26T11:23:59.944 INFO:tasks.workunit.client.0.smithi073.stdout:5/197: dwrite d4/de/d23/f36 [0,4194304] 0 2024-04-26T11:23:59.945 INFO:tasks.workunit.client.0.smithi073.stdout:7/203: readlink d1/d33/d1b/l2a 0 2024-04-26T11:23:59.946 INFO:tasks.workunit.client.0.smithi073.stdout:4/205: dwrite d8/d14/f30 [0,4194304] 0 2024-04-26T11:23:59.948 INFO:tasks.workunit.client.0.smithi073.stdout:5/198: readlink d4/de/d15/l3c 0 2024-04-26T11:23:59.948 INFO:tasks.workunit.client.0.smithi073.stdout:9/252: fdatasync d0/d13/d25/d2c/f33 0 2024-04-26T11:23:59.948 INFO:tasks.workunit.client.0.smithi073.stdout:3/159: dwrite d0/d11/d19/f17 [0,4194304] 0 2024-04-26T11:23:59.948 INFO:tasks.workunit.client.0.smithi073.stdout:9/253: dread - d0/d3c/f43 zero size 2024-04-26T11:23:59.949 INFO:tasks.workunit.client.0.smithi073.stdout:1/301: truncate d1/d73/d40/f28 3337717 0 2024-04-26T11:23:59.949 INFO:tasks.workunit.client.0.smithi073.stdout:6/140: dwrite d0/dc/f1b [0,4194304] 0 2024-04-26T11:23:59.949 INFO:tasks.workunit.client.0.smithi073.stdout:0/149: truncate d2/fb 838617 0 2024-04-26T11:23:59.950 INFO:tasks.workunit.client.0.smithi073.stdout:5/199: creat d4/de/d23/f44 x:0 0 0 2024-04-26T11:23:59.950 INFO:tasks.workunit.client.0.smithi073.stdout:4/206: write d8/f10 [233919,72199] 0 2024-04-26T11:23:59.951 INFO:tasks.workunit.client.0.smithi073.stdout:6/141: truncate d0/f16 4819287 0 2024-04-26T11:23:59.952 INFO:tasks.workunit.client.0.smithi073.stdout:9/254: write d0/d13/f20 [4907553,33793] 0 2024-04-26T11:23:59.952 INFO:tasks.workunit.client.0.smithi073.stdout:0/150: fdatasync d2/d1f/f26 0 2024-04-26T11:23:59.953 INFO:tasks.workunit.client.0.smithi073.stdout:4/207: write d8/d1a/d1b/f36 [833926,9612] 0 2024-04-26T11:23:59.953 INFO:tasks.workunit.client.0.smithi073.stdout:6/142: fsync d0/d19/d20/f22 0 2024-04-26T11:23:59.954 INFO:tasks.workunit.client.0.smithi073.stdout:0/151: symlink d2/l3a 0 2024-04-26T11:23:59.954 INFO:tasks.workunit.client.0.smithi073.stdout:1/302: rename d1/d6/l3f to d1/d8/d5d/l75 0 2024-04-26T11:23:59.955 INFO:tasks.workunit.client.0.smithi073.stdout:7/204: dwrite d1/f5 [0,4194304] 0 2024-04-26T11:23:59.955 INFO:tasks.workunit.client.0.smithi073.stdout:6/143: truncate d0/d19/f21 97309 0 2024-04-26T11:23:59.957 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:23:59.952+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:23:59.960 INFO:tasks.workunit.client.0.smithi073.stdout:0/152: mknod d2/c3b 0 2024-04-26T11:23:59.960 INFO:tasks.workunit.client.0.smithi073.stdout:7/205: creat d1/d33/d1f/d3c/f4c x:0 0 0 2024-04-26T11:23:59.960 INFO:tasks.workunit.client.0.smithi073.stdout:6/144: creat d0/dc/d1d/f28 x:0 0 0 2024-04-26T11:23:59.960 INFO:tasks.workunit.client.0.smithi073.stdout:4/208: dread d8/d1f/f22 [4194304,4194304] 0 2024-04-26T11:23:59.960 INFO:tasks.workunit.client.0.smithi073.stdout:1/303: link d1/d73/d40/f2c d1/d6/d6e/f76 0 2024-04-26T11:23:59.961 INFO:tasks.workunit.client.0.smithi073.stdout:0/153: readlink d2/lc 0 2024-04-26T11:23:59.961 INFO:tasks.workunit.client.0.smithi073.stdout:5/200: dwrite d4/de/d14/f2a [0,4194304] 0 2024-04-26T11:23:59.961 INFO:tasks.workunit.client.0.smithi073.stdout:9/255: dwrite d0/d1a/f36 [0,4194304] 0 2024-04-26T11:23:59.962 INFO:tasks.workunit.client.0.smithi073.stdout:1/304: mknod d1/d16/c77 0 2024-04-26T11:23:59.962 INFO:tasks.workunit.client.0.smithi073.stdout:7/206: symlink d1/d11/d24/l4d 0 2024-04-26T11:23:59.964 INFO:tasks.workunit.client.0.smithi073.stdout:9/256: mkdir d0/d13/db/d2e/d59 0 2024-04-26T11:23:59.964 INFO:tasks.workunit.client.0.smithi073.stdout:5/201: creat d4/de/d15/f45 x:0 0 0 2024-04-26T11:23:59.965 INFO:tasks.workunit.client.0.smithi073.stdout:9/257: write d0/d1a/f36 [70897,120982] 0 2024-04-26T11:23:59.965 INFO:tasks.workunit.client.0.smithi073.stdout:5/202: creat d4/d8/d9/f46 x:0 0 0 2024-04-26T11:23:59.965 INFO:tasks.workunit.client.0.smithi073.stdout:5/203: chown d4/de/d14 3038 1 2024-04-26T11:23:59.966 INFO:tasks.workunit.client.0.smithi073.stdout:9/258: write d0/d13/d25/d2c/f53 [614538,126615] 0 2024-04-26T11:23:59.966 INFO:tasks.workunit.client.0.smithi073.stdout:5/204: unlink d4/de/d14/f2a 0 2024-04-26T11:23:59.966 INFO:tasks.workunit.client.0.smithi073.stdout:9/259: fsync d0/d13/db/f23 0 2024-04-26T11:23:59.967 INFO:tasks.workunit.client.0.smithi073.stdout:5/205: rename d4/d8/c2b to d4/d8/d9/d42/c47 0 2024-04-26T11:23:59.972 INFO:tasks.workunit.client.0.smithi073.stdout:6/145: dwrite d0/d19/f21 [0,4194304] 0 2024-04-26T11:23:59.973 INFO:tasks.workunit.client.0.smithi073.stdout:6/146: readlink d0/dc/d1d/l1e 0 2024-04-26T11:23:59.974 INFO:tasks.workunit.client.0.smithi073.stdout:9/260: dwrite d0/d13/f20 [4194304,4194304] 0 2024-04-26T11:23:59.974 INFO:tasks.workunit.client.0.smithi073.stdout:5/206: dwrite d4/f1d [0,4194304] 0 2024-04-26T11:23:59.975 INFO:tasks.workunit.client.0.smithi073.stdout:5/207: write d4/d8/d9/f21 [278961,98246] 0 2024-04-26T11:23:59.976 INFO:tasks.workunit.client.0.smithi073.stdout:5/208: creat d4/de/d15/d33/f48 x:0 0 0 2024-04-26T11:23:59.977 INFO:tasks.workunit.client.0.smithi073.stdout:6/147: dread d0/f4 [0,4194304] 0 2024-04-26T11:23:59.977 INFO:tasks.workunit.client.0.smithi073.stdout:7/207: write d1/d11/d24/d29/f49 [1498891,127979] 0 2024-04-26T11:23:59.978 INFO:tasks.workunit.client.0.smithi073.stdout:5/209: creat d4/de/f49 x:0 0 0 2024-04-26T11:23:59.978 INFO:tasks.workunit.client.0.smithi073.stdout:5/210: sync 2024-04-26T11:23:59.978 INFO:tasks.workunit.client.0.smithi073.stdout:0/154: dread d2/f1d [0,4194304] 0 2024-04-26T11:23:59.978 INFO:tasks.workunit.client.0.smithi073.stdout:0/155: stat d2/f15 0 2024-04-26T11:23:59.979 INFO:tasks.workunit.client.0.smithi073.stdout:7/208: symlink d1/l4e 0 2024-04-26T11:23:59.980 INFO:tasks.workunit.client.0.smithi073.stdout:5/211: creat d4/d8/d9/d42/f4a x:0 0 0 2024-04-26T11:23:59.980 INFO:tasks.workunit.client.0.smithi073.stdout:6/148: creat d0/d1a/d26/d27/f29 x:0 0 0 2024-04-26T11:23:59.980 INFO:tasks.workunit.client.0.smithi073.stdout:6/149: chown d0/d1a 0 1 2024-04-26T11:23:59.981 INFO:tasks.workunit.client.0.smithi073.stdout:6/150: rmdir d0/d1a/d26 39 2024-04-26T11:23:59.981 INFO:tasks.workunit.client.0.smithi073.stdout:5/212: creat d4/de/d15/d33/f4b x:0 0 0 2024-04-26T11:23:59.982 INFO:tasks.workunit.client.0.smithi073.stdout:5/213: mknod d4/de/d14/c4c 0 2024-04-26T11:23:59.986 INFO:tasks.workunit.client.0.smithi073.stdout:5/214: mkdir d4/d8/d9/d42/d4d 0 2024-04-26T11:23:59.986 INFO:tasks.workunit.client.0.smithi073.stdout:7/209: dwrite d1/f19 [0,4194304] 0 2024-04-26T11:23:59.986 INFO:tasks.workunit.client.0.smithi073.stdout:5/215: chown d4/d8/d9 327604135 1 2024-04-26T11:23:59.986 INFO:tasks.workunit.client.0.smithi073.stdout:7/210: fdatasync d1/d11/f36 0 2024-04-26T11:23:59.987 INFO:tasks.workunit.client.0.smithi073.stdout:5/216: creat d4/de/d15/d33/f4e x:0 0 0 2024-04-26T11:23:59.987 INFO:tasks.workunit.client.0.smithi073.stdout:7/211: fdatasync d1/d11/d24/d26/f2c 0 2024-04-26T11:23:59.988 INFO:tasks.workunit.client.0.smithi073.stdout:7/212: creat d1/d11/d24/d26/d3d/f4f x:0 0 0 2024-04-26T11:23:59.989 INFO:tasks.workunit.client.0.smithi073.stdout:7/213: chown d1/d11/d24/d29 7489 1 2024-04-26T11:23:59.990 INFO:tasks.workunit.client.0.smithi073.stdout:7/214: mkdir d1/d46/d50 0 2024-04-26T11:23:59.991 INFO:tasks.workunit.client.0.smithi073.stdout:7/215: truncate d1/d33/d1f/f3b 325366 0 2024-04-26T11:23:59.991 INFO:tasks.workunit.client.0.smithi073.stdout:5/217: dwrite d4/f20 [0,4194304] 0 2024-04-26T11:23:59.994 INFO:tasks.workunit.client.0.smithi073.stdout:7/216: mkdir d1/d11/d51 0 2024-04-26T11:23:59.995 INFO:tasks.workunit.client.0.smithi073.stdout:7/217: dread - d1/d33/d1f/f40 zero size 2024-04-26T11:23:59.996 INFO:tasks.workunit.client.0.smithi073.stdout:0/156: truncate d2/f1c 1016352 0 2024-04-26T11:23:59.996 INFO:tasks.workunit.client.0.smithi073.stdout:7/218: write d1/d33/d1f/f40 [508861,16412] 0 2024-04-26T11:23:59.997 INFO:tasks.workunit.client.0.smithi073.stdout:0/157: dread d2/f17 [0,4194304] 0 2024-04-26T11:24:00.003 INFO:tasks.workunit.client.0.smithi073.stdout:7/219: dwrite d1/f44 [0,4194304] 0 2024-04-26T11:24:00.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/151: dwrite d0/d15/f14 [0,4194304] 0 2024-04-26T11:24:00.005 INFO:tasks.workunit.client.0.smithi073.stdout:7/220: symlink d1/d11/d10/l52 0 2024-04-26T11:24:00.008 INFO:tasks.workunit.client.0.smithi073.stdout:7/221: unlink d1/d33/d1f/f3b 0 2024-04-26T11:24:00.009 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:00.009 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:00.009 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:24:00.009 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:24:00.009 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:00.010 INFO:tasks.workunit.client.0.smithi073.stdout:2/177: dread dd/de/f18 [0,4194304] 0 2024-04-26T11:24:00.010 INFO:tasks.workunit.client.0.smithi073.stdout:7/222: readlink d1/d11/d10/l31 0 2024-04-26T11:24:00.012 INFO:tasks.workunit.client.0.smithi073.stdout:5/218: dwrite d4/de/f2c [0,4194304] 0 2024-04-26T11:24:00.012 INFO:tasks.workunit.client.0.smithi073.stdout:2/178: truncate dd/de/f11 23380 0 2024-04-26T11:24:00.013 INFO:tasks.workunit.client.0.smithi073.stdout:5/219: write d4/de/d23/f36 [2303992,19758] 0 2024-04-26T11:24:00.013 INFO:tasks.workunit.client.0.smithi073.stdout:6/152: dwrite d0/d19/d20/f22 [0,4194304] 0 2024-04-26T11:24:00.016 INFO:tasks.workunit.client.0.smithi073.stdout:6/153: creat d0/d15/f2a x:0 0 0 2024-04-26T11:24:00.016 INFO:tasks.workunit.client.0.smithi073.stdout:8/225: dread d1/f2f [0,4194304] 0 2024-04-26T11:24:00.016 INFO:tasks.workunit.client.0.smithi073.stdout:2/179: mknod dd/de/d38/c3a 0 2024-04-26T11:24:00.017 INFO:tasks.workunit.client.0.smithi073.stdout:2/180: sync 2024-04-26T11:24:00.017 INFO:tasks.workunit.client.0.smithi073.stdout:2/181: write dd/f1a [761928,99888] 0 2024-04-26T11:24:00.018 INFO:tasks.workunit.client.0.smithi073.stdout:2/182: unlink f7 0 2024-04-26T11:24:00.019 INFO:tasks.workunit.client.0.smithi073.stdout:2/183: mknod dd/de/c3b 0 2024-04-26T11:24:00.020 INFO:tasks.workunit.client.0.smithi073.stdout:5/220: dwrite d4/d8/fb [0,4194304] 0 2024-04-26T11:24:00.021 INFO:tasks.workunit.client.0.smithi073.stdout:6/154: dread d0/f4 [0,4194304] 0 2024-04-26T11:24:00.021 INFO:tasks.workunit.client.0.smithi073.stdout:5/221: mkdir d4/de/d23/d4f 0 2024-04-26T11:24:00.021 INFO:tasks.workunit.client.0.smithi073.stdout:2/184: creat dd/d1c/d1d/d30/f3c x:0 0 0 2024-04-26T11:24:00.021 INFO:tasks.workunit.client.0.smithi073.stdout:6/155: mkdir d0/dc/d1d/d2b 0 2024-04-26T11:24:00.022 INFO:tasks.workunit.client.0.smithi073.stdout:2/185: creat dd/de/d38/f3d x:0 0 0 2024-04-26T11:24:00.022 INFO:tasks.workunit.client.0.smithi073.stdout:6/156: truncate d0/d19/f21 4810820 0 2024-04-26T11:24:00.022 INFO:tasks.workunit.client.0.smithi073.stdout:2/186: symlink dd/de/d38/l3e 0 2024-04-26T11:24:00.023 INFO:tasks.workunit.client.0.smithi073.stdout:2/187: getdents dd/d1c/d1d 0 2024-04-26T11:24:00.024 INFO:tasks.workunit.client.0.smithi073.stdout:2/188: write dd/de/f28 [750118,52192] 0 2024-04-26T11:24:00.025 INFO:tasks.workunit.client.0.smithi073.stdout:2/189: creat dd/de/f3f x:0 0 0 2024-04-26T11:24:00.025 INFO:tasks.workunit.client.0.smithi073.stdout:2/190: rename dd/de/d2a to dd/de/d2a/d40 22 2024-04-26T11:24:00.025 INFO:tasks.workunit.client.0.smithi073.stdout:2/191: fdatasync dd/d1c/d1d/f36 0 2024-04-26T11:24:00.029 INFO:tasks.workunit.client.0.smithi073.stdout:7/223: truncate d1/f44 506051 0 2024-04-26T11:24:00.030 INFO:tasks.workunit.client.0.smithi073.stdout:7/224: write d1/d11/d24/d29/f49 [2573031,82863] 0 2024-04-26T11:24:00.031 INFO:tasks.workunit.client.0.smithi073.stdout:7/225: unlink d1/d11/d24/d29/f3f 0 2024-04-26T11:24:00.031 INFO:tasks.workunit.client.0.smithi073.stdout:7/226: sync 2024-04-26T11:24:00.032 INFO:tasks.workunit.client.0.smithi073.stdout:9/261: dread d0/d13/db/f4b [0,4194304] 0 2024-04-26T11:24:00.033 INFO:tasks.workunit.client.0.smithi073.stdout:9/262: mkdir d0/d13/d5a 0 2024-04-26T11:24:00.033 INFO:tasks.workunit.client.0.smithi073.stdout:7/227: symlink d1/d11/d24/d26/d3d/d41/l53 0 2024-04-26T11:24:00.034 INFO:tasks.workunit.client.0.smithi073.stdout:0/158: dwrite d2/f1c [0,4194304] 0 2024-04-26T11:24:00.036 INFO:tasks.workunit.client.0.smithi073.stdout:9/263: dread d0/d13/db/f4b [0,4194304] 0 2024-04-26T11:24:00.038 INFO:tasks.workunit.client.0.smithi073.stdout:6/157: truncate d0/d15/f14 4546678 0 2024-04-26T11:24:00.039 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:00.040 INFO:tasks.workunit.client.0.smithi073.stdout:8/226: dwrite d1/f26 [0,4194304] 0 2024-04-26T11:24:00.040 INFO:tasks.workunit.client.0.smithi073.stdout:6/158: fdatasync d0/d15/f2a 0 2024-04-26T11:24:00.041 INFO:tasks.workunit.client.0.smithi073.stdout:3/160: dread d0/d11/d19/f6 [0,4194304] 0 2024-04-26T11:24:00.041 INFO:tasks.workunit.client.0.smithi073.stdout:7/228: dwrite d1/f19 [0,4194304] 0 2024-04-26T11:24:00.042 INFO:tasks.workunit.client.0.smithi073.stdout:3/161: write d0/f2e [149993,110711] 0 2024-04-26T11:24:00.042 INFO:tasks.workunit.client.0.smithi073.stdout:3/162: write d0/d11/d19/f28 [2213951,126839] 0 2024-04-26T11:24:00.044 INFO:tasks.workunit.client.0.smithi073.stdout:6/159: dread d0/f4 [0,4194304] 0 2024-04-26T11:24:00.048 INFO:tasks.workunit.client.0.smithi073.stdout:1/305: dread d1/d8/fd [0,4194304] 0 2024-04-26T11:24:00.049 INFO:tasks.workunit.client.0.smithi073.stdout:8/227: rename d1/d4/c32 to d1/d21/c4e 0 2024-04-26T11:24:00.049 INFO:tasks.workunit.client.0.smithi073.stdout:7/229: creat d1/f54 x:0 0 0 2024-04-26T11:24:00.049 INFO:tasks.workunit.client.0.smithi073.stdout:4/209: dread d8/f2e [0,4194304] 0 2024-04-26T11:24:00.050 INFO:tasks.workunit.client.0.smithi073.stdout:7/230: write d1/d11/d24/d26/d3d/d41/f47 [724134,100999] 0 2024-04-26T11:24:00.051 INFO:tasks.workunit.client.0.smithi073.stdout:9/264: creat d0/d13/f5b x:0 0 0 2024-04-26T11:24:00.051 INFO:tasks.workunit.client.0.smithi073.stdout:6/160: mkdir d0/dc/d1d/d2b/d2c 0 2024-04-26T11:24:00.051 INFO:tasks.workunit.client.0.smithi073.stdout:3/163: mkdir d0/d34 0 2024-04-26T11:24:00.051 INFO:tasks.workunit.client.0.smithi073.stdout:3/164: dread - d0/d11/d19/f27 zero size 2024-04-26T11:24:00.051 INFO:tasks.workunit.client.0.smithi073.stdout:1/306: creat d1/d73/d34/f78 x:0 0 0 2024-04-26T11:24:00.052 INFO:tasks.workunit.client.0.smithi073.stdout:6/161: unlink d0/f9 0 2024-04-26T11:24:00.052 INFO:tasks.workunit.client.0.smithi073.stdout:9/265: creat d0/d1a/d4e/f5c x:0 0 0 2024-04-26T11:24:00.052 INFO:tasks.workunit.client.0.smithi073.stdout:4/210: write d8/d1a/d1b/d1d/f21 [5190888,115027] 0 2024-04-26T11:24:00.053 INFO:tasks.workunit.client.0.smithi073.stdout:8/228: dread d1/d4/d8/f22 [0,4194304] 0 2024-04-26T11:24:00.053 INFO:tasks.workunit.client.0.smithi073.stdout:1/307: creat d1/d16/d4f/f79 x:0 0 0 2024-04-26T11:24:00.054 INFO:tasks.workunit.client.0.smithi073.stdout:7/231: truncate d1/d11/d24/d26/f2c 2872919 0 2024-04-26T11:24:00.054 INFO:tasks.workunit.client.0.smithi073.stdout:6/162: dread - d0/d19/d20/f25 zero size 2024-04-26T11:24:00.054 INFO:tasks.workunit.client.0.smithi073.stdout:9/266: symlink d0/d3c/l5d 0 2024-04-26T11:24:00.054 INFO:tasks.workunit.client.0.smithi073.stdout:3/165: symlink d0/d11/d19/d1d/l35 0 2024-04-26T11:24:00.054 INFO:tasks.workunit.client.0.smithi073.stdout:9/267: fdatasync d0/d13/db/f23 0 2024-04-26T11:24:00.054 INFO:tasks.workunit.client.0.smithi073.stdout:8/229: creat d1/d4/d37/f4f x:0 0 0 2024-04-26T11:24:00.055 INFO:tasks.workunit.client.0.smithi073.stdout:1/308: write d1/d6/fb [9377470,1292] 0 2024-04-26T11:24:00.055 INFO:tasks.workunit.client.0.smithi073.stdout:3/166: symlink d0/l36 0 2024-04-26T11:24:00.055 INFO:tasks.workunit.client.0.smithi073.stdout:3/167: sync 2024-04-26T11:24:00.056 INFO:tasks.workunit.client.0.smithi073.stdout:0/159: dread d2/f25 [0,4194304] 0 2024-04-26T11:24:00.056 INFO:tasks.workunit.client.0.smithi073.stdout:9/268: write d0/d13/d25/d2c/f3a [1857075,61848] 0 2024-04-26T11:24:00.056 INFO:tasks.workunit.client.0.smithi073.stdout:1/309: truncate d1/d73/f35 4875794 0 2024-04-26T11:24:00.056 INFO:tasks.workunit.client.0.smithi073.stdout:3/168: chown d0/fa 180 1 2024-04-26T11:24:00.057 INFO:tasks.workunit.client.0.smithi073.stdout:9/269: chown d0/d13/ld 11319 1 2024-04-26T11:24:00.057 INFO:tasks.workunit.client.0.smithi073.stdout:5/222: dread d4/d8/f30 [0,4194304] 0 2024-04-26T11:24:00.058 INFO:tasks.workunit.client.0.smithi073.stdout:5/223: sync 2024-04-26T11:24:00.059 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:00.054+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:00.060 INFO:tasks.workunit.client.0.smithi073.stdout:3/169: creat d0/d11/d19/db/f37 x:0 0 0 2024-04-26T11:24:00.060 INFO:tasks.workunit.client.0.smithi073.stdout:9/270: mkdir d0/d13/d5a/d5e 0 2024-04-26T11:24:00.060 INFO:tasks.workunit.client.0.smithi073.stdout:1/310: creat d1/d16/d4f/d55/d5a/f7a x:0 0 0 2024-04-26T11:24:00.060 INFO:tasks.workunit.client.0.smithi073.stdout:5/224: mknod d4/c50 0 2024-04-26T11:24:00.060 INFO:tasks.workunit.client.0.smithi073.stdout:7/232: dread d1/f44 [0,4194304] 0 2024-04-26T11:24:00.060 INFO:tasks.workunit.client.0.smithi073.stdout:1/311: readlink d1/l32 0 2024-04-26T11:24:00.061 INFO:tasks.workunit.client.0.smithi073.stdout:9/271: chown d0/d3c/f43 51516 1 2024-04-26T11:24:00.061 INFO:tasks.workunit.client.0.smithi073.stdout:1/312: write d1/d51/f67 [424884,5082] 0 2024-04-26T11:24:00.062 INFO:tasks.workunit.client.0.smithi073.stdout:3/170: write d0/d11/d19/f25 [1001035,77828] 0 2024-04-26T11:24:00.062 INFO:tasks.workunit.client.0.smithi073.stdout:6/163: dwrite d0/d19/d20/f25 [0,4194304] 0 2024-04-26T11:24:00.062 INFO:tasks.workunit.client.0.smithi073.stdout:1/313: rename d1 to d1/d8/d57/d7b 22 2024-04-26T11:24:00.063 INFO:tasks.workunit.client.0.smithi073.stdout:4/211: dwrite d8/d1f/f22 [0,4194304] 0 2024-04-26T11:24:00.063 INFO:tasks.workunit.client.0.smithi073.stdout:9/272: write d0/d13/d25/d2c/f53 [787224,128752] 0 2024-04-26T11:24:00.063 INFO:tasks.workunit.client.0.smithi073.stdout:5/225: link d4/de/d14/l25 d4/de/d15/l51 0 2024-04-26T11:24:00.064 INFO:tasks.workunit.client.0.smithi073.stdout:6/164: write d0/f16 [416677,14355] 0 2024-04-26T11:24:00.065 INFO:tasks.workunit.client.0.smithi073.stdout:4/212: symlink d8/d1a/d1b/d24/l4c 0 2024-04-26T11:24:00.066 INFO:tasks.workunit.client.0.smithi073.stdout:3/171: getdents d0/d26/d2c/d33 0 2024-04-26T11:24:00.066 INFO:tasks.workunit.client.0.smithi073.stdout:6/165: unlink d0/dc/d1d/f28 0 2024-04-26T11:24:00.066 INFO:tasks.workunit.client.0.smithi073.stdout:1/314: mknod d1/d16/d68/c7c 0 2024-04-26T11:24:00.066 INFO:tasks.workunit.client.0.smithi073.stdout:9/273: symlink d0/d13/d5a/d5e/l5f 0 2024-04-26T11:24:00.067 INFO:tasks.workunit.client.0.smithi073.stdout:6/166: mkdir d0/d15/d2d 0 2024-04-26T11:24:00.067 INFO:tasks.workunit.client.0.smithi073.stdout:4/213: rmdir d8/d1f/d23 39 2024-04-26T11:24:00.067 INFO:tasks.workunit.client.0.smithi073.stdout:1/315: unlink d1/d6/fa 0 2024-04-26T11:24:00.067 INFO:tasks.workunit.client.0.smithi073.stdout:4/214: readlink d8/d1a/d1b/l3a 0 2024-04-26T11:24:00.067 INFO:tasks.workunit.client.0.smithi073.stdout:6/167: mkdir d0/dc/d2e 0 2024-04-26T11:24:00.068 INFO:tasks.workunit.client.0.smithi073.stdout:3/172: getdents d0/d11/d23 0 2024-04-26T11:24:00.068 INFO:tasks.workunit.client.0.smithi073.stdout:4/215: unlink d8/d1a/d1b/d1d/f40 0 2024-04-26T11:24:00.068 INFO:tasks.workunit.client.0.smithi073.stdout:6/168: dread - d0/d15/f2a zero size 2024-04-26T11:24:00.069 INFO:tasks.workunit.client.0.smithi073.stdout:3/173: creat d0/d34/f38 x:0 0 0 2024-04-26T11:24:00.069 INFO:tasks.workunit.client.0.smithi073.stdout:4/216: mkdir d8/d1a/d4d 0 2024-04-26T11:24:00.070 INFO:tasks.workunit.client.0.smithi073.stdout:6/169: write d0/f16 [5458470,96031] 0 2024-04-26T11:24:00.071 INFO:tasks.workunit.client.0.smithi073.stdout:9/274: dread d0/d1a/f36 [0,4194304] 0 2024-04-26T11:24:00.071 INFO:tasks.workunit.client.0.smithi073.stdout:5/226: dwrite d4/de/d14/f1a [0,4194304] 0 2024-04-26T11:24:00.071 INFO:tasks.workunit.client.0.smithi073.stdout:6/170: chown d0/dc/f1b 24539 1 2024-04-26T11:24:00.072 INFO:tasks.workunit.client.0.smithi073.stdout:1/316: creat d1/d51/f7d x:0 0 0 2024-04-26T11:24:00.072 INFO:tasks.workunit.client.0.smithi073.stdout:9/275: readlink d0/d13/d5a/d5e/l5f 0 2024-04-26T11:24:00.073 INFO:tasks.workunit.client.0.smithi073.stdout:1/317: truncate d1/d73/d40/f3a 630866 0 2024-04-26T11:24:00.073 INFO:tasks.workunit.client.0.smithi073.stdout:2/192: dread dd/d1c/d1d/f35 [0,4194304] 0 2024-04-26T11:24:00.074 INFO:tasks.workunit.client.0.smithi073.stdout:4/217: mknod d8/d14/c4e 0 2024-04-26T11:24:00.076 INFO:tasks.workunit.client.0.smithi073.stdout:6/171: rename d0/c8 to d0/dc/d2e/c2f 0 2024-04-26T11:24:00.076 INFO:tasks.workunit.client.0.smithi073.stdout:9/276: fsync d0/d1a/f36 0 2024-04-26T11:24:00.076 INFO:tasks.workunit.client.0.smithi073.stdout:1/318: creat d1/d73/d34/f7e x:0 0 0 2024-04-26T11:24:00.076 INFO:tasks.workunit.client.0.smithi073.stdout:3/174: creat d0/d11/d19/f39 x:0 0 0 2024-04-26T11:24:00.076 INFO:tasks.workunit.client.0.smithi073.stdout:7/233: dwrite d1/f44 [0,4194304] 0 2024-04-26T11:24:00.077 INFO:tasks.workunit.client.0.smithi073.stdout:5/227: dread d4/de/d14/f1a [0,4194304] 0 2024-04-26T11:24:00.077 INFO:tasks.workunit.client.0.smithi073.stdout:7/234: write d1/f19 [1636048,14084] 0 2024-04-26T11:24:00.078 INFO:tasks.workunit.client.0.smithi073.stdout:7/235: fsync d1/d11/d24/d29/f49 0 2024-04-26T11:24:00.078 INFO:tasks.workunit.client.0.smithi073.stdout:6/172: symlink d0/d15/l30 0 2024-04-26T11:24:00.079 INFO:tasks.workunit.client.0.smithi073.stdout:9/277: unlink d0/d13/db/c1b 0 2024-04-26T11:24:00.079 INFO:tasks.workunit.client.0.smithi073.stdout:5/228: mknod d4/d8/d9/d42/c52 0 2024-04-26T11:24:00.079 INFO:tasks.workunit.client.0.smithi073.stdout:7/236: unlink d1/f44 0 2024-04-26T11:24:00.080 INFO:tasks.workunit.client.0.smithi073.stdout:6/173: creat d0/d19/f31 x:0 0 0 2024-04-26T11:24:00.080 INFO:tasks.workunit.client.0.smithi073.stdout:3/175: symlink d0/d11/d19/d1d/l3a 0 2024-04-26T11:24:00.082 INFO:tasks.workunit.client.0.smithi073.stdout:9/278: creat d0/d13/f60 x:0 0 0 2024-04-26T11:24:00.082 INFO:tasks.workunit.client.0.smithi073.stdout:9/279: sync 2024-04-26T11:24:00.083 INFO:tasks.workunit.client.0.smithi073.stdout:5/229: truncate d4/de/d23/f44 57341 0 2024-04-26T11:24:00.083 INFO:tasks.workunit.client.0.smithi073.stdout:6/174: symlink d0/d1a/l32 0 2024-04-26T11:24:00.085 INFO:tasks.workunit.client.0.smithi073.stdout:9/280: fsync d0/f8 0 2024-04-26T11:24:00.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/230: mknod d4/de/d23/c53 0 2024-04-26T11:24:00.085 INFO:tasks.workunit.client.0.smithi073.stdout:1/319: dwrite d1/d51/f67 [0,4194304] 0 2024-04-26T11:24:00.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/231: chown d4/de/f49 480992117 1 2024-04-26T11:24:00.086 INFO:tasks.workunit.client.0.smithi073.stdout:9/281: unlink d0/d13/db/d2e/d46/f49 0 2024-04-26T11:24:00.086 INFO:tasks.workunit.client.0.smithi073.stdout:6/175: creat d0/d15/d2d/f33 x:0 0 0 2024-04-26T11:24:00.086 INFO:tasks.workunit.client.0.smithi073.stdout:1/320: write d1/d8/f18 [3053595,116947] 0 2024-04-26T11:24:00.087 INFO:tasks.workunit.client.0.smithi073.stdout:5/232: dread - d4/d8/d9/f46 zero size 2024-04-26T11:24:00.087 INFO:tasks.workunit.client.0.smithi073.stdout:9/282: write d0/d13/f20 [6888110,126803] 0 2024-04-26T11:24:00.087 INFO:tasks.workunit.client.0.smithi073.stdout:6/176: symlink d0/l34 0 2024-04-26T11:24:00.088 INFO:tasks.workunit.client.0.smithi073.stdout:1/321: unlink d1/d6/c5b 0 2024-04-26T11:24:00.089 INFO:tasks.workunit.client.0.smithi073.stdout:9/283: write d0/d13/f18 [4784255,94893] 0 2024-04-26T11:24:00.089 INFO:tasks.workunit.client.0.smithi073.stdout:1/322: unlink d1/d73/f5e 0 2024-04-26T11:24:00.089 INFO:tasks.workunit.client.0.smithi073.stdout:5/233: mkdir d4/de/d23/d4f/d54 0 2024-04-26T11:24:00.089 INFO:tasks.workunit.client.0.smithi073.stdout:4/218: dread d8/fe [0,4194304] 0 2024-04-26T11:24:00.090 INFO:tasks.workunit.client.0.smithi073.stdout:9/284: mknod d0/d13/db/c61 0 2024-04-26T11:24:00.090 INFO:tasks.workunit.client.0.smithi073.stdout:5/234: mknod d4/d8/d9/c55 0 2024-04-26T11:24:00.093 INFO:tasks.workunit.client.0.smithi073.stdout:7/237: dread d1/d33/d1b/f1e [0,4194304] 0 2024-04-26T11:24:00.094 INFO:tasks.workunit.client.0.smithi073.stdout:8/230: dread d1/f6 [4194304,4194304] 0 2024-04-26T11:24:00.095 INFO:tasks.workunit.client.0.smithi073.stdout:3/176: truncate d0/f7 2397293 0 2024-04-26T11:24:00.096 INFO:tasks.workunit.client.0.smithi073.stdout:2/193: dread dd/d1c/f25 [0,4194304] 0 2024-04-26T11:24:00.097 INFO:tasks.workunit.client.0.smithi073.stdout:8/231: read d1/d4/d8/f22 [27355,2491] 0 2024-04-26T11:24:00.098 INFO:tasks.workunit.client.0.smithi073.stdout:8/232: fsync d1/d4/d8/f42 0 2024-04-26T11:24:00.099 INFO:tasks.workunit.client.0.smithi073.stdout:6/177: dwrite d0/dc/f1b [0,4194304] 0 2024-04-26T11:24:00.104 INFO:tasks.workunit.client.0.smithi073.stdout:1/323: dwrite d1/d16/d6a/f72 [0,4194304] 0 2024-04-26T11:24:00.105 INFO:tasks.workunit.client.0.smithi073.stdout:1/324: readlink d1/l24 0 2024-04-26T11:24:00.106 INFO:tasks.workunit.client.0.smithi073.stdout:0/160: dread d2/d22/f33 [0,4194304] 0 2024-04-26T11:24:00.107 INFO:tasks.workunit.client.0.smithi073.stdout:0/161: truncate d2/f31 338330 0 2024-04-26T11:24:00.109 INFO:tasks.workunit.client.0.smithi073.stdout:2/194: dwrite dd/de/ff [0,4194304] 0 2024-04-26T11:24:00.109 INFO:tasks.workunit.client.0.smithi073.stdout:5/235: mknod d4/d8/d9/d42/c56 0 2024-04-26T11:24:00.109 INFO:tasks.workunit.client.0.smithi073.stdout:0/162: dread - d2/d22/f35 zero size 2024-04-26T11:24:00.110 INFO:tasks.workunit.client.0.smithi073.stdout:4/219: link d8/d1a/f2b d8/d1a/f4f 0 2024-04-26T11:24:00.110 INFO:tasks.workunit.client.0.smithi073.stdout:8/233: dwrite d1/f18 [8388608,4194304] 0 2024-04-26T11:24:00.110 INFO:tasks.workunit.client.0.smithi073.stdout:1/325: rmdir d1/d16/d4f/d55 39 2024-04-26T11:24:00.111 INFO:tasks.workunit.client.0.smithi073.stdout:3/177: write d0/d11/d19/f28 [3285533,21470] 0 2024-04-26T11:24:00.111 INFO:tasks.workunit.client.0.smithi073.stdout:8/234: dread - d1/d4/d37/f48 zero size 2024-04-26T11:24:00.112 INFO:tasks.workunit.client.0.smithi073.stdout:1/326: write d1/d8/d57/f6d [2678354,110946] 0 2024-04-26T11:24:00.116 INFO:tasks.workunit.client.0.smithi073.stdout:3/178: rmdir d0/d26/d2c 39 2024-04-26T11:24:00.116 INFO:tasks.workunit.client.0.smithi073.stdout:8/235: rename d1/d4/d8 to d1/d21/d50 0 2024-04-26T11:24:00.117 INFO:tasks.workunit.client.0.smithi073.stdout:5/236: chown d4/de/d14/l25 233838179 1 2024-04-26T11:24:00.117 INFO:tasks.workunit.client.0.smithi073.stdout:0/163: mkdir d2/d37/d3c 0 2024-04-26T11:24:00.117 INFO:tasks.workunit.client.0.smithi073.stdout:3/179: chown d0/l10 0 1 2024-04-26T11:24:00.118 INFO:tasks.workunit.client.0.smithi073.stdout:8/236: stat d1/d4/d37/f40 0 2024-04-26T11:24:00.118 INFO:tasks.workunit.client.0.smithi073.stdout:2/195: rmdir dd/d1c/d1d/d30 39 2024-04-26T11:24:00.118 INFO:tasks.workunit.client.0.smithi073.stdout:4/220: getdents d8/d1f/d25 0 2024-04-26T11:24:00.118 INFO:tasks.workunit.client.0.smithi073.stdout:1/327: getdents d1/d8 0 2024-04-26T11:24:00.119 INFO:tasks.workunit.client.0.smithi073.stdout:3/180: mkdir d0/d11/d23/d3b 0 2024-04-26T11:24:00.119 INFO:tasks.workunit.client.0.smithi073.stdout:0/164: creat d2/f3d x:0 0 0 2024-04-26T11:24:00.119 INFO:tasks.workunit.client.0.smithi073.stdout:0/165: stat d2/d1f/l30 0 2024-04-26T11:24:00.120 INFO:tasks.workunit.client.0.smithi073.stdout:0/166: chown d2 10936 1 2024-04-26T11:24:00.120 INFO:tasks.workunit.client.0.smithi073.stdout:1/328: truncate d1/d6/f22 1423962 0 2024-04-26T11:24:00.120 INFO:tasks.workunit.client.0.smithi073.stdout:3/181: getdents d0 0 2024-04-26T11:24:00.121 INFO:tasks.workunit.client.0.smithi073.stdout:0/167: rename d2/d22/c38 to d2/d37/d3c/c3e 0 2024-04-26T11:24:00.121 INFO:tasks.workunit.client.0.smithi073.stdout:1/329: dread - d1/d16/d4f/d55/f64 zero size 2024-04-26T11:24:00.121 INFO:tasks.workunit.client.0.smithi073.stdout:2/196: write dd/de/f28 [1690499,125746] 0 2024-04-26T11:24:00.122 INFO:tasks.workunit.client.0.smithi073.stdout:2/197: readlink dd/d1c/l26 0 2024-04-26T11:24:00.126 INFO:tasks.workunit.client.0.smithi073.stdout:0/168: creat d2/f3f x:0 0 0 2024-04-26T11:24:00.126 INFO:tasks.workunit.client.0.smithi073.stdout:1/330: rename d1/d6/d6e to d1/d6/d7f 0 2024-04-26T11:24:00.127 INFO:tasks.workunit.client.0.smithi073.stdout:2/198: write f5 [1901164,121052] 0 2024-04-26T11:24:00.127 INFO:tasks.workunit.client.0.smithi073.stdout:0/169: chown d2/l3a 202150759 1 2024-04-26T11:24:00.127 INFO:tasks.workunit.client.0.smithi073.stdout:1/331: unlink d1/d8/d57/f6d 0 2024-04-26T11:24:00.127 INFO:tasks.workunit.client.0.smithi073.stdout:2/199: rmdir dd/d1c/d1d 39 2024-04-26T11:24:00.127 INFO:tasks.workunit.client.0.smithi073.stdout:4/221: dwrite d8/d1a/d1b/f26 [0,4194304] 0 2024-04-26T11:24:00.127 INFO:tasks.workunit.client.0.smithi073.stdout:0/170: write d2/ff [652803,97491] 0 2024-04-26T11:24:00.128 INFO:tasks.workunit.client.0.smithi073.stdout:4/222: chown d8/f2e 54414 1 2024-04-26T11:24:00.128 INFO:tasks.workunit.client.0.smithi073.stdout:8/237: dwrite d1/d21/d2a/f2b [4194304,4194304] 0 2024-04-26T11:24:00.128 INFO:tasks.workunit.client.0.smithi073.stdout:3/182: dwrite d0/f2e [0,4194304] 0 2024-04-26T11:24:00.131 INFO:tasks.workunit.client.0.smithi073.stdout:0/171: write d2/f11 [1866946,86691] 0 2024-04-26T11:24:00.132 INFO:tasks.workunit.client.0.smithi073.stdout:3/183: write d0/d11/d19/db/f37 [114460,8544] 0 2024-04-26T11:24:00.132 INFO:tasks.workunit.client.0.smithi073.stdout:2/200: write dd/d1c/d1d/d30/f3c [565370,96943] 0 2024-04-26T11:24:00.132 INFO:tasks.workunit.client.0.smithi073.stdout:0/172: fdatasync d2/d22/f2a 0 2024-04-26T11:24:00.133 INFO:tasks.workunit.client.0.smithi073.stdout:7/238: dread d1/d11/f1c [0,4194304] 0 2024-04-26T11:24:00.133 INFO:tasks.workunit.client.0.smithi073.stdout:7/239: readlink d1/d33/d1b/l2a 0 2024-04-26T11:24:00.136 INFO:tasks.workunit.client.0.smithi073.stdout:0/173: mkdir d2/d1f/d40 0 2024-04-26T11:24:00.136 INFO:tasks.workunit.client.0.smithi073.stdout:3/184: mkdir d0/d11/d23/d3b/d3c 0 2024-04-26T11:24:00.137 INFO:tasks.workunit.client.0.smithi073.stdout:0/174: write d2/d1f/f28 [1628433,72929] 0 2024-04-26T11:24:00.137 INFO:tasks.workunit.client.0.smithi073.stdout:7/240: mkdir d1/d11/d55 0 2024-04-26T11:24:00.138 INFO:tasks.workunit.client.0.smithi073.stdout:0/175: dread - d2/d22/f39 zero size 2024-04-26T11:24:00.139 INFO:tasks.workunit.client.0.smithi073.stdout:2/201: dwrite dd/f1a [0,4194304] 0 2024-04-26T11:24:00.143 INFO:tasks.workunit.client.0.smithi073.stdout:0/176: rename d2/c8 to d2/d37/d3c/c41 0 2024-04-26T11:24:00.146 INFO:tasks.workunit.client.0.smithi073.stdout:5/237: rmdir d4/d8 39 2024-04-26T11:24:00.147 INFO:tasks.workunit.client.0.smithi073.stdout:9/285: truncate d0/d13/f20 2493109 0 2024-04-26T11:24:00.147 INFO:tasks.workunit.client.0.smithi073.stdout:2/202: creat dd/de/f41 x:0 0 0 2024-04-26T11:24:00.148 INFO:tasks.workunit.client.0.smithi073.stdout:8/238: write d1/d21/d50/f22 [547233,70759] 0 2024-04-26T11:24:00.148 INFO:tasks.workunit.client.0.smithi073.stdout:2/203: stat dd/de/d38/l3e 0 2024-04-26T11:24:00.148 INFO:tasks.workunit.client.0.smithi073.stdout:1/332: sync 2024-04-26T11:24:00.148 INFO:tasks.workunit.client.0.smithi073.stdout:9/286: rmdir d0/d13/db/d2e 39 2024-04-26T11:24:00.149 INFO:tasks.workunit.client.0.smithi073.stdout:8/239: stat d1/d21/d50/l28 0 2024-04-26T11:24:00.149 INFO:tasks.workunit.client.0.smithi073.stdout:1/333: fsync d1/d8/f2d 0 2024-04-26T11:24:00.149 INFO:tasks.workunit.client.0.smithi073.stdout:9/287: chown d0/d13/l17 0 1 2024-04-26T11:24:00.149 INFO:tasks.workunit.client.0.smithi073.stdout:2/204: dread - dd/d1c/d1d/f20 zero size 2024-04-26T11:24:00.149 INFO:tasks.workunit.client.0.smithi073.stdout:9/288: write d0/d13/f22 [3471374,55390] 0 2024-04-26T11:24:00.151 INFO:tasks.workunit.client.0.smithi073.stdout:4/223: dread d8/d15/f3f [0,4194304] 0 2024-04-26T11:24:00.151 INFO:tasks.workunit.client.0.smithi073.stdout:8/240: creat d1/d21/d2c/f51 x:0 0 0 2024-04-26T11:24:00.152 INFO:tasks.workunit.client.0.smithi073.stdout:9/289: write d0/d13/d25/d2c/f3a [3632136,54731] 0 2024-04-26T11:24:00.153 INFO:tasks.workunit.client.0.smithi073.stdout:2/205: creat dd/d1c/d1d/d17/f42 x:0 0 0 2024-04-26T11:24:00.154 INFO:tasks.workunit.client.0.smithi073.stdout:6/178: dread d0/f16 [0,4194304] 0 2024-04-26T11:24:00.154 INFO:tasks.workunit.client.0.smithi073.stdout:4/224: truncate d8/d1f/d23/f45 3029 0 2024-04-26T11:24:00.155 INFO:tasks.workunit.client.0.smithi073.stdout:2/206: chown dd/de/f41 0 1 2024-04-26T11:24:00.155 INFO:tasks.workunit.client.0.smithi073.stdout:6/179: chown d0/d19/f31 345112935 1 2024-04-26T11:24:00.156 INFO:tasks.workunit.client.0.smithi073.stdout:5/238: dwrite d4/de/d14/f1c [0,4194304] 0 2024-04-26T11:24:00.157 INFO:tasks.workunit.client.0.smithi073.stdout:3/185: truncate d0/f7 2840908 0 2024-04-26T11:24:00.158 INFO:tasks.workunit.client.0.smithi073.stdout:1/334: dwrite d1/f2b [0,4194304] 0 2024-04-26T11:24:00.158 INFO:tasks.workunit.client.0.smithi073.stdout:4/225: write d8/d1a/d1b/d24/f2d [231904,70902] 0 2024-04-26T11:24:00.158 INFO:tasks.workunit.client.0.smithi073.stdout:6/180: stat d0/c10 0 2024-04-26T11:24:00.159 INFO:tasks.workunit.client.0.smithi073.stdout:1/335: dread - d1/d16/d4f/f79 zero size 2024-04-26T11:24:00.160 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:00.154+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:00.161 INFO:tasks.workunit.client.0.smithi073.stdout:8/241: dwrite d1/d4/d37/f40 [0,4194304] 0 2024-04-26T11:24:00.164 INFO:tasks.workunit.client.0.smithi073.stdout:3/186: mknod d0/d11/d23/d3b/c3d 0 2024-04-26T11:24:00.164 INFO:tasks.workunit.client.0.smithi073.stdout:4/226: creat d8/d15/d1c/f50 x:0 0 0 2024-04-26T11:24:00.164 INFO:tasks.workunit.client.0.smithi073.stdout:6/181: rename d0/d15/l17 to d0/d19/l35 0 2024-04-26T11:24:00.164 INFO:tasks.workunit.client.0.smithi073.stdout:7/241: dread d1/d33/ff [0,4194304] 0 2024-04-26T11:24:00.164 INFO:tasks.workunit.client.0.smithi073.stdout:8/242: creat d1/d21/d2a/f52 x:0 0 0 2024-04-26T11:24:00.165 INFO:tasks.workunit.client.0.smithi073.stdout:5/239: symlink d4/de/d23/d4f/d54/l57 0 2024-04-26T11:24:00.165 INFO:tasks.workunit.client.0.smithi073.stdout:6/182: chown d0/d15 130570 1 2024-04-26T11:24:00.165 INFO:tasks.workunit.client.0.smithi073.stdout:1/336: chown d1/d73/d40/d44 46 1 2024-04-26T11:24:00.165 INFO:tasks.workunit.client.0.smithi073.stdout:8/243: mkdir d1/d4/d53 0 2024-04-26T11:24:00.165 INFO:tasks.workunit.client.0.smithi073.stdout:6/183: mknod d0/c36 0 2024-04-26T11:24:00.166 INFO:tasks.workunit.client.0.smithi073.stdout:5/240: write d4/de/d15/d33/f40 [1158569,29405] 0 2024-04-26T11:24:00.166 INFO:tasks.workunit.client.0.smithi073.stdout:6/184: chown d0/dc/l13 619494069 1 2024-04-26T11:24:00.166 INFO:tasks.workunit.client.0.smithi073.stdout:6/185: chown d0 2 1 2024-04-26T11:24:00.167 INFO:tasks.workunit.client.0.smithi073.stdout:6/186: fsync d0/d19/d20/f22 0 2024-04-26T11:24:00.167 INFO:tasks.workunit.client.0.smithi073.stdout:7/242: creat d1/d11/d24/d26/d4b/f56 x:0 0 0 2024-04-26T11:24:00.168 INFO:tasks.workunit.client.0.smithi073.stdout:6/187: read d0/dc/f1b [1089367,99333] 0 2024-04-26T11:24:00.168 INFO:tasks.workunit.client.0.smithi073.stdout:7/243: mknod d1/d11/d24/d29/c57 0 2024-04-26T11:24:00.169 INFO:tasks.workunit.client.0.smithi073.stdout:7/244: chown d1/d11/d10/l52 324202442 1 2024-04-26T11:24:00.169 INFO:tasks.workunit.client.0.smithi073.stdout:7/245: chown d1/d33 2535 1 2024-04-26T11:24:00.170 INFO:tasks.workunit.client.0.smithi073.stdout:1/337: write d1/d73/d40/f28 [4023979,74192] 0 2024-04-26T11:24:00.170 INFO:tasks.workunit.client.0.smithi073.stdout:4/227: dwrite d8/f2e [0,4194304] 0 2024-04-26T11:24:00.172 INFO:tasks.workunit.client.0.smithi073.stdout:7/246: truncate d1/d33/d1f/d3c/f4c 49892 0 2024-04-26T11:24:00.174 INFO:tasks.workunit.client.0.smithi073.stdout:5/241: dwrite d4/de/d15/f34 [0,4194304] 0 2024-04-26T11:24:00.174 INFO:tasks.workunit.client.0.smithi073.stdout:7/247: unlink d1/d33/d1b/l2a 0 2024-04-26T11:24:00.174 INFO:tasks.workunit.client.0.smithi073.stdout:3/187: dwrite d0/d11/d19/f27 [0,4194304] 0 2024-04-26T11:24:00.175 INFO:tasks.workunit.client.0.smithi073.stdout:7/248: dread - d1/d11/d24/d26/d3d/f4f zero size 2024-04-26T11:24:00.176 INFO:tasks.workunit.client.0.smithi073.stdout:7/249: symlink d1/l58 0 2024-04-26T11:24:00.176 INFO:tasks.workunit.client.0.smithi073.stdout:5/242: symlink d4/de/d23/d3b/l58 0 2024-04-26T11:24:00.176 INFO:tasks.workunit.client.0.smithi073.stdout:3/188: rename d0/d26/d2c to d0/d11/d19/db/d3e 0 2024-04-26T11:24:00.177 INFO:tasks.workunit.client.0.smithi073.stdout:5/243: chown d4/de/d23/d4f/d54 111438738 1 2024-04-26T11:24:00.177 INFO:tasks.workunit.client.0.smithi073.stdout:7/250: write d1/d33/d1b/f1e [1415680,8168] 0 2024-04-26T11:24:00.178 INFO:tasks.workunit.client.0.smithi073.stdout:7/251: rename d1/d11/l43 to d1/d11/d55/l59 0 2024-04-26T11:24:00.180 INFO:tasks.workunit.client.0.smithi073.stdout:7/252: symlink d1/d46/d50/l5a 0 2024-04-26T11:24:00.181 INFO:tasks.workunit.client.0.smithi073.stdout:7/253: mknod d1/c5b 0 2024-04-26T11:24:00.183 INFO:tasks.workunit.client.0.smithi073.stdout:7/254: write d1/d33/d1f/d3c/f4c [193706,14177] 0 2024-04-26T11:24:00.183 INFO:tasks.workunit.client.0.smithi073.stdout:3/189: dwrite d0/d11/d19/db/f37 [0,4194304] 0 2024-04-26T11:24:00.184 INFO:tasks.workunit.client.0.smithi073.stdout:5/244: dwrite d4/d8/f30 [0,4194304] 0 2024-04-26T11:24:00.186 INFO:tasks.workunit.client.0.smithi073.stdout:0/177: dread d2/d1f/f28 [0,4194304] 0 2024-04-26T11:24:00.186 INFO:tasks.workunit.client.0.smithi073.stdout:7/255: rename d1/d11/l7 to d1/d11/d55/l5c 0 2024-04-26T11:24:00.186 INFO:tasks.workunit.client.0.smithi073.stdout:0/178: readlink d2/l3a 0 2024-04-26T11:24:00.187 INFO:tasks.workunit.client.0.smithi073.stdout:0/179: mknod d2/d1f/c42 0 2024-04-26T11:24:00.188 INFO:tasks.workunit.client.0.smithi073.stdout:0/180: mknod d2/d1f/c43 0 2024-04-26T11:24:00.189 INFO:tasks.workunit.client.0.smithi073.stdout:7/256: dread d1/d11/fd [0,4194304] 0 2024-04-26T11:24:00.190 INFO:tasks.workunit.client.0.smithi073.stdout:0/181: creat d2/d1f/d40/f44 x:0 0 0 2024-04-26T11:24:00.190 INFO:tasks.workunit.client.0.smithi073.stdout:0/182: dread - d2/d22/f2a zero size 2024-04-26T11:24:00.191 INFO:tasks.workunit.client.0.smithi073.stdout:0/183: stat d2/d1f/d40/f44 0 2024-04-26T11:24:00.191 INFO:tasks.workunit.client.0.smithi073.stdout:0/184: creat d2/d37/f45 x:0 0 0 2024-04-26T11:24:00.192 INFO:tasks.workunit.client.0.smithi073.stdout:0/185: rename d2/d1f/c43 to d2/d1f/d40/c46 0 2024-04-26T11:24:00.192 INFO:tasks.workunit.client.0.smithi073.stdout:0/186: truncate d2/f3f 121794 0 2024-04-26T11:24:00.193 INFO:tasks.workunit.client.0.smithi073.stdout:0/187: creat d2/d37/d3c/f47 x:0 0 0 2024-04-26T11:24:00.193 INFO:tasks.workunit.client.0.smithi073.stdout:8/244: sync 2024-04-26T11:24:00.193 INFO:tasks.workunit.client.0.smithi073.stdout:6/188: sync 2024-04-26T11:24:00.193 INFO:tasks.workunit.client.0.smithi073.stdout:4/228: sync 2024-04-26T11:24:00.193 INFO:tasks.workunit.client.0.smithi073.stdout:3/190: sync 2024-04-26T11:24:00.194 INFO:tasks.workunit.client.0.smithi073.stdout:4/229: chown c6 1004 1 2024-04-26T11:24:00.194 INFO:tasks.workunit.client.0.smithi073.stdout:7/257: read d1/d11/f36 [392706,28845] 0 2024-04-26T11:24:00.194 INFO:tasks.workunit.client.0.smithi073.stdout:4/230: mkdir d8/d15/d1c/d51 0 2024-04-26T11:24:00.194 INFO:tasks.workunit.client.0.smithi073.stdout:0/188: mkdir d2/d1f/d40/d48 0 2024-04-26T11:24:00.195 INFO:tasks.workunit.client.0.smithi073.stdout:6/189: dread d0/f16 [4194304,4194304] 0 2024-04-26T11:24:00.195 INFO:tasks.workunit.client.0.smithi073.stdout:6/190: fdatasync d0/d19/f21 0 2024-04-26T11:24:00.196 INFO:tasks.workunit.client.0.smithi073.stdout:7/258: rename d1/d33/d1f to d1/d11/d24/d26/d3d/d5d 0 2024-04-26T11:24:00.196 INFO:tasks.workunit.client.0.smithi073.stdout:0/189: symlink d2/d1f/d40/d48/l49 0 2024-04-26T11:24:00.197 INFO:tasks.workunit.client.0.smithi073.stdout:6/191: mknod d0/d19/d20/c37 0 2024-04-26T11:24:00.197 INFO:tasks.workunit.client.0.smithi073.stdout:7/259: mkdir d1/d11/d5e 0 2024-04-26T11:24:00.198 INFO:tasks.workunit.client.0.smithi073.stdout:6/192: mkdir d0/dc/d1d/d38 0 2024-04-26T11:24:00.200 INFO:tasks.workunit.client.0.smithi073.stdout:1/338: dread d1/d73/d40/f2c [0,4194304] 0 2024-04-26T11:24:00.203 INFO:tasks.workunit.client.0.smithi073.stdout:9/290: dread d0/d13/f22 [0,4194304] 0 2024-04-26T11:24:00.203 INFO:tasks.workunit.client.0.smithi073.stdout:1/339: read d1/d73/d40/f28 [1808864,91304] 0 2024-04-26T11:24:00.204 INFO:tasks.workunit.client.0.smithi073.stdout:4/231: dwrite d8/d1f/d34/f42 [0,4194304] 0 2024-04-26T11:24:00.206 INFO:tasks.workunit.client.0.smithi073.stdout:3/191: dwrite d0/d11/f13 [0,4194304] 0 2024-04-26T11:24:00.207 INFO:tasks.workunit.client.0.smithi073.stdout:9/291: truncate d0/d3c/f43 591450 0 2024-04-26T11:24:00.207 INFO:tasks.workunit.client.0.smithi073.stdout:0/190: dwrite d2/d22/f2a [0,4194304] 0 2024-04-26T11:24:00.208 INFO:tasks.workunit.client.0.smithi073.stdout:4/232: write f7 [2500500,43871] 0 2024-04-26T11:24:00.208 INFO:tasks.workunit.client.0.smithi073.stdout:0/191: sync 2024-04-26T11:24:00.208 INFO:tasks.workunit.client.0.smithi073.stdout:3/192: write d0/d26/f29 [2739357,115975] 0 2024-04-26T11:24:00.209 INFO:tasks.workunit.client.0.smithi073.stdout:2/207: dread f5 [0,4194304] 0 2024-04-26T11:24:00.209 INFO:tasks.workunit.client.0.smithi073.stdout:1/340: mkdir d1/d73/d40/d44/d80 0 2024-04-26T11:24:00.209 INFO:tasks.workunit.client.0.smithi073.stdout:2/208: sync 2024-04-26T11:24:00.209 INFO:tasks.workunit.client.0.smithi073.stdout:7/260: dwrite d1/d11/f36 [0,4194304] 0 2024-04-26T11:24:00.209 INFO:tasks.workunit.client.0.smithi073.stdout:0/192: read - d2/d37/f45 zero size 2024-04-26T11:24:00.210 INFO:tasks.workunit.client.0.smithi073.stdout:2/209: fsync dd/d27/f31 0 2024-04-26T11:24:00.210 INFO:tasks.workunit.client.0.smithi073.stdout:4/233: mknod d8/d15/d1c/d51/c52 0 2024-04-26T11:24:00.210 INFO:tasks.workunit.client.0.smithi073.stdout:1/341: chown d1/d16/d6a 0 1 2024-04-26T11:24:00.210 INFO:tasks.workunit.client.0.smithi073.stdout:9/292: getdents d0 0 2024-04-26T11:24:00.210 INFO:tasks.workunit.client.0.smithi073.stdout:9/293: chown d0/d3c 130 1 2024-04-26T11:24:00.212 INFO:tasks.workunit.client.0.smithi073.stdout:7/261: creat d1/d11/d24/d26/d3d/d5d/d3c/f5f x:0 0 0 2024-04-26T11:24:00.212 INFO:tasks.workunit.client.0.smithi073.stdout:9/294: fdatasync d0/d13/f20 0 2024-04-26T11:24:00.212 INFO:tasks.workunit.client.0.smithi073.stdout:4/234: link d8/d1a/d1b/d24/f4a d8/d15/d1c/d51/f53 0 2024-04-26T11:24:00.213 INFO:tasks.workunit.client.0.smithi073.stdout:1/342: creat d1/d73/d40/f81 x:0 0 0 2024-04-26T11:24:00.213 INFO:tasks.workunit.client.0.smithi073.stdout:2/210: write dd/d1c/d1d/f35 [353275,66979] 0 2024-04-26T11:24:00.213 INFO:tasks.workunit.client.0.smithi073.stdout:4/235: readlink d8/d1a/d1b/l20 0 2024-04-26T11:24:00.213 INFO:tasks.workunit.client.0.smithi073.stdout:4/236: chown d8/f13 43549 1 2024-04-26T11:24:00.215 INFO:tasks.workunit.client.0.smithi073.stdout:6/193: rename d0/dc/d1d to d0/d39 0 2024-04-26T11:24:00.215 INFO:tasks.workunit.client.0.smithi073.stdout:4/237: fsync d8/fe 0 2024-04-26T11:24:00.215 INFO:tasks.workunit.client.0.smithi073.stdout:7/262: mknod d1/d33/c60 0 2024-04-26T11:24:00.215 INFO:tasks.workunit.client.0.smithi073.stdout:7/263: sync 2024-04-26T11:24:00.216 INFO:tasks.workunit.client.0.smithi073.stdout:3/193: dwrite d0/d26/f29 [0,4194304] 0 2024-04-26T11:24:00.218 INFO:tasks.workunit.client.0.smithi073.stdout:4/238: rmdir d8/d1f/d34/d37 39 2024-04-26T11:24:00.218 INFO:tasks.workunit.client.0.smithi073.stdout:7/264: write d1/d11/f1c [3847177,117437] 0 2024-04-26T11:24:00.219 INFO:tasks.workunit.client.0.smithi073.stdout:3/194: rmdir d0/d34 39 2024-04-26T11:24:00.219 INFO:tasks.workunit.client.0.smithi073.stdout:2/211: creat dd/d1c/f43 x:0 0 0 2024-04-26T11:24:00.220 INFO:tasks.workunit.client.0.smithi073.stdout:6/194: link d0/f16 d0/dc/d2e/f3a 0 2024-04-26T11:24:00.220 INFO:tasks.workunit.client.0.smithi073.stdout:0/193: read d2/f15 [560510,105056] 0 2024-04-26T11:24:00.220 INFO:tasks.workunit.client.0.smithi073.stdout:6/195: chown d0/f16 1618 1 2024-04-26T11:24:00.221 INFO:tasks.workunit.client.0.smithi073.stdout:6/196: write d0/d19/f31 [464882,2628] 0 2024-04-26T11:24:00.221 INFO:tasks.workunit.client.0.smithi073.stdout:1/343: dwrite d1/d73/d40/d44/f4e [4194304,4194304] 0 2024-04-26T11:24:00.222 INFO:tasks.workunit.client.0.smithi073.stdout:6/197: write d0/d15/d2d/f33 [425241,27491] 0 2024-04-26T11:24:00.223 INFO:tasks.workunit.client.0.smithi073.stdout:4/239: mknod d8/d1a/d1b/d1d/c54 0 2024-04-26T11:24:00.223 INFO:tasks.workunit.client.0.smithi073.stdout:0/194: rmdir d2/d37 39 2024-04-26T11:24:00.224 INFO:tasks.workunit.client.0.smithi073.stdout:0/195: sync 2024-04-26T11:24:00.224 INFO:tasks.workunit.client.0.smithi073.stdout:7/265: link d1/d33/d1b/l27 d1/d11/d24/d26/d3d/l61 0 2024-04-26T11:24:00.225 INFO:tasks.workunit.client.0.smithi073.stdout:9/295: dwrite d0/d13/db/d2e/d3b/f4d [0,4194304] 0 2024-04-26T11:24:00.225 INFO:tasks.workunit.client.0.smithi073.stdout:4/240: symlink d8/d15/d1c/d51/l55 0 2024-04-26T11:24:00.227 INFO:tasks.workunit.client.0.smithi073.stdout:2/212: dwrite dd/de/f41 [0,4194304] 0 2024-04-26T11:24:00.228 INFO:tasks.workunit.client.0.smithi073.stdout:2/213: fdatasync dd/d27/f31 0 2024-04-26T11:24:00.230 INFO:tasks.workunit.client.0.smithi073.stdout:4/241: creat d8/d1a/d1b/d1d/f56 x:0 0 0 2024-04-26T11:24:00.230 INFO:tasks.workunit.client.0.smithi073.stdout:0/196: creat d2/d1f/d40/d48/f4a x:0 0 0 2024-04-26T11:24:00.230 INFO:tasks.workunit.client.0.smithi073.stdout:5/245: dread d4/de/d14/f31 [0,4194304] 0 2024-04-26T11:24:00.233 INFO:tasks.workunit.client.0.smithi073.stdout:5/246: fdatasync d4/f20 0 2024-04-26T11:24:00.233 INFO:tasks.workunit.client.0.smithi073.stdout:2/214: creat dd/d1c/d1d/f44 x:0 0 0 2024-04-26T11:24:00.234 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:00.234 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:24:00.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:24:00.234 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:00.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.234 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 1284087~3916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.234 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:00.234 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.81853910100000005, 2024-04-26T11:24:00.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075641310000000003, 2024-04-26T11:24:00.235 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.235 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.235 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:00.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413130+0000", 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6770000000000001e-06 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413138+0000", 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.277e-06 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413143+0000", 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5609999999999998e-06 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478754+0000", 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065610702000000007 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478846+0000", 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1525000000000002e-05 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478916+0000", 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0630000000000006e-05 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481402+0000", 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00248577 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488675+0000", 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007273219 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488724+0000", 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8525e-05 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488764+0000", 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0095000000000002e-05 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.239 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 1288003~3903 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.81851216800000004, 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075709753000000005, 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413158+0000", 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413175+0000", 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7008999999999999e-05 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413181+0000", 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479410+0000", 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066228713999999994 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479498+0000", 2024-04-26T11:24:00.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7478000000000005e-05 2024-04-26T11:24:00.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479629+0000", 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013174500000000001 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482049+0000", 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024196249999999999 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488812+0000", 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067625810000000001 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488842+0000", 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0281e-05 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488859+0000", 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7306e-05 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 1291906~6986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.81847449500000002, 2024-04-26T11:24:00.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079787192000000007, 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:00.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413195+0000", 2024-04-26T11:24:00.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:24:00.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413204+0000", 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7839999999999992e-06 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413210+0000", 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8440000000000003e-06 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480166+0000", 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066956565999999995 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480263+0000", 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6997999999999995e-05 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480359+0000", 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5858000000000003e-05 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482071+0000", 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001711918 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492877+0000", 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010805465 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492942+0000", 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5456999999999993e-05 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492974+0000", 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2162000000000001e-05 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.250 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.251 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.251 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 1298892~7865 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.251 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:00.251 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.81844643699999997, 2024-04-26T11:24:00.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080075681999999995, 2024-04-26T11:24:00.251 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.251 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.251 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413225+0000", 2024-04-26T11:24:00.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0767e-05 2024-04-26T11:24:00.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413233+0000", 2024-04-26T11:24:00.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4540000000000001e-06 2024-04-26T11:24:00.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413239+0000", 2024-04-26T11:24:00.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0959999999999997e-06 2024-04-26T11:24:00.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480790+0000", 2024-04-26T11:24:00.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067551471000000002 2024-04-26T11:24:00.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480867+0000", 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6334000000000005e-05 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480982+0000", 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115395 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484440+0000", 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003458259 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493045+0000", 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086047999999999993 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493113+0000", 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8040000000000006e-05 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493291+0000", 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017755900000000001 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.256 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 1306757~7740 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.81552836200000001, 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.085136109000000001, 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416132+0000", 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416221+0000", 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8979000000000003e-05 2024-04-26T11:24:00.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416233+0000", 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.202e-05 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416242+0000", 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3299999999999999e-06 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481553+0000", 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065311285999999996 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481603+0000", 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0191000000000001e-05 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481668+0000", 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4961000000000004e-05 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484444+0000", 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027755100000000001 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501161+0000", 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016716992999999999 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501229+0000", 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8664000000000005e-05 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501269+0000", 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9956999999999997e-05 2024-04-26T11:24:00.261 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 1314497~14459 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.81474675900000004, 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.084463892999999998, 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:00.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416914+0000", 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416932+0000", 2024-04-26T11:24:00.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:24:00.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416943+0000", 2024-04-26T11:24:00.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0456e-05 2024-04-26T11:24:00.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416950+0000", 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.345e-06 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482123+0000", 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065173399000000007 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482206+0000", 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2589000000000005e-05 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482318+0000", 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011194200000000001 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484979+0000", 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026616019999999999 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501313+0000", 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016333174999999998 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501343+0000", 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0056000000000002e-05 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501379+0000", 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5991999999999997e-05 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 1328956~3568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.267 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.81279048200000004, 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082605777000000005, 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418870+0000", 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418878+0000", 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8629999999999997e-06 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418895+0000", 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6886999999999999e-05 2024-04-26T11:24:00.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418904+0000", 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5769999999999994e-06 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482753+0000", 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063849218999999999 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482799+0000", 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5346999999999998e-05 2024-04-26T11:24:00.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482864+0000", 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5124999999999997e-05 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484984+0000", 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021205820000000002 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501422+0000", 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016438066000000001 2024-04-26T11:24:00.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501457+0000", 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5154999999999998e-05 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501477+0000", 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9417999999999999e-05 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.272 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 1332524~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.81274898500000003, 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082655731999999996, 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:00.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418912+0000", 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418920+0000", 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418927+0000", 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6399999999999997e-06 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418933+0000", 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9270000000000002e-06 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483248+0000", 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064314274000000005 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483345+0000", 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7065000000000007e-05 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483458+0000", 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113285 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484989+0000", 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001531012 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501510+0000", 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016520981000000001 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501535+0000", 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501568+0000", 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2808000000000002e-05 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.277 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 1333928~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.812722893, 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082729079999999997, 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418938+0000", 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418946+0000", 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9929999999999995e-06 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418966+0000", 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0095e-05 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418973+0000", 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483863+0000", 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064890529000000002 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483929+0000", 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5665000000000002e-05 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484000+0000", 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0903999999999997e-05 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485480+0000", 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001480084 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501598+0000", 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016118789000000001 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501631+0000", 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3015000000000002e-05 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501668+0000", 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6239999999999999e-05 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.282 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 1336693~3915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.81257328100000004, 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082682631000000006, 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:00.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419095+0000", 2024-04-26T11:24:00.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7219999999999999e-06 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419120+0000", 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4854e-05 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419127+0000", 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4540000000000004e-06 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484461+0000", 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065334619999999996 2024-04-26T11:24:00.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484507+0000", 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5906999999999999e-05 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484612+0000", 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104813 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.486851+0000", 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022388479999999999 2024-04-26T11:24:00.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501706+0000", 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014855419999999999 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501734+0000", 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7617999999999999e-05 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501771+0000", 2024-04-26T11:24:00.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 1340608~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.80956582700000002, 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079811516999999998, 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422094+0000", 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422107+0000", 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2762000000000001e-05 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422121+0000", 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3784999999999999e-05 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422134+0000", 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3304e-05 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485009+0000", 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.062874860000000005 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485053+0000", 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3949000000000002e-05 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485172+0000", 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011921699999999999 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487692+0000", 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025201939999999999 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501818+0000", 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014125499 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501864+0000", 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6403999999999998e-05 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501907+0000", 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3266000000000002e-05 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:558 3.2 3:4272d415:::200.0000000b:head [write 1343057~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.80951722999999998, 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079859576000000002, 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422153+0000", 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909999999999999e-06 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422161+0000", 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4319999999999999e-06 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422168+0000", 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485516+0000", 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063348074000000004 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485624+0000", 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485781+0000", 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015710100000000001 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487700+0000", 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001918746 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501949+0000", 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014249114 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501973+0000", 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4627e-05 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502004+0000", 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:559 3.2 3:4272d415:::200.0000000b:head [write 1345015~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.80948817200000001, 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079931344000000001, 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.298 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422183+0000", 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8959999999999998e-06 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422190+0000", 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7669999999999998e-06 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422195+0000", 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.011e-06 2024-04-26T11:24:00.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487222+0000", 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065027153000000004 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487263+0000", 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1201000000000001e-05 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487330+0000", 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6507999999999994e-05 2024-04-26T11:24:00.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488866+0000", 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001536747 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502050+0000", 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013183540000000001 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502085+0000", 2024-04-26T11:24:00.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4952e-05 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502105+0000", 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9947999999999999e-05 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:560 3.2 3:4272d415:::200.0000000b:head [write 1349228~3445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.809461349, 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079997483999999994, 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.303 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422208+0000", 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0309999999999998e-06 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422214+0000", 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6560000000000003e-06 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422220+0000", 2024-04-26T11:24:00.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6489999999999996e-06 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487739+0000", 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065519226 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487833+0000", 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4106999999999999e-05 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487972+0000", 2024-04-26T11:24:00.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013830099999999999 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492072+0000", 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040998379999999997 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502140+0000", 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010068238 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502165+0000", 2024-04-26T11:24:00.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5454999999999999e-05 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502198+0000", 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2478999999999999e-05 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:561 3.2 3:4272d415:::200.0000000b:head [write 1352673~4505 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.80943442200000004, 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080048127999999996, 2024-04-26T11:24:00.308 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422235+0000", 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422242+0000", 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7670000000000003e-06 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422248+0000", 2024-04-26T11:24:00.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488886+0000", 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066638785000000006 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488982+0000", 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5387e-05 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489141+0000", 2024-04-26T11:24:00.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015913400000000001 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492079+0000", 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029382509999999998 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502233+0000", 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010154379 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502259+0000", 2024-04-26T11:24:00.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5029999999999999e-05 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502275+0000", 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6735000000000002e-05 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:562 3.2 3:4272d415:::200.0000000b:head [write 1357178~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.80940804300000002, 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080110050000000002, 2024-04-26T11:24:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422253+0000", 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422257+0000", 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422263+0000", 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0580000000000003e-06 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422268+0000", 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489892+0000", 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067623600000000006 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490047+0000", 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154933 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490335+0000", 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028846200000000002 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497761+0000", 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074257460000000004 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502307+0000", 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045457910000000004 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502331+0000", 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4601e-05 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502364+0000", 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2224000000000002e-05 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:563 3.2 3:4272d415:::200.0000000b:head [write 1358582~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:00.318 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.80938869599999996, 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080161018000000001, 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422272+0000", 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422280+0000", 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0250000000000002e-06 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422288+0000", 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422293+0000", 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3669999999999996e-06 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491197+0000", 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068903765000000006 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491329+0000", 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013223400000000001 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491443+0000", 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114159 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497769+0000", 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063253190000000003 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502392+0000", 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004622915 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502415+0000", 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3626e-05 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502434+0000", 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8703999999999999e-05 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:564 3.2 3:4272d415:::200.0000000b:head [write 1360496~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.323 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.80936145500000001, 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080221908999999994, 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422304+0000", 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9360000000000001e-06 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422311+0000", 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:24:00.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422317+0000", 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492152+0000", 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069834487000000001 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492258+0000", 2024-04-26T11:24:00.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106351 2024-04-26T11:24:00.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492423+0000", 2024-04-26T11:24:00.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016443600000000001 2024-04-26T11:24:00.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497775+0000", 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053519650000000002 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502465+0000", 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046902660000000002 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502490+0000", 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4777999999999999e-05 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502522+0000", 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2369999999999997e-05 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:565 3.2 3:4272d415:::200.0000000b:head [write 1362424~12956 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.808274414, 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079271854000000003, 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423386+0000", 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423436+0000", 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0121999999999999e-05 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423449+0000", 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2863e-05 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423459+0000", 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493380+0000", 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069921187999999995 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493456+0000", 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6416999999999997e-05 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493584+0000", 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000128009 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499173+0000", 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055883599999999997 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502578+0000", 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034056020000000002 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502625+0000", 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6285000000000002e-05 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502659+0000", 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:566 3.2 3:4272d415:::200.0000000b:head [write 1375380~4794 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.80588436699999999, 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.078877303999999995, 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.336 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425775+0000", 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:00.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425794+0000", 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425810+0000", 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.525e-05 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425821+0000", 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0981e-05 2024-04-26T11:24:00.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494069+0000", 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068247996000000005 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494115+0000", 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310999999999998e-05 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494183+0000", 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7841000000000003e-05 2024-04-26T11:24:00.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499177+0000", 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049940109999999996 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504563+0000", 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053863339999999996 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504614+0000", 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0334999999999998e-05 2024-04-26T11:24:00.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:00.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:00.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:00.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504654+0000", 2024-04-26T11:24:00.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0976000000000002e-05 2024-04-26T11:24:00.341 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.341 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.341 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.341 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:00.341 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:00.341 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:00.343 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:00.340+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:00.344 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:8/245: dread d1/d4/d15/f1f [0,4194304] 0 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/197: write d2/d22/f35 [557678,54369] 0 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:3/195: dwrite d0/d11/d19/f25 [0,4194304] 0 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:8/246: read - d1/d4/d15/f4d zero size 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:5/247: rmdir d4/d8/d9 39 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/198: truncate d2/d1f/d40/d48/f4a 908394 0 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:7/266: dwrite d1/d11/d24/d26/d3d/d5d/d3c/f5f [0,4194304] 0 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:3/196: write d0/d34/f38 [608259,120617] 0 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:8/247: write d1/d21/d2a/f52 [252012,120050] 0 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/199: stat d2/d1f/d40 0 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:5/248: read d4/de/d14/f1c [773671,60545] 0 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:2/215: getdents dd/d1c/d1d/d17 0 2024-04-26T11:24:00.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/200: read - d2/d1f/d40/f44 zero size 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:9/296: dwrite d0/d13/db/f4b [0,4194304] 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:4/242: dwrite d8/d1a/d1b/d24/f2d [0,4194304] 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:5/249: creat d4/de/d23/d4f/f59 x:0 0 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:8/248: mknod d1/d4/c54 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:7/267: mknod d1/d33/c62 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:3/197: mkdir d0/d11/d19/db/d3e/d3f 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:2/216: mknod dd/de/d38/c45 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:9/297: symlink d0/d13/l62 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:8/249: rename d1/f17 to d1/d4/f55 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:3/198: fsync d0/d11/f13 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:6/198: dread d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:2/217: mkdir dd/d1c/d1d/d30/d46 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:7/268: rename d1/f54 to d1/d11/d51/f63 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:6/199: unlink d0/d15/l23 0 2024-04-26T11:24:00.367 INFO:tasks.workunit.client.0.smithi073.stdout:5/250: truncate d4/f1d 2565119 0 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:4/243: rename d8/d1f/d34 to d8/d1a/d1b/d46/d57 0 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:6/200: write d0/f4 [5701623,57364] 0 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:2/218: write dd/f1a [3083303,65937] 0 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:5/251: chown d4/f1d 2604 1 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:3/199: rename d0/d11/d19/cd to d0/d11/d23/d3b/d3c/c40 0 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:0/201: dwrite d2/f3f [0,4194304] 0 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:2/219: read - dd/d1c/d1d/f44 zero size 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:7/269: dread d1/d46/f48 [0,4194304] 0 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:3/200: readlink d0/d11/d19/d1d/l3a 0 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:0/202: chown d2/c1b 13 1 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:4/244: link d8/d15/d1c/f50 d8/d1a/d1b/d41/f58 0 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:0/203: chown d2/f21 1018114948 1 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:2/220: symlink dd/de/d2a/l47 0 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:4/245: write d8/d1a/d1b/d1d/f56 [378979,8162] 0 2024-04-26T11:24:00.368 INFO:tasks.workunit.client.0.smithi073.stdout:7/270: write d1/d11/d51/f63 [4496,126285] 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:8/250: dwrite d1/f6 [0,4194304] 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:2/221: write dd/d1c/d1d/d30/f3c [135194,65644] 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:8/251: stat d1/f18 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:8/252: sync 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:7/271: read d1/d11/d24/d29/f49 [1697455,62466] 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:7/272: chown d1/d46/d50 10927805 1 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:6/201: dwrite d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:2/222: dwrite dd/de/d38/f3d [0,4194304] 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:2/223: truncate dd/d1c/d1d/f44 214356 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:8/253: rename d1/d21/d2c/f51 to d1/d21/d2c/f56 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:7/273: rename d1/d11/d24/d26/d3d/d5d/d3c to d1/d11/d24/d26/d3d/d41/d64 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:6/202: write d0/d1a/d26/d27/f29 [581445,118970] 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:3/201: rmdir d0/d11/d19/db/d3e/d33 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:2/224: rename dd/d1c/d1d/d30 to dd/d1c/d1d/d17/d48 0 2024-04-26T11:24:00.369 INFO:tasks.workunit.client.0.smithi073.stdout:0/204: creat d2/f4b x:0 0 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:2/225: write f0 [2193459,91421] 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:3/202: fdatasync d0/d11/d19/fc 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:0/205: chown d2/lc 264925 1 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:8/254: getdents d1/d4/d15 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:0/206: write d2/ff [2640474,45985] 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:5/252: rename d4/de/d23/l41 to d4/d8/d9/l5a 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:2/226: mkdir dd/de/d49 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:8/255: stat d1/d4/d37/c46 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:3/203: symlink d0/d11/l41 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:6/203: write d0/f16 [4146633,10166] 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:4/246: rename d8/d1a/d1b/d46/d57/d37/c47 to d8/d15/d1c/c59 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:8/256: creat d1/d21/d2c/f57 x:0 0 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:5/253: mknod d4/de/d14/c5b 0 2024-04-26T11:24:00.370 INFO:tasks.workunit.client.0.smithi073.stdout:3/204: truncate d0/d11/d19/f25 4469698 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:2/227: mknod dd/d1c/d1d/c4a 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:7/274: rename d1/d11/d24/d26/d3d/d41/l53 to d1/d11/d51/l65 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:0/207: link d2/f11 d2/d37/d3c/f4c 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:0/208: dread - d2/d1f/f2c zero size 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:7/275: rename d1/d46 to d1/d33/d1b/d66 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:0/209: write d2/f31 [1119833,14837] 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:4/247: mkdir d8/d15/d1c/d49/d5a 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:2/228: mkdir dd/de/d49/d4b 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:6/204: getdents d0/d1a/d26/d27 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:5/254: link d4/de/d14/c5b d4/d8/d9/c5c 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:3/205: rename d0/d11/d19/c8 to d0/d11/d19/db/d3e/d3f/c42 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:4/248: chown d8/d1a/d4d 789839 1 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:0/210: mknod d2/d37/c4d 0 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:0/211: dread - d2/f21 zero size 2024-04-26T11:24:00.371 INFO:tasks.workunit.client.0.smithi073.stdout:8/257: dread d1/f6 [0,4194304] 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:2/229: rename dd/d1c/d1d/d17 to dd/d4c 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:5/255: truncate d4/d8/d9/f1b 4475571 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:4/249: creat d8/d15/d1c/d49/f5b x:0 0 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:0/212: creat d2/d22/f4e x:0 0 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:0/213: sync 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:8/258: fsync d1/d21/d2c/f56 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:0/214: stat d2/l3a 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:4/250: chown d8/d1f/f22 2092 1 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:5/256: truncate d4/d8/d9/f21 1295008 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:0/215: read d2/f11 [2269110,76558] 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:0/216: stat d2/l34 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:4/251: truncate d8/d15/f17 1084491 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:0/217: rename d2/d1f/f32 to d2/f4f 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:1/344: dread d1/d8/d2e/d3c/f3e [0,4194304] 0 2024-04-26T11:24:00.372 INFO:tasks.workunit.client.0.smithi073.stdout:7/276: dwrite d1/d11/d24/d26/d3d/d5d/f28 [0,4194304] 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:0/218: write d2/f21 [778043,41036] 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:5/257: truncate d4/f5 1279808 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:1/345: write d1/d73/d40/d44/f4e [7819886,68047] 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:0/219: write d2/f4b [676351,89335] 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:2/230: dwrite dd/de/f12 [4194304,4194304] 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:3/206: dwrite d0/d11/d19/f6 [0,4194304] 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:8/259: dread d1/f6 [4194304,4194304] 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:2/231: symlink dd/de/d49/l4d 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:5/258: truncate d4/f20 444148 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:1/346: fdatasync d1/d6/fb 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:3/207: mknod d0/d11/d19/db/c43 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:7/277: dread d1/d11/d24/d29/f49 [0,4194304] 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:4/252: dwrite d8/d15/f17 [0,4194304] 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:5/259: unlink d4/d8/d9/f1b 0 2024-04-26T11:24:00.373 INFO:tasks.workunit.client.0.smithi073.stdout:1/347: mknod d1/d6/c82 0 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:2/232: mkdir dd/de/d38/d4e 0 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:3/208: creat d0/d11/d19/d1d/f44 x:0 0 0 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:4/253: mknod d8/d15/c5c 0 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:2/233: stat f0 0 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:1/348: fdatasync d1/d8/f2d 0 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:4/254: readlink d8/l19 0 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:3/209: rmdir d0/d2d 39 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:1/349: dread - d1/d73/d34/f78 zero size 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:2/234: mknod dd/de/d38/d4e/c4f 0 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:1/350: dread - d1/d16/d4f/d55/d5a/f7a zero size 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:2/235: chown dd/d1c/d1d/f20 1 1 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:1/351: fsync d1/d16/d4f/f79 0 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:2/236: dread - dd/d4c/d48/f2d zero size 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:1/352: dread - d1/d73/d34/f43 zero size 2024-04-26T11:24:00.374 INFO:tasks.workunit.client.0.smithi073.stdout:1/353: chown d1/d6/c4b 203805 1 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:4/255: dread d8/d1a/d1b/d24/f2d [0,4194304] 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:0/220: truncate d2/f15 1158519 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:8/260: truncate d1/f2f 3919338 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:7/278: dwrite d1/d33/d1b/f1e [0,4194304] 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:8/261: readlink d1/d4/le 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:1/354: symlink d1/d16/d6a/l83 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:5/260: rename d4/f5 to d4/de/d23/d4f/d54/f5d 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:7/279: unlink d1/d11/d51/l65 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:2/237: link dd/de/d38/c3a dd/de/d38/c50 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:5/261: write d4/de/f2c [698184,121850] 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:1/355: write d1/d16/d4f/d55/d5a/f7a [543601,94983] 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:0/221: dwrite d2/f4b [0,4194304] 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:8/262: getdents d1 0 2024-04-26T11:24:00.375 INFO:tasks.workunit.client.0.smithi073.stdout:7/280: unlink d1/d11/d24/d26/d3d/f4f 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:2/238: creat dd/de/d38/d4e/f51 x:0 0 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:0/222: creat d2/d22/f50 x:0 0 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:5/262: write d4/d8/d9/f46 [376600,3290] 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:7/281: write d1/d11/d24/d29/f49 [1702135,99193] 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:4/256: dwrite d8/d1a/d1b/d1d/f21 [0,4194304] 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:8/263: truncate d1/d21/d2a/f39 5109823 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:0/223: mkdir d2/d22/d51 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:1/356: mkdir d1/d16/d4f/d84 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:0/224: sync 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:7/282: fsync d1/d11/d24/d26/d3d/d41/d64/f42 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:2/239: rename dd/de/d38/c45 to dd/d1c/c52 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:2/240: chown dd/d4c/d48/d46 103217 1 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:1/357: rename d1/d8/d2e/l4d to d1/d6/d7f/l85 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:7/283: dread - d1/d11/d24/d26/d4b/f56 zero size 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:0/225: link d2/d22/f39 d2/d1f/d40/d48/f52 0 2024-04-26T11:24:00.376 INFO:tasks.workunit.client.0.smithi073.stdout:2/241: readlink dd/de/d49/l4d 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:1/358: symlink d1/d6/l86 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:7/284: rename d1/d11/d24/d26/d3d/d5d to d1/d11/d24/d26/d67 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:4/257: dwrite d8/d1a/d1b/d24/f3d [0,4194304] 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:0/226: creat d2/f53 x:0 0 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:0/227: fdatasync d2/f31 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:0/228: sync 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:0/229: dread - d2/d22/f4e zero size 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:4/258: creat d8/d15/d1c/d51/f5d x:0 0 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:3/210: fdatasync d0/d11/d19/f6 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:1/359: link d1/d8/d5d/f70 d1/d73/d40/d54/f87 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:5/263: truncate d4/de/d14/f16 3298179 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:1/360: fsync d1/d73/f23 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:2/242: truncate dd/d1c/f22 334614 0 2024-04-26T11:24:00.377 INFO:tasks.workunit.client.0.smithi073.stdout:3/211: write d0/d11/d19/d1d/f44 [477479,97392] 0 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:7/285: write d1/d11/d24/d26/f2c [2634827,77010] 0 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:2/243: write f5 [7644059,69661] 0 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:4/259: dwrite d8/f2e [0,4194304] 0 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:4/260: sync 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:0/230: dwrite d2/fb [0,4194304] 0 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:7/286: mkdir d1/d33/d68 0 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:5/264: link d4/de/d15/l17 d4/de/l5e 0 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:4/261: fdatasync d8/d1a/d1b/d24/f43 0 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:0/231: readlink d2/l19 0 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:4/262: fsync d8/d15/d1c/f27 0 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:0/232: dread - d2/d22/f4e zero size 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:0/233: write d2/d37/d3c/f47 [26696,31136] 0 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:4/263: chown d8/d15/d1c/d51/f5d 6 1 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:0/234: chown d2/d1f/d40/f44 1306 1 2024-04-26T11:24:00.378 INFO:tasks.workunit.client.0.smithi073.stdout:4/264: write d8/d1a/d1b/d1d/f21 [5452094,98048] 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:2/244: dwrite f0 [0,4194304] 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:1/361: dread d1/f1a [0,4194304] 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:0/235: chown d2/l19 74453 1 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:7/287: dread f0 [0,4194304] 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:1/362: write d1/d73/d40/f28 [850589,31869] 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:0/236: truncate d2/d22/f4e 994540 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:3/212: truncate d0/f2e 834978 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:4/265: mkdir d8/d1a/d5e 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:2/245: mkdir dd/de/d38/d53 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:5/265: fdatasync d4/de/d23/d4f/d54/f5d 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:3/213: write d0/d11/d19/f17 [3962892,99696] 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:4/266: creat d8/d1f/f5f x:0 0 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:8/264: dread d1/d21/d2a/f52 [0,4194304] 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:2/246: rename dd/d1c/d1d/c4a to dd/de/d38/c54 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:8/265: fdatasync d1/d21/d2a/f39 0 2024-04-26T11:24:00.379 INFO:tasks.workunit.client.0.smithi073.stdout:5/266: mkdir d4/d8/d9/d5f 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:2/247: creat dd/de/f55 x:0 0 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:4/267: unlink d8/d1a/d1b/l3a 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:0/237: link d2/f11 d2/d37/f54 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:3/214: creat d0/f45 x:0 0 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:4/268: rename d8/d1f/d23 to d8/d14/d60 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:1/363: dwrite d1/d8/fd [8388608,4194304] 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:7/288: dwrite d1/d11/d24/d26/d4b/f56 [0,4194304] 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:4/269: stat d8/d1a/d1b/d41/f48 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:4/270: dread - d8/d1a/d1b/d41/f58 zero size 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:2/248: link dd/de/d38/l3e dd/de/d38/d4e/l56 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:5/267: dread d4/de/d23/f44 [0,4194304] 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:0/238: rename d2/f1c to d2/d1f/d40/d48/f55 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:8/266: dwrite d1/d21/d50/f42 [0,4194304] 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:7/289: getdents d1/d11/d10 0 2024-04-26T11:24:00.380 INFO:tasks.workunit.client.0.smithi073.stdout:5/268: rename d4/de/d14 to d4/de/d15/d60 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:0/239: truncate d2/d22/f39 180658 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:7/290: creat d1/d33/d1b/d66/f69 x:0 0 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:8/267: dread - d1/d4/d37/f4f zero size 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:7/291: stat d1/d11/d24/d26/f2c 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:0/240: getdents d2/d1f 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:3/215: dwrite d0/d11/d19/d1d/f44 [0,4194304] 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:2/249: chown dd/d1c/d1d/f35 722 1 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:8/268: mkdir d1/d21/d58 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:8/269: write d1/d21/d2a/f43 [849804,106101] 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:2/250: write dd/d1c/f25 [2882358,114864] 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:0/241: mknod d2/d37/c56 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:2/251: readlink dd/l37 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:7/292: creat d1/d33/f6a x:0 0 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:6/205: dread d0/d19/f21 [0,4194304] 0 2024-04-26T11:24:00.381 INFO:tasks.workunit.client.0.smithi073.stdout:5/269: dwrite d4/de/d15/f19 [0,4194304] 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:6/206: write d0/dc/d2e/f3a [2612674,34112] 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:9/298: dread d0/f10 [0,4194304] 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:8/270: dwrite d1/d21/d2a/f43 [0,4194304] 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:2/252: dread dd/de/d38/f3d [0,4194304] 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:9/299: write d0/d13/d25/d2c/f3a [4728789,33642] 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:0/242: dwrite d2/d1f/f28 [0,4194304] 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:7/293: dwrite d1/d11/f1c [0,4194304] 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:1/364: dwrite d1/d73/f36 [0,4194304] 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:6/207: dread d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:5/270: dwrite d4/de/d15/f34 [4194304,4194304] 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:9/300: mknod d0/d13/db/d2e/c63 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:1/365: chown d1/d51/f67 0 1 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:8/271: mkdir d1/d4/d4c/d59 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:0/243: mkdir d2/d22/d51/d57 0 2024-04-26T11:24:00.382 INFO:tasks.workunit.client.0.smithi073.stdout:2/253: dread dd/de/f12 [0,4194304] 0 2024-04-26T11:24:00.383 INFO:tasks.workunit.client.0.smithi073.stdout:9/301: unlink d0/d1a/d4e/f5c 0 2024-04-26T11:24:00.383 INFO:tasks.workunit.client.0.smithi073.stdout:6/208: getdents d0/dc/d2e 0 2024-04-26T11:24:00.385 INFO:tasks.workunit.client.0.smithi073.stdout:2/254: write dd/d1c/f25 [973043,67181] 0 2024-04-26T11:24:00.385 INFO:tasks.workunit.client.0.smithi073.stdout:2/255: write dd/d4c/d48/f2c [537072,39636] 0 2024-04-26T11:24:00.385 INFO:tasks.workunit.client.0.smithi073.stdout:3/216: sync 2024-04-26T11:24:00.385 INFO:tasks.workunit.client.0.smithi073.stdout:0/244: symlink d2/d22/d51/d57/l58 0 2024-04-26T11:24:00.385 INFO:tasks.workunit.client.0.smithi073.stdout:3/217: write d0/d11/d19/f6 [293132,64348] 0 2024-04-26T11:24:00.385 INFO:tasks.workunit.client.0.smithi073.stdout:3/218: stat d0/lf 0 2024-04-26T11:24:00.385 INFO:tasks.workunit.client.0.smithi073.stdout:3/219: fdatasync d0/f45 0 2024-04-26T11:24:00.385 INFO:tasks.workunit.client.0.smithi073.stdout:6/209: getdents d0/dc 0 2024-04-26T11:24:00.385 INFO:tasks.workunit.client.0.smithi073.stdout:3/220: write d0/d11/f13 [2761822,27834] 0 2024-04-26T11:24:00.385 INFO:tasks.workunit.client.0.smithi073.stdout:2/256: link dd/d1c/c52 dd/d1c/c57 0 2024-04-26T11:24:00.386 INFO:tasks.workunit.client.0.smithi073.stdout:8/272: dwrite d1/d21/f29 [0,4194304] 0 2024-04-26T11:24:00.386 INFO:tasks.workunit.client.0.smithi073.stdout:8/273: fdatasync d1/d21/d2a/f2b 0 2024-04-26T11:24:00.386 INFO:tasks.workunit.client.0.smithi073.stdout:8/274: link d1/d4/d15/f4d d1/d4/f5a 0 2024-04-26T11:24:00.386 INFO:tasks.workunit.client.0.smithi073.stdout:0/245: dwrite d2/d22/f4e [0,4194304] 0 2024-04-26T11:24:00.386 INFO:tasks.workunit.client.0.smithi073.stdout:8/275: mkdir d1/d4/d37/d5b 0 2024-04-26T11:24:00.386 INFO:tasks.workunit.client.0.smithi073.stdout:8/276: symlink d1/d4/d4c/l5c 0 2024-04-26T11:24:00.386 INFO:tasks.workunit.client.0.smithi073.stdout:3/221: dwrite d0/d11/d19/db/f15 [0,4194304] 0 2024-04-26T11:24:00.386 INFO:tasks.workunit.client.0.smithi073.stdout:3/222: write d0/f45 [780557,39647] 0 2024-04-26T11:24:00.386 INFO:tasks.workunit.client.0.smithi073.stdout:8/277: write d1/f26 [1135596,40727] 0 2024-04-26T11:24:00.386 INFO:tasks.workunit.client.0.smithi073.stdout:3/223: getdents d0/d34 0 2024-04-26T11:24:00.386 INFO:tasks.workunit.client.0.smithi073.stdout:3/224: unlink d0/d34/f38 0 2024-04-26T11:24:00.387 INFO:tasks.workunit.client.0.smithi073.stdout:3/225: dwrite d0/d11/f13 [0,4194304] 0 2024-04-26T11:24:00.389 INFO:tasks.workunit.client.0.smithi073.stdout:2/257: dread dd/d27/f31 [0,4194304] 0 2024-04-26T11:24:00.389 INFO:tasks.workunit.client.0.smithi073.stdout:4/271: dread d8/fe [0,4194304] 0 2024-04-26T11:24:00.389 INFO:tasks.workunit.client.0.smithi073.stdout:8/278: dwrite d1/d21/d50/f42 [0,4194304] 0 2024-04-26T11:24:00.389 INFO:tasks.workunit.client.0.smithi073.stdout:3/226: link d0/d11/d19/db/f20 d0/d11/d23/d3b/f46 0 2024-04-26T11:24:00.389 INFO:tasks.workunit.client.0.smithi073.stdout:2/258: write dd/d4c/f42 [1033293,16020] 0 2024-04-26T11:24:00.390 INFO:tasks.workunit.client.0.smithi073.stdout:2/259: chown fb 74138 1 2024-04-26T11:24:00.390 INFO:tasks.workunit.client.0.smithi073.stdout:3/227: write d0/d11/d19/f17 [3551208,96842] 0 2024-04-26T11:24:00.391 INFO:tasks.workunit.client.0.smithi073.stdout:4/272: rename d8/d14/d60/c3b to d8/d1f/c61 0 2024-04-26T11:24:00.391 INFO:tasks.workunit.client.0.smithi073.stdout:3/228: mkdir d0/d11/d19/db/d3e/d47 0 2024-04-26T11:24:00.396 INFO:tasks.workunit.client.0.smithi073.stdout:2/260: dwrite dd/d4c/d48/f2d [0,4194304] 0 2024-04-26T11:24:00.397 INFO:tasks.workunit.client.0.smithi073.stdout:4/273: dwrite d8/d1a/d1b/f36 [0,4194304] 0 2024-04-26T11:24:00.399 INFO:tasks.workunit.client.0.smithi073.stdout:3/229: dwrite d0/f7 [0,4194304] 0 2024-04-26T11:24:00.403 INFO:tasks.workunit.client.0.smithi073.stdout:9/302: sync 2024-04-26T11:24:00.403 INFO:tasks.workunit.client.0.smithi073.stdout:1/366: sync 2024-04-26T11:24:00.403 INFO:tasks.workunit.client.0.smithi073.stdout:7/294: sync 2024-04-26T11:24:00.403 INFO:tasks.workunit.client.0.smithi073.stdout:2/261: sync 2024-04-26T11:24:00.403 INFO:tasks.workunit.client.0.smithi073.stdout:4/274: sync 2024-04-26T11:24:00.403 INFO:tasks.workunit.client.0.smithi073.stdout:7/295: fsync d1/d11/f1c 0 2024-04-26T11:24:00.404 INFO:tasks.workunit.client.0.smithi073.stdout:4/275: creat d8/d15/d1c/d49/f62 x:0 0 0 2024-04-26T11:24:00.405 INFO:tasks.workunit.client.0.smithi073.stdout:1/367: dread d1/d8/d2e/d3c/f3e [0,4194304] 0 2024-04-26T11:24:00.405 INFO:tasks.workunit.client.0.smithi073.stdout:1/368: chown d1/d73/d40/d54/f5f 877 1 2024-04-26T11:24:00.406 INFO:tasks.workunit.client.0.smithi073.stdout:1/369: fsync d1/d8/d5d/f60 0 2024-04-26T11:24:00.407 INFO:tasks.workunit.client.0.smithi073.stdout:4/276: mknod d8/d15/d1c/d49/c63 0 2024-04-26T11:24:00.408 INFO:tasks.workunit.client.0.smithi073.stdout:1/370: symlink d1/d6/l88 0 2024-04-26T11:24:00.408 INFO:tasks.workunit.client.0.smithi073.stdout:2/262: dread dd/d4c/d48/f2c [0,4194304] 0 2024-04-26T11:24:00.409 INFO:tasks.workunit.client.0.smithi073.stdout:1/371: mkdir d1/d8/d5d/d89 0 2024-04-26T11:24:00.409 INFO:tasks.workunit.client.0.smithi073.stdout:4/277: getdents d8/d15/d1c 0 2024-04-26T11:24:00.413 INFO:tasks.workunit.client.0.smithi073.stdout:9/303: dwrite d0/d1a/d2f/f41 [0,4194304] 0 2024-04-26T11:24:00.413 INFO:tasks.workunit.client.0.smithi073.stdout:1/372: dread - d1/d73/d40/f81 zero size 2024-04-26T11:24:00.413 INFO:tasks.workunit.client.0.smithi073.stdout:1/373: write d1/d8/f18 [1231012,62288] 0 2024-04-26T11:24:00.413 INFO:tasks.workunit.client.0.smithi073.stdout:3/230: dwrite d0/f2e [0,4194304] 0 2024-04-26T11:24:00.414 INFO:tasks.workunit.client.0.smithi073.stdout:3/231: chown d0/d11 651831 1 2024-04-26T11:24:00.414 INFO:tasks.workunit.client.0.smithi073.stdout:4/278: rename d8/d1f/d25 to d8/d14/d60/d64 0 2024-04-26T11:24:00.414 INFO:tasks.workunit.client.0.smithi073.stdout:9/304: symlink d0/d1a/d2f/l64 0 2024-04-26T11:24:00.414 INFO:tasks.workunit.client.0.smithi073.stdout:1/374: creat d1/d8/d5d/f8a x:0 0 0 2024-04-26T11:24:00.414 INFO:tasks.workunit.client.0.smithi073.stdout:1/375: fsync d1/d51/f7d 0 2024-04-26T11:24:00.414 INFO:tasks.workunit.client.0.smithi073.stdout:7/296: dwrite f0 [0,4194304] 0 2024-04-26T11:24:00.415 INFO:tasks.workunit.client.0.smithi073.stdout:9/305: write d0/d13/db/d2e/f34 [33210,39204] 0 2024-04-26T11:24:00.416 INFO:tasks.workunit.client.0.smithi073.stdout:3/232: chown d0/d11/d19/db/d3e/d3f/c42 368 1 2024-04-26T11:24:00.416 INFO:tasks.workunit.client.0.smithi073.stdout:7/297: chown d1/d33/c1a 2174371 1 2024-04-26T11:24:00.416 INFO:tasks.workunit.client.0.smithi073.stdout:7/298: fdatasync d1/d11/d24/d29/f49 0 2024-04-26T11:24:00.416 INFO:tasks.workunit.client.0.smithi073.stdout:9/306: mkdir d0/d13/d5a/d65 0 2024-04-26T11:24:00.416 INFO:tasks.workunit.client.0.smithi073.stdout:1/376: mknod d1/d6/d62/c8b 0 2024-04-26T11:24:00.416 INFO:tasks.workunit.client.0.smithi073.stdout:9/307: dread - d0/d13/f60 zero size 2024-04-26T11:24:00.417 INFO:tasks.workunit.client.0.smithi073.stdout:1/377: rename d1/d16 to d1/d16/d8c 22 2024-04-26T11:24:00.418 INFO:tasks.workunit.client.0.smithi073.stdout:0/246: dread d2/d1f/f26 [0,4194304] 0 2024-04-26T11:24:00.418 INFO:tasks.workunit.client.0.smithi073.stdout:9/308: chown d0/d13/l4 233 1 2024-04-26T11:24:00.418 INFO:tasks.workunit.client.0.smithi073.stdout:1/378: rename d1/d8/f18 to d1/d8/d57/f8d 0 2024-04-26T11:24:00.419 INFO:tasks.workunit.client.0.smithi073.stdout:1/379: chown d1/d16/d6a/f71 129176166 1 2024-04-26T11:24:00.421 INFO:tasks.workunit.client.0.smithi073.stdout:0/247: getdents d2/d1f 0 2024-04-26T11:24:00.421 INFO:tasks.workunit.client.0.smithi073.stdout:3/233: dwrite d0/d11/d19/db/f1a [0,4194304] 0 2024-04-26T11:24:00.422 INFO:tasks.workunit.client.0.smithi073.stdout:4/279: dwrite d8/d14/d60/f45 [0,4194304] 0 2024-04-26T11:24:00.423 INFO:tasks.workunit.client.0.smithi073.stdout:4/280: chown d8/d1a/d1b/f36 10697 1 2024-04-26T11:24:00.424 INFO:tasks.workunit.client.0.smithi073.stdout:9/309: truncate d0/d13/d25/d2c/f53 95922 0 2024-04-26T11:24:00.424 INFO:tasks.workunit.client.0.smithi073.stdout:7/299: dwrite d1/d11/f1c [0,4194304] 0 2024-04-26T11:24:00.427 INFO:tasks.workunit.client.0.smithi073.stdout:3/234: rename d0/d11/d19/d1d/l35 to d0/d11/d19/db/d3e/d3f/l48 0 2024-04-26T11:24:00.427 INFO:tasks.workunit.client.0.smithi073.stdout:4/281: creat d8/d15/d1c/d49/d5a/f65 x:0 0 0 2024-04-26T11:24:00.427 INFO:tasks.workunit.client.0.smithi073.stdout:9/310: write d0/d1a/d2f/f41 [975493,78958] 0 2024-04-26T11:24:00.427 INFO:tasks.workunit.client.0.smithi073.stdout:3/235: chown d0/d11/d23/d3b 26 1 2024-04-26T11:24:00.427 INFO:tasks.workunit.client.0.smithi073.stdout:9/311: fdatasync d0/d13/f18 0 2024-04-26T11:24:00.428 INFO:tasks.workunit.client.0.smithi073.stdout:4/282: rmdir d8/d15/d1c/d51 39 2024-04-26T11:24:00.428 INFO:tasks.workunit.client.0.smithi073.stdout:7/300: creat d1/d11/d24/d26/d4b/f6b x:0 0 0 2024-04-26T11:24:00.428 INFO:tasks.workunit.client.0.smithi073.stdout:3/236: symlink d0/d11/d19/db/l49 0 2024-04-26T11:24:00.429 INFO:tasks.workunit.client.0.smithi073.stdout:4/283: creat d8/d15/d1c/d49/d5a/f66 x:0 0 0 2024-04-26T11:24:00.429 INFO:tasks.workunit.client.0.smithi073.stdout:3/237: chown d0/d11/d19/f25 1183323 1 2024-04-26T11:24:00.430 INFO:tasks.workunit.client.0.smithi073.stdout:1/380: read d1/f2b [4253,38672] 0 2024-04-26T11:24:00.430 INFO:tasks.workunit.client.0.smithi073.stdout:3/238: fsync d0/d11/d19/db/f15 0 2024-04-26T11:24:00.430 INFO:tasks.workunit.client.0.smithi073.stdout:0/248: dwrite d2/d1f/f2b [0,4194304] 0 2024-04-26T11:24:00.430 INFO:tasks.workunit.client.0.smithi073.stdout:4/284: stat d8/d1a/d1b/d46/c4b 0 2024-04-26T11:24:00.431 INFO:tasks.workunit.client.0.smithi073.stdout:3/239: fsync d0/d26/f2a 0 2024-04-26T11:24:00.431 INFO:tasks.workunit.client.0.smithi073.stdout:9/312: mknod d0/d13/d5a/d65/c66 0 2024-04-26T11:24:00.431 INFO:tasks.workunit.client.0.smithi073.stdout:1/381: mkdir d1/d73/d40/d44/d8e 0 2024-04-26T11:24:00.433 INFO:tasks.workunit.client.0.smithi073.stdout:2/263: sync 2024-04-26T11:24:00.433 INFO:tasks.workunit.client.0.smithi073.stdout:4/285: creat d8/d15/d1c/d51/f67 x:0 0 0 2024-04-26T11:24:00.433 INFO:tasks.workunit.client.0.smithi073.stdout:1/382: write d1/d6/fb [12036593,44599] 0 2024-04-26T11:24:00.433 INFO:tasks.workunit.client.0.smithi073.stdout:0/249: link d2/l3a d2/d1f/d40/d48/l59 0 2024-04-26T11:24:00.434 INFO:tasks.workunit.client.0.smithi073.stdout:3/240: symlink d0/d11/d19/d1d/l4a 0 2024-04-26T11:24:00.434 INFO:tasks.workunit.client.0.smithi073.stdout:2/264: read - dd/d1c/d1d/f20 zero size 2024-04-26T11:24:00.434 INFO:tasks.workunit.client.0.smithi073.stdout:0/250: creat d2/d22/f5a x:0 0 0 2024-04-26T11:24:00.434 INFO:tasks.workunit.client.0.smithi073.stdout:1/383: mkdir d1/d6/d7f/d8f 0 2024-04-26T11:24:00.436 INFO:tasks.workunit.client.0.smithi073.stdout:7/301: dwrite d1/d11/d24/d26/d3d/d41/d64/f4c [0,4194304] 0 2024-04-26T11:24:00.437 INFO:tasks.workunit.client.0.smithi073.stdout:2/265: fsync dd/d4c/d48/f2c 0 2024-04-26T11:24:00.438 INFO:tasks.workunit.client.0.smithi073.stdout:1/384: write d1/d8/d57/f8d [4127786,31691] 0 2024-04-26T11:24:00.438 INFO:tasks.workunit.client.0.smithi073.stdout:2/266: chown dd/de/f12 59924 1 2024-04-26T11:24:00.439 INFO:tasks.workunit.client.0.smithi073.stdout:1/385: dread - d1/d8/d5d/f8a zero size 2024-04-26T11:24:00.439 INFO:tasks.workunit.client.0.smithi073.stdout:2/267: stat f5 0 2024-04-26T11:24:00.441 INFO:tasks.workunit.client.0.smithi073.stdout:2/268: write dd/d4c/d48/f2c [623133,88664] 0 2024-04-26T11:24:00.441 INFO:tasks.workunit.client.0.smithi073.stdout:3/241: dwrite d0/d11/f18 [0,4194304] 0 2024-04-26T11:24:00.442 INFO:tasks.workunit.client.0.smithi073.stdout:4/286: truncate d8/d1a/d1b/d46/d57/f42 2629184 0 2024-04-26T11:24:00.443 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:00.440+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:00.443 INFO:tasks.workunit.client.0.smithi073.stdout:1/386: dread d1/f13 [0,4194304] 0 2024-04-26T11:24:00.444 INFO:tasks.workunit.client.0.smithi073.stdout:0/251: dwrite d2/f21 [0,4194304] 0 2024-04-26T11:24:00.444 INFO:tasks.workunit.client.0.smithi073.stdout:0/252: readlink d2/l36 0 2024-04-26T11:24:00.444 INFO:tasks.workunit.client.0.smithi073.stdout:1/387: unlink d1/d73/c6c 0 2024-04-26T11:24:00.444 INFO:tasks.workunit.client.0.smithi073.stdout:4/287: mknod d8/d1a/d1b/d24/c68 0 2024-04-26T11:24:00.444 INFO:tasks.workunit.client.0.smithi073.stdout:0/253: chown d2/f3f 46494 1 2024-04-26T11:24:00.445 INFO:tasks.workunit.client.0.smithi073.stdout:0/254: write d2/d1f/d40/f44 [722205,10548] 0 2024-04-26T11:24:00.448 INFO:tasks.workunit.client.0.smithi073.stdout:7/302: dwrite d1/d11/d24/d26/d67/f28 [4194304,4194304] 0 2024-04-26T11:24:00.448 INFO:tasks.workunit.client.0.smithi073.stdout:1/388: write d1/d8/d5d/f70 [1888663,37204] 0 2024-04-26T11:24:00.448 INFO:tasks.workunit.client.0.smithi073.stdout:0/255: creat d2/d1f/d40/f5b x:0 0 0 2024-04-26T11:24:00.450 INFO:tasks.workunit.client.0.smithi073.stdout:0/256: write d2/d1f/f2b [3308027,60041] 0 2024-04-26T11:24:00.450 INFO:tasks.workunit.client.0.smithi073.stdout:1/389: getdents d1/d6/d7f/d8f 0 2024-04-26T11:24:00.451 INFO:tasks.workunit.client.0.smithi073.stdout:3/242: dwrite d0/d11/d19/d1d/f44 [0,4194304] 0 2024-04-26T11:24:00.451 INFO:tasks.workunit.client.0.smithi073.stdout:7/303: getdents d1 0 2024-04-26T11:24:00.452 INFO:tasks.workunit.client.0.smithi073.stdout:4/288: dwrite d8/d1a/d1b/d1d/f2c [0,4194304] 0 2024-04-26T11:24:00.453 INFO:tasks.workunit.client.0.smithi073.stdout:7/304: symlink d1/d33/d1b/l6c 0 2024-04-26T11:24:00.454 INFO:tasks.workunit.client.0.smithi073.stdout:7/305: rmdir d1 39 2024-04-26T11:24:00.454 INFO:tasks.workunit.client.0.smithi073.stdout:4/289: creat d8/d1a/d5e/f69 x:0 0 0 2024-04-26T11:24:00.454 INFO:tasks.workunit.client.0.smithi073.stdout:1/390: getdents d1/d73/d40/d54 0 2024-04-26T11:24:00.454 INFO:tasks.workunit.client.0.smithi073.stdout:3/243: getdents d0/d2d 0 2024-04-26T11:24:00.455 INFO:tasks.workunit.client.0.smithi073.stdout:7/306: rmdir d1/d11 39 2024-04-26T11:24:00.455 INFO:tasks.workunit.client.0.smithi073.stdout:7/307: chown d1 711847 1 2024-04-26T11:24:00.456 INFO:tasks.workunit.client.0.smithi073.stdout:3/244: rename d0/d11/d19/db/c43 to d0/d11/d23/c4b 0 2024-04-26T11:24:00.457 INFO:tasks.workunit.client.0.smithi073.stdout:6/210: dread d0/f2 [0,4194304] 0 2024-04-26T11:24:00.457 INFO:tasks.workunit.client.0.smithi073.stdout:7/308: getdents d1 0 2024-04-26T11:24:00.459 INFO:tasks.workunit.client.0.smithi073.stdout:6/211: unlink d0/d15/f2a 0 2024-04-26T11:24:00.461 INFO:tasks.workunit.client.0.smithi073.stdout:7/309: getdents d1/d11/d24/d26 0 2024-04-26T11:24:00.462 INFO:tasks.workunit.client.0.smithi073.stdout:4/290: dwrite d8/d15/d1c/d51/f67 [0,4194304] 0 2024-04-26T11:24:00.463 INFO:tasks.workunit.client.0.smithi073.stdout:6/212: creat d0/d39/d2b/d2c/f3b x:0 0 0 2024-04-26T11:24:00.464 INFO:tasks.workunit.client.0.smithi073.stdout:4/291: fdatasync d8/d15/d1c/d51/f5d 0 2024-04-26T11:24:00.465 INFO:tasks.workunit.client.0.smithi073.stdout:5/271: dread d4/de/d23/f36 [0,4194304] 0 2024-04-26T11:24:00.465 INFO:tasks.workunit.client.0.smithi073.stdout:7/310: dread d1/d11/d24/d29/f49 [0,4194304] 0 2024-04-26T11:24:00.465 INFO:tasks.workunit.client.0.smithi073.stdout:0/257: dread d2/f25 [0,4194304] 0 2024-04-26T11:24:00.469 INFO:tasks.workunit.client.0.smithi073.stdout:7/311: creat d1/d11/d24/d26/d3d/f6d x:0 0 0 2024-04-26T11:24:00.469 INFO:tasks.workunit.client.0.smithi073.stdout:0/258: creat d2/d22/d51/d57/f5c x:0 0 0 2024-04-26T11:24:00.469 INFO:tasks.workunit.client.0.smithi073.stdout:4/292: write d8/d1a/d1b/d41/f48 [398893,122463] 0 2024-04-26T11:24:00.469 INFO:tasks.workunit.client.0.smithi073.stdout:0/259: stat d2/d37/d3c/f4c 0 2024-04-26T11:24:00.470 INFO:tasks.workunit.client.0.smithi073.stdout:7/312: link d1/d11/fd d1/d33/d1b/d66/d50/f6e 0 2024-04-26T11:24:00.471 INFO:tasks.workunit.client.0.smithi073.stdout:7/313: fsync d1/d11/d24/d26/d3d/d41/d64/f4c 0 2024-04-26T11:24:00.471 INFO:tasks.workunit.client.0.smithi073.stdout:0/260: creat d2/d1f/d40/d48/f5d x:0 0 0 2024-04-26T11:24:00.471 INFO:tasks.workunit.client.0.smithi073.stdout:4/293: link d8/d1a/f4f d8/d1a/d1b/d1d/f6a 0 2024-04-26T11:24:00.472 INFO:tasks.workunit.client.0.smithi073.stdout:7/314: creat d1/d11/d24/d26/f6f x:0 0 0 2024-04-26T11:24:00.472 INFO:tasks.workunit.client.0.smithi073.stdout:0/261: creat d2/d22/d51/d57/f5e x:0 0 0 2024-04-26T11:24:00.473 INFO:tasks.workunit.client.0.smithi073.stdout:0/262: write d2/f17 [1817944,91516] 0 2024-04-26T11:24:00.473 INFO:tasks.workunit.client.0.smithi073.stdout:7/315: creat d1/d11/d24/d26/d4b/f70 x:0 0 0 2024-04-26T11:24:00.473 INFO:tasks.workunit.client.0.smithi073.stdout:0/263: mkdir d2/d5f 0 2024-04-26T11:24:00.474 INFO:tasks.workunit.client.0.smithi073.stdout:7/316: write d1/d33/d1b/d66/f69 [483922,12318] 0 2024-04-26T11:24:00.474 INFO:tasks.workunit.client.0.smithi073.stdout:0/264: truncate d2/f53 354209 0 2024-04-26T11:24:00.477 INFO:tasks.workunit.client.0.smithi073.stdout:7/317: rename d1/d11/d55 to d1/d11/d24/d71 0 2024-04-26T11:24:00.478 INFO:tasks.workunit.client.0.smithi073.stdout:0/265: rename d2/d1f/c42 to d2/d1f/c60 0 2024-04-26T11:24:00.478 INFO:tasks.workunit.client.0.smithi073.stdout:7/318: dread - d1/d11/d24/d26/f6f zero size 2024-04-26T11:24:00.478 INFO:tasks.workunit.client.0.smithi073.stdout:0/266: write d2/f4f [195921,115082] 0 2024-04-26T11:24:00.487 INFO:tasks.workunit.client.0.smithi073.stdout:2/269: dread dd/d1c/f22 [0,4194304] 0 2024-04-26T11:24:00.487 INFO:tasks.workunit.client.0.smithi073.stdout:2/270: readlink l4 0 2024-04-26T11:24:00.487 INFO:tasks.workunit.client.0.smithi073.stdout:0/267: dread d2/f4f [0,4194304] 0 2024-04-26T11:24:00.487 INFO:tasks.workunit.client.0.smithi073.stdout:2/271: dread f0 [0,4194304] 0 2024-04-26T11:24:00.487 INFO:tasks.workunit.client.0.smithi073.stdout:1/391: dread d1/d8/d57/f65 [0,4194304] 0 2024-04-26T11:24:00.487 INFO:tasks.workunit.client.0.smithi073.stdout:0/268: write d2/d22/f35 [1646042,12091] 0 2024-04-26T11:24:00.488 INFO:tasks.workunit.client.0.smithi073.stdout:1/392: chown d1/d51/f7d 408496 1 2024-04-26T11:24:00.488 INFO:tasks.workunit.client.0.smithi073.stdout:2/272: creat dd/de/d29/f58 x:0 0 0 2024-04-26T11:24:00.489 INFO:tasks.workunit.client.0.smithi073.stdout:0/269: write d2/d22/f33 [18545,77083] 0 2024-04-26T11:24:00.490 INFO:tasks.workunit.client.0.smithi073.stdout:0/270: write d2/d22/f33 [1888961,60507] 0 2024-04-26T11:24:00.490 INFO:tasks.workunit.client.0.smithi073.stdout:8/279: dread d1/d4/d37/f40 [0,4194304] 0 2024-04-26T11:24:00.491 INFO:tasks.workunit.client.0.smithi073.stdout:7/319: dread d1/d11/d24/d26/d67/f40 [0,4194304] 0 2024-04-26T11:24:00.491 INFO:tasks.workunit.client.0.smithi073.stdout:6/213: dread d0/d1a/d26/d27/f29 [0,4194304] 0 2024-04-26T11:24:00.491 INFO:tasks.workunit.client.0.smithi073.stdout:8/280: rmdir d1/d4/d53 0 2024-04-26T11:24:00.492 INFO:tasks.workunit.client.0.smithi073.stdout:6/214: rmdir d0/d39/d2b 39 2024-04-26T11:24:00.493 INFO:tasks.workunit.client.0.smithi073.stdout:7/320: write d1/d11/d24/d26/d67/f23 [3148909,126320] 0 2024-04-26T11:24:00.493 INFO:tasks.workunit.client.0.smithi073.stdout:6/215: chown d0/d39/l1e 3300 1 2024-04-26T11:24:00.493 INFO:tasks.workunit.client.0.smithi073.stdout:5/272: sync 2024-04-26T11:24:00.493 INFO:tasks.workunit.client.0.smithi073.stdout:6/216: fdatasync d0/dc/d2e/f3a 0 2024-04-26T11:24:00.494 INFO:tasks.workunit.client.0.smithi073.stdout:5/273: write d4/de/f2c [5119198,26179] 0 2024-04-26T11:24:00.495 INFO:tasks.workunit.client.0.smithi073.stdout:7/321: dread d1/d11/d24/d26/d67/f40 [0,4194304] 0 2024-04-26T11:24:00.495 INFO:tasks.workunit.client.0.smithi073.stdout:1/393: dwrite d1/d73/f35 [0,4194304] 0 2024-04-26T11:24:00.496 INFO:tasks.workunit.client.0.smithi073.stdout:7/322: write d1/d11/f36 [4972157,38031] 0 2024-04-26T11:24:00.497 INFO:tasks.workunit.client.0.smithi073.stdout:8/281: dread d1/d21/d50/f36 [0,4194304] 0 2024-04-26T11:24:00.498 INFO:tasks.workunit.client.0.smithi073.stdout:9/313: dread d0/d13/f18 [0,4194304] 0 2024-04-26T11:24:00.498 INFO:tasks.workunit.client.0.smithi073.stdout:4/294: sync 2024-04-26T11:24:00.499 INFO:tasks.workunit.client.0.smithi073.stdout:1/394: rmdir d1/d8/d2e 39 2024-04-26T11:24:00.499 INFO:tasks.workunit.client.0.smithi073.stdout:8/282: symlink d1/d21/d50/l5d 0 2024-04-26T11:24:00.499 INFO:tasks.workunit.client.0.smithi073.stdout:5/274: creat d4/d8/d9/d42/d4d/f61 x:0 0 0 2024-04-26T11:24:00.500 INFO:tasks.workunit.client.0.smithi073.stdout:4/295: mkdir d8/d15/d1c/d49/d5a/d6b 0 2024-04-26T11:24:00.500 INFO:tasks.workunit.client.0.smithi073.stdout:8/283: fsync d1/d21/d2a/f52 0 2024-04-26T11:24:00.500 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:953 3.0 3:07a02702:::200.0000000c:head [write 2316409~1959 [fadvise_dontneed] in=1959b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e63)", 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:00.500026+0000", 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00045666899999999999, 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00047736000000000002, 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:00.500026+0000", 2024-04-26T11:24:00.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:00.500026+0000", 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:00.500025+0000", 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:00.500035+0000", 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0137e-05 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:00.500057+0000", 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.2527999999999998e-05 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:00.500072+0000", 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4419999999999999e-05 2024-04-26T11:24:00.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:00.500111+0000", 2024-04-26T11:24:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8654e-05 2024-04-26T11:24:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:00.500173+0000", 2024-04-26T11:24:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2612000000000003e-05 2024-04-26T11:24:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.504 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-04-26T11:24:00.505 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-04-26T11:24:00.505 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:00.505 INFO:tasks.workunit.client.0.smithi073.stdout:8/284: fdatasync d1/d4/d37/f4f 0 2024-04-26T11:24:00.507 INFO:tasks.workunit.client.0.smithi073.stdout:4/296: creat d8/d15/d1c/d49/f6c x:0 0 0 2024-04-26T11:24:00.507 INFO:tasks.workunit.client.0.smithi073.stdout:8/285: fsync d1/d21/d2c/f3b 0 2024-04-26T11:24:00.507 INFO:tasks.workunit.client.0.smithi073.stdout:3/245: dread d0/d26/f29 [0,4194304] 0 2024-04-26T11:24:00.507 INFO:tasks.workunit.client.0.smithi073.stdout:5/275: link d4/d8/d9/c55 d4/de/d23/d4f/c62 0 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:1/395: chown d1/d16/d4f/f79 1 1 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:8/286: mknod d1/d4/d4c/c5e 0 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:1/396: stat d1/d6/d7f/d8f 0 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:3/246: creat d0/d11/d19/d1d/f4c x:0 0 0 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:5/276: write d4/de/d15/f45 [413426,105008] 0 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:8/287: dread - d1/d4/f5a zero size 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:8/288: chown d1/d4/d15 63 1 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:7/323: dwrite d1/d11/d24/d26/d4b/f56 [0,4194304] 0 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:8/289: fdatasync d1/d21/f29 0 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:8/290: chown d1/d4/f12 0 1 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:1/397: creat d1/d16/d61/f90 x:0 0 0 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:3/247: mkdir d0/d11/d19/db/d3e/d3f/d4d 0 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:5/277: creat d4/d8/d9/d42/f63 x:0 0 0 2024-04-26T11:24:00.508 INFO:tasks.workunit.client.0.smithi073.stdout:7/324: unlink d1/d11/d51/f63 0 2024-04-26T11:24:00.509 INFO:tasks.workunit.client.0.smithi073.stdout:4/297: dwrite d8/d1a/d1b/d1d/f56 [0,4194304] 0 2024-04-26T11:24:00.511 INFO:tasks.workunit.client.0.smithi073.stdout:5/278: symlink d4/de/d15/d33/l64 0 2024-04-26T11:24:00.513 INFO:tasks.workunit.client.0.smithi073.stdout:3/248: dwrite d0/f45 [0,4194304] 0 2024-04-26T11:24:00.514 INFO:tasks.workunit.client.0.smithi073.stdout:0/271: dread d2/d22/f35 [0,4194304] 0 2024-04-26T11:24:00.514 INFO:tasks.workunit.client.0.smithi073.stdout:3/249: write d0/d11/d19/f17 [2376023,15674] 0 2024-04-26T11:24:00.514 INFO:tasks.workunit.client.0.smithi073.stdout:3/250: sync 2024-04-26T11:24:00.514 INFO:tasks.workunit.client.0.smithi073.stdout:7/325: unlink d1/f19 0 2024-04-26T11:24:00.516 INFO:tasks.workunit.client.0.smithi073.stdout:4/298: write d8/d15/d1c/f50 [789684,45285] 0 2024-04-26T11:24:00.516 INFO:tasks.workunit.client.0.smithi073.stdout:5/279: dwrite d4/d8/fb [0,4194304] 0 2024-04-26T11:24:00.517 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:00.519 INFO:tasks.workunit.client.0.smithi073.stdout:0/272: creat d2/d37/d3c/f61 x:0 0 0 2024-04-26T11:24:00.520 INFO:tasks.workunit.client.0.smithi073.stdout:3/251: creat d0/d34/f4e x:0 0 0 2024-04-26T11:24:00.520 INFO:tasks.workunit.client.0.smithi073.stdout:1/398: creat d1/d73/d40/d44/d80/f91 x:0 0 0 2024-04-26T11:24:00.520 INFO:tasks.workunit.client.0.smithi073.stdout:8/291: link d1/d21/d50/l23 d1/d4/l5f 0 2024-04-26T11:24:00.520 INFO:tasks.workunit.client.0.smithi073.stdout:4/299: mkdir d8/d15/d1c/d49/d5a/d6d 0 2024-04-26T11:24:00.520 INFO:tasks.workunit.client.0.smithi073.stdout:5/280: unlink d4/de/d15/f34 0 2024-04-26T11:24:00.520 INFO:tasks.workunit.client.0.smithi073.stdout:8/292: stat d1/d21/d2a 0 2024-04-26T11:24:00.520 INFO:tasks.workunit.client.0.smithi073.stdout:5/281: readlink d4/de/l2d 0 2024-04-26T11:24:00.520 INFO:tasks.workunit.client.0.smithi073.stdout:1/399: write d1/d16/d61/f90 [617735,94623] 0 2024-04-26T11:24:00.520 INFO:tasks.workunit.client.0.smithi073.stdout:0/273: mkdir d2/d1f/d40/d48/d62 0 2024-04-26T11:24:00.520 INFO:tasks.workunit.client.0.smithi073.stdout:4/300: unlink d8/d14/d60/f45 0 2024-04-26T11:24:00.522 INFO:tasks.workunit.client.0.smithi073.stdout:5/282: fsync d4/de/f2c 0 2024-04-26T11:24:00.522 INFO:tasks.workunit.client.0.smithi073.stdout:8/293: creat d1/d4/d15/f60 x:0 0 0 2024-04-26T11:24:00.522 INFO:tasks.workunit.client.0.smithi073.stdout:7/326: write d1/d11/d24/d29/f49 [1622188,90087] 0 2024-04-26T11:24:00.522 INFO:tasks.workunit.client.0.smithi073.stdout:0/274: write d2/f21 [3814746,58000] 0 2024-04-26T11:24:00.523 INFO:tasks.workunit.client.0.smithi073.stdout:1/400: creat d1/d16/d61/f92 x:0 0 0 2024-04-26T11:24:00.523 INFO:tasks.workunit.client.0.smithi073.stdout:8/294: symlink d1/d21/d50/l61 0 2024-04-26T11:24:00.523 INFO:tasks.workunit.client.0.smithi073.stdout:0/275: dread - d2/d22/f50 zero size 2024-04-26T11:24:00.524 INFO:tasks.workunit.client.0.smithi073.stdout:7/327: mknod d1/d11/d24/d71/c72 0 2024-04-26T11:24:00.524 INFO:tasks.workunit.client.0.smithi073.stdout:8/295: write d1/d21/d50/f2e [355062,116238] 0 2024-04-26T11:24:00.524 INFO:tasks.workunit.client.0.smithi073.stdout:1/401: readlink d1/d8/d5d/l75 0 2024-04-26T11:24:00.524 INFO:tasks.workunit.client.0.smithi073.stdout:0/276: write d2/d22/f5a [953401,119613] 0 2024-04-26T11:24:00.524 INFO:tasks.workunit.client.0.smithi073.stdout:4/301: creat d8/d15/d1c/d49/d5a/d6b/f6e x:0 0 0 2024-04-26T11:24:00.526 INFO:tasks.workunit.client.0.smithi073.stdout:3/252: dwrite d0/d11/f18 [4194304,4194304] 0 2024-04-26T11:24:00.526 INFO:tasks.workunit.client.0.smithi073.stdout:6/217: dread d0/dc/d2e/f3a [0,4194304] 0 2024-04-26T11:24:00.526 INFO:tasks.workunit.client.0.smithi073.stdout:0/277: creat d2/d1f/d40/f63 x:0 0 0 2024-04-26T11:24:00.527 INFO:tasks.workunit.client.0.smithi073.stdout:8/296: rename d1/d21/d50/c4a to d1/c62 0 2024-04-26T11:24:00.527 INFO:tasks.workunit.client.0.smithi073.stdout:0/278: sync 2024-04-26T11:24:00.528 INFO:tasks.workunit.client.0.smithi073.stdout:6/218: chown d0/d15/d2d/f33 185884 1 2024-04-26T11:24:00.528 INFO:tasks.workunit.client.0.smithi073.stdout:0/279: creat d2/d22/d51/f64 x:0 0 0 2024-04-26T11:24:00.529 INFO:tasks.workunit.client.0.smithi073.stdout:9/314: dread d0/d13/f22 [0,4194304] 0 2024-04-26T11:24:00.529 INFO:tasks.workunit.client.0.smithi073.stdout:7/328: read d1/d11/d24/d26/d67/f28 [2232822,33662] 0 2024-04-26T11:24:00.529 INFO:tasks.workunit.client.0.smithi073.stdout:9/315: sync 2024-04-26T11:24:00.530 INFO:tasks.workunit.client.0.smithi073.stdout:7/329: sync 2024-04-26T11:24:00.530 INFO:tasks.workunit.client.0.smithi073.stdout:3/253: getdents d0/d11/d19/db/d3e/d47 0 2024-04-26T11:24:00.530 INFO:tasks.workunit.client.0.smithi073.stdout:5/283: read d4/de/f10 [2599013,84329] 0 2024-04-26T11:24:00.531 INFO:tasks.workunit.client.0.smithi073.stdout:6/219: rename d0/d19/d20/f25 to d0/d1a/d26/f3c 0 2024-04-26T11:24:00.531 INFO:tasks.workunit.client.0.smithi073.stdout:7/330: read d1/d11/fd [2958586,35187] 0 2024-04-26T11:24:00.531 INFO:tasks.workunit.client.0.smithi073.stdout:2/273: dread dd/de/f18 [0,4194304] 0 2024-04-26T11:24:00.532 INFO:tasks.workunit.client.0.smithi073.stdout:3/254: unlink d0/d11/d19/db/d3e/d3f/c42 0 2024-04-26T11:24:00.533 INFO:tasks.workunit.client.0.smithi073.stdout:6/220: chown d0/dc/d2e 248072830 1 2024-04-26T11:24:00.533 INFO:tasks.workunit.client.0.smithi073.stdout:0/280: dread d2/d37/d3c/f47 [0,4194304] 0 2024-04-26T11:24:00.533 INFO:tasks.workunit.client.0.smithi073.stdout:7/331: chown d1/d11/d24/d71 728576 1 2024-04-26T11:24:00.534 INFO:tasks.workunit.client.0.smithi073.stdout:4/302: dwrite d8/d1a/d1b/f36 [0,4194304] 0 2024-04-26T11:24:00.534 INFO:tasks.workunit.client.0.smithi073.stdout:1/402: dwrite d1/f2b [4194304,4194304] 0 2024-04-26T11:24:00.538 INFO:tasks.workunit.client.0.smithi073.stdout:2/274: unlink dd/d1c/c57 0 2024-04-26T11:24:00.539 INFO:tasks.workunit.client.0.smithi073.stdout:5/284: truncate d4/de/d15/d60/f3f 714382 0 2024-04-26T11:24:00.539 INFO:tasks.workunit.client.0.smithi073.stdout:4/303: dread d8/d1a/d1b/f36 [0,4194304] 0 2024-04-26T11:24:00.539 INFO:tasks.workunit.client.0.smithi073.stdout:1/403: creat d1/d73/d40/d44/d80/f93 x:0 0 0 2024-04-26T11:24:00.539 INFO:tasks.workunit.client.0.smithi073.stdout:8/297: creat d1/d21/d2a/f63 x:0 0 0 2024-04-26T11:24:00.539 INFO:tasks.workunit.client.0.smithi073.stdout:7/332: truncate d1/d33/f6a 314003 0 2024-04-26T11:24:00.540 INFO:tasks.workunit.client.0.smithi073.stdout:6/221: rename d0/d19/f31 to d0/d39/d2b/f3d 0 2024-04-26T11:24:00.541 INFO:tasks.workunit.client.0.smithi073.stdout:8/298: creat d1/d21/d50/f64 x:0 0 0 2024-04-26T11:24:00.541 INFO:tasks.workunit.client.0.smithi073.stdout:7/333: creat d1/d11/d24/d26/d67/f73 x:0 0 0 2024-04-26T11:24:00.542 INFO:tasks.workunit.client.0.smithi073.stdout:4/304: rename d8/d15/d1c/d49/f5b to d8/d14/d60/f6f 0 2024-04-26T11:24:00.542 INFO:tasks.workunit.client.0.smithi073.stdout:4/305: sync 2024-04-26T11:24:00.543 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:00.540+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:00.544 INFO:tasks.workunit.client.0.smithi073.stdout:6/222: write d0/f4 [6459488,15642] 0 2024-04-26T11:24:00.544 INFO:tasks.workunit.client.0.smithi073.stdout:1/404: getdents d1/d8 0 2024-04-26T11:24:00.545 INFO:tasks.workunit.client.0.smithi073.stdout:0/281: dwrite d2/f4f [0,4194304] 0 2024-04-26T11:24:00.546 INFO:tasks.workunit.client.0.smithi073.stdout:4/306: creat d8/d1a/d1b/d46/d57/d37/f70 x:0 0 0 2024-04-26T11:24:00.546 INFO:tasks.workunit.client.0.smithi073.stdout:8/299: link d1/d4/le d1/d4/d37/l65 0 2024-04-26T11:24:00.546 INFO:tasks.workunit.client.0.smithi073.stdout:6/223: fdatasync d0/dc/f1b 0 2024-04-26T11:24:00.546 INFO:tasks.workunit.client.0.smithi073.stdout:0/282: dread - d2/f3d zero size 2024-04-26T11:24:00.547 INFO:tasks.workunit.client.0.smithi073.stdout:8/300: read - d1/d4/f5a zero size 2024-04-26T11:24:00.548 INFO:tasks.workunit.client.0.smithi073.stdout:2/275: dwrite f0 [4194304,4194304] 0 2024-04-26T11:24:00.548 INFO:tasks.workunit.client.0.smithi073.stdout:5/285: dwrite d4/de/d23/d4f/d54/f5d [0,4194304] 0 2024-04-26T11:24:00.549 INFO:tasks.workunit.client.0.smithi073.stdout:0/283: truncate d2/d1f/f28 5050667 0 2024-04-26T11:24:00.551 INFO:tasks.workunit.client.0.smithi073.stdout:1/405: read d1/d16/d6a/f72 [2283072,40684] 0 2024-04-26T11:24:00.552 INFO:tasks.workunit.client.0.smithi073.stdout:4/307: rename d8/d15/d1c/d51/f53 to d8/d15/d1c/d51/f71 0 2024-04-26T11:24:00.554 INFO:tasks.workunit.client.0.smithi073.stdout:6/224: creat d0/d39/d2b/f3e x:0 0 0 2024-04-26T11:24:00.554 INFO:tasks.workunit.client.0.smithi073.stdout:6/225: sync 2024-04-26T11:24:00.554 INFO:tasks.workunit.client.0.smithi073.stdout:7/334: write f0 [2472459,126629] 0 2024-04-26T11:24:00.554 INFO:tasks.workunit.client.0.smithi073.stdout:8/301: mkdir d1/d4/d4c/d66 0 2024-04-26T11:24:00.554 INFO:tasks.workunit.client.0.smithi073.stdout:5/286: creat d4/de/d15/f65 x:0 0 0 2024-04-26T11:24:00.554 INFO:tasks.workunit.client.0.smithi073.stdout:1/406: rename d1/d16/d68/c7c to d1/d73/d34/c94 0 2024-04-26T11:24:00.554 INFO:tasks.workunit.client.0.smithi073.stdout:2/276: mkdir dd/de/d38/d53/d59 0 2024-04-26T11:24:00.555 INFO:tasks.workunit.client.0.smithi073.stdout:7/335: write d1/d11/f1c [4071067,14969] 0 2024-04-26T11:24:00.555 INFO:tasks.workunit.client.0.smithi073.stdout:4/308: read - d8/d15/d1c/d49/d5a/d6b/f6e zero size 2024-04-26T11:24:00.556 INFO:tasks.workunit.client.0.smithi073.stdout:1/407: symlink d1/d6/l95 0 2024-04-26T11:24:00.556 INFO:tasks.workunit.client.0.smithi073.stdout:5/287: creat d4/de/d15/d60/f66 x:0 0 0 2024-04-26T11:24:00.556 INFO:tasks.workunit.client.0.smithi073.stdout:6/226: write d0/d39/d2b/d2c/f3b [416584,40606] 0 2024-04-26T11:24:00.556 INFO:tasks.workunit.client.0.smithi073.stdout:4/309: unlink d8/c29 0 2024-04-26T11:24:00.556 INFO:tasks.workunit.client.0.smithi073.stdout:6/227: stat d0/d1a 0 2024-04-26T11:24:00.557 INFO:tasks.workunit.client.0.smithi073.stdout:2/277: chown dd/d1c/c52 180759 1 2024-04-26T11:24:00.557 INFO:tasks.workunit.client.0.smithi073.stdout:5/288: mkdir d4/de/d15/d67 0 2024-04-26T11:24:00.558 INFO:tasks.workunit.client.0.smithi073.stdout:8/302: write d1/d4/f5a [826716,49784] 0 2024-04-26T11:24:00.558 INFO:tasks.workunit.client.0.smithi073.stdout:1/408: mknod d1/d16/d4f/d55/d5a/c96 0 2024-04-26T11:24:00.558 INFO:tasks.workunit.client.0.smithi073.stdout:5/289: dread - d4/de/f49 zero size 2024-04-26T11:24:00.558 INFO:tasks.workunit.client.0.smithi073.stdout:6/228: write d0/f2 [3610721,128709] 0 2024-04-26T11:24:00.558 INFO:tasks.workunit.client.0.smithi073.stdout:7/336: rename d1/d33/d1b/d66/f48 to d1/d11/d24/d29/f74 0 2024-04-26T11:24:00.558 INFO:tasks.workunit.client.0.smithi073.stdout:4/310: mkdir d8/d15/d1c/d72 0 2024-04-26T11:24:00.558 INFO:tasks.workunit.client.0.smithi073.stdout:1/409: write d1/f1a [794640,29822] 0 2024-04-26T11:24:00.559 INFO:tasks.workunit.client.0.smithi073.stdout:6/229: mkdir d0/d15/d2d/d3f 0 2024-04-26T11:24:00.560 INFO:tasks.workunit.client.0.smithi073.stdout:4/311: mknod d8/d14/c73 0 2024-04-26T11:24:00.560 INFO:tasks.workunit.client.0.smithi073.stdout:7/337: fdatasync d1/d11/d24/d26/d4b/f6b 0 2024-04-26T11:24:00.560 INFO:tasks.workunit.client.0.smithi073.stdout:5/290: mkdir d4/d8/d9/d42/d68 0 2024-04-26T11:24:00.560 INFO:tasks.workunit.client.0.smithi073.stdout:4/312: mknod d8/d1a/c74 0 2024-04-26T11:24:00.560 INFO:tasks.workunit.client.0.smithi073.stdout:6/230: symlink d0/d19/d20/l40 0 2024-04-26T11:24:00.560 INFO:tasks.workunit.client.0.smithi073.stdout:6/231: fsync d0/dc/d2e/f3a 0 2024-04-26T11:24:00.560 INFO:tasks.workunit.client.0.smithi073.stdout:4/313: creat d8/d14/f75 x:0 0 0 2024-04-26T11:24:00.561 INFO:tasks.workunit.client.0.smithi073.stdout:7/338: rename d1/d11/d24/d26/d67/f73 to d1/f75 0 2024-04-26T11:24:00.561 INFO:tasks.workunit.client.0.smithi073.stdout:4/314: dread - d8/d1f/f5f zero size 2024-04-26T11:24:00.561 INFO:tasks.workunit.client.0.smithi073.stdout:6/232: write d0/d39/d2b/f3d [1444904,22259] 0 2024-04-26T11:24:00.561 INFO:tasks.workunit.client.0.smithi073.stdout:7/339: chown d1/f75 0 1 2024-04-26T11:24:00.561 INFO:tasks.workunit.client.0.smithi073.stdout:5/291: getdents d4/de/d15 0 2024-04-26T11:24:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:9/316: dread d0/f3f [0,4194304] 0 2024-04-26T11:24:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:2/278: truncate dd/d4c/d48/f2c 502392 0 2024-04-26T11:24:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:1/410: truncate d1/d73/f1c 1746415 0 2024-04-26T11:24:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:6/233: read d0/d15/d2d/f33 [172287,111775] 0 2024-04-26T11:24:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:5/292: rmdir d4/de/d23/d4f 39 2024-04-26T11:24:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:7/340: link d1/d11/d10/c3a d1/d11/d24/d26/d4b/c76 0 2024-04-26T11:24:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:6/234: rmdir d0/d15/d2d 39 2024-04-26T11:24:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:2/279: write dd/d1c/d1d/f44 [202469,56505] 0 2024-04-26T11:24:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:9/317: creat d0/d13/db/d2e/d51/f67 x:0 0 0 2024-04-26T11:24:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:7/341: chown d1 1 1 2024-04-26T11:24:00.564 INFO:tasks.workunit.client.0.smithi073.stdout:2/280: fsync dd/de/f3f 0 2024-04-26T11:24:00.565 INFO:tasks.workunit.client.0.smithi073.stdout:5/293: dread - d4/d8/d9/d42/d4d/f61 zero size 2024-04-26T11:24:00.565 INFO:tasks.workunit.client.0.smithi073.stdout:6/235: mkdir d0/d39/d2b/d2c/d41 0 2024-04-26T11:24:00.565 INFO:tasks.workunit.client.0.smithi073.stdout:7/342: write d1/d11/f36 [3396360,42225] 0 2024-04-26T11:24:00.565 INFO:tasks.workunit.client.0.smithi073.stdout:1/411: rename d1/d6/d7f/d47/c48 to d1/d8/d57/c97 0 2024-04-26T11:24:00.566 INFO:tasks.workunit.client.0.smithi073.stdout:2/281: mknod dd/d1c/c5a 0 2024-04-26T11:24:00.566 INFO:tasks.workunit.client.0.smithi073.stdout:5/294: chown d4/de/d15/f19 227 1 2024-04-26T11:24:00.566 INFO:tasks.workunit.client.0.smithi073.stdout:2/282: rmdir dd/d1c/d1d 39 2024-04-26T11:24:00.566 INFO:tasks.workunit.client.0.smithi073.stdout:6/236: symlink d0/d19/d20/l42 0 2024-04-26T11:24:00.566 INFO:tasks.workunit.client.0.smithi073.stdout:1/412: truncate d1/d6/d7f/f76 1533152 0 2024-04-26T11:24:00.566 INFO:tasks.workunit.client.0.smithi073.stdout:5/295: rmdir d4/de/d23/d4f 39 2024-04-26T11:24:00.567 INFO:tasks.workunit.client.0.smithi073.stdout:7/343: truncate d1/d11/d24/d26/d4b/f6b 384724 0 2024-04-26T11:24:00.567 INFO:tasks.workunit.client.0.smithi073.stdout:6/237: mkdir d0/d39/d2b/d43 0 2024-04-26T11:24:00.567 INFO:tasks.workunit.client.0.smithi073.stdout:8/303: dread d1/d21/d50/f30 [0,4194304] 0 2024-04-26T11:24:00.567 INFO:tasks.workunit.client.0.smithi073.stdout:6/238: readlink d0/l18 0 2024-04-26T11:24:00.568 INFO:tasks.workunit.client.0.smithi073.stdout:1/413: fdatasync d1/d16/d6a/f72 0 2024-04-26T11:24:00.568 INFO:tasks.workunit.client.0.smithi073.stdout:8/304: mkdir d1/d21/d50/d67 0 2024-04-26T11:24:00.568 INFO:tasks.workunit.client.0.smithi073.stdout:1/414: write d1/d73/d34/f43 [309581,47997] 0 2024-04-26T11:24:00.571 INFO:tasks.workunit.client.0.smithi073.stdout:6/239: creat d0/d19/f44 x:0 0 0 2024-04-26T11:24:00.571 INFO:tasks.workunit.client.0.smithi073.stdout:1/415: mkdir d1/d73/d34/d98 0 2024-04-26T11:24:00.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/240: fdatasync d0/dc/d2e/f3a 0 2024-04-26T11:24:00.573 INFO:tasks.workunit.client.0.smithi073.stdout:5/296: rename d4/d8/d9/d42/d4d/f61 to d4/de/d23/d4f/f69 0 2024-04-26T11:24:00.573 INFO:tasks.workunit.client.0.smithi073.stdout:4/315: dread d8/d1a/d1b/d46/d57/f42 [0,4194304] 0 2024-04-26T11:24:00.573 INFO:tasks.workunit.client.0.smithi073.stdout:2/283: dwrite dd/d1c/f43 [0,4194304] 0 2024-04-26T11:24:00.574 INFO:tasks.workunit.client.0.smithi073.stdout:0/284: dread d2/f31 [0,4194304] 0 2024-04-26T11:24:00.574 INFO:tasks.workunit.client.0.smithi073.stdout:1/416: write d1/d73/d40/d54/f87 [198246,66870] 0 2024-04-26T11:24:00.574 INFO:tasks.workunit.client.0.smithi073.stdout:8/305: rmdir d1/d21/d50 39 2024-04-26T11:24:00.575 INFO:tasks.workunit.client.0.smithi073.stdout:4/316: creat d8/d15/f76 x:0 0 0 2024-04-26T11:24:00.576 INFO:tasks.workunit.client.0.smithi073.stdout:2/284: creat dd/de/d2a/f5b x:0 0 0 2024-04-26T11:24:00.576 INFO:tasks.workunit.client.0.smithi073.stdout:7/344: dwrite d1/d11/d24/d26/d3d/d41/d64/f42 [0,4194304] 0 2024-04-26T11:24:00.577 INFO:tasks.workunit.client.0.smithi073.stdout:5/297: symlink d4/de/d15/d60/l6a 0 2024-04-26T11:24:00.577 INFO:tasks.workunit.client.0.smithi073.stdout:1/417: write d1/d8/d5d/f8a [729015,99885] 0 2024-04-26T11:24:00.578 INFO:tasks.workunit.client.0.smithi073.stdout:2/285: chown dd/de/f18 32544 1 2024-04-26T11:24:00.578 INFO:tasks.workunit.client.0.smithi073.stdout:1/418: chown d1/d16 11 1 2024-04-26T11:24:00.578 INFO:tasks.workunit.client.0.smithi073.stdout:7/345: chown d1/d11/c1d 130108 1 2024-04-26T11:24:00.579 INFO:tasks.workunit.client.0.smithi073.stdout:3/255: dread d0/d11/d19/f6 [0,4194304] 0 2024-04-26T11:24:00.580 INFO:tasks.workunit.client.0.smithi073.stdout:1/419: chown d1/d73/d40/d44/d80/f91 161203839 1 2024-04-26T11:24:00.581 INFO:tasks.workunit.client.0.smithi073.stdout:8/306: link d1/d4/c1b d1/d21/d50/c68 0 2024-04-26T11:24:00.581 INFO:tasks.workunit.client.0.smithi073.stdout:7/346: symlink d1/d11/d24/d26/d3d/d41/d64/l77 0 2024-04-26T11:24:00.583 INFO:tasks.workunit.client.0.smithi073.stdout:8/307: creat d1/d4/d37/d5b/f69 x:0 0 0 2024-04-26T11:24:00.583 INFO:tasks.workunit.client.0.smithi073.stdout:7/347: mkdir d1/d33/d68/d78 0 2024-04-26T11:24:00.584 INFO:tasks.workunit.client.0.smithi073.stdout:0/285: dwrite d2/f31 [0,4194304] 0 2024-04-26T11:24:00.585 INFO:tasks.workunit.client.0.smithi073.stdout:5/298: write d4/f20 [1013653,4349] 0 2024-04-26T11:24:00.585 INFO:tasks.workunit.client.0.smithi073.stdout:2/286: truncate dd/de/d38/f3d 2590497 0 2024-04-26T11:24:00.586 INFO:tasks.workunit.client.0.smithi073.stdout:4/317: dwrite d8/d1a/d1b/f26 [0,4194304] 0 2024-04-26T11:24:00.587 INFO:tasks.workunit.client.0.smithi073.stdout:1/420: creat d1/d73/d40/d44/d80/f99 x:0 0 0 2024-04-26T11:24:00.587 INFO:tasks.workunit.client.0.smithi073.stdout:8/308: unlink d1/d21/d2a/f63 0 2024-04-26T11:24:00.587 INFO:tasks.workunit.client.0.smithi073.stdout:6/241: dwrite d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:00.588 INFO:tasks.workunit.client.0.smithi073.stdout:0/286: creat d2/d22/f65 x:0 0 0 2024-04-26T11:24:00.588 INFO:tasks.workunit.client.0.smithi073.stdout:4/318: truncate f5 911207 0 2024-04-26T11:24:00.588 INFO:tasks.workunit.client.0.smithi073.stdout:6/242: stat d0/d39/l1e 0 2024-04-26T11:24:00.589 INFO:tasks.workunit.client.0.smithi073.stdout:5/299: write d4/de/d15/d60/f1a [968511,15334] 0 2024-04-26T11:24:00.589 INFO:tasks.workunit.client.0.smithi073.stdout:7/348: link d1/d33/c1a d1/d11/d24/d29/c79 0 2024-04-26T11:24:00.589 INFO:tasks.workunit.client.0.smithi073.stdout:0/287: creat d2/d1f/d40/f66 x:0 0 0 2024-04-26T11:24:00.589 INFO:tasks.workunit.client.0.smithi073.stdout:4/319: mkdir d8/d15/d1c/d72/d77 0 2024-04-26T11:24:00.590 INFO:tasks.workunit.client.0.smithi073.stdout:1/421: creat d1/d73/d40/d44/d8e/f9a x:0 0 0 2024-04-26T11:24:00.590 INFO:tasks.workunit.client.0.smithi073.stdout:8/309: write d1/d4/d15/f1f [413858,35361] 0 2024-04-26T11:24:00.590 INFO:tasks.workunit.client.0.smithi073.stdout:6/243: mknod d0/d15/d2d/c45 0 2024-04-26T11:24:00.590 INFO:tasks.workunit.client.0.smithi073.stdout:0/288: chown d2/d22/f2f 27814283 1 2024-04-26T11:24:00.591 INFO:tasks.workunit.client.0.smithi073.stdout:3/256: dwrite d0/d11/d19/f39 [0,4194304] 0 2024-04-26T11:24:00.591 INFO:tasks.workunit.client.0.smithi073.stdout:0/289: dread - d2/d1f/d40/f5b zero size 2024-04-26T11:24:00.592 INFO:tasks.workunit.client.0.smithi073.stdout:6/244: write d0/d39/d2b/f3e [181578,837] 0 2024-04-26T11:24:00.593 INFO:tasks.workunit.client.0.smithi073.stdout:9/318: sync 2024-04-26T11:24:00.593 INFO:tasks.workunit.client.0.smithi073.stdout:6/245: chown d0/d19 159950850 1 2024-04-26T11:24:00.593 INFO:tasks.workunit.client.0.smithi073.stdout:0/290: write d2/d22/d51/f64 [22734,85054] 0 2024-04-26T11:24:00.594 INFO:tasks.workunit.client.0.smithi073.stdout:5/300: rename d4/de/d15/d60/l6a to d4/l6b 0 2024-04-26T11:24:00.594 INFO:tasks.workunit.client.0.smithi073.stdout:0/291: fdatasync d2/f3d 0 2024-04-26T11:24:00.595 INFO:tasks.workunit.client.0.smithi073.stdout:3/257: creat d0/d11/d19/db/d3e/d47/f4f x:0 0 0 2024-04-26T11:24:00.598 INFO:tasks.workunit.client.0.smithi073.stdout:3/258: write d0/d11/d19/fc [2836613,99031] 0 2024-04-26T11:24:00.599 INFO:tasks.workunit.client.0.smithi073.stdout:5/301: creat d4/de/d15/d33/f6c x:0 0 0 2024-04-26T11:24:00.599 INFO:tasks.workunit.client.0.smithi073.stdout:0/292: rename d2/d22/l23 to d2/d22/d51/d57/l67 0 2024-04-26T11:24:00.600 INFO:tasks.workunit.client.0.smithi073.stdout:6/246: creat d0/d39/d2b/d2c/d41/f46 x:0 0 0 2024-04-26T11:24:00.601 INFO:tasks.workunit.client.0.smithi073.stdout:3/259: chown d0/d11/d19/db 5 1 2024-04-26T11:24:00.602 INFO:tasks.workunit.client.0.smithi073.stdout:7/349: dwrite d1/d11/d24/d26/d4b/f56 [0,4194304] 0 2024-04-26T11:24:00.602 INFO:tasks.workunit.client.0.smithi073.stdout:1/422: dwrite d1/d8/f15 [0,4194304] 0 2024-04-26T11:24:00.602 INFO:tasks.workunit.client.0.smithi073.stdout:4/320: dwrite d8/d1a/d5e/f69 [0,4194304] 0 2024-04-26T11:24:00.602 INFO:tasks.workunit.client.0.smithi073.stdout:8/310: dwrite d1/d4/d37/f48 [0,4194304] 0 2024-04-26T11:24:00.602 INFO:tasks.workunit.client.0.smithi073.stdout:5/302: chown d4/de/d15/f65 2 1 2024-04-26T11:24:00.603 INFO:tasks.workunit.client.0.smithi073.stdout:6/247: mknod d0/d1a/d26/c47 0 2024-04-26T11:24:00.603 INFO:tasks.workunit.client.0.smithi073.stdout:0/293: rename d2/d37/f54 to d2/d22/f68 0 2024-04-26T11:24:00.603 INFO:tasks.workunit.client.0.smithi073.stdout:4/321: rename d8/d1a/d4d to d8/d1a/d4d/d78 22 2024-04-26T11:24:00.604 INFO:tasks.workunit.client.0.smithi073.stdout:5/303: write d4/d8/d9/f21 [354934,71316] 0 2024-04-26T11:24:00.604 INFO:tasks.workunit.client.0.smithi073.stdout:7/350: write d1/d33/d1b/d66/d50/f6e [5036818,62291] 0 2024-04-26T11:24:00.605 INFO:tasks.workunit.client.0.smithi073.stdout:8/311: mknod d1/d4/d15/c6a 0 2024-04-26T11:24:00.605 INFO:tasks.workunit.client.0.smithi073.stdout:3/260: creat d0/d11/d19/d1d/f50 x:0 0 0 2024-04-26T11:24:00.605 INFO:tasks.workunit.client.0.smithi073.stdout:6/248: mknod d0/d1a/d26/d27/c48 0 2024-04-26T11:24:00.605 INFO:tasks.workunit.client.0.smithi073.stdout:4/322: creat d8/d15/d1c/d51/f79 x:0 0 0 2024-04-26T11:24:00.606 INFO:tasks.workunit.client.0.smithi073.stdout:3/261: fsync d0/d11/d19/f17 0 2024-04-26T11:24:00.607 INFO:tasks.workunit.client.0.smithi073.stdout:7/351: rmdir d1/d11/d24/d26/d3d/d41/d64 39 2024-04-26T11:24:00.607 INFO:tasks.workunit.client.0.smithi073.stdout:1/423: creat d1/d16/d4f/f9b x:0 0 0 2024-04-26T11:24:00.607 INFO:tasks.workunit.client.0.smithi073.stdout:5/304: symlink d4/de/l6d 0 2024-04-26T11:24:00.607 INFO:tasks.workunit.client.0.smithi073.stdout:8/312: link d1/d21/d50/f64 d1/d21/d2a/f6b 0 2024-04-26T11:24:00.607 INFO:tasks.workunit.client.0.smithi073.stdout:3/262: truncate d0/d11/d19/db/f20 4100868 0 2024-04-26T11:24:00.608 INFO:tasks.workunit.client.0.smithi073.stdout:6/249: mkdir d0/d39/d49 0 2024-04-26T11:24:00.608 INFO:tasks.workunit.client.0.smithi073.stdout:1/424: write d1/d73/d40/d54/f5f [1263690,2057] 0 2024-04-26T11:24:00.608 INFO:tasks.workunit.client.0.smithi073.stdout:8/313: fdatasync d1/d21/f29 0 2024-04-26T11:24:00.609 INFO:tasks.workunit.client.0.smithi073.stdout:8/314: chown d1/d21/d50/l23 146120878 1 2024-04-26T11:24:00.609 INFO:tasks.workunit.client.0.smithi073.stdout:1/425: dread - d1/d73/d40/d44/d8e/f9a zero size 2024-04-26T11:24:00.610 INFO:tasks.workunit.client.0.smithi073.stdout:5/305: creat d4/d8/d9/d42/d68/f6e x:0 0 0 2024-04-26T11:24:00.611 INFO:tasks.workunit.client.0.smithi073.stdout:5/306: write d4/de/d23/f36 [5035590,7315] 0 2024-04-26T11:24:00.612 INFO:tasks.workunit.client.0.smithi073.stdout:5/307: mknod d4/d8/d9/c6f 0 2024-04-26T11:24:00.613 INFO:tasks.workunit.client.0.smithi073.stdout:5/308: chown d4/de/d15/d60/l28 30145 1 2024-04-26T11:24:00.614 INFO:tasks.workunit.client.0.smithi073.stdout:4/323: dwrite d8/d14/d60/f6f [0,4194304] 0 2024-04-26T11:24:00.617 INFO:tasks.workunit.client.0.smithi073.stdout:1/426: dwrite d1/d73/d53/f59 [0,4194304] 0 2024-04-26T11:24:00.618 INFO:tasks.workunit.client.0.smithi073.stdout:1/427: creat d1/d16/d61/f9c x:0 0 0 2024-04-26T11:24:00.619 INFO:tasks.workunit.client.0.smithi073.stdout:5/309: dwrite d4/f20 [0,4194304] 0 2024-04-26T11:24:00.619 INFO:tasks.workunit.client.0.smithi073.stdout:1/428: truncate d1/d16/d6a/f71 42083 0 2024-04-26T11:24:00.626 INFO:tasks.workunit.client.0.smithi073.stdout:0/294: read d2/d1f/d40/d48/f52 [153539,83883] 0 2024-04-26T11:24:00.635 INFO:tasks.workunit.client.0.smithi073.stdout:1/429: dread d1/d73/f36 [0,4194304] 0 2024-04-26T11:24:00.636 INFO:tasks.workunit.client.0.smithi073.stdout:2/287: sync 2024-04-26T11:24:00.636 INFO:tasks.workunit.client.0.smithi073.stdout:7/352: sync 2024-04-26T11:24:00.636 INFO:tasks.workunit.client.0.smithi073.stdout:0/295: sync 2024-04-26T11:24:00.636 INFO:tasks.workunit.client.0.smithi073.stdout:3/263: sync 2024-04-26T11:24:00.636 INFO:tasks.workunit.client.0.smithi073.stdout:7/353: chown d1/l58 5972186 1 2024-04-26T11:24:00.637 INFO:tasks.workunit.client.0.smithi073.stdout:7/354: mknod d1/d33/d68/c7a 0 2024-04-26T11:24:00.638 INFO:tasks.workunit.client.0.smithi073.stdout:1/430: truncate d1/f1a 433383 0 2024-04-26T11:24:00.639 INFO:tasks.workunit.client.0.smithi073.stdout:7/355: mkdir d1/d11/d24/d26/d3d/d7b 0 2024-04-26T11:24:00.639 INFO:tasks.workunit.client.0.smithi073.stdout:0/296: link d2/d37/d3c/c41 d2/d22/c69 0 2024-04-26T11:24:00.639 INFO:tasks.workunit.client.0.smithi073.stdout:1/431: readlink d1/d73/d53/l58 0 2024-04-26T11:24:00.642 INFO:tasks.workunit.client.0.smithi073.stdout:1/432: getdents d1/d73/d53 0 2024-04-26T11:24:00.642 INFO:tasks.workunit.client.0.smithi073.stdout:7/356: dread d1/d11/d24/d29/f49 [0,4194304] 0 2024-04-26T11:24:00.644 INFO:tasks.workunit.client.0.smithi073.stdout:7/357: mkdir d1/d11/d24/d26/d3d/d7c 0 2024-04-26T11:24:00.644 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:00.642+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:00.646 INFO:tasks.workunit.client.0.smithi073.stdout:7/358: creat d1/d33/d1b/d66/d50/f7d x:0 0 0 2024-04-26T11:24:00.646 INFO:tasks.workunit.client.0.smithi073.stdout:0/297: dwrite d2/d1f/d40/d48/f5d [0,4194304] 0 2024-04-26T11:24:00.648 INFO:tasks.workunit.client.0.smithi073.stdout:8/315: dread d1/d21/d2a/f2b [0,4194304] 0 2024-04-26T11:24:00.649 INFO:tasks.workunit.client.0.smithi073.stdout:1/433: dwrite d1/d73/d40/f2a [0,4194304] 0 2024-04-26T11:24:00.653 INFO:tasks.workunit.client.0.smithi073.stdout:9/319: dread d0/f10 [0,4194304] 0 2024-04-26T11:24:00.653 INFO:tasks.workunit.client.0.smithi073.stdout:0/298: mkdir d2/d37/d3c/d6a 0 2024-04-26T11:24:00.653 INFO:tasks.workunit.client.0.smithi073.stdout:7/359: creat d1/d11/d24/d26/d3d/f7e x:0 0 0 2024-04-26T11:24:00.653 INFO:tasks.workunit.client.0.smithi073.stdout:1/434: rmdir d1/d6 39 2024-04-26T11:24:00.653 INFO:tasks.workunit.client.0.smithi073.stdout:0/299: write d2/f4f [2260897,48841] 0 2024-04-26T11:24:00.654 INFO:tasks.workunit.client.0.smithi073.stdout:8/316: getdents d1/d4/d4c/d59 0 2024-04-26T11:24:00.655 INFO:tasks.workunit.client.0.smithi073.stdout:6/250: dread d0/dc/f1b [0,4194304] 0 2024-04-26T11:24:00.656 INFO:tasks.workunit.client.0.smithi073.stdout:1/435: mknod d1/d8/d2e/d3c/c9d 0 2024-04-26T11:24:00.656 INFO:tasks.workunit.client.0.smithi073.stdout:5/310: dread d4/d8/f30 [0,4194304] 0 2024-04-26T11:24:00.656 INFO:tasks.workunit.client.0.smithi073.stdout:8/317: creat d1/d4/d4c/f6c x:0 0 0 2024-04-26T11:24:00.656 INFO:tasks.workunit.client.0.smithi073.stdout:6/251: unlink d0/d19/c24 0 2024-04-26T11:24:00.657 INFO:tasks.workunit.client.0.smithi073.stdout:5/311: write d4/de/d15/f19 [2660832,129371] 0 2024-04-26T11:24:00.657 INFO:tasks.workunit.client.0.smithi073.stdout:7/360: rename d1/d11/d24/d26/c37 to d1/d11/d24/d26/d3d/d41/d64/c7f 0 2024-04-26T11:24:00.657 INFO:tasks.workunit.client.0.smithi073.stdout:6/252: write d0/d19/f21 [2166139,60275] 0 2024-04-26T11:24:00.657 INFO:tasks.workunit.client.0.smithi073.stdout:8/318: mknod d1/d21/d50/c6d 0 2024-04-26T11:24:00.658 INFO:tasks.workunit.client.0.smithi073.stdout:1/436: write d1/d8/d57/f65 [5079702,41918] 0 2024-04-26T11:24:00.659 INFO:tasks.workunit.client.0.smithi073.stdout:1/437: readlink d1/l24 0 2024-04-26T11:24:00.659 INFO:tasks.workunit.client.0.smithi073.stdout:5/312: creat d4/de/f70 x:0 0 0 2024-04-26T11:24:00.659 INFO:tasks.workunit.client.0.smithi073.stdout:8/319: symlink d1/d4/d4c/l6e 0 2024-04-26T11:24:00.659 INFO:tasks.workunit.client.0.smithi073.stdout:7/361: read d1/d11/d24/d29/f49 [96141,77302] 0 2024-04-26T11:24:00.659 INFO:tasks.workunit.client.0.smithi073.stdout:4/324: dread d8/f10 [0,4194304] 0 2024-04-26T11:24:00.660 INFO:tasks.workunit.client.0.smithi073.stdout:5/313: fdatasync d4/d8/d9/d42/d68/f6e 0 2024-04-26T11:24:00.660 INFO:tasks.workunit.client.0.smithi073.stdout:8/320: dread - d1/d21/d50/f64 zero size 2024-04-26T11:24:00.660 INFO:tasks.workunit.client.0.smithi073.stdout:6/253: read d0/d39/d2b/f3d [177639,46599] 0 2024-04-26T11:24:00.660 INFO:tasks.workunit.client.0.smithi073.stdout:1/438: creat d1/d73/d40/d44/f9e x:0 0 0 2024-04-26T11:24:00.660 INFO:tasks.workunit.client.0.smithi073.stdout:7/362: mkdir d1/d11/d24/d26/d80 0 2024-04-26T11:24:00.661 INFO:tasks.workunit.client.0.smithi073.stdout:4/325: creat d8/d15/d1c/d72/d77/f7a x:0 0 0 2024-04-26T11:24:00.661 INFO:tasks.workunit.client.0.smithi073.stdout:5/314: creat d4/d8/d9/d42/d68/f71 x:0 0 0 2024-04-26T11:24:00.662 INFO:tasks.workunit.client.0.smithi073.stdout:4/326: readlink d8/d1a/d1b/d24/l4c 0 2024-04-26T11:24:00.662 INFO:tasks.workunit.client.0.smithi073.stdout:5/315: fdatasync d4/de/d23/f36 0 2024-04-26T11:24:00.664 INFO:tasks.workunit.client.0.smithi073.stdout:1/439: mkdir d1/d8/d2e/d37/d9f 0 2024-04-26T11:24:00.664 INFO:tasks.workunit.client.0.smithi073.stdout:5/316: mkdir d4/d72 0 2024-04-26T11:24:00.666 INFO:tasks.workunit.client.0.smithi073.stdout:7/363: dread d1/d33/d1b/d66/d50/f6e [0,4194304] 0 2024-04-26T11:24:00.667 INFO:tasks.workunit.client.0.smithi073.stdout:4/327: rename d8/d1a/d1b/d1d/f2c to d8/d1a/d1b/d46/d57/f7b 0 2024-04-26T11:24:00.668 INFO:tasks.workunit.client.0.smithi073.stdout:9/320: dread d0/d13/f20 [0,4194304] 0 2024-04-26T11:24:00.668 INFO:tasks.workunit.client.0.smithi073.stdout:8/321: dwrite d1/d21/d2a/f39 [0,4194304] 0 2024-04-26T11:24:00.668 INFO:tasks.workunit.client.0.smithi073.stdout:3/264: dread d0/d11/d19/db/f15 [0,4194304] 0 2024-04-26T11:24:00.669 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:24:00.669 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:24:00.669 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:00.670 INFO:tasks.workunit.client.0.smithi073.stdout:4/328: chown d8/d15/d1c/d49/d5a/d6b/f6e 4 1 2024-04-26T11:24:00.670 INFO:tasks.workunit.client.0.smithi073.stdout:4/329: readlink d8/l19 0 2024-04-26T11:24:00.670 INFO:tasks.workunit.client.0.smithi073.stdout:6/254: dwrite d0/d39/d2b/d2c/f3b [0,4194304] 0 2024-04-26T11:24:00.670 INFO:tasks.workunit.client.0.smithi073.stdout:6/255: write d0/f16 [2206593,124193] 0 2024-04-26T11:24:00.670 INFO:tasks.workunit.client.0.smithi073.stdout:4/330: chown d8/d1a/d1b/d24/f3d 0 1 2024-04-26T11:24:00.673 INFO:tasks.workunit.client.0.smithi073.stdout:1/440: symlink d1/d16/d61/la0 0 2024-04-26T11:24:00.674 INFO:tasks.workunit.client.0.smithi073.stdout:7/364: creat d1/d11/d24/d26/d67/f81 x:0 0 0 2024-04-26T11:24:00.674 INFO:tasks.workunit.client.0.smithi073.stdout:8/322: unlink d1/d21/d50/f64 0 2024-04-26T11:24:00.674 INFO:tasks.workunit.client.0.smithi073.stdout:6/256: symlink d0/d39/d2b/l4a 0 2024-04-26T11:24:00.674 INFO:tasks.workunit.client.0.smithi073.stdout:3/265: dwrite d0/f45 [0,4194304] 0 2024-04-26T11:24:00.675 INFO:tasks.workunit.client.0.smithi073.stdout:5/317: mkdir d4/d73 0 2024-04-26T11:24:00.675 INFO:tasks.workunit.client.0.smithi073.stdout:3/266: write d0/f45 [1903226,53324] 0 2024-04-26T11:24:00.678 INFO:tasks.workunit.client.0.smithi073.stdout:4/331: getdents d8/d1a/d5e 0 2024-04-26T11:24:00.679 INFO:tasks.workunit.client.0.smithi073.stdout:4/332: mkdir d8/d1a/d5e/d7c 0 2024-04-26T11:24:00.680 INFO:tasks.workunit.client.0.smithi073.stdout:4/333: fsync d8/d15/d1c/d49/f62 0 2024-04-26T11:24:00.680 INFO:tasks.workunit.client.0.smithi073.stdout:1/441: dwrite d1/d16/d4f/f79 [0,4194304] 0 2024-04-26T11:24:00.681 INFO:tasks.workunit.client.0.smithi073.stdout:1/442: chown d1/d16/d4f 60 1 2024-04-26T11:24:00.681 INFO:tasks.workunit.client.0.smithi073.stdout:3/267: dread d0/d11/f18 [4194304,4194304] 0 2024-04-26T11:24:00.681 INFO:tasks.workunit.client.0.smithi073.stdout:6/257: rename d0/d39 to d0/d1a/d26/d4b 0 2024-04-26T11:24:00.682 INFO:tasks.workunit.client.0.smithi073.stdout:4/334: mknod d8/d14/d60/d64/c7d 0 2024-04-26T11:24:00.682 INFO:tasks.workunit.client.0.smithi073.stdout:7/365: truncate d1/d33/d1b/f1e 2976909 0 2024-04-26T11:24:00.682 INFO:tasks.workunit.client.0.smithi073.stdout:4/335: readlink d8/d1a/d1b/d24/l4c 0 2024-04-26T11:24:00.684 INFO:tasks.workunit.client.0.smithi073.stdout:1/443: truncate d1/d16/d4f/d55/f64 285520 0 2024-04-26T11:24:00.684 INFO:tasks.workunit.client.0.smithi073.stdout:4/336: chown f7 3716995 1 2024-04-26T11:24:00.684 INFO:tasks.workunit.client.0.smithi073.stdout:1/444: dread - d1/d16/d61/f9c zero size 2024-04-26T11:24:00.684 INFO:tasks.workunit.client.0.smithi073.stdout:4/337: mkdir d8/d1a/d1b/d46/d7e 0 2024-04-26T11:24:00.684 INFO:tasks.workunit.client.0.smithi073.stdout:4/338: rmdir d8/d1f 39 2024-04-26T11:24:00.688 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:00.689 INFO:tasks.workunit.client.0.smithi073.stdout:3/268: truncate d0/d11/d19/db/f37 2254874 0 2024-04-26T11:24:00.689 INFO:tasks.workunit.client.0.smithi073.stdout:4/339: dread d8/d14/d60/f6f [0,4194304] 0 2024-04-26T11:24:00.689 INFO:tasks.workunit.client.0.smithi073.stdout:7/366: dwrite d1/f5 [0,4194304] 0 2024-04-26T11:24:00.689 INFO:tasks.workunit.client.0.smithi073.stdout:8/323: read d1/d21/f29 [1373073,122338] 0 2024-04-26T11:24:00.689 INFO:tasks.workunit.client.0.smithi073.stdout:4/340: chown d8/d1a/d1b/d46/d57/f42 91195 1 2024-04-26T11:24:00.691 INFO:tasks.workunit.client.0.smithi073.stdout:3/269: mkdir d0/d11/d19/db/d51 0 2024-04-26T11:24:00.691 INFO:tasks.workunit.client.0.smithi073.stdout:7/367: unlink d1/d11/d24/d26/d67/f81 0 2024-04-26T11:24:00.693 INFO:tasks.workunit.client.0.smithi073.stdout:3/270: write d0/d11/d19/d1d/f44 [751929,104544] 0 2024-04-26T11:24:00.695 INFO:tasks.workunit.client.0.smithi073.stdout:7/368: dread d1/d33/f6a [0,4194304] 0 2024-04-26T11:24:00.696 INFO:tasks.workunit.client.0.smithi073.stdout:8/324: dwrite d1/d21/d50/f42 [0,4194304] 0 2024-04-26T11:24:00.697 INFO:tasks.workunit.client.0.smithi073.stdout:4/341: dwrite f5 [0,4194304] 0 2024-04-26T11:24:00.698 INFO:tasks.workunit.client.0.smithi073.stdout:7/369: symlink d1/d33/d68/l82 0 2024-04-26T11:24:00.699 INFO:tasks.workunit.client.0.smithi073.stdout:8/325: creat d1/d4/d4c/d59/f6f x:0 0 0 2024-04-26T11:24:00.699 INFO:tasks.workunit.client.0.smithi073.stdout:4/342: creat d8/d1a/d5e/d7c/f7f x:0 0 0 2024-04-26T11:24:00.703 INFO:tasks.workunit.client.0.smithi073.stdout:8/326: fdatasync d1/d21/d50/f30 0 2024-04-26T11:24:00.703 INFO:tasks.workunit.client.0.smithi073.stdout:7/370: mknod d1/d33/d1b/c83 0 2024-04-26T11:24:00.703 INFO:tasks.workunit.client.0.smithi073.stdout:4/343: rename d8/d14/f30 to d8/d15/d1c/d72/f80 0 2024-04-26T11:24:00.703 INFO:tasks.workunit.client.0.smithi073.stdout:7/371: rmdir d1/d11/d24/d26/d3d/d41 39 2024-04-26T11:24:00.703 INFO:tasks.workunit.client.0.smithi073.stdout:4/344: write d8/f10 [618501,104620] 0 2024-04-26T11:24:00.704 INFO:tasks.workunit.client.0.smithi073.stdout:4/345: write d8/d1a/d1b/d24/f43 [720337,118764] 0 2024-04-26T11:24:00.704 INFO:tasks.workunit.client.0.smithi073.stdout:7/372: truncate d1/d11/d24/d26/d4b/f70 899689 0 2024-04-26T11:24:00.705 INFO:tasks.workunit.client.0.smithi073.stdout:7/373: write d1/f75 [237407,21253] 0 2024-04-26T11:24:00.706 INFO:tasks.workunit.client.0.smithi073.stdout:4/346: link d8/d1a/d1b/d24/f43 d8/d1a/d1b/d46/f81 0 2024-04-26T11:24:00.707 INFO:tasks.workunit.client.0.smithi073.stdout:1/445: dread d1/d73/d40/f28 [0,4194304] 0 2024-04-26T11:24:00.709 INFO:tasks.workunit.client.0.smithi073.stdout:1/446: chown d1/d6/d7f/f76 1876 1 2024-04-26T11:24:00.709 INFO:tasks.workunit.client.0.smithi073.stdout:2/288: sync 2024-04-26T11:24:00.712 INFO:tasks.workunit.client.0.smithi073.stdout:3/271: dread d0/d11/d23/d3b/f46 [0,4194304] 0 2024-04-26T11:24:00.713 INFO:tasks.workunit.client.0.smithi073.stdout:1/447: creat d1/d8/d2e/d37/d9f/fa1 x:0 0 0 2024-04-26T11:24:00.714 INFO:tasks.workunit.client.0.smithi073.stdout:3/272: stat d0/d11/d19/db/f15 0 2024-04-26T11:24:00.715 INFO:tasks.workunit.client.0.smithi073.stdout:4/347: dwrite d8/f13 [0,4194304] 0 2024-04-26T11:24:00.715 INFO:tasks.workunit.client.0.smithi073.stdout:7/374: dwrite d1/d11/d24/d29/f74 [0,4194304] 0 2024-04-26T11:24:00.716 INFO:tasks.workunit.client.0.smithi073.stdout:7/375: fsync d1/d11/f1c 0 2024-04-26T11:24:00.716 INFO:tasks.workunit.client.0.smithi073.stdout:4/348: write f7 [1252517,54312] 0 2024-04-26T11:24:00.716 INFO:tasks.workunit.client.0.smithi073.stdout:4/349: fdatasync d8/d15/f3e 0 2024-04-26T11:24:00.716 INFO:tasks.workunit.client.0.smithi073.stdout:2/289: dread dd/d1c/f43 [0,4194304] 0 2024-04-26T11:24:00.717 INFO:tasks.workunit.client.0.smithi073.stdout:4/350: chown d8/d15/d1c/d49/c63 216 1 2024-04-26T11:24:00.717 INFO:tasks.workunit.client.0.smithi073.stdout:2/290: write dd/d4c/f42 [1165680,99952] 0 2024-04-26T11:24:00.717 INFO:tasks.workunit.client.0.smithi073.stdout:8/327: dread d1/d4/d15/f1f [0,4194304] 0 2024-04-26T11:24:00.717 INFO:tasks.workunit.client.0.smithi073.stdout:2/291: fdatasync dd/d27/f31 0 2024-04-26T11:24:00.717 INFO:tasks.workunit.client.0.smithi073.stdout:8/328: chown d1/d4/d15 10 1 2024-04-26T11:24:00.723 INFO:tasks.workunit.client.0.smithi073.stdout:7/376: chown d1/d33/d1b/f1e 969 1 2024-04-26T11:24:00.723 INFO:tasks.workunit.client.0.smithi073.stdout:3/273: mkdir d0/d11/d19/d52 0 2024-04-26T11:24:00.724 INFO:tasks.workunit.client.0.smithi073.stdout:4/351: getdents d8/d15/d1c/d72/d77 0 2024-04-26T11:24:00.725 INFO:tasks.workunit.client.0.smithi073.stdout:3/274: write d0/d11/d19/db/f1a [3993948,80314] 0 2024-04-26T11:24:00.725 INFO:tasks.workunit.client.0.smithi073.stdout:7/377: symlink d1/d33/d68/l84 0 2024-04-26T11:24:00.725 INFO:tasks.workunit.client.0.smithi073.stdout:2/292: creat dd/d1c/d1d/f5c x:0 0 0 2024-04-26T11:24:00.726 INFO:tasks.workunit.client.0.smithi073.stdout:1/448: dwrite d1/d73/f1b [0,4194304] 0 2024-04-26T11:24:00.726 INFO:tasks.workunit.client.0.smithi073.stdout:7/378: symlink d1/d11/d24/d29/l85 0 2024-04-26T11:24:00.727 INFO:tasks.workunit.client.0.smithi073.stdout:1/449: chown d1/d6/d7f 40374 1 2024-04-26T11:24:00.728 INFO:tasks.workunit.client.0.smithi073.stdout:3/275: mknod d0/d11/d19/db/d3e/d47/c53 0 2024-04-26T11:24:00.729 INFO:tasks.workunit.client.0.smithi073.stdout:1/450: fsync d1/d6/f22 0 2024-04-26T11:24:00.731 INFO:tasks.workunit.client.0.smithi073.stdout:1/451: mkdir d1/d16/d4f/d55/da2 0 2024-04-26T11:24:00.733 INFO:tasks.workunit.client.0.smithi073.stdout:2/293: dwrite dd/de/f55 [0,4194304] 0 2024-04-26T11:24:00.733 INFO:tasks.workunit.client.0.smithi073.stdout:4/352: dwrite d8/d1a/d1b/d24/f43 [0,4194304] 0 2024-04-26T11:24:00.738 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:24:00.739 INFO:tasks.workunit.client.0.smithi073.stdout:3/276: creat d0/d11/d19/d52/f54 x:0 0 0 2024-04-26T11:24:00.739 INFO:tasks.workunit.client.0.smithi073.stdout:1/452: creat d1/d16/d4f/d55/fa3 x:0 0 0 2024-04-26T11:24:00.739 INFO:tasks.workunit.client.0.smithi073.stdout:1/453: write d1/d16/d4f/d55/d5a/f7a [830962,100978] 0 2024-04-26T11:24:00.740 INFO:tasks.workunit.client.0.smithi073.stdout:1/454: chown d1/d16/d4f/d55/f64 12 1 2024-04-26T11:24:00.741 INFO:tasks.workunit.client.0.smithi073.stdout:4/353: creat d8/d1a/d5e/d7c/f82 x:0 0 0 2024-04-26T11:24:00.741 INFO:tasks.workunit.client.0.smithi073.stdout:7/379: creat d1/d33/f86 x:0 0 0 2024-04-26T11:24:00.741 INFO:tasks.workunit.client.0.smithi073.stdout:2/294: chown dd/d1c/d1d/f36 1599588 1 2024-04-26T11:24:00.741 INFO:tasks.workunit.client.0.smithi073.stdout:9/321: dread d0/d13/db/f23 [0,4194304] 0 2024-04-26T11:24:00.742 INFO:tasks.workunit.client.0.smithi073.stdout:6/258: dread d0/d19/d20/f22 [0,4194304] 0 2024-04-26T11:24:00.742 INFO:tasks.workunit.client.0.smithi073.stdout:7/380: unlink d1/d33/c1a 0 2024-04-26T11:24:00.747 INFO:tasks.workunit.client.0.smithi073.stdout:2/295: mknod dd/de/d38/d53/c5d 0 2024-04-26T11:24:00.747 INFO:tasks.workunit.client.0.smithi073.stdout:9/322: fdatasync d0/d13/d25/d2c/f53 0 2024-04-26T11:24:00.747 INFO:tasks.workunit.client.0.smithi073.stdout:2/296: fsync dd/d4c/f42 0 2024-04-26T11:24:00.747 INFO:tasks.workunit.client.0.smithi073.stdout:7/381: write d1/d11/d24/d29/f74 [275723,10595] 0 2024-04-26T11:24:00.747 INFO:tasks.workunit.client.0.smithi073.stdout:6/259: write d0/d1a/d26/d27/f29 [1141610,16796] 0 2024-04-26T11:24:00.747 INFO:tasks.workunit.client.0.smithi073.stdout:3/277: dwrite d0/f2e [0,4194304] 0 2024-04-26T11:24:00.747 INFO:tasks.workunit.client.0.smithi073.stdout:9/323: dread d0/d13/f20 [0,4194304] 0 2024-04-26T11:24:00.747 INFO:tasks.workunit.client.0.smithi073.stdout:7/382: symlink d1/d11/d10/l87 0 2024-04-26T11:24:00.747 INFO:tasks.workunit.client.0.smithi073.stdout:9/324: fsync d0/d13/f5b 0 2024-04-26T11:24:00.749 INFO:tasks.workunit.client.0.smithi073.stdout:2/297: truncate dd/de/d38/f3d 2253229 0 2024-04-26T11:24:00.749 INFO:tasks.workunit.client.0.smithi073.stdout:3/278: creat d0/d11/d19/db/d3e/d3f/f55 x:0 0 0 2024-04-26T11:24:00.749 INFO:tasks.workunit.client.0.smithi073.stdout:9/325: symlink d0/l68 0 2024-04-26T11:24:00.749 INFO:tasks.workunit.client.0.smithi073.stdout:6/260: symlink d0/d1a/d26/d4b/d38/l4c 0 2024-04-26T11:24:00.749 INFO:tasks.workunit.client.0.smithi073.stdout:2/298: chown dd/d1c/l26 135 1 2024-04-26T11:24:00.749 INFO:tasks.workunit.client.0.smithi073.stdout:3/279: fdatasync d0/d11/d19/d1d/f50 0 2024-04-26T11:24:00.749 INFO:tasks.workunit.client.0.smithi073.stdout:7/383: symlink d1/d11/d24/d26/d3d/d41/l88 0 2024-04-26T11:24:00.749 INFO:tasks.workunit.client.0.smithi073.stdout:6/261: stat d0/d1a/d26/d4b/d2b/d2c/f3b 0 2024-04-26T11:24:00.750 INFO:tasks.workunit.client.0.smithi073.stdout:3/280: symlink d0/d11/d23/d3b/l56 0 2024-04-26T11:24:00.756 INFO:tasks.workunit.client.0.smithi073.stdout:9/326: mknod d0/d13/db/d2e/d51/c69 0 2024-04-26T11:24:00.757 INFO:tasks.workunit.client.0.smithi073.stdout:2/299: dwrite dd/d1c/f43 [0,4194304] 0 2024-04-26T11:24:00.759 INFO:tasks.workunit.client.0.smithi073.stdout:6/262: dwrite d0/d1a/d26/d4b/d2b/f3e [0,4194304] 0 2024-04-26T11:24:00.760 INFO:tasks.workunit.client.0.smithi073.stdout:2/300: truncate dd/d1c/f43 4597654 0 2024-04-26T11:24:00.760 INFO:tasks.workunit.client.0.smithi073.stdout:7/384: dwrite d1/d11/d24/d26/d3d/d41/d64/f42 [0,4194304] 0 2024-04-26T11:24:00.760 INFO:tasks.workunit.client.0.smithi073.stdout:3/281: dwrite d0/f45 [0,4194304] 0 2024-04-26T11:24:00.761 INFO:tasks.workunit.client.0.smithi073.stdout:6/263: mkdir d0/d19/d4d 0 2024-04-26T11:24:00.762 INFO:tasks.workunit.client.0.smithi073.stdout:9/327: truncate d0/d13/f18 230568 0 2024-04-26T11:24:00.762 INFO:tasks.workunit.client.0.smithi073.stdout:2/301: creat dd/d1c/f5e x:0 0 0 2024-04-26T11:24:00.763 INFO:tasks.workunit.client.0.smithi073.stdout:6/264: mkdir d0/d1a/d4e 0 2024-04-26T11:24:00.763 INFO:tasks.workunit.client.0.smithi073.stdout:2/302: fdatasync dd/f1a 0 2024-04-26T11:24:00.763 INFO:tasks.workunit.client.0.smithi073.stdout:9/328: unlink d0/d13/l4 0 2024-04-26T11:24:00.764 INFO:tasks.workunit.client.0.smithi073.stdout:2/303: truncate dd/de/f3f 710112 0 2024-04-26T11:24:00.764 INFO:tasks.workunit.client.0.smithi073.stdout:3/282: dread d0/d11/d19/db/f20 [0,4194304] 0 2024-04-26T11:24:00.767 INFO:tasks.workunit.client.0.smithi073.stdout:7/385: truncate d1/d11/d24/d26/d67/f23 3102842 0 2024-04-26T11:24:00.769 INFO:tasks.workunit.client.0.smithi073.stdout:3/283: dread d0/f2e [0,4194304] 0 2024-04-26T11:24:00.771 INFO:tasks.workunit.client.0.smithi073.stdout:7/386: symlink d1/d11/d24/d26/d3d/d7b/l89 0 2024-04-26T11:24:00.771 INFO:tasks.workunit.client.0.smithi073.stdout:2/304: dwrite dd/d1c/d1d/f20 [0,4194304] 0 2024-04-26T11:24:00.772 INFO:tasks.workunit.client.0.smithi073.stdout:4/354: dread d8/d1a/d1b/d1d/f56 [0,4194304] 0 2024-04-26T11:24:00.772 INFO:tasks.workunit.client.0.smithi073.stdout:7/387: mkdir d1/d11/d24/d26/d3d/d7b/d8a 0 2024-04-26T11:24:00.772 INFO:tasks.workunit.client.0.smithi073.stdout:2/305: dread - dd/d1c/f5e zero size 2024-04-26T11:24:00.773 INFO:tasks.workunit.client.0.smithi073.stdout:7/388: chown d1/d11/d24/d26/d3d/d41/d64/f4c 344 1 2024-04-26T11:24:00.773 INFO:tasks.workunit.client.0.smithi073.stdout:3/284: creat d0/d11/d19/f57 x:0 0 0 2024-04-26T11:24:00.773 INFO:tasks.workunit.client.0.smithi073.stdout:4/355: creat d8/d1a/d1b/f83 x:0 0 0 2024-04-26T11:24:00.774 INFO:tasks.workunit.client.0.smithi073.stdout:7/389: stat d1/d33/c17 0 2024-04-26T11:24:00.775 INFO:tasks.workunit.client.0.smithi073.stdout:4/356: rmdir d8/d15/d1c 39 2024-04-26T11:24:00.775 INFO:tasks.workunit.client.0.smithi073.stdout:2/306: getdents dd/de 0 2024-04-26T11:24:00.777 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:00.774+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:00.777 INFO:tasks.workunit.client.0.smithi073.stdout:4/357: rename d8/d15/d1c/d49/d5a/d6b to d8/d15/d1c/d49/d84 0 2024-04-26T11:24:00.778 INFO:tasks.workunit.client.0.smithi073.stdout:4/358: readlink d8/d1a/d1b/l20 0 2024-04-26T11:24:00.778 INFO:tasks.workunit.client.0.smithi073.stdout:9/329: dwrite d0/d13/f18 [0,4194304] 0 2024-04-26T11:24:00.778 INFO:tasks.workunit.client.0.smithi073.stdout:3/285: dread d0/d11/d19/f39 [0,4194304] 0 2024-04-26T11:24:00.780 INFO:tasks.workunit.client.0.smithi073.stdout:4/359: rename d8/d15/d1c/d51 to d8/d15/d1c/d49/d85 0 2024-04-26T11:24:00.780 INFO:tasks.workunit.client.0.smithi073.stdout:3/286: stat d0/d11/d23/c4b 0 2024-04-26T11:24:00.780 INFO:tasks.workunit.client.0.smithi073.stdout:4/360: chown f7 407541 1 2024-04-26T11:24:00.781 INFO:tasks.workunit.client.0.smithi073.stdout:4/361: mkdir d8/d1a/d86 0 2024-04-26T11:24:00.781 INFO:tasks.workunit.client.0.smithi073.stdout:3/287: creat d0/d26/f58 x:0 0 0 2024-04-26T11:24:00.782 INFO:tasks.workunit.client.0.smithi073.stdout:4/362: chown d8/d15/d1c/d49/d84/f6e 827 1 2024-04-26T11:24:00.782 INFO:tasks.workunit.client.0.smithi073.stdout:3/288: rename d0/d11/d19/db/f20 to d0/d11/d19/db/d3e/d3f/f59 0 2024-04-26T11:24:00.783 INFO:tasks.workunit.client.0.smithi073.stdout:9/330: link d0/d13/db/d2e/d51/c58 d0/d1a/d2f/c6a 0 2024-04-26T11:24:00.783 INFO:tasks.workunit.client.0.smithi073.stdout:3/289: chown d0/d11/d19/fc 40 1 2024-04-26T11:24:00.784 INFO:tasks.workunit.client.0.smithi073.stdout:9/331: write d0/d13/db/d2e/d51/f67 [631394,73065] 0 2024-04-26T11:24:00.784 INFO:tasks.workunit.client.0.smithi073.stdout:2/307: write dd/de/d38/f3d [427124,35108] 0 2024-04-26T11:24:00.785 INFO:tasks.workunit.client.0.smithi073.stdout:9/332: read d0/d13/f20 [1716230,52096] 0 2024-04-26T11:24:00.785 INFO:tasks.workunit.client.0.smithi073.stdout:0/300: sync 2024-04-26T11:24:00.786 INFO:tasks.workunit.client.0.smithi073.stdout:5/318: sync 2024-04-26T11:24:00.786 INFO:tasks.workunit.client.0.smithi073.stdout:8/329: sync 2024-04-26T11:24:00.786 INFO:tasks.workunit.client.0.smithi073.stdout:2/308: creat dd/de/d49/d4b/f5f x:0 0 0 2024-04-26T11:24:00.788 INFO:tasks.workunit.client.0.smithi073.stdout:4/363: dread d8/f13 [0,4194304] 0 2024-04-26T11:24:00.788 INFO:tasks.workunit.client.0.smithi073.stdout:2/309: mkdir dd/de/d38/d53/d60 0 2024-04-26T11:24:00.788 INFO:tasks.workunit.client.0.smithi073.stdout:8/330: symlink d1/l70 0 2024-04-26T11:24:00.788 INFO:tasks.workunit.client.0.smithi073.stdout:0/301: creat d2/d37/d3c/d6a/f6b x:0 0 0 2024-04-26T11:24:00.788 INFO:tasks.workunit.client.0.smithi073.stdout:4/364: readlink l4 0 2024-04-26T11:24:00.788 INFO:tasks.workunit.client.0.smithi073.stdout:5/319: symlink d4/de/l74 0 2024-04-26T11:24:00.789 INFO:tasks.workunit.client.0.smithi073.stdout:0/302: fsync d2/d22/f2f 0 2024-04-26T11:24:00.789 INFO:tasks.workunit.client.0.smithi073.stdout:2/310: creat dd/de/d49/d4b/f61 x:0 0 0 2024-04-26T11:24:00.789 INFO:tasks.workunit.client.0.smithi073.stdout:8/331: creat d1/d4/d37/f71 x:0 0 0 2024-04-26T11:24:00.789 INFO:tasks.workunit.client.0.smithi073.stdout:5/320: symlink d4/d8/d9/d5f/l75 0 2024-04-26T11:24:00.789 INFO:tasks.workunit.client.0.smithi073.stdout:2/311: fsync dd/f1a 0 2024-04-26T11:24:00.790 INFO:tasks.workunit.client.0.smithi073.stdout:3/290: dwrite d0/d11/d19/f27 [0,4194304] 0 2024-04-26T11:24:00.792 INFO:tasks.workunit.client.0.smithi073.stdout:2/312: rmdir dd/d4c 39 2024-04-26T11:24:00.793 INFO:tasks.workunit.client.0.smithi073.stdout:5/321: mknod d4/d73/c76 0 2024-04-26T11:24:00.793 INFO:tasks.workunit.client.0.smithi073.stdout:3/291: mknod d0/d11/d19/c5a 0 2024-04-26T11:24:00.794 INFO:tasks.workunit.client.0.smithi073.stdout:5/322: fsync d4/d8/d9/f46 0 2024-04-26T11:24:00.794 INFO:tasks.workunit.client.0.smithi073.stdout:8/332: truncate d1/d21/d2c/f57 380547 0 2024-04-26T11:24:00.794 INFO:tasks.workunit.client.0.smithi073.stdout:3/292: mkdir d0/d11/d19/d5b 0 2024-04-26T11:24:00.795 INFO:tasks.workunit.client.0.smithi073.stdout:8/333: dread - d1/d4/d15/f60 zero size 2024-04-26T11:24:00.795 INFO:tasks.workunit.client.0.smithi073.stdout:3/293: truncate d0/d26/f58 383840 0 2024-04-26T11:24:00.796 INFO:tasks.workunit.client.0.smithi073.stdout:4/365: dwrite d8/d15/d1c/d49/d85/f71 [0,4194304] 0 2024-04-26T11:24:00.797 INFO:tasks.workunit.client.0.smithi073.stdout:3/294: write d0/d11/d19/f25 [1139052,33229] 0 2024-04-26T11:24:00.798 INFO:tasks.workunit.client.0.smithi073.stdout:5/323: write d4/de/d15/d60/f16 [4154212,45997] 0 2024-04-26T11:24:00.799 INFO:tasks.workunit.client.0.smithi073.stdout:4/366: unlink d8/d1a/d1b/d46/d57/f7b 0 2024-04-26T11:24:00.801 INFO:tasks.workunit.client.0.smithi073.stdout:5/324: symlink d4/de/d23/d4f/d54/l77 0 2024-04-26T11:24:00.802 INFO:tasks.workunit.client.0.smithi073.stdout:2/313: dwrite dd/de/d49/d4b/f5f [0,4194304] 0 2024-04-26T11:24:00.803 INFO:tasks.workunit.client.0.smithi073.stdout:4/367: write d8/d1a/d1b/d24/f3d [4699798,76324] 0 2024-04-26T11:24:00.804 INFO:tasks.workunit.client.0.smithi073.stdout:8/334: dwrite d1/d4/d37/f71 [0,4194304] 0 2024-04-26T11:24:00.805 INFO:tasks.workunit.client.0.smithi073.stdout:3/295: dwrite d0/d11/d19/db/fe [4194304,4194304] 0 2024-04-26T11:24:00.805 INFO:tasks.workunit.client.0.smithi073.stdout:9/333: dread d0/d13/db/d2e/d51/f67 [0,4194304] 0 2024-04-26T11:24:00.806 INFO:tasks.workunit.client.0.smithi073.stdout:5/325: rmdir d4/d8/d9/d42/d4d 0 2024-04-26T11:24:00.806 INFO:tasks.workunit.client.0.smithi073.stdout:9/334: mknod d0/d1a/c6b 0 2024-04-26T11:24:00.807 INFO:tasks.workunit.client.0.smithi073.stdout:8/335: creat d1/d4/d4c/d66/f72 x:0 0 0 2024-04-26T11:24:00.807 INFO:tasks.workunit.client.0.smithi073.stdout:2/314: rename dd/de/ff to dd/d4c/d48/f62 0 2024-04-26T11:24:00.807 INFO:tasks.workunit.client.0.smithi073.stdout:8/336: dread - d1/d4/d4c/f6c zero size 2024-04-26T11:24:00.809 INFO:tasks.workunit.client.0.smithi073.stdout:5/326: creat d4/de/d23/d4f/d54/f78 x:0 0 0 2024-04-26T11:24:00.809 INFO:tasks.workunit.client.0.smithi073.stdout:2/315: mknod dd/de/c63 0 2024-04-26T11:24:00.813 INFO:tasks.workunit.client.0.smithi073.stdout:8/337: dread d1/d21/d50/f2e [0,4194304] 0 2024-04-26T11:24:00.814 INFO:tasks.workunit.client.0.smithi073.stdout:8/338: rmdir d1/d21/d58 0 2024-04-26T11:24:00.814 INFO:tasks.workunit.client.0.smithi073.stdout:3/296: dwrite d0/d11/d19/db/f37 [0,4194304] 0 2024-04-26T11:24:00.815 INFO:tasks.workunit.client.0.smithi073.stdout:9/335: dwrite d0/f3f [0,4194304] 0 2024-04-26T11:24:00.815 INFO:tasks.workunit.client.0.smithi073.stdout:3/297: chown d0/d2d/c30 587 1 2024-04-26T11:24:00.817 INFO:tasks.workunit.client.0.smithi073.stdout:3/298: chown d0/d11/f18 0 1 2024-04-26T11:24:00.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/336: chown d0/d13/d25/d2c/f3a 512247592 1 2024-04-26T11:24:00.817 INFO:tasks.workunit.client.0.smithi073.stdout:8/339: write d1/d21/d2a/f6b [385868,32857] 0 2024-04-26T11:24:00.818 INFO:tasks.workunit.client.0.smithi073.stdout:9/337: chown d0/d13/db/d2e/d46 49 1 2024-04-26T11:24:00.819 INFO:tasks.workunit.client.0.smithi073.stdout:9/338: mkdir d0/d6c 0 2024-04-26T11:24:00.819 INFO:tasks.workunit.client.0.smithi073.stdout:8/340: dread d1/d21/d50/f30 [0,4194304] 0 2024-04-26T11:24:00.820 INFO:tasks.workunit.client.0.smithi073.stdout:5/327: dwrite d4/de/d15/d60/f16 [0,4194304] 0 2024-04-26T11:24:00.820 INFO:tasks.workunit.client.0.smithi073.stdout:8/341: chown d1/d21/d50/f30 69589 1 2024-04-26T11:24:00.822 INFO:tasks.workunit.client.0.smithi073.stdout:3/299: truncate d0/d26/f29 2135283 0 2024-04-26T11:24:00.823 INFO:tasks.workunit.client.0.smithi073.stdout:9/339: rename d0/d13/db/d2e/f34 to d0/d13/d5a/d5e/f6d 0 2024-04-26T11:24:00.824 INFO:tasks.workunit.client.0.smithi073.stdout:3/300: link d0/d11/d19/db/fe d0/d11/d23/d3b/f5c 0 2024-04-26T11:24:00.824 INFO:tasks.workunit.client.0.smithi073.stdout:3/301: creat d0/d11/d19/d1d/f5d x:0 0 0 2024-04-26T11:24:00.829 INFO:tasks.workunit.client.0.smithi073.stdout:3/302: dwrite d0/f7 [0,4194304] 0 2024-04-26T11:24:00.832 INFO:tasks.workunit.client.0.smithi073.stdout:8/342: truncate d1/d4/d37/f71 3419273 0 2024-04-26T11:24:00.833 INFO:tasks.workunit.client.0.smithi073.stdout:8/343: read d1/d21/d50/f30 [166716,77653] 0 2024-04-26T11:24:00.835 INFO:tasks.workunit.client.0.smithi073.stdout:3/303: link d0/d26/f29 d0/d11/d19/d5b/f5e 0 2024-04-26T11:24:00.836 INFO:tasks.workunit.client.0.smithi073.stdout:3/304: symlink d0/d11/d23/d3b/d3c/l5f 0 2024-04-26T11:24:00.838 INFO:tasks.workunit.client.0.smithi073.stdout:9/340: dread d0/d13/f32 [0,4194304] 0 2024-04-26T11:24:00.838 INFO:tasks.workunit.client.0.smithi073.stdout:3/305: write d0/d11/d19/f39 [4673359,114401] 0 2024-04-26T11:24:00.839 INFO:tasks.workunit.client.0.smithi073.stdout:8/344: dwrite d1/d4/d37/f4f [0,4194304] 0 2024-04-26T11:24:00.840 INFO:tasks.workunit.client.0.smithi073.stdout:3/306: mkdir d0/d11/d19/db/d3e/d3f/d4d/d60 0 2024-04-26T11:24:00.840 INFO:tasks.workunit.client.0.smithi073.stdout:8/345: symlink d1/d4/d4c/d66/l73 0 2024-04-26T11:24:00.841 INFO:tasks.workunit.client.0.smithi073.stdout:3/307: creat d0/f61 x:0 0 0 2024-04-26T11:24:00.841 INFO:tasks.workunit.client.0.smithi073.stdout:9/341: rename d0/d13/db/d2e/d3b/l57 to d0/d1a/d2f/l6e 0 2024-04-26T11:24:00.841 INFO:tasks.workunit.client.0.smithi073.stdout:8/346: rmdir d1/d4 39 2024-04-26T11:24:00.843 INFO:tasks.workunit.client.0.smithi073.stdout:9/342: rename d0/d1a/d2f/c6a to d0/d13/db/d2e/d59/c6f 0 2024-04-26T11:24:00.845 INFO:tasks.workunit.client.0.smithi073.stdout:9/343: write d0/d13/f60 [745213,75816] 0 2024-04-26T11:24:00.847 INFO:tasks.workunit.client.0.smithi073.stdout:9/344: write d0/d13/d25/d2c/f3a [1082594,105588] 0 2024-04-26T11:24:00.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-04-26T11:24:00.849 INFO:tasks.workunit.client.0.smithi073.stdout:8/347: dwrite d1/d4/f12 [0,4194304] 0 2024-04-26T11:24:00.849 INFO:tasks.workunit.client.0.smithi073.stdout:2/316: dread fb [0,4194304] 0 2024-04-26T11:24:00.849 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:00.844+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:00.851 INFO:tasks.workunit.client.0.smithi073.stdout:9/345: rename d0/d13/db/d2e to d0/d1a/d4e/d70 0 2024-04-26T11:24:00.851 INFO:tasks.workunit.client.0.smithi073.stdout:5/328: dread d4/de/f2c [0,4194304] 0 2024-04-26T11:24:00.852 INFO:tasks.workunit.client.0.smithi073.stdout:2/317: symlink dd/d4c/d48/l64 0 2024-04-26T11:24:00.852 INFO:tasks.workunit.client.0.smithi073.stdout:9/346: mknod d0/d13/d5a/d5e/c71 0 2024-04-26T11:24:00.852 INFO:tasks.workunit.client.0.smithi073.stdout:5/329: symlink d4/de/d23/d3b/l79 0 2024-04-26T11:24:00.853 INFO:tasks.workunit.client.0.smithi073.stdout:8/348: creat d1/d4/f74 x:0 0 0 2024-04-26T11:24:00.853 INFO:tasks.workunit.client.0.smithi073.stdout:2/318: dread - dd/de/d38/d4e/f51 zero size 2024-04-26T11:24:00.853 INFO:tasks.workunit.client.0.smithi073.stdout:5/330: chown d4/de/d15/d33/f40 27808774 1 2024-04-26T11:24:00.853 INFO:tasks.workunit.client.0.smithi073.stdout:9/347: mknod d0/d13/d25/d2c/c72 0 2024-04-26T11:24:00.855 INFO:tasks.workunit.client.0.smithi073.stdout:5/331: creat d4/f7a x:0 0 0 2024-04-26T11:24:00.855 INFO:tasks.workunit.client.0.smithi073.stdout:2/319: link dd/de/c63 dd/de/d38/d53/d60/c65 0 2024-04-26T11:24:00.856 INFO:tasks.workunit.client.0.smithi073.stdout:2/320: write f9 [1077211,43722] 0 2024-04-26T11:24:00.856 INFO:tasks.workunit.client.0.smithi073.stdout:5/332: dread - d4/de/d15/d33/f4e zero size 2024-04-26T11:24:00.857 INFO:tasks.workunit.client.0.smithi073.stdout:2/321: chown l4 9358 1 2024-04-26T11:24:00.858 INFO:tasks.workunit.client.0.smithi073.stdout:8/349: truncate d1/f26 2652054 0 2024-04-26T11:24:00.858 INFO:tasks.workunit.client.0.smithi073.stdout:5/333: read d4/d8/d9/f21 [1215290,127279] 0 2024-04-26T11:24:00.859 INFO:tasks.workunit.client.0.smithi073.stdout:8/350: creat d1/d4/d15/f75 x:0 0 0 2024-04-26T11:24:00.860 INFO:tasks.workunit.client.0.smithi073.stdout:9/348: dwrite d0/f40 [0,4194304] 0 2024-04-26T11:24:00.860 INFO:tasks.workunit.client.0.smithi073.stdout:8/351: truncate d1/d21/d2c/f57 417251 0 2024-04-26T11:24:00.861 INFO:tasks.workunit.client.0.smithi073.stdout:8/352: write d1/d4/d37/f48 [3405513,55896] 0 2024-04-26T11:24:00.862 INFO:tasks.workunit.client.0.smithi073.stdout:8/353: write d1/d21/d2c/f3b [377312,105483] 0 2024-04-26T11:24:00.864 INFO:tasks.workunit.client.0.smithi073.stdout:8/354: read d1/d21/d2a/f52 [348184,34591] 0 2024-04-26T11:24:00.865 INFO:tasks.workunit.client.0.smithi073.stdout:1/455: sync 2024-04-26T11:24:00.866 INFO:tasks.workunit.client.0.smithi073.stdout:3/308: dread d0/d11/f13 [0,4194304] 0 2024-04-26T11:24:00.868 INFO:tasks.workunit.client.0.smithi073.stdout:2/322: dread dd/d1c/d1d/f36 [0,4194304] 0 2024-04-26T11:24:00.868 INFO:tasks.workunit.client.0.smithi073.stdout:5/334: truncate d4/de/d15/f19 1343335 0 2024-04-26T11:24:00.868 INFO:tasks.workunit.client.0.smithi073.stdout:2/323: stat dd/d4c/d48/d46 0 2024-04-26T11:24:00.869 INFO:tasks.workunit.client.0.smithi073.stdout:5/335: read - d4/d8/d9/d42/d68/f71 zero size 2024-04-26T11:24:00.870 INFO:tasks.workunit.client.0.smithi073.stdout:2/324: symlink dd/d4c/d48/d46/l66 0 2024-04-26T11:24:00.870 INFO:tasks.workunit.client.0.smithi073.stdout:1/456: dwrite d1/d73/d34/f7e [0,4194304] 0 2024-04-26T11:24:00.872 INFO:tasks.workunit.client.0.smithi073.stdout:2/325: rename dd/d4c/d48/f62 to dd/de/d49/f67 0 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3873410~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4624163970000001, 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.049732789999999999, 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410916+0000", 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410925+0000", 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1030000000000002e-06 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410943+0000", 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8139999999999999e-05 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410957+0000", 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3939e-05 2024-04-26T11:24:00.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.453976+0000", 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043019730999999999 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.454179+0000", 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000202964 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460360+0000", 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061803910000000004 2024-04-26T11:24:00.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460473+0000", 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113402 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460650+0000", 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177236 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.880 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3874807~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4623655209999997, 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.049989594999999998, 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410967+0000", 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410985+0000", 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7580000000000001e-05 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411007+0000", 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1752000000000001e-05 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411021+0000", 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749999999999999e-05 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455415+0000", 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044393763000000003 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455544+0000", 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012836299999999999 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460672+0000", 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051280620000000001 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460775+0000", 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010309 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460958+0000", 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018335500000000001 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3876210~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4622996529999996, 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050240140000000003, 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411033+0000", 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411042+0000", 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7930000000000003e-06 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411064+0000", 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1869999999999999e-05 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411077+0000", 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.456448+0000", 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.045371178999999998 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.456668+0000", 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022021899999999999 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460979+0000", 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043111490000000002 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461088+0000", 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010888 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461274+0000", 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018618000000000001 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.889 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3877613~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4622457310000003, 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.052990624, 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411087+0000", 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411105+0000", 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7580000000000001e-05 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411124+0000", 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9108999999999999e-05 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411139+0000", 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4676e-05 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.458214+0000", 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.047075327 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.458359+0000", 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537299999999999 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.463839+0000", 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054799050000000002 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.463918+0000", 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8887999999999994e-05 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464079+0000", 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160719 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3879013~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4621820620000001, 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053236793999999997, 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411151+0000", 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411160+0000", 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9760000000000001e-06 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411180+0000", 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9902999999999999e-05 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411196+0000", 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6129000000000001e-05 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459318+0000", 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048122047000000001 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459507+0000", 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189598 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464107+0000", 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045994979999999996 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464199+0000", 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2083999999999995e-05 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464389+0000", 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189662 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3880419~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.898 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.462125501, 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.055882977, 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411207+0000", 2024-04-26T11:24:00.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411215+0000", 2024-04-26T11:24:00.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000007e-06 2024-04-26T11:24:00.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411234+0000", 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8563000000000002e-05 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411248+0000", 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4499e-05 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461384+0000", 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050136067999999999 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461534+0000", 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014934400000000001 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.466771+0000", 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052373610000000003 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.466900+0000", 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012929200000000001 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467091+0000", 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000191153 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3881822~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4620732219999999, 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.057533475000000001, 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.903 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411260+0000", 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411279+0000", 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9055999999999998e-05 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411300+0000", 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1556000000000002e-05 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411315+0000", 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4307e-05 2024-04-26T11:24:00.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.462268+0000", 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050953713999999997 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.462480+0000", 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021157500000000001 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468480+0000", 2024-04-26T11:24:00.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059997169999999999 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468609+0000", 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012991700000000001 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468794+0000", 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000184766 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.907 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3883227~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4620069170000001, 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.060065495000000003, 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:24:00.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411326+0000", 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411334+0000", 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7570000000000004e-06 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411351+0000", 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7523000000000001e-05 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411367+0000", 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5909e-05 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464493+0000", 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053126200999999998 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464716+0000", 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000222244 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471192+0000", 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064765689999999997 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471299+0000", 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010697200000000001 2024-04-26T11:24:00.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471393+0000", 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3399999999999993e-05 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3884626~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4619547349999999, 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.060192189, 2024-04-26T11:24:00.912 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411378+0000", 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411394+0000", 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6047000000000001e-05 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411413+0000", 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9159000000000001e-05 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.914 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411428+0000", 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4543e-05 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465657+0000", 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.054228982000000002 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465838+0000", 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000180719 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471407+0000", 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055695709999999997 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471487+0000", 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9555999999999995e-05 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471571+0000", 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4635000000000005e-05 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.916 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 3886023~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4618937489999997, 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064564381000000004, 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411439+0000", 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411449+0000", 2024-04-26T11:24:00.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0056e-05 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411467+0000", 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7367000000000002e-05 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411484+0000", 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6949e-05 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467227+0000", 2024-04-26T11:24:00.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.055743085999999997 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467347+0000", 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012048999999999999 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.475804+0000", 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084571980000000008 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.475897+0000", 2024-04-26T11:24:00.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2601000000000003e-05 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476005+0000", 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010764099999999999 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 3887426~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4618386680000004, 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064774331000000004, 2024-04-26T11:24:00.921 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411494+0000", 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411509+0000", 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4463e-05 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411526+0000", 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7226000000000001e-05 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411540+0000", 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4063000000000001e-05 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468882+0000", 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.057341548999999999 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.469023+0000", 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141357 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476029+0000", 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070060829999999998 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476132+0000", 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103045 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476270+0000", 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013762099999999999 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.925 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:8088 4.5 4:a3b551eb:::100000024d3.00000000:head [write 0~479] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4530366409999997, 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.056313184000000002, 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 8088 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420295+0000", 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999971 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420310+0000", 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.554e-05 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420344+0000", 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4195e-05 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420365+0000", 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0726000000000001e-05 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468869+0000", 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048503444 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.469179+0000", 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030999599999999999 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476290+0000", 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071110239999999996 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476425+0000", 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013510200000000001 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476611+0000", 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018590699999999999 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.930 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 3985361~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4181397110000002, 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048391816999999997, 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:24:00.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455192+0000", 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455205+0000", 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2816000000000001e-05 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455231+0000", 2024-04-26T11:24:00.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455247+0000", 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6446000000000001e-05 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.495318+0000", 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.040070460000000002 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.495514+0000", 2024-04-26T11:24:00.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019605800000000001 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503340+0000", 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078268000000000001 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503478+0000", 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137847 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503586+0000", 2024-04-26T11:24:00.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0001078 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 3986766~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.418057943, 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048511780999999997, 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455275+0000", 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455295+0000", 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9556999999999999e-05 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455309+0000", 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4129e-05 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455318+0000", 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9099999999999994e-06 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.497677+0000", 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042359494999999997 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.497779+0000", 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101652 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503601+0000", 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058225500000000001 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503667+0000", 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6165000000000001e-05 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503788+0000", 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012043 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 4002753~2766 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:24:00.939 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4134777029999999, 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.051229524999999998, 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459855+0000", 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459863+0000", 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1429999999999998e-06 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459873+0000", 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459885+0000", 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.253e-05 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.501870+0000", 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041984759000000003 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.502112+0000", 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241387 2024-04-26T11:24:00.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510903+0000", 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087910309999999995 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510975+0000", 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2683999999999997e-05 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511086+0000", 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110534 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 4005519~5851 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4134415970000003, 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.051351761000000003, 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.944 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:00.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459920+0000", 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8198999999999999e-05 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459931+0000", 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0896e-05 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459939+0000", 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8040000000000002e-06 2024-04-26T11:24:00.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503910+0000", 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043971057000000001 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.504155+0000", 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024487100000000002 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511096+0000", 2024-04-26T11:24:00.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069414660000000003 2024-04-26T11:24:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511153+0000", 2024-04-26T11:24:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7126999999999997e-05 2024-04-26T11:24:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511244+0000", 2024-04-26T11:24:00.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1044000000000004e-05 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 4011370~3881 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4133870850000001, 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053603985999999999, 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459946+0000", 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.951 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459963+0000", 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7090000000000001e-05 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459985+0000", 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1889e-05 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459998+0000", 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.344e-05 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.505665+0000", 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.045666292999999997 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.505878+0000", 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021291999999999999 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513229+0000", 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073514380000000001 2024-04-26T11:24:00.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513355+0000", 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012582000000000001 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513551+0000", 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019610600000000001 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.954 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 4015251~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4125973140000001, 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053137220999999998, 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460735+0000", 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460752+0000", 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7016000000000001e-05 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460797+0000", 2024-04-26T11:24:00.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5136000000000003e-05 2024-04-26T11:24:00.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460813+0000", 2024-04-26T11:24:00.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6138999999999999e-05 2024-04-26T11:24:00.957 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.508005+0000", 2024-04-26T11:24:00.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0471923 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.508158+0000", 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152096 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513572+0000", 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054148490000000002 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513680+0000", 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107243 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513874+0000", 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019425200000000001 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 4017160~11347 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:24:00.959 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.409139916, 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053850265000000001, 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464192+0000", 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464228+0000", 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6162999999999999e-05 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464256+0000", 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7665999999999999e-05 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464276+0000", 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0403000000000001e-05 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.509181+0000", 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044904685999999999 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.509391+0000", 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021012299999999999 2024-04-26T11:24:00.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.517888+0000", 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084974600000000001 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.517941+0000", 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2484000000000001e-05 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518044+0000", 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103424 2024-04-26T11:24:00.963 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:8119 4.5 4:a024dd33:::100000024f3.00000000:head [write 0~1435] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 6.4076526529999995, 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.052532417999999997, 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 8119 2024-04-26T11:24:00.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465679+0000", 2024-04-26T11:24:00.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465695+0000", 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5287000000000001e-05 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465725+0000", 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0284999999999999e-05 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:00.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465744+0000", 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9414000000000001e-05 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510010+0000", 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044265697999999999 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510296+0000", 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000286323 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:00.967 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518060+0000", 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077638289999999999 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518111+0000", 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1144999999999999e-05 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518214+0000", 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102564 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.968 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:00.969 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:00.969 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:00.971 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:00.971 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:00.966+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:00.976 INFO:tasks.workunit.client.0.smithi073.stdout:2/326: getdents dd/d4c/d48 0 2024-04-26T11:24:00.976 INFO:tasks.workunit.client.0.smithi073.stdout:2/327: symlink dd/d4c/l68 0 2024-04-26T11:24:00.976 INFO:tasks.workunit.client.0.smithi073.stdout:3/309: dwrite d0/d11/d19/db/d3e/d3f/f59 [0,4194304] 0 2024-04-26T11:24:00.976 INFO:tasks.workunit.client.0.smithi073.stdout:2/328: unlink dd/d1c/c5a 0 2024-04-26T11:24:00.976 INFO:tasks.workunit.client.0.smithi073.stdout:5/336: dwrite d4/de/d23/f44 [0,4194304] 0 2024-04-26T11:24:00.976 INFO:tasks.workunit.client.0.smithi073.stdout:5/337: fdatasync f2 0 2024-04-26T11:24:00.976 INFO:tasks.workunit.client.0.smithi073.stdout:3/310: mknod d0/d2d/c62 0 2024-04-26T11:24:00.976 INFO:tasks.workunit.client.0.smithi073.stdout:2/329: rename dd/de/f41 to dd/d4c/d48/d46/f69 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:8/355: dwrite d1/f26 [0,4194304] 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:3/311: write d0/d11/d19/db/f1a [2412618,13952] 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:8/356: write d1/d21/d50/f42 [3117929,126716] 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:5/338: mknod d4/d8/c7b 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:3/312: chown d0/d11/d23/d3b/c3d 4153057 1 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:5/339: fdatasync d4/de/d15/f65 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:8/357: write d1/d21/d2c/f56 [567958,77721] 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:3/313: write d0/d11/f18 [6064981,34112] 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:5/340: truncate d4/de/d23/d4f/d54/f78 1010687 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:3/314: rmdir d0/d11/d19/db/d3e/d47 39 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:2/330: dread dd/d1c/d1d/f36 [0,4194304] 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:2/331: rmdir dd/d1c/d1d 39 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:3/315: rename d0/d11/d19/f57 to d0/d11/d19/db/d3e/d47/f63 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:2/332: symlink dd/d4c/l6a 0 2024-04-26T11:24:00.977 INFO:tasks.workunit.client.0.smithi073.stdout:2/333: chown dd/de/d38/d53/d60 32 1 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:3/316: mknod d0/d11/d19/db/d51/c64 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:3/317: fdatasync d0/d11/d19/d1d/f50 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:3/318: creat d0/f65 x:0 0 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:5/341: dwrite d4/d8/f35 [0,4194304] 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:3/319: rename d0/d11/d19/db/fe to d0/d34/f66 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:3/320: symlink d0/d11/d19/db/d51/l67 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:3/321: stat d0/d11/d19/c16 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:2/334: write dd/d4c/d48/f2c [496926,30001] 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:3/322: getdents d0/d11/d23 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:3/323: rename d0/d11/d19/f17 to d0/d34/f68 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:5/342: dwrite d4/de/d15/d33/f6c [0,4194304] 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:2/335: truncate dd/d1c/d1d/f35 658574 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:2/336: chown dd/l2e 484668 1 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:3/324: write d0/f2e [4770770,5125] 0 2024-04-26T11:24:00.978 INFO:tasks.workunit.client.0.smithi073.stdout:2/337: rename dd/de/d49/d4b to dd/de/d6b 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:3/325: mkdir d0/d11/d19/db/d3e/d3f/d69 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:5/343: link d4/de/d23/d3b/l58 d4/de/d23/l7c 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:3/326: mkdir d0/d11/d6a 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:5/344: dread - d4/de/d15/d33/f4e zero size 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:3/327: chown d0/d11/d19/db/d51 399650365 1 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:5/345: write d4/de/d15/d33/f4b [531976,59146] 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:5/346: dread - d4/d8/d9/d42/d68/f6e zero size 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:5/347: rename d4/d72 to d4/d8/d9/d7d 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:3/328: dread d0/d11/d19/f27 [0,4194304] 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:2/338: dread dd/d1c/d1d/f20 [0,4194304] 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:5/348: symlink d4/d73/l7e 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:3/329: creat d0/d2d/f6b x:0 0 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:5/349: unlink d4/l6b 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:1/457: dread d1/d8/fd [4194304,4194304] 0 2024-04-26T11:24:00.979 INFO:tasks.workunit.client.0.smithi073.stdout:5/350: mknod d4/de/d23/d4f/d54/c7f 0 2024-04-26T11:24:00.980 INFO:tasks.workunit.client.0.smithi073.stdout:5/351: dread - d4/f7a zero size 2024-04-26T11:24:00.980 INFO:tasks.workunit.client.0.smithi073.stdout:1/458: symlink d1/d73/d34/d98/la4 0 2024-04-26T11:24:00.980 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:24:00.983 INFO:tasks.workunit.client.0.smithi073.stdout:5/352: dwrite d4/de/d15/d33/f6c [4194304,4194304] 0 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:3/330: dwrite d0/d26/f29 [0,4194304] 0 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:5/353: rename d4/d8/ld to d4/d8/d9/d7d/l80 0 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:3/331: stat d0/d11/d19/d1d/f44 0 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:3/332: read d0/d11/d19/f27 [3655907,46388] 0 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:5/354: truncate d4/de/d23/f36 4638900 0 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:3/333: dwrite d0/d11/d19/f28 [0,4194304] 0 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:9/349: sync 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:0/303: sync 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:6/265: sync 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:4/368: sync 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:7/390: sync 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:8/358: sync 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:3/334: rename d0/d11/d19/d5b/f5e to d0/d11/f6c 0 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:6/266: symlink d0/d19/l4f 0 2024-04-26T11:24:00.984 INFO:tasks.workunit.client.0.smithi073.stdout:9/350: rmdir d0/d1a/d4e/d70/d51 39 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:8/359: write d1/d21/d2c/f57 [627077,33537] 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:5/355: dwrite d4/de/d15/d33/f4b [0,4194304] 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:4/369: symlink d8/l87 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:6/267: symlink d0/d19/d20/l50 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:9/351: write d0/d13/f1c [1390251,59556] 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:0/304: link d2/d22/d51/d57/f5c d2/d5f/f6c 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:8/360: mknod d1/d21/d2a/c76 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:7/391: link d1/d33/d1b/f1e d1/d33/d68/f8b 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:3/335: link d0/d2d/c62 d0/d11/d19/db/d3e/d3f/d4d/d60/c6d 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:9/352: mknod d0/d13/d25/d2c/c73 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:0/305: creat d2/d37/d3c/d6a/f6d x:0 0 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:9/353: creat d0/d1a/f74 x:0 0 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:0/306: write d2/d22/f65 [111905,84286] 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:9/354: mkdir d0/d13/d25/d75 0 2024-04-26T11:24:00.985 INFO:tasks.workunit.client.0.smithi073.stdout:0/307: rename d2/d1f/d40/f63 to d2/d37/f6e 0 2024-04-26T11:24:00.986 INFO:tasks.workunit.client.0.smithi073.stdout:8/361: dread - d1/d4/d4c/d66/f72 zero size 2024-04-26T11:24:00.986 INFO:tasks.workunit.client.0.smithi073.stdout:0/308: chown d2/l3a 485588 1 2024-04-26T11:24:00.986 INFO:tasks.workunit.client.0.smithi073.stdout:8/362: link d1/d4/d15/c6a d1/d21/d50/d67/c77 0 2024-04-26T11:24:00.986 INFO:tasks.workunit.client.0.smithi073.stdout:6/268: dwrite d0/d1a/d26/d4b/d2b/d2c/d41/f46 [0,4194304] 0 2024-04-26T11:24:00.986 INFO:tasks.workunit.client.0.smithi073.stdout:5/356: dread d4/d8/fb [4194304,4194304] 0 2024-04-26T11:24:00.986 INFO:tasks.workunit.client.0.smithi073.stdout:7/392: dread d1/d11/d24/d26/d4b/f70 [0,4194304] 0 2024-04-26T11:24:00.986 INFO:tasks.workunit.client.0.smithi073.stdout:6/269: fdatasync d0/d1a/d26/d4b/d2b/f3e 0 2024-04-26T11:24:00.986 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:24:00.987 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:24:00.991 INFO:tasks.workunit.client.0.smithi073.stdout:8/363: truncate d1/d4/f55 973206 0 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:7/393: chown d1/d11/d24/d29 21574667 1 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:6/270: creat d0/d1a/d4e/f51 x:0 0 0 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:0/309: dwrite d2/d22/f65 [0,4194304] 0 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:7/394: chown d1/d11/d24/d26/d3d/f6d 357292426 1 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:8/364: rename d1/d4/d4c/d59/f6f to d1/d4/d4c/d66/f78 0 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:0/310: symlink d2/l6f 0 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:7/395: rename d1/d11/d24/d26/d3d/d7b/l89 to d1/d33/d68/l8c 0 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:8/365: readlink d1/l10 0 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:5/357: dwrite d4/de/d15/d33/f6c [0,4194304] 0 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:0/311: readlink d2/l27 0 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:7/396: dread - d1/d33/f86 zero size 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:6/271: dwrite d0/d19/f21 [4194304,4194304] 0 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:8/366: chown d1/d21/d50/c68 1860 1 2024-04-26T11:24:00.992 INFO:tasks.workunit.client.0.smithi073.stdout:5/358: creat d4/d8/f81 x:0 0 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:8/367: truncate d1/d21/d50/f2e 715776 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:1/459: dread d1/d73/d53/f59 [0,4194304] 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:6/272: mkdir d0/d1a/d26/d27/d52 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:5/359: symlink d4/de/d23/d4f/d54/l82 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:8/368: fdatasync d1/d21/d50/f36 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:1/460: rename d1/f2b to d1/d16/d4f/d84/fa5 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:0/312: getdents d2/d22 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:6/273: write d0/d15/d2d/f33 [4263924,90155] 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:1/461: symlink d1/d8/la6 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:6/274: fdatasync d0/f4 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:8/369: fsync d1/f6 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:6/275: symlink d0/d15/d2d/l53 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:5/360: rename d4/de/c11 to d4/de/d23/c83 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:1/462: mknod d1/d16/d4f/d55/d5a/ca7 0 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:8/370: chown d1/c44 138 1 2024-04-26T11:24:00.993 INFO:tasks.workunit.client.0.smithi073.stdout:5/361: write d4/f20 [3740269,71636] 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:7/397: read d1/d11/d24/d26/d4b/f56 [860564,27017] 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:6/276: creat d0/d1a/d26/f54 x:0 0 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:6/277: chown d0/dc 1898428386 1 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:1/463: mknod d1/d73/d40/d44/d80/ca8 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:5/362: fsync d4/d8/f81 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:8/371: link d1/d21/d2a/f2b d1/d4/d15/f79 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:7/398: symlink d1/d11/d24/d26/d80/l8d 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:1/464: creat d1/d6/d7f/d47/fa9 x:0 0 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:6/278: rename d0/d1a/d26/d4b/d2b/d2c/d41 to d0/dc/d55 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:1/465: chown d1/d73/l63 52461357 1 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:5/363: rename d4/de/d23/d4f/d54 to d4/d8/d9/d7d/d84 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:7/399: mknod d1/d11/d24/d29/c8e 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:5/364: rename d4/d8/d9/c55 to d4/de/d23/c85 0 2024-04-26T11:24:00.994 INFO:tasks.workunit.client.0.smithi073.stdout:7/400: getdents d1/d33 0 2024-04-26T11:24:00.995 INFO:tasks.workunit.client.0.smithi073.stdout:6/279: getdents d0/d1a/d26 0 2024-04-26T11:24:00.995 INFO:tasks.workunit.client.0.smithi073.stdout:8/372: write d1/d4/d37/f71 [3920634,68781] 0 2024-04-26T11:24:00.995 INFO:tasks.workunit.client.0.smithi073.stdout:7/401: mkdir d1/d11/d5e/d8f 0 2024-04-26T11:24:00.995 INFO:tasks.workunit.client.0.smithi073.stdout:5/365: write d4/de/d23/d4f/f69 [700576,72781] 0 2024-04-26T11:24:00.995 INFO:tasks.workunit.client.0.smithi073.stdout:8/373: chown d1/f26 157 1 2024-04-26T11:24:00.995 INFO:tasks.workunit.client.0.smithi073.stdout:8/374: stat d1/d4/d37 0 2024-04-26T11:24:00.995 INFO:tasks.workunit.client.0.smithi073.stdout:7/402: mkdir d1/d11/d24/d71/d90 0 2024-04-26T11:24:00.995 INFO:tasks.workunit.client.0.smithi073.stdout:8/375: dread - d1/d4/d4c/d66/f72 zero size 2024-04-26T11:24:00.995 INFO:tasks.workunit.client.0.smithi073.stdout:5/366: rename d4/de/f49 to d4/de/d23/f86 0 2024-04-26T11:24:00.995 INFO:tasks.workunit.client.0.smithi073.stdout:1/466: dwrite d1/d73/d40/d44/d80/f93 [0,4194304] 0 2024-04-26T11:24:00.995 INFO:tasks.workunit.client.0.smithi073.stdout:9/355: dread d0/f10 [0,4194304] 0 2024-04-26T11:24:00.995 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:24:00.996 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:24:00.996 INFO:tasks.workunit.client.0.smithi073.stdout:7/403: creat d1/d11/d5e/d8f/f91 x:0 0 0 2024-04-26T11:24:00.996 INFO:tasks.workunit.client.0.smithi073.stdout:8/376: rename d1/d21/d50/f30 to d1/d4/d37/d5b/f7a 0 2024-04-26T11:24:00.996 INFO:tasks.workunit.client.0.smithi073.stdout:7/404: chown d1/d11/d24/d26/d3d/d7c 1420521 1 2024-04-26T11:24:00.996 INFO:tasks.workunit.client.0.smithi073.stdout:9/356: creat d0/d1a/d4e/d70/f76 x:0 0 0 2024-04-26T11:24:00.997 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:24:00.997 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:24:01.001 INFO:tasks.workunit.client.0.smithi073.stdout:7/405: truncate d1/d11/d24/d26/d67/f40 577020 0 2024-04-26T11:24:01.001 INFO:tasks.workunit.client.0.smithi073.stdout:9/357: chown d0/d13/f5b 14379672 1 2024-04-26T11:24:01.001 INFO:tasks.workunit.client.0.smithi073.stdout:7/406: readlink d1/d11/d24/d71/l59 0 2024-04-26T11:24:01.001 INFO:tasks.workunit.client.0.smithi073.stdout:9/358: truncate d0/f8 332999 0 2024-04-26T11:24:01.001 INFO:tasks.workunit.client.0.smithi073.stdout:9/359: dread - d0/d13/f5b zero size 2024-04-26T11:24:01.001 INFO:tasks.workunit.client.0.smithi073.stdout:9/360: chown d0/d1a/d2f/f3e 595 1 2024-04-26T11:24:01.001 INFO:tasks.workunit.client.0.smithi073.stdout:5/367: dwrite d4/de/d15/d60/f31 [4194304,4194304] 0 2024-04-26T11:24:01.001 INFO:tasks.workunit.client.0.smithi073.stdout:4/370: dread d8/d1a/d1b/d1d/f21 [0,4194304] 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:9/361: creat d0/d13/d5a/d65/f77 x:0 0 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:7/407: truncate d1/f75 162421 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:5/368: creat d4/d8/d9/d5f/f87 x:0 0 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:5/369: readlink d4/de/l74 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:7/408: symlink d1/d11/d24/l92 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:5/370: write d4/de/f2c [2805881,88870] 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:9/362: link d0/d1a/l37 d0/d1a/d4e/d70/d51/l78 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:7/409: creat d1/d11/d24/d26/d3d/f93 x:0 0 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:5/371: symlink d4/d73/l88 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:5/372: fsync d4/de/d23/f36 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:5/373: creat d4/de/d15/d60/f89 x:0 0 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:4/371: dwrite d8/d1a/d1b/d1d/f6a [0,4194304] 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:4/372: write d8/d1a/d1b/d1d/f6a [1037795,118489] 0 2024-04-26T11:24:01.002 INFO:tasks.workunit.client.0.smithi073.stdout:2/339: sync 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:2/340: write dd/d1c/f25 [1863708,31285] 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:9/363: truncate d0/d1a/d4e/d70/d51/f67 327360 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:2/341: write dd/d1c/d1d/f44 [983190,79905] 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:9/364: rename d0/d1a/d4e/c54 to d0/d13/d25/d2c/c79 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:9/365: creat d0/d3c/f7a x:0 0 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:9/366: rename d0/d13/l50 to d0/d1a/d2f/l7b 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:9/367: getdents d0/d13/d5a 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:5/374: truncate d4/de/d23/f44 3446394 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:5/375: dread - d4/de/d15/d60/f66 zero size 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:5/376: mkdir d4/d73/d8a 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:5/377: mknod d4/de/d15/d33/c8b 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:5/378: write d4/f1f [1160614,85576] 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:9/368: truncate d0/d3c/f43 312993 0 2024-04-26T11:24:01.003 INFO:tasks.workunit.client.0.smithi073.stdout:6/280: dread d0/d1a/d26/d4b/d2b/d2c/f3b [0,4194304] 0 2024-04-26T11:24:01.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/281: rmdir d0/dc/d2e 39 2024-04-26T11:24:01.004 INFO:tasks.workunit.client.0.smithi073.stdout:6/282: dread - d0/d19/f44 zero size 2024-04-26T11:24:01.004 INFO:tasks.workunit.client.0.smithi073.stdout:8/377: dread d1/f2f [0,4194304] 0 2024-04-26T11:24:01.004 INFO:tasks.workunit.client.0.smithi073.stdout:9/369: dread d0/d13/d5a/d5e/f6d [0,4194304] 0 2024-04-26T11:24:01.004 INFO:tasks.workunit.client.0.smithi073.stdout:8/378: rmdir d1/d21/d2c 39 2024-04-26T11:24:01.005 INFO:tasks.workunit.client.0.smithi073.stdout:6/283: creat d0/d1a/d26/d27/d52/f56 x:0 0 0 2024-04-26T11:24:01.005 INFO:tasks.workunit.client.0.smithi073.stdout:9/370: write d0/d13/db/f4b [3458194,124262] 0 2024-04-26T11:24:01.005 INFO:tasks.workunit.client.0.smithi073.stdout:5/379: dwrite d4/d8/d9/d5f/f87 [0,4194304] 0 2024-04-26T11:24:01.005 INFO:tasks.workunit.client.0.smithi073.stdout:1/467: dread d1/d8/f15 [0,4194304] 0 2024-04-26T11:24:01.005 INFO:tasks.workunit.client.0.smithi073.stdout:6/284: creat d0/d1a/d26/d27/f57 x:0 0 0 2024-04-26T11:24:01.005 INFO:tasks.workunit.client.0.smithi073.stdout:9/371: symlink d0/d13/d25/l7c 0 2024-04-26T11:24:01.005 INFO:tasks.workunit.client.0.smithi073.stdout:5/380: write d4/de/d15/d60/f16 [2174140,27969] 0 2024-04-26T11:24:01.006 INFO:tasks.workunit.client.0.smithi073.stdout:1/468: mkdir d1/d73/d34/d98/daa 0 2024-04-26T11:24:01.006 INFO:tasks.workunit.client.0.smithi073.stdout:1/469: fdatasync d1/d73/d40/d44/f9e 0 2024-04-26T11:24:01.006 INFO:tasks.workunit.client.0.smithi073.stdout:6/285: write d0/d1a/d26/d4b/d2b/f3d [1293777,78048] 0 2024-04-26T11:24:01.006 INFO:tasks.workunit.client.0.smithi073.stdout:5/381: symlink d4/de/l8c 0 2024-04-26T11:24:01.006 INFO:tasks.workunit.client.0.smithi073.stdout:5/382: mknod d4/de/d23/c8d 0 2024-04-26T11:24:01.006 INFO:tasks.workunit.client.0.smithi073.stdout:1/470: truncate d1/d73/d40/d44/d8e/f9a 935024 0 2024-04-26T11:24:01.007 INFO:tasks.workunit.client.0.smithi073.stdout:6/286: link d0/d1a/d26/d4b/d2b/f3d d0/f58 0 2024-04-26T11:24:01.007 INFO:tasks.workunit.client.0.smithi073.stdout:5/383: write d4/d8/d9/d42/f63 [486749,47196] 0 2024-04-26T11:24:01.008 INFO:tasks.workunit.client.0.smithi073.stdout:1/471: truncate d1/d73/d40/f2a 5086394 0 2024-04-26T11:24:01.008 INFO:tasks.workunit.client.0.smithi073.stdout:6/287: mkdir d0/d15/d2d/d3f/d59 0 2024-04-26T11:24:01.008 INFO:tasks.workunit.client.0.smithi073.stdout:5/384: unlink d4/de/d15/d60/c26 0 2024-04-26T11:24:01.009 INFO:tasks.workunit.client.0.smithi073.stdout:8/379: truncate d1/d21/d2c/f56 96171 0 2024-04-26T11:24:01.009 INFO:tasks.workunit.client.0.smithi073.stdout:6/288: write d0/f16 [1048814,83702] 0 2024-04-26T11:24:01.010 INFO:tasks.workunit.client.0.smithi073.stdout:8/380: mkdir d1/d4/d7b 0 2024-04-26T11:24:01.010 INFO:tasks.workunit.client.0.smithi073.stdout:9/372: dwrite d0/d13/d25/d2c/f3a [0,4194304] 0 2024-04-26T11:24:01.011 INFO:tasks.workunit.client.0.smithi073.stdout:6/289: fsync d0/d1a/d26/d27/d52/f56 0 2024-04-26T11:24:01.011 INFO:tasks.workunit.client.0.smithi073.stdout:8/381: fdatasync d1/d4/d15/f4d 0 2024-04-26T11:24:01.011 INFO:tasks.workunit.client.0.smithi073.stdout:6/290: fdatasync d0/d1a/d26/d27/f29 0 2024-04-26T11:24:01.011 INFO:tasks.workunit.client.0.smithi073.stdout:9/373: truncate d0/d13/d25/d2c/f3a 5806842 0 2024-04-26T11:24:01.012 INFO:tasks.workunit.client.0.smithi073.stdout:5/385: rename d4/d8/d9/d5f to d4/d8/d8e 0 2024-04-26T11:24:01.013 INFO:tasks.workunit.client.0.smithi073.stdout:8/382: readlink d1/d4/d37/l65 0 2024-04-26T11:24:01.014 INFO:tasks.workunit.client.0.smithi073.stdout:8/383: creat d1/d4/d37/d5b/f7c x:0 0 0 2024-04-26T11:24:01.014 INFO:tasks.workunit.client.0.smithi073.stdout:9/374: rename d0/d13/d25/c44 to d0/d13/db/c7d 0 2024-04-26T11:24:01.015 INFO:tasks.workunit.client.0.smithi073.stdout:8/384: unlink d1/d21/d50/c68 0 2024-04-26T11:24:01.015 INFO:tasks.workunit.client.0.smithi073.stdout:2/342: dread dd/d4c/d48/f2d [0,4194304] 0 2024-04-26T11:24:01.015 INFO:tasks.workunit.client.0.smithi073.stdout:9/375: creat d0/d13/d25/d2c/f7e x:0 0 0 2024-04-26T11:24:01.015 INFO:tasks.workunit.client.0.smithi073.stdout:8/385: dread - d1/d4/d37/d5b/f7c zero size 2024-04-26T11:24:01.016 INFO:tasks.workunit.client.0.smithi073.stdout:9/376: mknod d0/d1a/d4e/c7f 0 2024-04-26T11:24:01.016 INFO:tasks.workunit.client.0.smithi073.stdout:8/386: dread - d1/d4/d4c/f6c zero size 2024-04-26T11:24:01.017 INFO:tasks.workunit.client.0.smithi073.stdout:9/377: chown d0/d1a/d4e/d70/d46/c4f 474285 1 2024-04-26T11:24:01.017 INFO:tasks.workunit.client.0.smithi073.stdout:6/291: dwrite d0/d1a/d26/d4b/d2b/f3e [0,4194304] 0 2024-04-26T11:24:01.018 INFO:tasks.workunit.client.0.smithi073.stdout:6/292: write d0/f2 [3759056,128286] 0 2024-04-26T11:24:01.018 INFO:tasks.workunit.client.0.smithi073.stdout:6/293: fdatasync d0/d1a/d26/d27/f57 0 2024-04-26T11:24:01.020 INFO:tasks.workunit.client.0.smithi073.stdout:8/387: creat d1/d4/d7b/f7d x:0 0 0 2024-04-26T11:24:01.020 INFO:tasks.workunit.client.0.smithi073.stdout:2/343: dread dd/de/f12 [4194304,4194304] 0 2024-04-26T11:24:01.020 INFO:tasks.workunit.client.0.smithi073.stdout:8/388: dread - d1/d4/d4c/f6c zero size 2024-04-26T11:24:01.021 INFO:tasks.workunit.client.0.smithi073.stdout:8/389: read d1/d21/d50/f22 [471741,40024] 0 2024-04-26T11:24:01.021 INFO:tasks.workunit.client.0.smithi073.stdout:9/378: link d0/d13/d5a/d65/c66 d0/d1a/d4e/d70/d3b/c80 0 2024-04-26T11:24:01.021 INFO:tasks.workunit.client.0.smithi073.stdout:2/344: unlink dd/de/d38/l3e 0 2024-04-26T11:24:01.022 INFO:tasks.workunit.client.0.smithi073.stdout:2/345: fdatasync dd/de/d38/f3d 0 2024-04-26T11:24:01.022 INFO:tasks.workunit.client.0.smithi073.stdout:9/379: creat d0/d1a/d4e/d70/d3b/f81 x:0 0 0 2024-04-26T11:24:01.023 INFO:tasks.workunit.client.0.smithi073.stdout:8/390: getdents d1/d4/d15 0 2024-04-26T11:24:01.023 INFO:tasks.workunit.client.0.smithi073.stdout:8/391: stat d1/d4/l49 0 2024-04-26T11:24:01.023 INFO:tasks.workunit.client.0.smithi073.stdout:9/380: symlink d0/d13/d5a/l82 0 2024-04-26T11:24:01.023 INFO:tasks.workunit.client.0.smithi073.stdout:2/346: mknod dd/de/d38/c6c 0 2024-04-26T11:24:01.024 INFO:tasks.workunit.client.0.smithi073.stdout:9/381: mkdir d0/d83 0 2024-04-26T11:24:01.024 INFO:tasks.workunit.client.0.smithi073.stdout:2/347: symlink dd/d1c/l6d 0 2024-04-26T11:24:01.024 INFO:tasks.workunit.client.0.smithi073.stdout:6/294: dread d0/d1a/d26/d4b/d2b/d2c/f3b [0,4194304] 0 2024-04-26T11:24:01.024 INFO:tasks.workunit.client.0.smithi073.stdout:8/392: getdents d1/d21/d2a 0 2024-04-26T11:24:01.024 INFO:tasks.workunit.client.0.smithi073.stdout:2/348: mknod dd/d4c/d48/c6e 0 2024-04-26T11:24:01.025 INFO:tasks.workunit.client.0.smithi073.stdout:8/393: mknod d1/d21/d50/d67/c7e 0 2024-04-26T11:24:01.026 INFO:tasks.workunit.client.0.smithi073.stdout:9/382: link d0/d1a/d2f/l7b d0/d1a/d4e/d70/l84 0 2024-04-26T11:24:01.026 INFO:tasks.workunit.client.0.smithi073.stdout:8/394: stat d1/l70 0 2024-04-26T11:24:01.026 INFO:tasks.workunit.client.0.smithi073.stdout:8/395: mknod d1/d4/d7b/c7f 0 2024-04-26T11:24:01.026 INFO:tasks.workunit.client.0.smithi073.stdout:9/383: creat d0/d13/db/f85 x:0 0 0 2024-04-26T11:24:01.027 INFO:tasks.workunit.client.0.smithi073.stdout:8/396: mknod d1/d21/d2a/c80 0 2024-04-26T11:24:01.027 INFO:tasks.workunit.client.0.smithi073.stdout:8/397: mkdir d1/d21/d50/d67/d81 0 2024-04-26T11:24:01.027 INFO:tasks.workunit.client.0.smithi073.stdout:9/384: chown d0/d1a/d2f/l7b 235468 1 2024-04-26T11:24:01.028 INFO:tasks.workunit.client.0.smithi073.stdout:9/385: unlink d0/d13/d25/d2c/f7e 0 2024-04-26T11:24:01.028 INFO:tasks.workunit.client.0.smithi073.stdout:8/398: read d1/d4/d37/f40 [1047520,31707] 0 2024-04-26T11:24:01.029 INFO:tasks.workunit.client.0.smithi073.stdout:9/386: creat d0/d83/f86 x:0 0 0 2024-04-26T11:24:01.030 INFO:tasks.workunit.client.0.smithi073.stdout:6/295: dwrite d0/f58 [0,4194304] 0 2024-04-26T11:24:01.030 INFO:tasks.workunit.client.0.smithi073.stdout:9/387: symlink d0/d1a/d2f/l87 0 2024-04-26T11:24:01.031 INFO:tasks.workunit.client.0.smithi073.stdout:6/296: creat d0/d1a/d26/d4b/f5a x:0 0 0 2024-04-26T11:24:01.032 INFO:tasks.workunit.client.0.smithi073.stdout:2/349: stat dd/de/d38/d4e/c4f 0 2024-04-26T11:24:01.033 INFO:tasks.workunit.client.0.smithi073.stdout:2/350: truncate dd/d1c/f22 505241 0 2024-04-26T11:24:01.034 INFO:tasks.workunit.client.0.smithi073.stdout:9/388: dread d0/f8 [0,4194304] 0 2024-04-26T11:24:01.035 INFO:tasks.workunit.client.0.smithi073.stdout:2/351: creat dd/d1c/f6f x:0 0 0 2024-04-26T11:24:01.035 INFO:tasks.workunit.client.0.smithi073.stdout:2/352: fdatasync f0 0 2024-04-26T11:24:01.035 INFO:tasks.workunit.client.0.smithi073.stdout:9/389: getdents d0/d13/d5a 0 2024-04-26T11:24:01.035 INFO:tasks.workunit.client.0.smithi073.stdout:2/353: chown dd/d1c/d1d/f36 1 1 2024-04-26T11:24:01.036 INFO:tasks.workunit.client.0.smithi073.stdout:2/354: write f6 [6687072,21406] 0 2024-04-26T11:24:01.036 INFO:tasks.workunit.client.0.smithi073.stdout:9/390: truncate d0/f8 749401 0 2024-04-26T11:24:01.037 INFO:tasks.workunit.client.0.smithi073.stdout:6/297: dwrite d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:01.038 INFO:tasks.workunit.client.0.smithi073.stdout:6/298: readlink d0/d19/d20/l42 0 2024-04-26T11:24:01.038 INFO:tasks.workunit.client.0.smithi073.stdout:9/391: fdatasync d0/f3f 0 2024-04-26T11:24:01.038 INFO:tasks.workunit.client.0.smithi073.stdout:6/299: fsync d0/dc/d55/f46 0 2024-04-26T11:24:01.039 INFO:tasks.workunit.client.0.smithi073.stdout:8/399: dwrite d1/d21/d2a/f39 [0,4194304] 0 2024-04-26T11:24:01.039 INFO:tasks.workunit.client.0.smithi073.stdout:9/392: creat d0/d1a/d4e/d70/d51/f88 x:0 0 0 2024-04-26T11:24:01.040 INFO:tasks.workunit.client.0.smithi073.stdout:6/300: unlink d0/dc/f1b 0 2024-04-26T11:24:01.040 INFO:tasks.workunit.client.0.smithi073.stdout:8/400: creat d1/d4/d4c/d59/f82 x:0 0 0 2024-04-26T11:24:01.041 INFO:tasks.workunit.client.0.smithi073.stdout:9/393: creat d0/d13/d25/d75/f89 x:0 0 0 2024-04-26T11:24:01.041 INFO:tasks.workunit.client.0.smithi073.stdout:8/401: mkdir d1/d4/d37/d5b/d83 0 2024-04-26T11:24:01.042 INFO:tasks.workunit.client.0.smithi073.stdout:9/394: write d0/f40 [1379023,68915] 0 2024-04-26T11:24:01.042 INFO:tasks.workunit.client.0.smithi073.stdout:6/301: rename d0/dc/d2e/f3a to d0/d1a/d26/d4b/f5b 0 2024-04-26T11:24:01.043 INFO:tasks.workunit.client.0.smithi073.stdout:8/402: creat d1/d21/d50/d67/d81/f84 x:0 0 0 2024-04-26T11:24:01.043 INFO:tasks.workunit.client.0.smithi073.stdout:9/395: truncate d0/d1a/d2f/f3e 4431574 0 2024-04-26T11:24:01.043 INFO:tasks.workunit.client.0.smithi073.stdout:6/302: rename d0/d15/d2d/c45 to d0/d1a/d26/d27/c5c 0 2024-04-26T11:24:01.044 INFO:tasks.workunit.client.0.smithi073.stdout:6/303: symlink d0/d1a/l5d 0 2024-04-26T11:24:01.045 INFO:tasks.workunit.client.0.smithi073.stdout:6/304: write d0/d1a/d4e/f51 [428436,1371] 0 2024-04-26T11:24:01.049 INFO:tasks.workunit.client.0.smithi073.stdout:9/396: dwrite d0/d13/d25/d2c/f53 [0,4194304] 0 2024-04-26T11:24:01.051 INFO:tasks.workunit.client.0.smithi073.stdout:9/397: creat d0/d1a/d4e/d70/d46/f8a x:0 0 0 2024-04-26T11:24:01.052 INFO:tasks.workunit.client.0.smithi073.stdout:9/398: creat d0/d1a/d4e/d70/d46/f8b x:0 0 0 2024-04-26T11:24:01.054 INFO:tasks.workunit.client.0.smithi073.stdout:2/355: dread dd/d1c/d1d/f15 [0,4194304] 0 2024-04-26T11:24:01.060 INFO:tasks.workunit.client.0.smithi073.stdout:2/356: dwrite dd/de/f55 [0,4194304] 0 2024-04-26T11:24:01.070 INFO:tasks.workunit.client.0.smithi073.stdout:9/399: dread d0/d1a/f36 [0,4194304] 0 2024-04-26T11:24:01.070 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:01.066+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:01.073 INFO:tasks.workunit.client.0.smithi073.stdout:2/357: dread dd/de/f28 [0,4194304] 0 2024-04-26T11:24:01.073 INFO:tasks.workunit.client.0.smithi073.stdout:6/305: dread d0/d1a/d26/f3c [0,4194304] 0 2024-04-26T11:24:01.077 INFO:tasks.workunit.client.0.smithi073.stdout:2/358: write dd/d1c/d1d/f35 [332639,122624] 0 2024-04-26T11:24:01.078 INFO:tasks.workunit.client.0.smithi073.stdout:2/359: creat dd/de/d38/f70 x:0 0 0 2024-04-26T11:24:01.079 INFO:tasks.workunit.client.0.smithi073.stdout:2/360: chown dd/de/d38/c3a 13641 1 2024-04-26T11:24:01.079 INFO:tasks.workunit.client.0.smithi073.stdout:6/306: dwrite d0/d1a/d26/d27/d52/f56 [0,4194304] 0 2024-04-26T11:24:01.080 INFO:tasks.workunit.client.0.smithi073.stdout:0/313: sync 2024-04-26T11:24:01.081 INFO:tasks.workunit.client.0.smithi073.stdout:3/336: sync 2024-04-26T11:24:01.081 INFO:tasks.workunit.client.0.smithi073.stdout:3/337: chown d0/d2d 11530 1 2024-04-26T11:24:01.081 INFO:tasks.workunit.client.0.smithi073.stdout:2/361: creat dd/de/f71 x:0 0 0 2024-04-26T11:24:01.081 INFO:tasks.workunit.client.0.smithi073.stdout:0/314: mknod d2/d1f/d40/d48/c70 0 2024-04-26T11:24:01.081 INFO:tasks.workunit.client.0.smithi073.stdout:3/338: read - d0/d2d/f6b zero size 2024-04-26T11:24:01.082 INFO:tasks.workunit.client.0.smithi073.stdout:0/315: creat d2/d1f/d40/d48/d62/f71 x:0 0 0 2024-04-26T11:24:01.083 INFO:tasks.workunit.client.0.smithi073.stdout:3/339: link d0/d2d/c62 d0/d2d/c6e 0 2024-04-26T11:24:01.083 INFO:tasks.workunit.client.0.smithi073.stdout:0/316: write d2/d37/d3c/d6a/f6b [371609,13550] 0 2024-04-26T11:24:01.083 INFO:tasks.workunit.client.0.smithi073.stdout:3/340: fsync d0/d11/d19/db/f15 0 2024-04-26T11:24:01.084 INFO:tasks.workunit.client.0.smithi073.stdout:0/317: chown d2/d22/d51 1 1 2024-04-26T11:24:01.086 INFO:tasks.workunit.client.0.smithi073.stdout:9/400: dread d0/d13/f1f [0,4194304] 0 2024-04-26T11:24:01.087 INFO:tasks.workunit.client.0.smithi073.stdout:6/307: dwrite d0/d1a/d26/d27/f57 [0,4194304] 0 2024-04-26T11:24:01.088 INFO:tasks.workunit.client.0.smithi073.stdout:6/308: fsync d0/d1a/d26/d27/f29 0 2024-04-26T11:24:01.089 INFO:tasks.workunit.client.0.smithi073.stdout:9/401: creat d0/d1a/f8c x:0 0 0 2024-04-26T11:24:01.089 INFO:tasks.workunit.client.0.smithi073.stdout:6/309: mknod d0/d1a/d26/c5e 0 2024-04-26T11:24:01.089 INFO:tasks.workunit.client.0.smithi073.stdout:3/341: dwrite d0/d11/d19/db/f15 [4194304,4194304] 0 2024-04-26T11:24:01.090 INFO:tasks.workunit.client.0.smithi073.stdout:6/310: chown d0/dc/d55/f46 19173947 1 2024-04-26T11:24:01.090 INFO:tasks.workunit.client.0.smithi073.stdout:6/311: stat d0/d1a/d26/d4b/d2b/f3d 0 2024-04-26T11:24:01.091 INFO:tasks.workunit.client.0.smithi073.stdout:9/402: unlink d0/d13/l55 0 2024-04-26T11:24:01.091 INFO:tasks.workunit.client.0.smithi073.stdout:6/312: unlink d0/d1a/d26/d27/f57 0 2024-04-26T11:24:01.098 INFO:tasks.workunit.client.0.smithi073.stdout:6/313: dread d0/d1a/d26/d4b/d2b/f3e [0,4194304] 0 2024-04-26T11:24:01.099 INFO:tasks.workunit.client.0.smithi073.stdout:3/342: dwrite d0/d11/d19/f6 [4194304,4194304] 0 2024-04-26T11:24:01.100 INFO:tasks.workunit.client.0.smithi073.stdout:3/343: dread - d0/f61 zero size 2024-04-26T11:24:01.100 INFO:tasks.workunit.client.0.smithi073.stdout:9/403: dwrite d0/d1a/d2f/f41 [4194304,4194304] 0 2024-04-26T11:24:01.107 INFO:tasks.workunit.client.0.smithi073.stdout:6/314: dwrite d0/d1a/d26/d4b/f5a [0,4194304] 0 2024-04-26T11:24:01.107 INFO:tasks.workunit.client.0.smithi073.stdout:9/404: rename d0/d1a/d4e/d70/d3b/f81 to d0/d13/d5a/d65/f8d 0 2024-04-26T11:24:01.107 INFO:tasks.workunit.client.0.smithi073.stdout:3/344: link d0/d11/d19/db/f1a d0/d11/f6f 0 2024-04-26T11:24:01.108 INFO:tasks.workunit.client.0.smithi073.stdout:6/315: unlink d0/d19/d20/l40 0 2024-04-26T11:24:01.108 INFO:tasks.workunit.client.0.smithi073.stdout:9/405: write d0/d13/d5a/d65/f77 [485783,116841] 0 2024-04-26T11:24:01.108 INFO:tasks.workunit.client.0.smithi073.stdout:3/345: write d0/d11/d19/f39 [1723791,69078] 0 2024-04-26T11:24:01.108 INFO:tasks.workunit.client.0.smithi073.stdout:3/346: stat d0/d11/d19/f25 0 2024-04-26T11:24:01.109 INFO:tasks.workunit.client.0.smithi073.stdout:3/347: read d0/d26/f29 [1479594,123350] 0 2024-04-26T11:24:01.111 INFO:tasks.workunit.client.0.smithi073.stdout:3/348: rename d0/d11/d6a to d0/d11/d19/d70 0 2024-04-26T11:24:01.112 INFO:tasks.workunit.client.0.smithi073.stdout:3/349: creat d0/d11/d19/f71 x:0 0 0 2024-04-26T11:24:01.113 INFO:tasks.workunit.client.0.smithi073.stdout:3/350: symlink d0/d11/d19/db/d3e/d47/l72 0 2024-04-26T11:24:01.113 INFO:tasks.workunit.client.0.smithi073.stdout:0/318: dread d2/f1d [0,4194304] 0 2024-04-26T11:24:01.115 INFO:tasks.workunit.client.0.smithi073.stdout:3/351: creat d0/d11/d19/db/d3e/d47/f73 x:0 0 0 2024-04-26T11:24:01.115 INFO:tasks.workunit.client.0.smithi073.stdout:9/406: dwrite d0/f40 [0,4194304] 0 2024-04-26T11:24:01.115 INFO:tasks.workunit.client.0.smithi073.stdout:0/319: symlink d2/d37/d3c/d6a/l72 0 2024-04-26T11:24:01.115 INFO:tasks.workunit.client.0.smithi073.stdout:3/352: creat d0/d11/d19/db/f74 x:0 0 0 2024-04-26T11:24:01.115 INFO:tasks.workunit.client.0.smithi073.stdout:9/407: mkdir d0/d13/d25/d75/d8e 0 2024-04-26T11:24:01.117 INFO:tasks.workunit.client.0.smithi073.stdout:3/353: symlink d0/d34/l75 0 2024-04-26T11:24:01.117 INFO:tasks.workunit.client.0.smithi073.stdout:9/408: chown d0/d13/db/f85 4119029 1 2024-04-26T11:24:01.118 INFO:tasks.workunit.client.0.smithi073.stdout:0/320: read d2/d1f/d40/f44 [342269,126030] 0 2024-04-26T11:24:01.118 INFO:tasks.workunit.client.0.smithi073.stdout:3/354: dread - d0/d11/d19/f71 zero size 2024-04-26T11:24:01.118 INFO:tasks.workunit.client.0.smithi073.stdout:9/409: mkdir d0/d1a/d4e/d8f 0 2024-04-26T11:24:01.118 INFO:tasks.workunit.client.0.smithi073.stdout:0/321: mkdir d2/d37/d3c/d73 0 2024-04-26T11:24:01.118 INFO:tasks.workunit.client.0.smithi073.stdout:3/355: creat d0/d11/d23/d3b/f76 x:0 0 0 2024-04-26T11:24:01.118 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:01.119 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:01.119 INFO:tasks.workunit.client.0.smithi073.stdout:3/356: write d0/d11/d19/f27 [297653,55713] 0 2024-04-26T11:24:01.120 INFO:tasks.workunit.client.0.smithi073.stdout:9/410: read d0/d1a/d4e/d70/f38 [1533878,50496] 0 2024-04-26T11:24:01.120 INFO:tasks.workunit.client.0.smithi073.stdout:3/357: write d0/d11/f6f [4054414,93713] 0 2024-04-26T11:24:01.123 INFO:tasks.workunit.client.0.smithi073.stdout:7/410: sync 2024-04-26T11:24:01.123 INFO:tasks.workunit.client.0.smithi073.stdout:0/322: dwrite d2/d22/f2a [0,4194304] 0 2024-04-26T11:24:01.123 INFO:tasks.workunit.client.0.smithi073.stdout:4/373: sync 2024-04-26T11:24:01.123 INFO:tasks.workunit.client.0.smithi073.stdout:5/386: sync 2024-04-26T11:24:01.123 INFO:tasks.workunit.client.0.smithi073.stdout:1/472: sync 2024-04-26T11:24:01.123 INFO:tasks.workunit.client.0.smithi073.stdout:8/403: sync 2024-04-26T11:24:01.124 INFO:tasks.workunit.client.0.smithi073.stdout:2/362: sync 2024-04-26T11:24:01.125 INFO:tasks.workunit.client.0.smithi073.stdout:8/404: write d1/f26 [2256643,118825] 0 2024-04-26T11:24:01.126 INFO:tasks.workunit.client.0.smithi073.stdout:4/374: write d8/d15/d1c/d72/d77/f7a [460058,95657] 0 2024-04-26T11:24:01.128 INFO:tasks.workunit.client.0.smithi073.stdout:8/405: dread - d1/d4/d15/f75 zero size 2024-04-26T11:24:01.131 INFO:tasks.workunit.client.0.smithi073.stdout:6/316: truncate d0/d1a/d26/d4b/f5a 3057849 0 2024-04-26T11:24:01.131 INFO:tasks.workunit.client.0.smithi073.stdout:0/323: mknod d2/d22/d51/c74 0 2024-04-26T11:24:01.131 INFO:tasks.workunit.client.0.smithi073.stdout:3/358: rmdir d0/d11/d19 39 2024-04-26T11:24:01.132 INFO:tasks.workunit.client.0.smithi073.stdout:9/411: creat d0/d6c/f90 x:0 0 0 2024-04-26T11:24:01.132 INFO:tasks.workunit.client.0.smithi073.stdout:4/375: unlink d8/d1a/d1b/d46/d57/f42 0 2024-04-26T11:24:01.132 INFO:tasks.workunit.client.0.smithi073.stdout:8/406: stat d1/d4/c1b 0 2024-04-26T11:24:01.133 INFO:tasks.workunit.client.0.smithi073.stdout:1/473: rename d1/d73/c26 to d1/d73/d40/d44/d80/cab 0 2024-04-26T11:24:01.133 INFO:tasks.workunit.client.0.smithi073.stdout:6/317: mknod d0/d1a/d26/d4b/d38/c5f 0 2024-04-26T11:24:01.133 INFO:tasks.workunit.client.0.smithi073.stdout:6/318: readlink d0/l5 0 2024-04-26T11:24:01.134 INFO:tasks.workunit.client.0.smithi073.stdout:1/474: stat d1/d73/f1b 0 2024-04-26T11:24:01.134 INFO:tasks.workunit.client.0.smithi073.stdout:0/324: rename d2/l34 to d2/d37/d3c/l75 0 2024-04-26T11:24:01.135 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:01.136 INFO:tasks.workunit.client.0.smithi073.stdout:5/387: dwrite d4/de/d15/d60/f31 [4194304,4194304] 0 2024-04-26T11:24:01.136 INFO:tasks.workunit.client.0.smithi073.stdout:2/363: truncate dd/de/d6b/f5f 2217362 0 2024-04-26T11:24:01.136 INFO:tasks.workunit.client.0.smithi073.stdout:1/475: rmdir d1/d51 39 2024-04-26T11:24:01.136 INFO:tasks.workunit.client.0.smithi073.stdout:8/407: symlink d1/d4/d37/d5b/d83/l85 0 2024-04-26T11:24:01.136 INFO:tasks.workunit.client.0.smithi073.stdout:6/319: truncate d0/d19/f44 571418 0 2024-04-26T11:24:01.136 INFO:tasks.workunit.client.0.smithi073.stdout:2/364: fsync dd/de/d6b/f61 0 2024-04-26T11:24:01.138 INFO:tasks.workunit.client.0.smithi073.stdout:0/325: creat d2/d22/d51/d57/f76 x:0 0 0 2024-04-26T11:24:01.138 INFO:tasks.workunit.client.0.smithi073.stdout:9/412: rename d0/d1a/d2f/l7b to d0/d1a/d4e/d70/d51/l91 0 2024-04-26T11:24:01.138 INFO:tasks.workunit.client.0.smithi073.stdout:3/359: mknod d0/d11/d19/db/d3e/d3f/d69/c77 0 2024-04-26T11:24:01.138 INFO:tasks.workunit.client.0.smithi073.stdout:8/408: creat d1/d4/d37/f86 x:0 0 0 2024-04-26T11:24:01.138 INFO:tasks.workunit.client.0.smithi073.stdout:6/320: unlink d0/d1a/d26/d4b/f5a 0 2024-04-26T11:24:01.138 INFO:tasks.workunit.client.0.smithi073.stdout:4/376: link d8/d1a/d5e/d7c/f7f d8/d1f/f88 0 2024-04-26T11:24:01.140 INFO:tasks.workunit.client.0.smithi073.stdout:3/360: chown d0/d11/d19/f25 156 1 2024-04-26T11:24:01.140 INFO:tasks.workunit.client.0.smithi073.stdout:2/365: rmdir dd/de/d38/d53/d59 0 2024-04-26T11:24:01.140 INFO:tasks.workunit.client.0.smithi073.stdout:8/409: write d1/d4/f5a [561329,7515] 0 2024-04-26T11:24:01.141 INFO:tasks.workunit.client.0.smithi073.stdout:1/476: link d1/d8/d57/f65 d1/d16/d4f/fac 0 2024-04-26T11:24:01.141 INFO:tasks.workunit.client.0.smithi073.stdout:2/366: rmdir dd/d4c 39 2024-04-26T11:24:01.141 INFO:tasks.workunit.client.0.smithi073.stdout:5/388: creat d4/de/d15/d33/f8f x:0 0 0 2024-04-26T11:24:01.141 INFO:tasks.workunit.client.0.smithi073.stdout:7/411: truncate d1/d11/d24/d29/f74 439628 0 2024-04-26T11:24:01.141 INFO:tasks.workunit.client.0.smithi073.stdout:8/410: fdatasync d1/d21/f29 0 2024-04-26T11:24:01.141 INFO:tasks.workunit.client.0.smithi073.stdout:3/361: dread - d0/d11/d19/db/d3e/d3f/f55 zero size 2024-04-26T11:24:01.141 INFO:tasks.workunit.client.0.smithi073.stdout:5/389: symlink d4/de/d15/d33/l90 0 2024-04-26T11:24:01.142 INFO:tasks.workunit.client.0.smithi073.stdout:1/477: chown d1/d8/d2e/d37/c39 94 1 2024-04-26T11:24:01.142 INFO:tasks.workunit.client.0.smithi073.stdout:2/367: rename dd/de/d38/f3d to dd/de/f72 0 2024-04-26T11:24:01.142 INFO:tasks.workunit.client.0.smithi073.stdout:7/412: creat d1/d11/d24/d29/f94 x:0 0 0 2024-04-26T11:24:01.144 INFO:tasks.workunit.client.0.smithi073.stdout:1/478: write d1/d16/d61/f90 [1319453,36953] 0 2024-04-26T11:24:01.145 INFO:tasks.workunit.client.0.smithi073.stdout:2/368: creat dd/d1c/d1d/f73 x:0 0 0 2024-04-26T11:24:01.145 INFO:tasks.workunit.client.0.smithi073.stdout:9/413: dwrite d0/d6c/f90 [0,4194304] 0 2024-04-26T11:24:01.146 INFO:tasks.workunit.client.0.smithi073.stdout:6/321: dwrite d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:01.149 INFO:tasks.workunit.client.0.smithi073.stdout:1/479: mknod d1/d73/d53/cad 0 2024-04-26T11:24:01.149 INFO:tasks.workunit.client.0.smithi073.stdout:8/411: truncate d1/d4/d37/f71 1700958 0 2024-04-26T11:24:01.149 INFO:tasks.workunit.client.0.smithi073.stdout:2/369: creat dd/de/d38/d53/f74 x:0 0 0 2024-04-26T11:24:01.150 INFO:tasks.workunit.client.0.smithi073.stdout:7/413: getdents d1/d33/d1b/d66/d50 0 2024-04-26T11:24:01.150 INFO:tasks.workunit.client.0.smithi073.stdout:8/412: stat d1/d21/c4e 0 2024-04-26T11:24:01.155 INFO:tasks.workunit.client.0.smithi073.stdout:2/370: dread - dd/d1c/d1d/f73 zero size 2024-04-26T11:24:01.155 INFO:tasks.workunit.client.0.smithi073.stdout:7/414: mkdir d1/d33/d1b/d95 0 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:6/322: creat d0/d19/f60 x:0 0 0 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:2/371: stat dd/d1c/d1d/f5c 0 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:8/413: chown d1/d21/d2c/f57 209444063 1 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:7/415: symlink d1/d33/d68/d78/l96 0 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:3/362: dwrite d0/d11/d19/db/d3e/d3f/f59 [0,4194304] 0 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:0/326: sync 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:2/372: rmdir dd/de/d2a 39 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:0/327: readlink d2/l19 0 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:6/323: creat d0/f61 x:0 0 0 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:3/363: chown d0/d2d/c30 6 1 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:5/390: dwrite d4/de/d23/f36 [0,4194304] 0 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:2/373: chown dd/de/d29 0 1 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:3/364: write d0/d11/d19/f39 [5760784,91786] 0 2024-04-26T11:24:01.156 INFO:tasks.workunit.client.0.smithi073.stdout:2/374: write dd/d1c/f43 [4706569,21121] 0 2024-04-26T11:24:01.157 INFO:tasks.workunit.client.0.smithi073.stdout:5/391: mknod d4/de/d23/d3b/c91 0 2024-04-26T11:24:01.157 INFO:tasks.workunit.client.0.smithi073.stdout:6/324: unlink d0/d1a/d26/d27/c5c 0 2024-04-26T11:24:01.157 INFO:tasks.workunit.client.0.smithi073.stdout:9/414: truncate d0/d13/f1c 4182238 0 2024-04-26T11:24:01.159 INFO:tasks.workunit.client.0.smithi073.stdout:8/414: creat d1/f87 x:0 0 0 2024-04-26T11:24:01.159 INFO:tasks.workunit.client.0.smithi073.stdout:1/480: dread d1/d73/d40/d44/d8e/f9a [0,4194304] 0 2024-04-26T11:24:01.159 INFO:tasks.workunit.client.0.smithi073.stdout:5/392: fdatasync d4/de/f10 0 2024-04-26T11:24:01.159 INFO:tasks.workunit.client.0.smithi073.stdout:3/365: mknod d0/d11/d19/db/d3e/d3f/d4d/c78 0 2024-04-26T11:24:01.160 INFO:tasks.workunit.client.0.smithi073.stdout:6/325: mkdir d0/d15/d2d/d3f/d59/d62 0 2024-04-26T11:24:01.161 INFO:tasks.workunit.client.0.smithi073.stdout:1/481: rename d1/d16/d68 to d1/d16/d4f/dae 0 2024-04-26T11:24:01.162 INFO:tasks.workunit.client.0.smithi073.stdout:6/326: fdatasync d0/d1a/d26/d4b/f5b 0 2024-04-26T11:24:01.162 INFO:tasks.workunit.client.0.smithi073.stdout:0/328: dwrite d2/d1f/d40/d48/f5d [0,4194304] 0 2024-04-26T11:24:01.163 INFO:tasks.workunit.client.0.smithi073.stdout:6/327: write d0/d19/d20/f22 [3149691,48188] 0 2024-04-26T11:24:01.163 INFO:tasks.workunit.client.0.smithi073.stdout:9/415: dread d0/f10 [0,4194304] 0 2024-04-26T11:24:01.164 INFO:tasks.workunit.client.0.smithi073.stdout:4/377: dread f7 [0,4194304] 0 2024-04-26T11:24:01.165 INFO:tasks.workunit.client.0.smithi073.stdout:4/378: chown d8/d14/c73 2428 1 2024-04-26T11:24:01.165 INFO:tasks.workunit.client.0.smithi073.stdout:9/416: fsync d0/d13/f32 0 2024-04-26T11:24:01.165 INFO:tasks.workunit.client.0.smithi073.stdout:6/328: truncate d0/d1a/d26/d4b/f5b 2740259 0 2024-04-26T11:24:01.167 INFO:tasks.workunit.client.0.smithi073.stdout:1/482: getdents d1/d73/d40/d44 0 2024-04-26T11:24:01.167 INFO:tasks.workunit.client.0.smithi073.stdout:4/379: symlink d8/d1a/d1b/l89 0 2024-04-26T11:24:01.167 INFO:tasks.workunit.client.0.smithi073.stdout:3/366: dread d0/d11/d23/d3b/f46 [0,4194304] 0 2024-04-26T11:24:01.167 INFO:tasks.workunit.client.0.smithi073.stdout:6/329: mkdir d0/d1a/d26/d4b/d63 0 2024-04-26T11:24:01.167 INFO:tasks.workunit.client.0.smithi073.stdout:4/380: creat d8/d1a/d1b/d46/d57/f8a x:0 0 0 2024-04-26T11:24:01.169 INFO:tasks.workunit.client.0.smithi073.stdout:1/483: write d1/d8/d57/f8d [759519,74232] 0 2024-04-26T11:24:01.170 INFO:tasks.workunit.client.0.smithi073.stdout:6/330: creat d0/dc/f64 x:0 0 0 2024-04-26T11:24:01.170 INFO:tasks.workunit.client.0.smithi073.stdout:3/367: rename d0/f65 to d0/d11/d19/db/d3e/d47/f79 0 2024-04-26T11:24:01.171 INFO:tasks.workunit.client.0.smithi073.stdout:1/484: creat d1/d8/d2e/d37/d9f/faf x:0 0 0 2024-04-26T11:24:01.171 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:01.166+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:01.171 INFO:tasks.workunit.client.0.smithi073.stdout:2/375: dread dd/d1c/f22 [0,4194304] 0 2024-04-26T11:24:01.172 INFO:tasks.workunit.client.0.smithi073.stdout:8/415: dwrite d1/d4/f55 [0,4194304] 0 2024-04-26T11:24:01.172 INFO:tasks.workunit.client.0.smithi073.stdout:6/331: write d0/dc/f64 [740868,110290] 0 2024-04-26T11:24:01.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/332: write d0/d1a/d26/f54 [198625,14595] 0 2024-04-26T11:24:01.174 INFO:tasks.workunit.client.0.smithi073.stdout:4/381: dwrite f5 [4194304,4194304] 0 2024-04-26T11:24:01.176 INFO:tasks.workunit.client.0.smithi073.stdout:3/368: mkdir d0/d11/d19/db/d3e/d3f/d4d/d7a 0 2024-04-26T11:24:01.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/416: creat d1/d21/d50/d67/d81/f88 x:0 0 0 2024-04-26T11:24:01.176 INFO:tasks.workunit.client.0.smithi073.stdout:6/333: creat d0/d19/d20/f65 x:0 0 0 2024-04-26T11:24:01.176 INFO:tasks.workunit.client.0.smithi073.stdout:8/417: chown d1/f87 52559386 1 2024-04-26T11:24:01.177 INFO:tasks.workunit.client.0.smithi073.stdout:2/376: unlink dd/de/d38/d53/d60/c65 0 2024-04-26T11:24:01.177 INFO:tasks.workunit.client.0.smithi073.stdout:9/417: write d0/d3c/f43 [187433,112650] 0 2024-04-26T11:24:01.178 INFO:tasks.workunit.client.0.smithi073.stdout:1/485: link d1/d6/l95 d1/d16/d6a/lb0 0 2024-04-26T11:24:01.178 INFO:tasks.workunit.client.0.smithi073.stdout:3/369: symlink d0/d11/l7b 0 2024-04-26T11:24:01.179 INFO:tasks.workunit.client.0.smithi073.stdout:8/418: creat d1/d4/f89 x:0 0 0 2024-04-26T11:24:01.179 INFO:tasks.workunit.client.0.smithi073.stdout:2/377: creat dd/de/d38/f75 x:0 0 0 2024-04-26T11:24:01.179 INFO:tasks.workunit.client.0.smithi073.stdout:3/370: chown d0/d2d/c30 227365 1 2024-04-26T11:24:01.181 INFO:tasks.workunit.client.0.smithi073.stdout:9/418: symlink d0/d13/db/l92 0 2024-04-26T11:24:01.181 INFO:tasks.workunit.client.0.smithi073.stdout:1/486: mkdir d1/d8/d57/db1 0 2024-04-26T11:24:01.182 INFO:tasks.workunit.client.0.smithi073.stdout:6/334: dread d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:01.182 INFO:tasks.workunit.client.0.smithi073.stdout:2/378: truncate dd/de/d38/d53/f74 120737 0 2024-04-26T11:24:01.182 INFO:tasks.workunit.client.0.smithi073.stdout:0/329: dwrite d2/f15 [0,4194304] 0 2024-04-26T11:24:01.183 INFO:tasks.workunit.client.0.smithi073.stdout:3/371: creat d0/d11/d19/db/d3e/d3f/d4d/f7c x:0 0 0 2024-04-26T11:24:01.183 INFO:tasks.workunit.client.0.smithi073.stdout:1/487: fsync d1/d73/d34/f43 0 2024-04-26T11:24:01.183 INFO:tasks.workunit.client.0.smithi073.stdout:8/419: getdents d1/d21/d50/d67 0 2024-04-26T11:24:01.183 INFO:tasks.workunit.client.0.smithi073.stdout:4/382: dwrite d8/d1a/d1b/d46/f81 [4194304,4194304] 0 2024-04-26T11:24:01.184 INFO:tasks.workunit.client.0.smithi073.stdout:9/419: write d0/d3c/f7a [456382,117439] 0 2024-04-26T11:24:01.184 INFO:tasks.workunit.client.0.smithi073.stdout:0/330: fsync d2/d1f/d40/f5b 0 2024-04-26T11:24:01.184 INFO:tasks.workunit.client.0.smithi073.stdout:3/372: write d0/f2e [5671227,107269] 0 2024-04-26T11:24:01.184 INFO:tasks.workunit.client.0.smithi073.stdout:1/488: write d1/d8/d2e/d37/f5c [162410,67916] 0 2024-04-26T11:24:01.185 INFO:tasks.workunit.client.0.smithi073.stdout:4/383: stat d8/d1a/d1b/d1d/f56 0 2024-04-26T11:24:01.185 INFO:tasks.workunit.client.0.smithi073.stdout:5/393: dread d4/de/d15/f19 [0,4194304] 0 2024-04-26T11:24:01.186 INFO:tasks.workunit.client.0.smithi073.stdout:8/420: mkdir d1/d4/d7b/d8a 0 2024-04-26T11:24:01.186 INFO:tasks.workunit.client.0.smithi073.stdout:0/331: mknod d2/d1f/d40/d48/d62/c77 0 2024-04-26T11:24:01.186 INFO:tasks.workunit.client.0.smithi073.stdout:3/373: mknod d0/d11/d19/d70/c7d 0 2024-04-26T11:24:01.186 INFO:tasks.workunit.client.0.smithi073.stdout:2/379: dread dd/d1c/d1d/f15 [0,4194304] 0 2024-04-26T11:24:01.187 INFO:tasks.workunit.client.0.smithi073.stdout:2/380: chown dd/d1c/f6f 518307067 1 2024-04-26T11:24:01.187 INFO:tasks.workunit.client.0.smithi073.stdout:5/394: symlink d4/de/d23/d4f/l92 0 2024-04-26T11:24:01.187 INFO:tasks.workunit.client.0.smithi073.stdout:9/420: symlink d0/d13/l93 0 2024-04-26T11:24:01.187 INFO:tasks.workunit.client.0.smithi073.stdout:4/384: rename d8/d15/d1c/d49/d5a to d8/d15/d1c/d49/d85/d8b 0 2024-04-26T11:24:01.188 INFO:tasks.workunit.client.0.smithi073.stdout:8/421: mkdir d1/d4/d4c/d66/d8b 0 2024-04-26T11:24:01.188 INFO:tasks.workunit.client.0.smithi073.stdout:0/332: mkdir d2/d22/d51/d57/d78 0 2024-04-26T11:24:01.188 INFO:tasks.workunit.client.0.smithi073.stdout:3/374: creat d0/d11/d19/d5b/f7e x:0 0 0 2024-04-26T11:24:01.189 INFO:tasks.workunit.client.0.smithi073.stdout:6/335: link d0/d19/f60 d0/dc/f66 0 2024-04-26T11:24:01.189 INFO:tasks.workunit.client.0.smithi073.stdout:5/395: dread - d4/de/d15/d33/f48 zero size 2024-04-26T11:24:01.189 INFO:tasks.workunit.client.0.smithi073.stdout:9/421: stat d0/d1a/d4e/d70/d51/c52 0 2024-04-26T11:24:01.189 INFO:tasks.workunit.client.0.smithi073.stdout:1/489: rename d1/d6/d7f/l85 to d1/d73/d34/d98/lb2 0 2024-04-26T11:24:01.190 INFO:tasks.workunit.client.0.smithi073.stdout:6/336: unlink d0/dc/cf 0 2024-04-26T11:24:01.190 INFO:tasks.workunit.client.0.smithi073.stdout:0/333: write d2/f4f [35769,127382] 0 2024-04-26T11:24:01.190 INFO:tasks.workunit.client.0.smithi073.stdout:5/396: mknod d4/d8/d9/c93 0 2024-04-26T11:24:01.191 INFO:tasks.workunit.client.0.smithi073.stdout:4/385: write d8/d1a/d1b/d24/f43 [5382308,4019] 0 2024-04-26T11:24:01.191 INFO:tasks.workunit.client.0.smithi073.stdout:9/422: creat d0/d13/d5a/d5e/f94 x:0 0 0 2024-04-26T11:24:01.191 INFO:tasks.workunit.client.0.smithi073.stdout:5/397: fsync d4/de/d15/d33/f4e 0 2024-04-26T11:24:01.191 INFO:tasks.workunit.client.0.smithi073.stdout:0/334: chown d2/d22/c69 0 1 2024-04-26T11:24:01.191 INFO:tasks.workunit.client.0.smithi073.stdout:3/375: creat d0/d11/d23/d3b/f7f x:0 0 0 2024-04-26T11:24:01.192 INFO:tasks.workunit.client.0.smithi073.stdout:5/398: write d4/de/f70 [78022,9616] 0 2024-04-26T11:24:01.193 INFO:tasks.workunit.client.0.smithi073.stdout:4/386: rename d8/d1a/c74 to d8/d1a/d1b/c8c 0 2024-04-26T11:24:01.193 INFO:tasks.workunit.client.0.smithi073.stdout:3/376: rename d0/d11/d19 to d0/d11/d19/db/d51/d80 22 2024-04-26T11:24:01.194 INFO:tasks.workunit.client.0.smithi073.stdout:6/337: mkdir d0/d1a/d4e/d67 0 2024-04-26T11:24:01.194 INFO:tasks.workunit.client.0.smithi073.stdout:4/387: chown d8/d14/f2a 166905382 1 2024-04-26T11:24:01.194 INFO:tasks.workunit.client.0.smithi073.stdout:0/335: link d2/d22/f33 d2/d37/f79 0 2024-04-26T11:24:01.195 INFO:tasks.workunit.client.0.smithi073.stdout:9/423: getdents d0/d13/db 0 2024-04-26T11:24:01.195 INFO:tasks.workunit.client.0.smithi073.stdout:4/388: fsync d8/d15/d1c/d49/f62 0 2024-04-26T11:24:01.196 INFO:tasks.workunit.client.0.smithi073.stdout:2/381: dwrite dd/de/f18 [0,4194304] 0 2024-04-26T11:24:01.196 INFO:tasks.workunit.client.0.smithi073.stdout:3/377: read - d0/d11/d19/db/d3e/d47/f63 zero size 2024-04-26T11:24:01.197 INFO:tasks.workunit.client.0.smithi073.stdout:2/382: fsync dd/d1c/d1d/f36 0 2024-04-26T11:24:01.197 INFO:tasks.workunit.client.0.smithi073.stdout:9/424: write d0/d1a/d4e/d70/d46/f8b [401359,110495] 0 2024-04-26T11:24:01.197 INFO:tasks.workunit.client.0.smithi073.stdout:1/490: dwrite d1/d8/d2e/d37/d9f/faf [0,4194304] 0 2024-04-26T11:24:01.198 INFO:tasks.workunit.client.0.smithi073.stdout:5/399: rename d4/d8/d8e/f87 to d4/de/d15/f94 0 2024-04-26T11:24:01.198 INFO:tasks.workunit.client.0.smithi073.stdout:0/336: mknod d2/d37/c7a 0 2024-04-26T11:24:01.199 INFO:tasks.workunit.client.0.smithi073.stdout:5/400: chown d4/d8/d9/d42/d68/f71 826 1 2024-04-26T11:24:01.199 INFO:tasks.workunit.client.0.smithi073.stdout:8/422: truncate d1/d4/d37/f4f 3171233 0 2024-04-26T11:24:01.200 INFO:tasks.workunit.client.0.smithi073.stdout:4/389: rename d8/d14/d60/d64/l28 to d8/d14/d60/d64/l8d 0 2024-04-26T11:24:01.201 INFO:tasks.workunit.client.0.smithi073.stdout:2/383: mknod dd/de/d6b/c76 0 2024-04-26T11:24:01.202 INFO:tasks.workunit.client.0.smithi073.stdout:0/337: symlink d2/d22/d51/d57/d78/l7b 0 2024-04-26T11:24:01.202 INFO:tasks.workunit.client.0.smithi073.stdout:5/401: mkdir d4/d95 0 2024-04-26T11:24:01.203 INFO:tasks.workunit.client.0.smithi073.stdout:3/378: rename d0/d11/d19/db/d3e/d3f/l48 to d0/d34/l81 0 2024-04-26T11:24:01.203 INFO:tasks.workunit.client.0.smithi073.stdout:4/390: mknod d8/d14/d60/c8e 0 2024-04-26T11:24:01.203 INFO:tasks.workunit.client.0.smithi073.stdout:2/384: chown dd/d1c/f22 20257 1 2024-04-26T11:24:01.203 INFO:tasks.workunit.client.0.smithi073.stdout:9/425: dread d0/f40 [0,4194304] 0 2024-04-26T11:24:01.204 INFO:tasks.workunit.client.0.smithi073.stdout:2/385: unlink dd/de/f3f 0 2024-04-26T11:24:01.204 INFO:tasks.workunit.client.0.smithi073.stdout:4/391: fdatasync d8/d1a/d1b/d46/f81 0 2024-04-26T11:24:01.204 INFO:tasks.workunit.client.0.smithi073.stdout:6/338: dwrite d0/d19/d20/f22 [0,4194304] 0 2024-04-26T11:24:01.204 INFO:tasks.workunit.client.0.smithi073.stdout:3/379: stat d0/d11/d19/db/d3e/d3f/d4d/d60/c6d 0 2024-04-26T11:24:01.205 INFO:tasks.workunit.client.0.smithi073.stdout:3/380: write d0/d11/d19/f28 [2348125,26128] 0 2024-04-26T11:24:01.206 INFO:tasks.workunit.client.0.smithi073.stdout:5/402: symlink d4/d8/d9/d7d/l96 0 2024-04-26T11:24:01.206 INFO:tasks.workunit.client.0.smithi073.stdout:9/426: mknod d0/d1a/d4e/d70/d51/c95 0 2024-04-26T11:24:01.206 INFO:tasks.workunit.client.0.smithi073.stdout:2/386: mkdir dd/d4c/d48/d77 0 2024-04-26T11:24:01.206 INFO:tasks.workunit.client.0.smithi073.stdout:6/339: symlink d0/d15/d2d/l68 0 2024-04-26T11:24:01.206 INFO:tasks.workunit.client.0.smithi073.stdout:4/392: symlink d8/d15/l8f 0 2024-04-26T11:24:01.206 INFO:tasks.workunit.client.0.smithi073.stdout:5/403: rename d4/d8 to d4/d8/d8e/d97 22 2024-04-26T11:24:01.207 INFO:tasks.workunit.client.0.smithi073.stdout:9/427: symlink d0/d1a/d4e/d70/d3b/l96 0 2024-04-26T11:24:01.207 INFO:tasks.workunit.client.0.smithi073.stdout:3/381: link d0/fa d0/d11/d19/db/f82 0 2024-04-26T11:24:01.207 INFO:tasks.workunit.client.0.smithi073.stdout:2/387: getdents dd/d27 0 2024-04-26T11:24:01.208 INFO:tasks.workunit.client.0.smithi073.stdout:4/393: rename d8/d15/d1c/d49/d85/f67 to d8/d1a/d5e/d7c/f90 0 2024-04-26T11:24:01.208 INFO:tasks.workunit.client.0.smithi073.stdout:3/382: read - d0/d11/d23/d3b/f7f zero size 2024-04-26T11:24:01.208 INFO:tasks.workunit.client.0.smithi073.stdout:9/428: chown d0/d13/l62 5601 1 2024-04-26T11:24:01.209 INFO:tasks.workunit.client.0.smithi073.stdout:1/491: truncate d1/d51/f67 3645489 0 2024-04-26T11:24:01.209 INFO:tasks.workunit.client.0.smithi073.stdout:4/394: creat d8/d15/d1c/d49/f91 x:0 0 0 2024-04-26T11:24:01.209 INFO:tasks.workunit.client.0.smithi073.stdout:2/388: link dd/de/d2a/f5b dd/d4c/f78 0 2024-04-26T11:24:01.210 INFO:tasks.workunit.client.0.smithi073.stdout:3/383: creat d0/d11/d19/db/d3e/d47/f83 x:0 0 0 2024-04-26T11:24:01.211 INFO:tasks.workunit.client.0.smithi073.stdout:1/492: readlink d1/d73/d34/d98/la4 0 2024-04-26T11:24:01.211 INFO:tasks.workunit.client.0.smithi073.stdout:9/429: creat d0/d6c/f97 x:0 0 0 2024-04-26T11:24:01.211 INFO:tasks.workunit.client.0.smithi073.stdout:4/395: symlink d8/d15/d1c/d72/l92 0 2024-04-26T11:24:01.211 INFO:tasks.workunit.client.0.smithi073.stdout:0/338: dwrite d2/f3f [0,4194304] 0 2024-04-26T11:24:01.211 INFO:tasks.workunit.client.0.smithi073.stdout:3/384: creat d0/d11/d19/d70/f84 x:0 0 0 2024-04-26T11:24:01.212 INFO:tasks.workunit.client.0.smithi073.stdout:0/339: truncate d2/d22/f5a 1496078 0 2024-04-26T11:24:01.213 INFO:tasks.workunit.client.0.smithi073.stdout:0/340: readlink d2/d22/d51/d57/l58 0 2024-04-26T11:24:01.214 INFO:tasks.workunit.client.0.smithi073.stdout:1/493: fdatasync d1/d73/f36 0 2024-04-26T11:24:01.215 INFO:tasks.workunit.client.0.smithi073.stdout:0/341: unlink d2/d1f/f26 0 2024-04-26T11:24:01.216 INFO:tasks.workunit.client.0.smithi073.stdout:3/385: mknod d0/d11/d19/db/d3e/d3f/d4d/d7a/c85 0 2024-04-26T11:24:01.216 INFO:tasks.workunit.client.0.smithi073.stdout:1/494: write d1/d16/d4f/f79 [1367623,73808] 0 2024-04-26T11:24:01.217 INFO:tasks.workunit.client.0.smithi073.stdout:0/342: creat d2/d37/d3c/d73/f7c x:0 0 0 2024-04-26T11:24:01.217 INFO:tasks.workunit.client.0.smithi073.stdout:7/416: dread d1/d11/d24/d26/d3d/d41/d64/f5f [0,4194304] 0 2024-04-26T11:24:01.218 INFO:tasks.workunit.client.0.smithi073.stdout:3/386: unlink d0/d11/d19/db/f74 0 2024-04-26T11:24:01.218 INFO:tasks.workunit.client.0.smithi073.stdout:3/387: mkdir d0/d11/d23/d86 0 2024-04-26T11:24:01.219 INFO:tasks.workunit.client.0.smithi073.stdout:3/388: fdatasync d0/d11/f6f 0 2024-04-26T11:24:01.219 INFO:tasks.workunit.client.0.smithi073.stdout:2/389: dwrite dd/de/d49/f67 [0,4194304] 0 2024-04-26T11:24:01.219 INFO:tasks.workunit.client.0.smithi073.stdout:9/430: dwrite d0/d13/f5b [0,4194304] 0 2024-04-26T11:24:01.222 INFO:tasks.workunit.client.0.smithi073.stdout:0/343: truncate d2/d22/d51/d57/f76 367448 0 2024-04-26T11:24:01.222 INFO:tasks.workunit.client.0.smithi073.stdout:2/390: chown dd/d1c 1206 1 2024-04-26T11:24:01.222 INFO:tasks.workunit.client.0.smithi073.stdout:9/431: write d0/d13/d5a/d5e/f94 [55581,22886] 0 2024-04-26T11:24:01.223 INFO:tasks.workunit.client.0.smithi073.stdout:1/495: rmdir d1 39 2024-04-26T11:24:01.223 INFO:tasks.workunit.client.0.smithi073.stdout:3/389: symlink d0/d11/d23/l87 0 2024-04-26T11:24:01.223 INFO:tasks.workunit.client.0.smithi073.stdout:9/432: readlink d0/d13/ld 0 2024-04-26T11:24:01.224 INFO:tasks.workunit.client.0.smithi073.stdout:9/433: mkdir d0/d13/d25/d75/d98 0 2024-04-26T11:24:01.224 INFO:tasks.workunit.client.0.smithi073.stdout:1/496: write d1/d8/f2d [3374336,5920] 0 2024-04-26T11:24:01.225 INFO:tasks.workunit.client.0.smithi073.stdout:3/390: sync 2024-04-26T11:24:01.225 INFO:tasks.workunit.client.0.smithi073.stdout:3/391: creat d0/d11/d23/f88 x:0 0 0 2024-04-26T11:24:01.226 INFO:tasks.workunit.client.0.smithi073.stdout:9/434: rename d0/d1a/l37 to d0/d1a/l99 0 2024-04-26T11:24:01.226 INFO:tasks.workunit.client.0.smithi073.stdout:3/392: chown d0/d11/d19/d70/c7d 3679 1 2024-04-26T11:24:01.227 INFO:tasks.workunit.client.0.smithi073.stdout:9/435: symlink d0/d1a/l9a 0 2024-04-26T11:24:01.227 INFO:tasks.workunit.client.0.smithi073.stdout:9/436: chown d0/d13/db/l92 45 1 2024-04-26T11:24:01.228 INFO:tasks.workunit.client.0.smithi073.stdout:9/437: mknod d0/d83/c9b 0 2024-04-26T11:24:01.228 INFO:tasks.workunit.client.0.smithi073.stdout:3/393: truncate d0/d11/d23/d3b/f7f 273743 0 2024-04-26T11:24:01.228 INFO:tasks.workunit.client.0.smithi073.stdout:2/391: dread dd/d27/f31 [0,4194304] 0 2024-04-26T11:24:01.228 INFO:tasks.workunit.client.0.smithi073.stdout:4/396: read d8/fe [163800,127897] 0 2024-04-26T11:24:01.229 INFO:tasks.workunit.client.0.smithi073.stdout:0/344: dwrite d2/d37/d3c/f47 [0,4194304] 0 2024-04-26T11:24:01.229 INFO:tasks.workunit.client.0.smithi073.stdout:3/394: creat d0/d2d/f89 x:0 0 0 2024-04-26T11:24:01.229 INFO:tasks.workunit.client.0.smithi073.stdout:9/438: mkdir d0/d13/d25/d9c 0 2024-04-26T11:24:01.229 INFO:tasks.workunit.client.0.smithi073.stdout:2/392: creat dd/de/d49/f79 x:0 0 0 2024-04-26T11:24:01.230 INFO:tasks.workunit.client.0.smithi073.stdout:0/345: write d2/f21 [2732658,59657] 0 2024-04-26T11:24:01.230 INFO:tasks.workunit.client.0.smithi073.stdout:4/397: creat d8/d14/f93 x:0 0 0 2024-04-26T11:24:01.231 INFO:tasks.workunit.client.0.smithi073.stdout:4/398: write d8/d1a/d5e/d7c/f82 [860589,83171] 0 2024-04-26T11:24:01.233 INFO:tasks.workunit.client.0.smithi073.stdout:7/417: dread d1/d11/d24/d29/f74 [0,4194304] 0 2024-04-26T11:24:01.233 INFO:tasks.workunit.client.0.smithi073.stdout:2/393: symlink dd/de/l7a 0 2024-04-26T11:24:01.233 INFO:tasks.workunit.client.0.smithi073.stdout:2/394: write dd/de/f11 [519559,19623] 0 2024-04-26T11:24:01.233 INFO:tasks.workunit.client.0.smithi073.stdout:7/418: chown d1/d11/d24/d26/d3d/f6d 1340687877 1 2024-04-26T11:24:01.233 INFO:tasks.workunit.client.0.smithi073.stdout:1/497: truncate d1/d6/fb 6336999 0 2024-04-26T11:24:01.234 INFO:tasks.workunit.client.0.smithi073.stdout:7/419: creat d1/d33/f97 x:0 0 0 2024-04-26T11:24:01.234 INFO:tasks.workunit.client.0.smithi073.stdout:4/399: link d8/d15/d1c/d72/l92 d8/d1a/d1b/l94 0 2024-04-26T11:24:01.235 INFO:tasks.workunit.client.0.smithi073.stdout:1/498: write d1/d73/d34/f78 [675588,54992] 0 2024-04-26T11:24:01.235 INFO:tasks.workunit.client.0.smithi073.stdout:9/439: dread d0/f3f [0,4194304] 0 2024-04-26T11:24:01.236 INFO:tasks.workunit.client.0.smithi073.stdout:5/404: dread d4/f1f [0,4194304] 0 2024-04-26T11:24:01.237 INFO:tasks.workunit.client.0.smithi073.stdout:1/499: rename d1/d8/d2e/d37 to d1/d6/db3 0 2024-04-26T11:24:01.237 INFO:tasks.workunit.client.0.smithi073.stdout:9/440: truncate d0/d1a/d4e/d70/d46/f8a 129824 0 2024-04-26T11:24:01.238 INFO:tasks.workunit.client.0.smithi073.stdout:7/420: creat d1/d11/f98 x:0 0 0 2024-04-26T11:24:01.238 INFO:tasks.workunit.client.0.smithi073.stdout:3/395: dwrite d0/d11/d19/db/d3e/d3f/f59 [0,4194304] 0 2024-04-26T11:24:01.238 INFO:tasks.workunit.client.0.smithi073.stdout:2/395: truncate dd/de/f28 244349 0 2024-04-26T11:24:01.239 INFO:tasks.workunit.client.0.smithi073.stdout:1/500: creat d1/d16/fb4 x:0 0 0 2024-04-26T11:24:01.239 INFO:tasks.workunit.client.0.smithi073.stdout:5/405: write d4/de/d15/d60/f3f [543878,119640] 0 2024-04-26T11:24:01.241 INFO:tasks.workunit.client.0.smithi073.stdout:3/396: truncate d0/d11/d19/d1d/f4c 705385 0 2024-04-26T11:24:01.241 INFO:tasks.workunit.client.0.smithi073.stdout:5/406: truncate d4/d8/d9/f21 1627739 0 2024-04-26T11:24:01.242 INFO:tasks.workunit.client.0.smithi073.stdout:4/400: dwrite d8/d14/f75 [0,4194304] 0 2024-04-26T11:24:01.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/407: stat d4/de/d15/d60/l28 0 2024-04-26T11:24:01.243 INFO:tasks.workunit.client.0.smithi073.stdout:2/396: fdatasync dd/d1c/d1d/f15 0 2024-04-26T11:24:01.243 INFO:tasks.workunit.client.0.smithi073.stdout:8/423: dread d1/f26 [0,4194304] 0 2024-04-26T11:24:01.243 INFO:tasks.workunit.client.0.smithi073.stdout:7/421: symlink d1/d11/d24/d26/d4b/l99 0 2024-04-26T11:24:01.244 INFO:tasks.workunit.client.0.smithi073.stdout:5/408: fdatasync d4/d8/d9/d7d/d84/f78 0 2024-04-26T11:24:01.245 INFO:tasks.workunit.client.0.smithi073.stdout:6/340: dread d0/f2 [0,4194304] 0 2024-04-26T11:24:01.245 INFO:tasks.workunit.client.0.smithi073.stdout:3/397: creat d0/d11/d19/d1d/f8a x:0 0 0 2024-04-26T11:24:01.245 INFO:tasks.workunit.client.0.smithi073.stdout:8/424: creat d1/d21/d2c/f8c x:0 0 0 2024-04-26T11:24:01.246 INFO:tasks.workunit.client.0.smithi073.stdout:2/397: read - dd/de/d38/d4e/f51 zero size 2024-04-26T11:24:01.246 INFO:tasks.workunit.client.0.smithi073.stdout:1/501: creat d1/fb5 x:0 0 0 2024-04-26T11:24:01.246 INFO:tasks.workunit.client.0.smithi073.stdout:4/401: symlink d8/d1a/d86/l95 0 2024-04-26T11:24:01.247 INFO:tasks.workunit.client.0.smithi073.stdout:9/441: dwrite d0/d13/db/f23 [4194304,4194304] 0 2024-04-26T11:24:01.247 INFO:tasks.workunit.client.0.smithi073.stdout:7/422: write d1/d33/f86 [505587,28522] 0 2024-04-26T11:24:01.247 INFO:tasks.workunit.client.0.smithi073.stdout:2/398: stat dd/de/d2a/f5b 0 2024-04-26T11:24:01.247 INFO:tasks.workunit.client.0.smithi073.stdout:1/502: fsync d1/d6/d7f/d47/fa9 0 2024-04-26T11:24:01.248 INFO:tasks.workunit.client.0.smithi073.stdout:4/402: fsync d8/d1a/d1b/d41/f48 0 2024-04-26T11:24:01.248 INFO:tasks.workunit.client.0.smithi073.stdout:2/399: rename dd to dd/d4c/d48/d77/d7b 22 2024-04-26T11:24:01.248 INFO:tasks.workunit.client.0.smithi073.stdout:4/403: fsync d8/d15/d1c/d49/d85/f5d 0 2024-04-26T11:24:01.249 INFO:tasks.workunit.client.0.smithi073.stdout:9/442: write d0/d1a/d4e/d70/d3b/f4d [45006,11761] 0 2024-04-26T11:24:01.249 INFO:tasks.workunit.client.0.smithi073.stdout:4/404: dread - d8/d15/d1c/d49/d85/f5d zero size 2024-04-26T11:24:01.251 INFO:tasks.workunit.client.0.smithi073.stdout:4/405: dread - d8/d15/d1c/d49/f6c zero size 2024-04-26T11:24:01.251 INFO:tasks.workunit.client.0.smithi073.stdout:8/425: mkdir d1/d4/d7b/d8d 0 2024-04-26T11:24:01.252 INFO:tasks.workunit.client.0.smithi073.stdout:2/400: unlink dd/de/d2a/l47 0 2024-04-26T11:24:01.252 INFO:tasks.workunit.client.0.smithi073.stdout:4/406: mkdir d8/d15/d1c/d72/d77/d96 0 2024-04-26T11:24:01.252 INFO:tasks.workunit.client.0.smithi073.stdout:6/341: rmdir d0/d15/d2d/d3f/d59/d62 0 2024-04-26T11:24:01.253 INFO:tasks.workunit.client.0.smithi073.stdout:1/503: creat d1/fb6 x:0 0 0 2024-04-26T11:24:01.253 INFO:tasks.workunit.client.0.smithi073.stdout:3/398: dwrite d0/d11/d19/d1d/f50 [0,4194304] 0 2024-04-26T11:24:01.254 INFO:tasks.workunit.client.0.smithi073.stdout:2/401: dread - dd/de/d49/f79 zero size 2024-04-26T11:24:01.254 INFO:tasks.workunit.client.0.smithi073.stdout:1/504: chown d1/fb6 316093834 1 2024-04-26T11:24:01.256 INFO:tasks.workunit.client.0.smithi073.stdout:1/505: write d1/d73/f35 [1000509,130523] 0 2024-04-26T11:24:01.257 INFO:tasks.workunit.client.0.smithi073.stdout:4/407: creat d8/d15/d1c/d49/d84/f97 x:0 0 0 2024-04-26T11:24:01.257 INFO:tasks.workunit.client.0.smithi073.stdout:2/402: rename dd/f1a to dd/d4c/f7c 0 2024-04-26T11:24:01.257 INFO:tasks.workunit.client.0.smithi073.stdout:3/399: mkdir d0/d11/d19/db/d3e/d3f/d4d/d8b 0 2024-04-26T11:24:01.257 INFO:tasks.workunit.client.0.smithi073.stdout:8/426: link d1/d4/d37/d5b/f7c d1/d4/d4c/f8e 0 2024-04-26T11:24:01.257 INFO:tasks.workunit.client.0.smithi073.stdout:9/443: dwrite d0/d6c/f97 [0,4194304] 0 2024-04-26T11:24:01.258 INFO:tasks.workunit.client.0.smithi073.stdout:5/409: dwrite d4/de/d23/f44 [0,4194304] 0 2024-04-26T11:24:01.259 INFO:tasks.workunit.client.0.smithi073.stdout:8/427: chown d1/d21/d2a/f39 41273 1 2024-04-26T11:24:01.259 INFO:tasks.workunit.client.0.smithi073.stdout:9/444: chown d0/d3c/l5d 13786 1 2024-04-26T11:24:01.260 INFO:tasks.workunit.client.0.smithi073.stdout:2/403: creat dd/de/d38/d53/d60/f7d x:0 0 0 2024-04-26T11:24:01.260 INFO:tasks.workunit.client.0.smithi073.stdout:3/400: mkdir d0/d11/d19/db/d3e/d3f/d4d/d8b/d8c 0 2024-04-26T11:24:01.260 INFO:tasks.workunit.client.0.smithi073.stdout:8/428: creat d1/d4/d4c/d66/f8f x:0 0 0 2024-04-26T11:24:01.260 INFO:tasks.workunit.client.0.smithi073.stdout:5/410: rename d4/d8/d9/d42 to d4/d8/d9/d42/d98 22 2024-04-26T11:24:01.261 INFO:tasks.workunit.client.0.smithi073.stdout:9/445: chown d0/d1a/d4e/c7f 163 1 2024-04-26T11:24:01.261 INFO:tasks.workunit.client.0.smithi073.stdout:2/404: chown dd/de/d49/f67 979 1 2024-04-26T11:24:01.261 INFO:tasks.workunit.client.0.smithi073.stdout:3/401: chown d0/d11/d19/fc 1377 1 2024-04-26T11:24:01.262 INFO:tasks.workunit.client.0.smithi073.stdout:3/402: sync 2024-04-26T11:24:01.262 INFO:tasks.workunit.client.0.smithi073.stdout:8/429: write d1/f26 [3649361,28188] 0 2024-04-26T11:24:01.263 INFO:tasks.workunit.client.0.smithi073.stdout:3/403: creat d0/d11/d19/d1d/f8d x:0 0 0 2024-04-26T11:24:01.264 INFO:tasks.workunit.client.0.smithi073.stdout:8/430: mkdir d1/d4/d37/d90 0 2024-04-26T11:24:01.264 INFO:tasks.workunit.client.0.smithi073.stdout:1/506: dwrite d1/d73/f35 [4194304,4194304] 0 2024-04-26T11:24:01.264 INFO:tasks.workunit.client.0.smithi073.stdout:4/408: truncate d8/d1a/d1b/d1d/f56 431390 0 2024-04-26T11:24:01.264 INFO:tasks.workunit.client.0.smithi073.stdout:8/431: sync 2024-04-26T11:24:01.265 INFO:tasks.workunit.client.0.smithi073.stdout:4/409: creat d8/d1a/d86/f98 x:0 0 0 2024-04-26T11:24:01.265 INFO:tasks.workunit.client.0.smithi073.stdout:1/507: readlink d1/d6/l95 0 2024-04-26T11:24:01.265 INFO:tasks.workunit.client.0.smithi073.stdout:1/508: readlink d1/d16/d61/la0 0 2024-04-26T11:24:01.266 INFO:tasks.workunit.client.0.smithi073.stdout:8/432: rename d1/d4/c54 to d1/d21/d2a/c91 0 2024-04-26T11:24:01.266 INFO:tasks.workunit.client.0.smithi073.stdout:4/410: dread - d8/d1a/d5e/d7c/f7f zero size 2024-04-26T11:24:01.267 INFO:tasks.workunit.client.0.smithi073.stdout:1/509: fsync d1/d6/f29 0 2024-04-26T11:24:01.267 INFO:tasks.workunit.client.0.smithi073.stdout:2/405: dread dd/d4c/d48/f2d [0,4194304] 0 2024-04-26T11:24:01.269 INFO:tasks.workunit.client.0.smithi073.stdout:2/406: write dd/de/d38/f70 [988838,29771] 0 2024-04-26T11:24:01.269 INFO:tasks.workunit.client.0.smithi073.stdout:5/411: dwrite d4/d8/d9/f21 [0,4194304] 0 2024-04-26T11:24:01.270 INFO:tasks.workunit.client.0.smithi073.stdout:8/433: getdents d1/d4/d4c/d66/d8b 0 2024-04-26T11:24:01.271 INFO:tasks.workunit.client.0.smithi073.stdout:3/404: dwrite d0/f45 [0,4194304] 0 2024-04-26T11:24:01.271 INFO:tasks.workunit.client.0.smithi073.stdout:3/405: sync 2024-04-26T11:24:01.271 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:01.266+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:01.272 INFO:tasks.workunit.client.0.smithi073.stdout:2/407: symlink dd/de/d38/d53/l7e 0 2024-04-26T11:24:01.272 INFO:tasks.workunit.client.0.smithi073.stdout:0/346: dread d2/d1f/d40/d48/f55 [0,4194304] 0 2024-04-26T11:24:01.272 INFO:tasks.workunit.client.0.smithi073.stdout:8/434: write d1/d4/d37/f48 [1734286,94282] 0 2024-04-26T11:24:01.272 INFO:tasks.workunit.client.0.smithi073.stdout:5/412: rename d4/de/d15/d60/f31 to d4/d8/d9/d42/f99 0 2024-04-26T11:24:01.272 INFO:tasks.workunit.client.0.smithi073.stdout:0/347: write d2/d1f/d40/d48/f4a [1362762,10688] 0 2024-04-26T11:24:01.273 INFO:tasks.workunit.client.0.smithi073.stdout:8/435: truncate d1/d4/d15/f60 51176 0 2024-04-26T11:24:01.273 INFO:tasks.workunit.client.0.smithi073.stdout:3/406: rmdir d0/d11/d23/d3b/d3c 39 2024-04-26T11:24:01.273 INFO:tasks.workunit.client.0.smithi073.stdout:7/423: dread d1/d11/d24/d26/d3d/d41/f47 [0,4194304] 0 2024-04-26T11:24:01.274 INFO:tasks.workunit.client.0.smithi073.stdout:2/408: link dd/de/d38/d53/f74 dd/d4c/d48/f7f 0 2024-04-26T11:24:01.274 INFO:tasks.workunit.client.0.smithi073.stdout:0/348: creat d2/d5f/f7d x:0 0 0 2024-04-26T11:24:01.274 INFO:tasks.workunit.client.0.smithi073.stdout:5/413: rename d4/d8/f35 to d4/de/d23/f9a 0 2024-04-26T11:24:01.274 INFO:tasks.workunit.client.0.smithi073.stdout:0/349: sync 2024-04-26T11:24:01.275 INFO:tasks.workunit.client.0.smithi073.stdout:2/409: chown dd/d4c/f78 19737068 1 2024-04-26T11:24:01.275 INFO:tasks.workunit.client.0.smithi073.stdout:7/424: chown d1/d33/d1b/d66/d50/f7d 0 1 2024-04-26T11:24:01.275 INFO:tasks.workunit.client.0.smithi073.stdout:0/350: mknod d2/d37/c7e 0 2024-04-26T11:24:01.275 INFO:tasks.workunit.client.0.smithi073.stdout:5/414: symlink d4/de/d15/d67/l9b 0 2024-04-26T11:24:01.276 INFO:tasks.workunit.client.0.smithi073.stdout:2/410: write dd/d4c/f7c [1152660,75123] 0 2024-04-26T11:24:01.276 INFO:tasks.workunit.client.0.smithi073.stdout:3/407: rename d0/d34/l81 to d0/d11/d19/l8e 0 2024-04-26T11:24:01.277 INFO:tasks.workunit.client.0.smithi073.stdout:0/351: mknod d2/d1f/d40/d48/c7f 0 2024-04-26T11:24:01.277 INFO:tasks.workunit.client.0.smithi073.stdout:2/411: mkdir dd/d4c/d48/d77/d80 0 2024-04-26T11:24:01.281 INFO:tasks.workunit.client.0.smithi073.stdout:3/408: getdents d0/d11/d19/d52 0 2024-04-26T11:24:01.281 INFO:tasks.workunit.client.0.smithi073.stdout:8/436: dwrite d1/d4/f5a [0,4194304] 0 2024-04-26T11:24:01.283 INFO:tasks.workunit.client.0.smithi073.stdout:8/437: symlink d1/d4/d37/d5b/d83/l92 0 2024-04-26T11:24:01.284 INFO:tasks.workunit.client.0.smithi073.stdout:3/409: creat d0/d26/f8f x:0 0 0 2024-04-26T11:24:01.286 INFO:tasks.workunit.client.0.smithi073.stdout:7/425: dwrite d1/d11/d24/d26/d4b/f56 [0,4194304] 0 2024-04-26T11:24:01.286 INFO:tasks.workunit.client.0.smithi073.stdout:8/438: fsync d1/d4/d4c/d66/f8f 0 2024-04-26T11:24:01.287 INFO:tasks.workunit.client.0.smithi073.stdout:3/410: readlink d0/d11/d23/l87 0 2024-04-26T11:24:01.287 INFO:tasks.workunit.client.0.smithi073.stdout:5/415: dwrite d4/de/f70 [0,4194304] 0 2024-04-26T11:24:01.287 INFO:tasks.workunit.client.0.smithi073.stdout:7/426: read d1/d11/d24/d26/d3d/d41/d64/f5f [3623293,31365] 0 2024-04-26T11:24:01.288 INFO:tasks.workunit.client.0.smithi073.stdout:5/416: truncate d4/d8/d9/f46 970415 0 2024-04-26T11:24:01.288 INFO:tasks.workunit.client.0.smithi073.stdout:3/411: mkdir d0/d11/d19/db/d3e/d3f/d4d/d8b/d8c/d90 0 2024-04-26T11:24:01.288 INFO:tasks.workunit.client.0.smithi073.stdout:0/352: dwrite d2/d37/d3c/f47 [0,4194304] 0 2024-04-26T11:24:01.288 INFO:tasks.workunit.client.0.smithi073.stdout:8/439: rename d1/d4/d4c/f8e to d1/d4/d7b/d8d/f93 0 2024-04-26T11:24:01.288 INFO:tasks.workunit.client.0.smithi073.stdout:3/412: chown d0/d11/d19/d70/f84 0 1 2024-04-26T11:24:01.289 INFO:tasks.workunit.client.0.smithi073.stdout:3/413: write d0/d11/d19/db/d3e/d47/f4f [109925,22804] 0 2024-04-26T11:24:01.290 INFO:tasks.workunit.client.0.smithi073.stdout:5/417: rename d4/de/d15/d60/f66 to d4/d8/d9/d42/f9c 0 2024-04-26T11:24:01.290 INFO:tasks.workunit.client.0.smithi073.stdout:7/427: symlink d1/d11/d24/d26/d3d/d41/d64/l9a 0 2024-04-26T11:24:01.291 INFO:tasks.workunit.client.0.smithi073.stdout:5/418: creat d4/de/d15/d33/f9d x:0 0 0 2024-04-26T11:24:01.291 INFO:tasks.workunit.client.0.smithi073.stdout:7/428: fdatasync d1/d11/d24/d26/d3d/f93 0 2024-04-26T11:24:01.293 INFO:tasks.workunit.client.0.smithi073.stdout:5/419: getdents d4/d8/d8e 0 2024-04-26T11:24:01.294 INFO:tasks.workunit.client.0.smithi073.stdout:0/353: dwrite d2/d22/f2f [0,4194304] 0 2024-04-26T11:24:01.298 INFO:tasks.workunit.client.0.smithi073.stdout:0/354: mknod d2/d37/d3c/d6a/c80 0 2024-04-26T11:24:01.304 INFO:tasks.workunit.client.0.smithi073.stdout:8/440: truncate d1/d21/d2a/f43 2066617 0 2024-04-26T11:24:01.304 INFO:tasks.workunit.client.0.smithi073.stdout:7/429: truncate f0 1306752 0 2024-04-26T11:24:01.305 INFO:tasks.workunit.client.0.smithi073.stdout:8/441: write d1/d21/f29 [3695237,581] 0 2024-04-26T11:24:01.305 INFO:tasks.workunit.client.0.smithi073.stdout:7/430: symlink d1/d11/d24/d26/d3d/d41/d64/l9b 0 2024-04-26T11:24:01.306 INFO:tasks.workunit.client.0.smithi073.stdout:7/431: write d1/d33/d1b/d66/f69 [788056,123052] 0 2024-04-26T11:24:01.306 INFO:tasks.workunit.client.0.smithi073.stdout:8/442: rename d1/d4/d37/f86 to d1/d4/d4c/d66/d8b/f94 0 2024-04-26T11:24:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:01.307 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:01.307 INFO:tasks.workunit.client.0.smithi073.stdout:7/432: creat d1/d11/d10/f9c x:0 0 0 2024-04-26T11:24:01.307 INFO:tasks.workunit.client.0.smithi073.stdout:8/443: mknod d1/d4/d4c/c95 0 2024-04-26T11:24:01.307 INFO:tasks.workunit.client.0.smithi073.stdout:8/444: mkdir d1/d4/d4c/d96 0 2024-04-26T11:24:01.308 INFO:tasks.workunit.client.0.smithi073.stdout:7/433: creat d1/d11/d24/d26/d67/f9d x:0 0 0 2024-04-26T11:24:01.314 INFO:tasks.workunit.client.0.smithi073.stdout:0/355: rmdir d2/d37/d3c 39 2024-04-26T11:24:01.314 INFO:tasks.workunit.client.0.smithi073.stdout:5/420: truncate d4/de/d15/d60/f16 3055712 0 2024-04-26T11:24:01.314 INFO:tasks.workunit.client.0.smithi073.stdout:8/445: write d1/d4/d7b/d8d/f93 [462828,128078] 0 2024-04-26T11:24:01.314 INFO:tasks.workunit.client.0.smithi073.stdout:5/421: chown d4/d8/f81 7899625 1 2024-04-26T11:24:01.314 INFO:tasks.workunit.client.0.smithi073.stdout:0/356: symlink d2/d1f/d40/l81 0 2024-04-26T11:24:01.315 INFO:tasks.workunit.client.0.smithi073.stdout:8/446: symlink d1/d21/d50/d67/l97 0 2024-04-26T11:24:01.315 INFO:tasks.workunit.client.0.smithi073.stdout:7/434: dwrite d1/d11/d5e/d8f/f91 [0,4194304] 0 2024-04-26T11:24:01.315 INFO:tasks.workunit.client.0.smithi073.stdout:5/422: fdatasync d4/d8/d9/d42/f9c 0 2024-04-26T11:24:01.317 INFO:tasks.workunit.client.0.smithi073.stdout:2/412: dread f9 [0,4194304] 0 2024-04-26T11:24:01.318 INFO:tasks.workunit.client.0.smithi073.stdout:0/357: creat d2/d1f/d40/f82 x:0 0 0 2024-04-26T11:24:01.319 INFO:tasks.workunit.client.0.smithi073.stdout:5/423: link d4/d8/d9/f21 d4/de/d15/f9e 0 2024-04-26T11:24:01.320 INFO:tasks.workunit.client.0.smithi073.stdout:0/358: chown d2/l5 0 1 2024-04-26T11:24:01.320 INFO:tasks.workunit.client.0.smithi073.stdout:6/342: dread d0/d19/f21 [4194304,4194304] 0 2024-04-26T11:24:01.321 INFO:tasks.workunit.client.0.smithi073.stdout:8/447: rename d1/d4/d37/f71 to d1/d21/d50/d67/f98 0 2024-04-26T11:24:01.322 INFO:tasks.workunit.client.0.smithi073.stdout:1/510: dread d1/d6/f29 [0,4194304] 0 2024-04-26T11:24:01.322 INFO:tasks.workunit.client.0.smithi073.stdout:7/435: dwrite d1/d11/f1c [0,4194304] 0 2024-04-26T11:24:01.322 INFO:tasks.workunit.client.0.smithi073.stdout:8/448: stat d1/d4/d37/f40 0 2024-04-26T11:24:01.322 INFO:tasks.workunit.client.0.smithi073.stdout:0/359: creat d2/d37/f83 x:0 0 0 2024-04-26T11:24:01.325 INFO:tasks.workunit.client.0.smithi073.stdout:1/511: mkdir d1/d6/d7f/d47/db7 0 2024-04-26T11:24:01.326 INFO:tasks.workunit.client.0.smithi073.stdout:0/360: mkdir d2/d84 0 2024-04-26T11:24:01.326 INFO:tasks.workunit.client.0.smithi073.stdout:8/449: write d1/d4/d37/d5b/f7a [1209261,97821] 0 2024-04-26T11:24:01.326 INFO:tasks.workunit.client.0.smithi073.stdout:1/512: readlink d1/d8/d2e/l50 0 2024-04-26T11:24:01.327 INFO:tasks.workunit.client.0.smithi073.stdout:5/424: dwrite d4/de/d15/d60/f1a [0,4194304] 0 2024-04-26T11:24:01.327 INFO:tasks.workunit.client.0.smithi073.stdout:0/361: write d2/d1f/f28 [201272,33130] 0 2024-04-26T11:24:01.327 INFO:tasks.workunit.client.0.smithi073.stdout:8/450: stat d1/d21/d50/d67/d81/f88 0 2024-04-26T11:24:01.328 INFO:tasks.workunit.client.0.smithi073.stdout:0/362: readlink d2/d22/d51/d57/d78/l7b 0 2024-04-26T11:24:01.328 INFO:tasks.workunit.client.0.smithi073.stdout:6/343: dwrite d0/d15/f14 [0,4194304] 0 2024-04-26T11:24:01.331 INFO:tasks.workunit.client.0.smithi073.stdout:4/411: dread d8/d1a/d1b/f36 [0,4194304] 0 2024-04-26T11:24:01.331 INFO:tasks.workunit.client.0.smithi073.stdout:7/436: truncate d1/d33/d1b/f1e 3197195 0 2024-04-26T11:24:01.332 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:01.332 INFO:tasks.workunit.client.0.smithi073.stdout:8/451: symlink d1/d21/d50/d67/l99 0 2024-04-26T11:24:01.332 INFO:tasks.workunit.client.0.smithi073.stdout:0/363: creat d2/d22/d51/d57/f85 x:0 0 0 2024-04-26T11:24:01.333 INFO:tasks.workunit.client.0.smithi073.stdout:6/344: symlink d0/d1a/d4e/l69 0 2024-04-26T11:24:01.333 INFO:tasks.workunit.client.0.smithi073.stdout:4/412: symlink d8/d1a/d86/l99 0 2024-04-26T11:24:01.333 INFO:tasks.workunit.client.0.smithi073.stdout:8/452: write d1/d21/d2c/f3b [829952,30575] 0 2024-04-26T11:24:01.334 INFO:tasks.workunit.client.0.smithi073.stdout:6/345: mknod d0/d1a/d26/d27/c6a 0 2024-04-26T11:24:01.334 INFO:tasks.workunit.client.0.smithi073.stdout:0/364: rmdir d2/d22/d51/d57/d78 39 2024-04-26T11:24:01.334 INFO:tasks.workunit.client.0.smithi073.stdout:5/425: link d4/d8/d9/d7d/d84/l77 d4/de/d23/d4f/l9f 0 2024-04-26T11:24:01.334 INFO:tasks.workunit.client.0.smithi073.stdout:8/453: dread - d1/d4/f74 zero size 2024-04-26T11:24:01.334 INFO:tasks.workunit.client.0.smithi073.stdout:4/413: mknod d8/d15/d1c/d49/d85/c9a 0 2024-04-26T11:24:01.335 INFO:tasks.workunit.client.0.smithi073.stdout:0/365: write d2/d37/f45 [71386,53655] 0 2024-04-26T11:24:01.335 INFO:tasks.workunit.client.0.smithi073.stdout:6/346: creat d0/d15/d2d/d3f/d59/f6b x:0 0 0 2024-04-26T11:24:01.335 INFO:tasks.workunit.client.0.smithi073.stdout:7/437: creat d1/d11/d24/d26/d3d/f9e x:0 0 0 2024-04-26T11:24:01.336 INFO:tasks.workunit.client.0.smithi073.stdout:0/366: fsync d2/d5f/f7d 0 2024-04-26T11:24:01.337 INFO:tasks.workunit.client.0.smithi073.stdout:5/426: sync 2024-04-26T11:24:01.337 INFO:tasks.workunit.client.0.smithi073.stdout:4/414: rmdir d8/d1a/d5e 39 2024-04-26T11:24:01.337 INFO:tasks.workunit.client.0.smithi073.stdout:6/347: write d0/dc/f64 [1743192,51148] 0 2024-04-26T11:24:01.337 INFO:tasks.workunit.client.0.smithi073.stdout:9/446: dread d0/d13/db/f4b [0,4194304] 0 2024-04-26T11:24:01.337 INFO:tasks.workunit.client.0.smithi073.stdout:8/454: rmdir d1/d4/d4c/d96 0 2024-04-26T11:24:01.337 INFO:tasks.workunit.client.0.smithi073.stdout:6/348: chown d0/d1a/d4e 0 1 2024-04-26T11:24:01.337 INFO:tasks.workunit.client.0.smithi073.stdout:1/513: truncate d1/d8/d2e/d3c/f3e 280156 0 2024-04-26T11:24:01.337 INFO:tasks.workunit.client.0.smithi073.stdout:8/455: fsync d1/f6 0 2024-04-26T11:24:01.337 INFO:tasks.workunit.client.0.smithi073.stdout:5/427: mkdir d4/d73/d8a/da0 0 2024-04-26T11:24:01.338 INFO:tasks.workunit.client.0.smithi073.stdout:0/367: creat d2/d22/d51/d57/d78/f86 x:0 0 0 2024-04-26T11:24:01.338 INFO:tasks.workunit.client.0.smithi073.stdout:9/447: mknod d0/d1a/d4e/d8f/c9d 0 2024-04-26T11:24:01.338 INFO:tasks.workunit.client.0.smithi073.stdout:8/456: fdatasync d1/d4/d15/f1f 0 2024-04-26T11:24:01.338 INFO:tasks.workunit.client.0.smithi073.stdout:5/428: creat d4/d8/d9/fa1 x:0 0 0 2024-04-26T11:24:01.338 INFO:tasks.workunit.client.0.smithi073.stdout:4/415: getdents d8/d15/d1c/d49 0 2024-04-26T11:24:01.339 INFO:tasks.workunit.client.0.smithi073.stdout:6/349: creat d0/d19/d4d/f6c x:0 0 0 2024-04-26T11:24:01.339 INFO:tasks.workunit.client.0.smithi073.stdout:9/448: write d0/d13/f5b [268092,4772] 0 2024-04-26T11:24:01.339 INFO:tasks.workunit.client.0.smithi073.stdout:0/368: fsync d2/d22/d51/d57/f85 0 2024-04-26T11:24:01.339 INFO:tasks.workunit.client.0.smithi073.stdout:1/514: fsync d1/d51/f67 0 2024-04-26T11:24:01.339 INFO:tasks.workunit.client.0.smithi073.stdout:4/416: write f5 [2721981,85729] 0 2024-04-26T11:24:01.339 INFO:tasks.workunit.client.0.smithi073.stdout:8/457: truncate d1/d4/f74 606744 0 2024-04-26T11:24:01.340 INFO:tasks.workunit.client.0.smithi073.stdout:1/515: write d1/d6/db3/f5c [762400,91735] 0 2024-04-26T11:24:01.340 INFO:tasks.workunit.client.0.smithi073.stdout:0/369: creat d2/d22/d51/d57/d78/f87 x:0 0 0 2024-04-26T11:24:01.340 INFO:tasks.workunit.client.0.smithi073.stdout:9/449: chown d0/d13/db/l56 227 1 2024-04-26T11:24:01.341 INFO:tasks.workunit.client.0.smithi073.stdout:1/516: symlink d1/d6/d7f/d47/lb8 0 2024-04-26T11:24:01.341 INFO:tasks.workunit.client.0.smithi073.stdout:9/450: unlink d0/d1a/d4e/c7f 0 2024-04-26T11:24:01.342 INFO:tasks.workunit.client.0.smithi073.stdout:9/451: readlink d0/l68 0 2024-04-26T11:24:01.344 INFO:tasks.workunit.client.0.smithi073.stdout:3/414: dread d0/f7 [0,4194304] 0 2024-04-26T11:24:01.345 INFO:tasks.workunit.client.0.smithi073.stdout:7/438: dread d1/d11/f36 [4194304,4194304] 0 2024-04-26T11:24:01.345 INFO:tasks.workunit.client.0.smithi073.stdout:3/415: chown d0/f7 0 1 2024-04-26T11:24:01.345 INFO:tasks.workunit.client.0.smithi073.stdout:8/458: link d1/d4/d37/l65 d1/d21/d50/d67/l9a 0 2024-04-26T11:24:01.347 INFO:tasks.workunit.client.0.smithi073.stdout:8/459: fdatasync d1/d21/d50/f42 0 2024-04-26T11:24:01.347 INFO:tasks.workunit.client.0.smithi073.stdout:9/452: link d0/d13/db/c61 d0/d13/d25/d2c/c9e 0 2024-04-26T11:24:01.347 INFO:tasks.workunit.client.0.smithi073.stdout:0/370: write d2/d22/d51/d57/f5c [191850,50684] 0 2024-04-26T11:24:01.349 INFO:tasks.workunit.client.0.smithi073.stdout:2/413: dread dd/de/d6b/f5f [0,4194304] 0 2024-04-26T11:24:01.350 INFO:tasks.workunit.client.0.smithi073.stdout:6/350: dwrite d0/d1a/d26/d4b/d2b/d2c/f3b [0,4194304] 0 2024-04-26T11:24:01.350 INFO:tasks.workunit.client.0.smithi073.stdout:7/439: creat d1/d11/d24/d71/d90/f9f x:0 0 0 2024-04-26T11:24:01.351 INFO:tasks.workunit.client.0.smithi073.stdout:5/429: dwrite d4/d8/d9/d42/f9c [0,4194304] 0 2024-04-26T11:24:01.353 INFO:tasks.workunit.client.0.smithi073.stdout:3/416: creat d0/d11/f91 x:0 0 0 2024-04-26T11:24:01.353 INFO:tasks.workunit.client.0.smithi073.stdout:1/517: dwrite d1/d73/d34/f43 [0,4194304] 0 2024-04-26T11:24:01.354 INFO:tasks.workunit.client.0.smithi073.stdout:5/430: write d4/de/d15/d60/f3f [1142150,26002] 0 2024-04-26T11:24:01.359 INFO:tasks.workunit.client.0.smithi073.stdout:7/440: write d1/d11/d24/d26/d3d/f9e [928694,54746] 0 2024-04-26T11:24:01.359 INFO:tasks.workunit.client.0.smithi073.stdout:1/518: read - d1/d73/d40/d44/d80/f91 zero size 2024-04-26T11:24:01.359 INFO:tasks.workunit.client.0.smithi073.stdout:8/460: rmdir d1/d4/d7b/d8a 0 2024-04-26T11:24:01.359 INFO:tasks.workunit.client.0.smithi073.stdout:5/431: stat d4/d8/c18 0 2024-04-26T11:24:01.359 INFO:tasks.workunit.client.0.smithi073.stdout:7/441: readlink d1/d11/d10/l52 0 2024-04-26T11:24:01.359 INFO:tasks.workunit.client.0.smithi073.stdout:5/432: stat d4/de/d15/d60 0 2024-04-26T11:24:01.359 INFO:tasks.workunit.client.0.smithi073.stdout:9/453: dread d0/d6c/f97 [0,4194304] 0 2024-04-26T11:24:01.359 INFO:tasks.workunit.client.0.smithi073.stdout:0/371: read d2/d22/d51/d57/f76 [98788,55465] 0 2024-04-26T11:24:01.359 INFO:tasks.workunit.client.0.smithi073.stdout:2/414: creat dd/d1c/d1d/f81 x:0 0 0 2024-04-26T11:24:01.360 INFO:tasks.workunit.client.0.smithi073.stdout:5/433: stat d4/d8/cf 0 2024-04-26T11:24:01.360 INFO:tasks.workunit.client.0.smithi073.stdout:4/417: dread d8/d15/d1c/d49/d85/f71 [0,4194304] 0 2024-04-26T11:24:01.360 INFO:tasks.workunit.client.0.smithi073.stdout:3/417: rename d0/l10 to d0/d11/d19/db/d51/l92 0 2024-04-26T11:24:01.360 INFO:tasks.workunit.client.0.smithi073.stdout:3/418: truncate d0/d11/d19/db/f15 8583031 0 2024-04-26T11:24:01.360 INFO:tasks.workunit.client.0.smithi073.stdout:0/372: unlink d2/l20 0 2024-04-26T11:24:01.360 INFO:tasks.workunit.client.0.smithi073.stdout:5/434: unlink d4/d8/fb 0 2024-04-26T11:24:01.362 INFO:tasks.workunit.client.0.smithi073.stdout:0/373: rmdir d2/d1f 39 2024-04-26T11:24:01.362 INFO:tasks.workunit.client.0.smithi073.stdout:4/418: rename d8/d14/d60/c8e to d8/d15/d1c/c9b 0 2024-04-26T11:24:01.363 INFO:tasks.workunit.client.0.smithi073.stdout:0/374: fsync d2/ff 0 2024-04-26T11:24:01.363 INFO:tasks.workunit.client.0.smithi073.stdout:8/461: getdents d1/d4/d37/d5b/d83 0 2024-04-26T11:24:01.364 INFO:tasks.workunit.client.0.smithi073.stdout:1/519: dwrite d1/d73/d34/f78 [0,4194304] 0 2024-04-26T11:24:01.365 INFO:tasks.workunit.client.0.smithi073.stdout:4/419: mkdir d8/d1a/d9c 0 2024-04-26T11:24:01.366 INFO:tasks.workunit.client.0.smithi073.stdout:8/462: write d1/d21/d2a/f6b [393293,42520] 0 2024-04-26T11:24:01.366 INFO:tasks.workunit.client.0.smithi073.stdout:9/454: dwrite d0/d13/d25/d2c/f3a [0,4194304] 0 2024-04-26T11:24:01.367 INFO:tasks.workunit.client.0.smithi073.stdout:6/351: dread d0/dc/f64 [0,4194304] 0 2024-04-26T11:24:01.367 INFO:tasks.workunit.client.0.smithi073.stdout:2/415: dwrite dd/d1c/d1d/f81 [0,4194304] 0 2024-04-26T11:24:01.367 INFO:tasks.workunit.client.0.smithi073.stdout:4/420: chown d8/d1a/d1b/d46/d57/f8a 236402 1 2024-04-26T11:24:01.368 INFO:tasks.workunit.client.0.smithi073.stdout:2/416: write dd/de/f71 [536597,22257] 0 2024-04-26T11:24:01.370 INFO:tasks.workunit.client.0.smithi073.stdout:3/419: rename d0/d11/d19/db/d3e/d3f/d69/c77 to d0/d11/d19/db/d3e/d3f/d4d/d8b/d8c/d90/c93 0 2024-04-26T11:24:01.371 INFO:tasks.workunit.client.0.smithi073.stdout:9/455: write d0/d13/f18 [1554506,121587] 0 2024-04-26T11:24:01.372 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:01.366+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:01.373 INFO:tasks.workunit.client.0.smithi073.stdout:0/375: rename d2/d22/d51/f64 to d2/d37/d3c/f88 0 2024-04-26T11:24:01.373 INFO:tasks.workunit.client.0.smithi073.stdout:2/417: creat dd/d4c/d48/d46/f82 x:0 0 0 2024-04-26T11:24:01.373 INFO:tasks.workunit.client.0.smithi073.stdout:3/420: mknod d0/d11/d19/db/d3e/d47/c94 0 2024-04-26T11:24:01.373 INFO:tasks.workunit.client.0.smithi073.stdout:9/456: symlink d0/d1a/d4e/d70/d46/l9f 0 2024-04-26T11:24:01.374 INFO:tasks.workunit.client.0.smithi073.stdout:0/376: chown d2/l6f 605021 1 2024-04-26T11:24:01.374 INFO:tasks.workunit.client.0.smithi073.stdout:6/352: dwrite d0/f4 [0,4194304] 0 2024-04-26T11:24:01.374 INFO:tasks.workunit.client.0.smithi073.stdout:3/421: chown d0/d11/d23 78963722 1 2024-04-26T11:24:01.375 INFO:tasks.workunit.client.0.smithi073.stdout:2/418: write dd/d4c/d48/d46/f82 [87366,104313] 0 2024-04-26T11:24:01.375 INFO:tasks.workunit.client.0.smithi073.stdout:9/457: mknod d0/d13/d25/d2c/ca0 0 2024-04-26T11:24:01.375 INFO:tasks.workunit.client.0.smithi073.stdout:6/353: write d0/f4 [6949865,62683] 0 2024-04-26T11:24:01.375 INFO:tasks.workunit.client.0.smithi073.stdout:3/422: symlink d0/d11/d19/db/d3e/d3f/l95 0 2024-04-26T11:24:01.375 INFO:tasks.workunit.client.0.smithi073.stdout:6/354: write d0/d1a/d4e/f51 [910431,127130] 0 2024-04-26T11:24:01.376 INFO:tasks.workunit.client.0.smithi073.stdout:1/520: truncate d1/d8/d5d/f8a 91599 0 2024-04-26T11:24:01.377 INFO:tasks.workunit.client.0.smithi073.stdout:0/377: readlink d2/d1f/l29 0 2024-04-26T11:24:01.377 INFO:tasks.workunit.client.0.smithi073.stdout:1/521: chown d1/d8/d57/f8d 1703550 1 2024-04-26T11:24:01.378 INFO:tasks.workunit.client.0.smithi073.stdout:0/378: mknod d2/d84/c89 0 2024-04-26T11:24:01.378 INFO:tasks.workunit.client.0.smithi073.stdout:1/522: creat d1/d6/db3/fb9 x:0 0 0 2024-04-26T11:24:01.378 INFO:tasks.workunit.client.0.smithi073.stdout:4/421: dread d8/d1a/d1b/d41/f48 [0,4194304] 0 2024-04-26T11:24:01.378 INFO:tasks.workunit.client.0.smithi073.stdout:0/379: stat d2/d1f/f2b 0 2024-04-26T11:24:01.380 INFO:tasks.workunit.client.0.smithi073.stdout:6/355: write d0/d19/f60 [1034851,107066] 0 2024-04-26T11:24:01.380 INFO:tasks.workunit.client.0.smithi073.stdout:9/458: dread d0/d13/d5a/d65/f77 [0,4194304] 0 2024-04-26T11:24:01.380 INFO:tasks.workunit.client.0.smithi073.stdout:4/422: mkdir d8/d1a/d9c/d9d 0 2024-04-26T11:24:01.381 INFO:tasks.workunit.client.0.smithi073.stdout:1/523: rename d1/d73/d34/f43 to d1/d8/fba 0 2024-04-26T11:24:01.381 INFO:tasks.workunit.client.0.smithi073.stdout:0/380: rmdir d2/d1f/d40/d48 39 2024-04-26T11:24:01.382 INFO:tasks.workunit.client.0.smithi073.stdout:1/524: truncate d1/d16/d61/f9c 901261 0 2024-04-26T11:24:01.382 INFO:tasks.workunit.client.0.smithi073.stdout:9/459: truncate d0/d1a/d4e/d70/d51/f88 159357 0 2024-04-26T11:24:01.382 INFO:tasks.workunit.client.0.smithi073.stdout:4/423: unlink d8/d1a/d1b/c8c 0 2024-04-26T11:24:01.383 INFO:tasks.workunit.client.0.smithi073.stdout:0/381: creat d2/f8a x:0 0 0 2024-04-26T11:24:01.383 INFO:tasks.workunit.client.0.smithi073.stdout:1/525: mkdir d1/d73/d40/d54/dbb 0 2024-04-26T11:24:01.386 INFO:tasks.workunit.client.0.smithi073.stdout:0/382: write d2/d37/d3c/d6a/f6d [544458,26741] 0 2024-04-26T11:24:01.386 INFO:tasks.workunit.client.0.smithi073.stdout:1/526: rename d1/d73/d40/f2a to d1/d6/fbc 0 2024-04-26T11:24:01.386 INFO:tasks.workunit.client.0.smithi073.stdout:4/424: read d8/d1a/d5e/d7c/f90 [933031,102213] 0 2024-04-26T11:24:01.387 INFO:tasks.workunit.client.0.smithi073.stdout:7/442: dread d1/d33/d68/f8b [0,4194304] 0 2024-04-26T11:24:01.388 INFO:tasks.workunit.client.0.smithi073.stdout:0/383: truncate d2/d37/d3c/d73/f7c 179178 0 2024-04-26T11:24:01.388 INFO:tasks.workunit.client.0.smithi073.stdout:7/443: dread - d1/d11/d24/d26/f6f zero size 2024-04-26T11:24:01.389 INFO:tasks.workunit.client.0.smithi073.stdout:6/356: dwrite d0/d1a/d26/f54 [0,4194304] 0 2024-04-26T11:24:01.389 INFO:tasks.workunit.client.0.smithi073.stdout:4/425: link d8/d1a/d1b/l20 d8/d15/l9e 0 2024-04-26T11:24:01.391 INFO:tasks.workunit.client.0.smithi073.stdout:1/527: dread d1/d6/db3/f5c [0,4194304] 0 2024-04-26T11:24:01.391 INFO:tasks.workunit.client.0.smithi073.stdout:9/460: dwrite d0/d1a/d4e/d70/d3b/f4d [0,4194304] 0 2024-04-26T11:24:01.391 INFO:tasks.workunit.client.0.smithi073.stdout:1/528: chown d1/d16/c77 8948 1 2024-04-26T11:24:01.391 INFO:tasks.workunit.client.0.smithi073.stdout:0/384: readlink d2/d1f/d40/d48/l59 0 2024-04-26T11:24:01.392 INFO:tasks.workunit.client.0.smithi073.stdout:7/444: chown d1/d11/d24/d29/l85 0 1 2024-04-26T11:24:01.392 INFO:tasks.workunit.client.0.smithi073.stdout:0/385: fdatasync d2/d37/f83 0 2024-04-26T11:24:01.392 INFO:tasks.workunit.client.0.smithi073.stdout:7/445: dread - d1/d11/d24/d26/d67/f9d zero size 2024-04-26T11:24:01.392 INFO:tasks.workunit.client.0.smithi073.stdout:0/386: fsync d2/d5f/f7d 0 2024-04-26T11:24:01.395 INFO:tasks.workunit.client.0.smithi073.stdout:6/357: symlink d0/d19/d4d/l6d 0 2024-04-26T11:24:01.395 INFO:tasks.workunit.client.0.smithi073.stdout:4/426: rename d8/d15/c5c to d8/d1a/d5e/d7c/c9f 0 2024-04-26T11:24:01.395 INFO:tasks.workunit.client.0.smithi073.stdout:9/461: unlink d0/d1a/c6b 0 2024-04-26T11:24:01.396 INFO:tasks.workunit.client.0.smithi073.stdout:1/529: creat d1/d16/fbd x:0 0 0 2024-04-26T11:24:01.396 INFO:tasks.workunit.client.0.smithi073.stdout:0/387: mkdir d2/d37/d8b 0 2024-04-26T11:24:01.396 INFO:tasks.workunit.client.0.smithi073.stdout:1/530: creat d1/d8/d57/fbe x:0 0 0 2024-04-26T11:24:01.396 INFO:tasks.workunit.client.0.smithi073.stdout:6/358: write d0/d1a/d26/d27/d52/f56 [3180668,124212] 0 2024-04-26T11:24:01.397 INFO:tasks.workunit.client.0.smithi073.stdout:4/427: rename d8/d1a/c38 to d8/d1a/d86/ca0 0 2024-04-26T11:24:01.397 INFO:tasks.workunit.client.0.smithi073.stdout:1/531: symlink d1/d51/lbf 0 2024-04-26T11:24:01.398 INFO:tasks.workunit.client.0.smithi073.stdout:9/462: rename d0/d13/db/f2b to d0/d83/fa1 0 2024-04-26T11:24:01.398 INFO:tasks.workunit.client.0.smithi073.stdout:1/532: readlink d1/l49 0 2024-04-26T11:24:01.398 INFO:tasks.workunit.client.0.smithi073.stdout:6/359: chown d0/d19/f60 13117212 1 2024-04-26T11:24:01.398 INFO:tasks.workunit.client.0.smithi073.stdout:4/428: fsync d8/d1a/d1b/d1d/f56 0 2024-04-26T11:24:01.398 INFO:tasks.workunit.client.0.smithi073.stdout:1/533: symlink d1/d73/d34/lc0 0 2024-04-26T11:24:01.398 INFO:tasks.workunit.client.0.smithi073.stdout:6/360: mkdir d0/dc/d2e/d6e 0 2024-04-26T11:24:01.399 INFO:tasks.workunit.client.0.smithi073.stdout:4/429: mkdir d8/d15/da1 0 2024-04-26T11:24:01.399 INFO:tasks.workunit.client.0.smithi073.stdout:7/446: dwrite d1/d11/d24/d29/f94 [0,4194304] 0 2024-04-26T11:24:01.400 INFO:tasks.workunit.client.0.smithi073.stdout:4/430: write d8/d14/f75 [1032381,112077] 0 2024-04-26T11:24:01.400 INFO:tasks.workunit.client.0.smithi073.stdout:1/534: truncate d1/d8/d57/fbe 144238 0 2024-04-26T11:24:01.400 INFO:tasks.workunit.client.0.smithi073.stdout:4/431: chown d8/d1a/d9c/d9d 79685 1 2024-04-26T11:24:01.401 INFO:tasks.workunit.client.0.smithi073.stdout:4/432: readlink d8/d1a/d1b/d24/l4c 0 2024-04-26T11:24:01.401 INFO:tasks.workunit.client.0.smithi073.stdout:1/535: creat d1/d8/d2e/d3c/fc1 x:0 0 0 2024-04-26T11:24:01.401 INFO:tasks.workunit.client.0.smithi073.stdout:4/433: read d8/d1a/d1b/d24/f4a [2408034,50310] 0 2024-04-26T11:24:01.403 INFO:tasks.workunit.client.0.smithi073.stdout:1/536: chown d1/d73/f35 11 1 2024-04-26T11:24:01.403 INFO:tasks.workunit.client.0.smithi073.stdout:7/447: truncate d1/d33/ff 1119785 0 2024-04-26T11:24:01.404 INFO:tasks.workunit.client.0.smithi073.stdout:6/361: dwrite d0/d19/d20/f22 [0,4194304] 0 2024-04-26T11:24:01.404 INFO:tasks.workunit.client.0.smithi073.stdout:4/434: mkdir d8/d1a/d1b/d41/da2 0 2024-04-26T11:24:01.405 INFO:tasks.workunit.client.0.smithi073.stdout:6/362: readlink d0/l18 0 2024-04-26T11:24:01.405 INFO:tasks.workunit.client.0.smithi073.stdout:7/448: write d1/d11/d24/d26/d3d/f7e [549589,89479] 0 2024-04-26T11:24:01.406 INFO:tasks.workunit.client.0.smithi073.stdout:6/363: rmdir d0/d1a 39 2024-04-26T11:24:01.407 INFO:tasks.workunit.client.0.smithi073.stdout:4/435: mkdir d8/d15/d1c/d72/da3 0 2024-04-26T11:24:01.407 INFO:tasks.workunit.client.0.smithi073.stdout:7/449: mkdir d1/d11/d24/d26/d80/da0 0 2024-04-26T11:24:01.407 INFO:tasks.workunit.client.0.smithi073.stdout:9/463: write d0/d13/db/f23 [6129221,58469] 0 2024-04-26T11:24:01.407 INFO:tasks.workunit.client.0.smithi073.stdout:1/537: getdents d1/d73/d40 0 2024-04-26T11:24:01.409 INFO:tasks.workunit.client.0.smithi073.stdout:1/538: creat d1/d6/d7f/d47/fc2 x:0 0 0 2024-04-26T11:24:01.409 INFO:tasks.workunit.client.0.smithi073.stdout:1/539: write d1/d73/d40/d44/f9e [55543,51138] 0 2024-04-26T11:24:01.409 INFO:tasks.workunit.client.0.smithi073.stdout:1/540: symlink d1/d16/d6a/lc3 0 2024-04-26T11:24:01.410 INFO:tasks.workunit.client.0.smithi073.stdout:1/541: creat d1/d73/d40/d54/fc4 x:0 0 0 2024-04-26T11:24:01.410 INFO:tasks.workunit.client.0.smithi073.stdout:6/364: dread d0/d19/f21 [4194304,4194304] 0 2024-04-26T11:24:01.412 INFO:tasks.workunit.client.0.smithi073.stdout:5/435: sync 2024-04-26T11:24:01.412 INFO:tasks.workunit.client.0.smithi073.stdout:2/419: sync 2024-04-26T11:24:01.412 INFO:tasks.workunit.client.0.smithi073.stdout:1/542: truncate d1/d73/d40/d54/fc4 376550 0 2024-04-26T11:24:01.412 INFO:tasks.workunit.client.0.smithi073.stdout:7/450: truncate d1/d11/d24/d29/f74 1543674 0 2024-04-26T11:24:01.413 INFO:tasks.workunit.client.0.smithi073.stdout:9/464: dwrite d0/d3c/f7a [0,4194304] 0 2024-04-26T11:24:01.416 INFO:tasks.workunit.client.0.smithi073.stdout:4/436: dwrite d8/d15/d1c/d49/d84/f6e [0,4194304] 0 2024-04-26T11:24:01.416 INFO:tasks.workunit.client.0.smithi073.stdout:7/451: symlink d1/d33/d68/d78/la1 0 2024-04-26T11:24:01.417 INFO:tasks.workunit.client.0.smithi073.stdout:9/465: creat d0/d13/d5a/fa2 x:0 0 0 2024-04-26T11:24:01.418 INFO:tasks.workunit.client.0.smithi073.stdout:7/452: rmdir d1/d33/d68/d78 39 2024-04-26T11:24:01.418 INFO:tasks.workunit.client.0.smithi073.stdout:4/437: rename d8/d14/f75 to d8/d15/d1c/d72/d77/d96/fa4 0 2024-04-26T11:24:01.418 INFO:tasks.workunit.client.0.smithi073.stdout:9/466: creat d0/d3c/fa3 x:0 0 0 2024-04-26T11:24:01.418 INFO:tasks.workunit.client.0.smithi073.stdout:7/453: rmdir d1/d33 39 2024-04-26T11:24:01.419 INFO:tasks.workunit.client.0.smithi073.stdout:6/365: dwrite d0/d15/f14 [0,4194304] 0 2024-04-26T11:24:01.420 INFO:tasks.workunit.client.0.smithi073.stdout:9/467: link d0/d1a/d4e/d70/d3b/f4d d0/d13/d25/d2c/fa4 0 2024-04-26T11:24:01.421 INFO:tasks.workunit.client.0.smithi073.stdout:9/468: chown d0/c45 0 1 2024-04-26T11:24:01.425 INFO:tasks.workunit.client.0.smithi073.stdout:2/420: dread dd/de/f28 [0,4194304] 0 2024-04-26T11:24:01.425 INFO:tasks.workunit.client.0.smithi073.stdout:7/454: dwrite d1/d11/f1c [0,4194304] 0 2024-04-26T11:24:01.427 INFO:tasks.workunit.client.0.smithi073.stdout:7/455: fsync d1/d11/d24/d26/d4b/f6b 0 2024-04-26T11:24:01.427 INFO:tasks.workunit.client.0.smithi073.stdout:4/438: dwrite d8/fe [0,4194304] 0 2024-04-26T11:24:01.428 INFO:tasks.workunit.client.0.smithi073.stdout:2/421: dread dd/de/d6b/f5f [0,4194304] 0 2024-04-26T11:24:01.428 INFO:tasks.workunit.client.0.smithi073.stdout:4/439: write d8/d1a/d1b/d41/f48 [1462793,75347] 0 2024-04-26T11:24:01.429 INFO:tasks.workunit.client.0.smithi073.stdout:4/440: fdatasync d8/d14/d60/f6f 0 2024-04-26T11:24:01.431 INFO:tasks.workunit.client.0.smithi073.stdout:2/422: getdents dd/de/d38/d53 0 2024-04-26T11:24:01.431 INFO:tasks.workunit.client.0.smithi073.stdout:4/441: chown d8/d15/d1c/d72/f80 52116 1 2024-04-26T11:24:01.431 INFO:tasks.workunit.client.0.smithi073.stdout:2/423: fsync dd/d1c/f5e 0 2024-04-26T11:24:01.431 INFO:tasks.workunit.client.0.smithi073.stdout:4/442: creat d8/d1a/d9c/fa5 x:0 0 0 2024-04-26T11:24:01.433 INFO:tasks.workunit.client.0.smithi073.stdout:4/443: write d8/d1a/d5e/d7c/f82 [1025392,53085] 0 2024-04-26T11:24:01.433 INFO:tasks.workunit.client.0.smithi073.stdout:4/444: chown d8/d1a/d5e/d7c/f7f 32183274 1 2024-04-26T11:24:01.434 INFO:tasks.workunit.client.0.smithi073.stdout:7/456: write d1/d33/ff [2325340,54536] 0 2024-04-26T11:24:01.434 INFO:tasks.workunit.client.0.smithi073.stdout:7/457: chown d1/c12 16971 1 2024-04-26T11:24:01.435 INFO:tasks.workunit.client.0.smithi073.stdout:7/458: stat d1/d11/d24/d26/d3d/f6d 0 2024-04-26T11:24:01.435 INFO:tasks.workunit.client.0.smithi073.stdout:7/459: rmdir d1 39 2024-04-26T11:24:01.437 INFO:tasks.workunit.client.0.smithi073.stdout:5/436: dread d4/f20 [0,4194304] 0 2024-04-26T11:24:01.437 INFO:tasks.workunit.client.0.smithi073.stdout:2/424: read dd/d4c/d48/d46/f69 [779304,124856] 0 2024-04-26T11:24:01.437 INFO:tasks.workunit.client.0.smithi073.stdout:7/460: creat d1/d11/d5e/d8f/fa2 x:0 0 0 2024-04-26T11:24:01.437 INFO:tasks.workunit.client.0.smithi073.stdout:5/437: write d4/de/d15/d33/f8f [448759,63652] 0 2024-04-26T11:24:01.439 INFO:tasks.workunit.client.0.smithi073.stdout:5/438: unlink d4/de/d23/c83 0 2024-04-26T11:24:01.439 INFO:tasks.workunit.client.0.smithi073.stdout:4/445: dwrite d8/f2e [4194304,4194304] 0 2024-04-26T11:24:01.441 INFO:tasks.workunit.client.0.smithi073.stdout:8/463: sync 2024-04-26T11:24:01.441 INFO:tasks.workunit.client.0.smithi073.stdout:0/388: sync 2024-04-26T11:24:01.442 INFO:tasks.workunit.client.0.smithi073.stdout:3/423: sync 2024-04-26T11:24:01.442 INFO:tasks.workunit.client.0.smithi073.stdout:1/543: sync 2024-04-26T11:24:01.442 INFO:tasks.workunit.client.0.smithi073.stdout:9/469: sync 2024-04-26T11:24:01.442 INFO:tasks.workunit.client.0.smithi073.stdout:3/424: read d0/f45 [2025575,127404] 0 2024-04-26T11:24:01.443 INFO:tasks.workunit.client.0.smithi073.stdout:5/439: symlink d4/d8/d9/la2 0 2024-04-26T11:24:01.443 INFO:tasks.workunit.client.0.smithi073.stdout:4/446: mknod d8/d1a/d5e/d7c/ca6 0 2024-04-26T11:24:01.443 INFO:tasks.workunit.client.0.smithi073.stdout:2/425: truncate dd/de/f12 6671345 0 2024-04-26T11:24:01.444 INFO:tasks.workunit.client.0.smithi073.stdout:5/440: mkdir d4/d8/d9/d7d/da3 0 2024-04-26T11:24:01.444 INFO:tasks.workunit.client.0.smithi073.stdout:8/464: mknod d1/d4/d37/d90/c9b 0 2024-04-26T11:24:01.444 INFO:tasks.workunit.client.0.smithi073.stdout:4/447: mkdir d8/d15/d1c/da7 0 2024-04-26T11:24:01.444 INFO:tasks.workunit.client.0.smithi073.stdout:1/544: link d1/d8/d5d/l75 d1/d8/d57/lc5 0 2024-04-26T11:24:01.445 INFO:tasks.workunit.client.0.smithi073.stdout:4/448: creat d8/d1a/d86/fa8 x:0 0 0 2024-04-26T11:24:01.445 INFO:tasks.workunit.client.0.smithi073.stdout:5/441: write d4/de/d15/d33/f48 [343920,126983] 0 2024-04-26T11:24:01.445 INFO:tasks.workunit.client.0.smithi073.stdout:4/449: fdatasync f7 0 2024-04-26T11:24:01.445 INFO:tasks.workunit.client.0.smithi073.stdout:1/545: truncate d1/d8/d2e/d3c/fc1 860381 0 2024-04-26T11:24:01.445 INFO:tasks.workunit.client.0.smithi073.stdout:5/442: mknod d4/d95/ca4 0 2024-04-26T11:24:01.446 INFO:tasks.workunit.client.0.smithi073.stdout:3/425: mkdir d0/d11/d19/db/d3e/d3f/d69/d96 0 2024-04-26T11:24:01.446 INFO:tasks.workunit.client.0.smithi073.stdout:5/443: mkdir d4/d95/da5 0 2024-04-26T11:24:01.446 INFO:tasks.workunit.client.0.smithi073.stdout:4/450: creat d8/d15/da1/fa9 x:0 0 0 2024-04-26T11:24:01.446 INFO:tasks.workunit.client.0.smithi073.stdout:8/465: creat d1/d21/d50/d67/d81/f9c x:0 0 0 2024-04-26T11:24:01.449 INFO:tasks.workunit.client.0.smithi073.stdout:4/451: creat d8/d1a/d1b/d1d/faa x:0 0 0 2024-04-26T11:24:01.449 INFO:tasks.workunit.client.0.smithi073.stdout:2/426: truncate dd/d4c/d48/f2d 3239765 0 2024-04-26T11:24:01.450 INFO:tasks.workunit.client.0.smithi073.stdout:7/461: dread d1/d11/d24/d26/d67/f40 [0,4194304] 0 2024-04-26T11:24:01.450 INFO:tasks.workunit.client.0.smithi073.stdout:9/470: dwrite d0/d13/f22 [4194304,4194304] 0 2024-04-26T11:24:01.453 INFO:tasks.workunit.client.0.smithi073.stdout:3/426: dread d0/f7 [0,4194304] 0 2024-04-26T11:24:01.454 INFO:tasks.workunit.client.0.smithi073.stdout:2/427: creat dd/de/d2a/f83 x:0 0 0 2024-04-26T11:24:01.455 INFO:tasks.workunit.client.0.smithi073.stdout:7/462: mkdir d1/d11/d24/d71/d90/da3 0 2024-04-26T11:24:01.455 INFO:tasks.workunit.client.0.smithi073.stdout:8/466: dwrite d1/d4/f74 [0,4194304] 0 2024-04-26T11:24:01.456 INFO:tasks.workunit.client.0.smithi073.stdout:2/428: fsync dd/de/f11 0 2024-04-26T11:24:01.456 INFO:tasks.workunit.client.0.smithi073.stdout:1/546: dwrite d1/d8/fd [4194304,4194304] 0 2024-04-26T11:24:01.456 INFO:tasks.workunit.client.0.smithi073.stdout:3/427: write d0/d11/d19/d52/f54 [434844,90941] 0 2024-04-26T11:24:01.459 INFO:tasks.workunit.client.0.smithi073.stdout:8/467: mknod d1/d4/d4c/d66/c9d 0 2024-04-26T11:24:01.459 INFO:tasks.workunit.client.0.smithi073.stdout:5/444: dread d4/d8/d9/f46 [0,4194304] 0 2024-04-26T11:24:01.461 INFO:tasks.workunit.client.0.smithi073.stdout:7/463: rename d1/d33/f6a to d1/d11/d24/d29/fa4 0 2024-04-26T11:24:01.461 INFO:tasks.workunit.client.0.smithi073.stdout:8/468: symlink d1/d4/d4c/d66/l9e 0 2024-04-26T11:24:01.463 INFO:tasks.workunit.client.0.smithi073.stdout:8/469: write d1/d4/d15/f75 [315361,109267] 0 2024-04-26T11:24:01.463 INFO:tasks.workunit.client.0.smithi073.stdout:7/464: dread - d1/d11/d24/d26/d3d/f93 zero size 2024-04-26T11:24:01.465 INFO:tasks.workunit.client.0.smithi073.stdout:1/547: dwrite d1/d8/f2d [0,4194304] 0 2024-04-26T11:24:01.465 INFO:tasks.workunit.client.0.smithi073.stdout:0/389: dread d2/f4f [0,4194304] 0 2024-04-26T11:24:01.467 INFO:tasks.workunit.client.0.smithi073.stdout:4/452: dwrite d8/d1a/d5e/d7c/f7f [0,4194304] 0 2024-04-26T11:24:01.467 INFO:tasks.workunit.client.0.smithi073.stdout:2/429: rename f5 to dd/d4c/d48/d46/f84 0 2024-04-26T11:24:01.467 INFO:tasks.workunit.client.0.smithi073.stdout:6/366: dread d0/d1a/d26/d27/d52/f56 [0,4194304] 0 2024-04-26T11:24:01.468 INFO:tasks.workunit.client.0.smithi073.stdout:6/367: readlink d0/d1a/l32 0 2024-04-26T11:24:01.469 INFO:tasks.workunit.client.0.smithi073.stdout:0/390: creat d2/d5f/f8c x:0 0 0 2024-04-26T11:24:01.470 INFO:tasks.workunit.client.0.smithi073.stdout:1/548: mkdir d1/d16/d4f/d55/d5a/dc6 0 2024-04-26T11:24:01.470 INFO:tasks.workunit.client.0.smithi073.stdout:4/453: mknod d8/d14/d60/cab 0 2024-04-26T11:24:01.470 INFO:tasks.workunit.client.0.smithi073.stdout:7/465: mknod d1/d11/d24/d26/d3d/d7b/d8a/ca5 0 2024-04-26T11:24:01.470 INFO:tasks.workunit.client.0.smithi073.stdout:8/470: link d1/d4/le d1/d21/d50/d67/d81/l9f 0 2024-04-26T11:24:01.471 INFO:tasks.workunit.client.0.smithi073.stdout:6/368: write d0/d19/d4d/f6c [488856,74619] 0 2024-04-26T11:24:01.471 INFO:tasks.workunit.client.0.smithi073.stdout:0/391: chown d2/l2e 46021673 1 2024-04-26T11:24:01.472 INFO:tasks.workunit.client.0.smithi073.stdout:9/471: dwrite d0/d1a/d4e/d70/d51/f67 [0,4194304] 0 2024-04-26T11:24:01.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:01.470+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:01.473 INFO:tasks.workunit.client.0.smithi073.stdout:0/392: unlink d2/lc 0 2024-04-26T11:24:01.473 INFO:tasks.workunit.client.0.smithi073.stdout:7/466: fdatasync d1/d11/d24/d29/f49 0 2024-04-26T11:24:01.474 INFO:tasks.workunit.client.0.smithi073.stdout:5/445: dwrite d4/d8/d9/d42/f4a [0,4194304] 0 2024-04-26T11:24:01.474 INFO:tasks.workunit.client.0.smithi073.stdout:6/369: dread - d0/d15/d2d/d3f/d59/f6b zero size 2024-04-26T11:24:01.474 INFO:tasks.workunit.client.0.smithi073.stdout:7/467: chown d1/d11/l20 6556351 1 2024-04-26T11:24:01.474 INFO:tasks.workunit.client.0.smithi073.stdout:1/549: creat d1/d16/d4f/fc7 x:0 0 0 2024-04-26T11:24:01.474 INFO:tasks.workunit.client.0.smithi073.stdout:7/468: fdatasync d1/d11/d24/d26/d4b/f56 0 2024-04-26T11:24:01.474 INFO:tasks.workunit.client.0.smithi073.stdout:6/370: truncate d0/d15/d2d/d3f/d59/f6b 671425 0 2024-04-26T11:24:01.474 INFO:tasks.workunit.client.0.smithi073.stdout:7/469: fdatasync d1/d11/d10/f2f 0 2024-04-26T11:24:01.476 INFO:tasks.workunit.client.0.smithi073.stdout:4/454: rename d8/d15/d1c to d8/d1a/d1b/d24/dac 0 2024-04-26T11:24:01.476 INFO:tasks.workunit.client.0.smithi073.stdout:9/472: symlink d0/d3c/la5 0 2024-04-26T11:24:01.476 INFO:tasks.workunit.client.0.smithi073.stdout:2/430: read dd/d4c/d48/d46/f69 [1417644,96684] 0 2024-04-26T11:24:01.476 INFO:tasks.workunit.client.0.smithi073.stdout:0/393: symlink d2/d22/d51/l8d 0 2024-04-26T11:24:01.476 INFO:tasks.workunit.client.0.smithi073.stdout:5/446: rmdir d4/de/d15 39 2024-04-26T11:24:01.476 INFO:tasks.workunit.client.0.smithi073.stdout:6/371: creat d0/d19/f6f x:0 0 0 2024-04-26T11:24:01.477 INFO:tasks.workunit.client.0.smithi073.stdout:8/471: write d1/d4/d4c/d66/d8b/f94 [485154,82256] 0 2024-04-26T11:24:01.478 INFO:tasks.workunit.client.0.smithi073.stdout:0/394: readlink d2/l10 0 2024-04-26T11:24:01.478 INFO:tasks.workunit.client.0.smithi073.stdout:1/550: link d1/d6/d7f/f76 d1/d16/d6a/fc8 0 2024-04-26T11:24:01.478 INFO:tasks.workunit.client.0.smithi073.stdout:7/470: rename d1/d33/d1b/d66/f69 to d1/d11/d24/d26/d3d/d41/d64/fa6 0 2024-04-26T11:24:01.478 INFO:tasks.workunit.client.0.smithi073.stdout:4/455: fsync d8/d15/f17 0 2024-04-26T11:24:01.478 INFO:tasks.workunit.client.0.smithi073.stdout:1/551: fdatasync d1/d6/db3/fb9 0 2024-04-26T11:24:01.478 INFO:tasks.workunit.client.0.smithi073.stdout:6/372: write d0/dc/d55/f46 [3805388,20693] 0 2024-04-26T11:24:01.478 INFO:tasks.workunit.client.0.smithi073.stdout:8/472: creat d1/d4/d4c/d66/fa0 x:0 0 0 2024-04-26T11:24:01.479 INFO:tasks.workunit.client.0.smithi073.stdout:0/395: rename d2/d37/c7a to d2/d37/d3c/d73/c8e 0 2024-04-26T11:24:01.479 INFO:tasks.workunit.client.0.smithi073.stdout:4/456: mkdir d8/d1a/d1b/d24/dac/d49/dad 0 2024-04-26T11:24:01.479 INFO:tasks.workunit.client.0.smithi073.stdout:7/471: creat d1/fa7 x:0 0 0 2024-04-26T11:24:01.480 INFO:tasks.workunit.client.0.smithi073.stdout:1/552: creat d1/d73/d34/fc9 x:0 0 0 2024-04-26T11:24:01.480 INFO:tasks.workunit.client.0.smithi073.stdout:9/473: symlink d0/d13/d5a/d65/la6 0 2024-04-26T11:24:01.480 INFO:tasks.workunit.client.0.smithi073.stdout:8/473: dread - d1/d21/d50/d67/d81/f9c zero size 2024-04-26T11:24:01.480 INFO:tasks.workunit.client.0.smithi073.stdout:9/474: fdatasync d0/d13/d25/d2c/f3a 0 2024-04-26T11:24:01.481 INFO:tasks.workunit.client.0.smithi073.stdout:2/431: dread dd/d4c/d48/f2d [0,4194304] 0 2024-04-26T11:24:01.484 INFO:tasks.workunit.client.0.smithi073.stdout:0/396: chown d2/d22/f65 1 1 2024-04-26T11:24:01.484 INFO:tasks.workunit.client.0.smithi073.stdout:2/432: fsync f9 0 2024-04-26T11:24:01.484 INFO:tasks.workunit.client.0.smithi073.stdout:7/472: symlink d1/d33/d1b/d95/la8 0 2024-04-26T11:24:01.484 INFO:tasks.workunit.client.0.smithi073.stdout:6/373: write d0/d1a/d26/d4b/d2b/f3e [2639825,53996] 0 2024-04-26T11:24:01.484 INFO:tasks.workunit.client.0.smithi073.stdout:0/397: readlink d2/d1f/d40/d48/l49 0 2024-04-26T11:24:01.485 INFO:tasks.workunit.client.0.smithi073.stdout:8/474: getdents d1 0 2024-04-26T11:24:01.486 INFO:tasks.workunit.client.0.smithi073.stdout:9/475: getdents d0/d1a/d4e/d70/d3b 0 2024-04-26T11:24:01.486 INFO:tasks.workunit.client.0.smithi073.stdout:5/447: dwrite d4/de/d15/f94 [0,4194304] 0 2024-04-26T11:24:01.487 INFO:tasks.workunit.client.0.smithi073.stdout:4/457: read d8/d1a/d1b/d24/f2d [317179,125270] 0 2024-04-26T11:24:01.487 INFO:tasks.workunit.client.0.smithi073.stdout:9/476: creat d0/fa7 x:0 0 0 2024-04-26T11:24:01.487 INFO:tasks.workunit.client.0.smithi073.stdout:6/374: creat d0/dc/d2e/d6e/f70 x:0 0 0 2024-04-26T11:24:01.488 INFO:tasks.workunit.client.0.smithi073.stdout:1/553: dwrite d1/d16/d4f/f79 [0,4194304] 0 2024-04-26T11:24:01.488 INFO:tasks.workunit.client.0.smithi073.stdout:7/473: creat d1/d11/d24/d26/d4b/fa9 x:0 0 0 2024-04-26T11:24:01.488 INFO:tasks.workunit.client.0.smithi073.stdout:8/475: truncate d1/d4/d37/f4f 3411056 0 2024-04-26T11:24:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:01.489 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:01.491 INFO:tasks.workunit.client.0.smithi073.stdout:9/477: chown d0/d1a/d4e/d70 171717 1 2024-04-26T11:24:01.491 INFO:tasks.workunit.client.0.smithi073.stdout:1/554: read - d1/d6/d7f/d47/fc2 zero size 2024-04-26T11:24:01.491 INFO:tasks.workunit.client.0.smithi073.stdout:4/458: creat d8/d1a/d9c/d9d/fae x:0 0 0 2024-04-26T11:24:01.491 INFO:tasks.workunit.client.0.smithi073.stdout:8/476: creat d1/d4/d7b/d8d/fa1 x:0 0 0 2024-04-26T11:24:01.491 INFO:tasks.workunit.client.0.smithi073.stdout:2/433: dread dd/de/f71 [0,4194304] 0 2024-04-26T11:24:01.491 INFO:tasks.workunit.client.0.smithi073.stdout:9/478: symlink d0/d1a/d4e/la8 0 2024-04-26T11:24:01.491 INFO:tasks.workunit.client.0.smithi073.stdout:6/375: link d0/d1a/d4e/f51 d0/f71 0 2024-04-26T11:24:01.491 INFO:tasks.workunit.client.0.smithi073.stdout:7/474: creat d1/d33/d68/faa x:0 0 0 2024-04-26T11:24:01.492 INFO:tasks.workunit.client.0.smithi073.stdout:0/398: dread d2/d1f/d40/f44 [0,4194304] 0 2024-04-26T11:24:01.493 INFO:tasks.workunit.client.0.smithi073.stdout:9/479: mknod d0/d13/d5a/d5e/ca9 0 2024-04-26T11:24:01.493 INFO:tasks.workunit.client.0.smithi073.stdout:7/475: creat d1/d11/d5e/fab x:0 0 0 2024-04-26T11:24:01.496 INFO:tasks.workunit.client.0.smithi073.stdout:3/428: dread d0/d11/d19/fc [0,4194304] 0 2024-04-26T11:24:01.497 INFO:tasks.workunit.client.0.smithi073.stdout:5/448: dwrite d4/de/d23/f86 [0,4194304] 0 2024-04-26T11:24:01.498 INFO:tasks.workunit.client.0.smithi073.stdout:3/429: chown d0/d11/d19/f27 3043 1 2024-04-26T11:24:01.498 INFO:tasks.workunit.client.0.smithi073.stdout:1/555: dwrite d1/d51/f7d [0,4194304] 0 2024-04-26T11:24:01.499 INFO:tasks.workunit.client.0.smithi073.stdout:6/376: dwrite d0/f4 [4194304,4194304] 0 2024-04-26T11:24:01.501 INFO:tasks.workunit.client.0.smithi073.stdout:8/477: dwrite d1/d4/d37/f40 [0,4194304] 0 2024-04-26T11:24:01.502 INFO:tasks.workunit.client.0.smithi073.stdout:6/377: read d0/d19/d4d/f6c [47507,128468] 0 2024-04-26T11:24:01.502 INFO:tasks.workunit.client.0.smithi073.stdout:4/459: truncate d8/d1a/d1b/d24/dac/d72/d77/f7a 140783 0 2024-04-26T11:24:01.502 INFO:tasks.workunit.client.0.smithi073.stdout:0/399: truncate d2/f4b 3384903 0 2024-04-26T11:24:01.502 INFO:tasks.workunit.client.0.smithi073.stdout:7/476: link d1/d11/c6 d1/d33/d1b/cac 0 2024-04-26T11:24:01.502 INFO:tasks.workunit.client.0.smithi073.stdout:5/449: mknod d4/de/ca6 0 2024-04-26T11:24:01.502 INFO:tasks.workunit.client.0.smithi073.stdout:3/430: symlink d0/d11/d19/l97 0 2024-04-26T11:24:01.503 INFO:tasks.workunit.client.0.smithi073.stdout:7/477: fsync d1/d11/d24/d29/f49 0 2024-04-26T11:24:01.503 INFO:tasks.workunit.client.0.smithi073.stdout:3/431: dread - d0/d11/d19/d1d/f5d zero size 2024-04-26T11:24:01.503 INFO:tasks.workunit.client.0.smithi073.stdout:4/460: dread - d8/d1a/d1b/d24/dac/d49/d85/d8b/f66 zero size 2024-04-26T11:24:01.505 INFO:tasks.workunit.client.0.smithi073.stdout:3/432: dread - d0/d11/d19/d5b/f7e zero size 2024-04-26T11:24:01.505 INFO:tasks.workunit.client.0.smithi073.stdout:0/400: mkdir d2/d84/d8f 0 2024-04-26T11:24:01.505 INFO:tasks.workunit.client.0.smithi073.stdout:8/478: rename d1/d21/d2c/f56 to d1/d4/d37/d5b/fa2 0 2024-04-26T11:24:01.506 INFO:tasks.workunit.client.0.smithi073.stdout:8/479: readlink d1/l10 0 2024-04-26T11:24:01.506 INFO:tasks.workunit.client.0.smithi073.stdout:7/478: creat d1/d33/d68/fad x:0 0 0 2024-04-26T11:24:01.507 INFO:tasks.workunit.client.0.smithi073.stdout:0/401: fdatasync d2/f4b 0 2024-04-26T11:24:01.507 INFO:tasks.workunit.client.0.smithi073.stdout:4/461: link d8/d1a/d1b/d24/c68 d8/d1f/caf 0 2024-04-26T11:24:01.508 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:01.509 INFO:tasks.workunit.client.0.smithi073.stdout:2/434: dread dd/d1c/d1d/f15 [0,4194304] 0 2024-04-26T11:24:01.509 INFO:tasks.workunit.client.0.smithi073.stdout:4/462: chown d8/d1a/d1b/d24/dac/d49/d85/c9a 771000159 1 2024-04-26T11:24:01.509 INFO:tasks.workunit.client.0.smithi073.stdout:6/378: dwrite d0/d19/f60 [0,4194304] 0 2024-04-26T11:24:01.509 INFO:tasks.workunit.client.0.smithi073.stdout:2/435: chown dd/d4c/f78 47537 1 2024-04-26T11:24:01.510 INFO:tasks.workunit.client.0.smithi073.stdout:6/379: readlink d0/d1a/l32 0 2024-04-26T11:24:01.510 INFO:tasks.workunit.client.0.smithi073.stdout:8/480: creat d1/d4/d37/d5b/d83/fa3 x:0 0 0 2024-04-26T11:24:01.511 INFO:tasks.workunit.client.0.smithi073.stdout:3/433: symlink d0/d11/d19/db/d3e/d3f/d4d/d8b/d8c/d90/l98 0 2024-04-26T11:24:01.511 INFO:tasks.workunit.client.0.smithi073.stdout:7/479: mkdir d1/d11/d24/d26/d3d/d41/d64/dae 0 2024-04-26T11:24:01.511 INFO:tasks.workunit.client.0.smithi073.stdout:4/463: chown d8/d14/d60/d64/c33 11030394 1 2024-04-26T11:24:01.511 INFO:tasks.workunit.client.0.smithi073.stdout:8/481: chown d1/d4/f74 29 1 2024-04-26T11:24:01.511 INFO:tasks.workunit.client.0.smithi073.stdout:3/434: dread - d0/d11/d19/db/d3e/d3f/d4d/f7c zero size 2024-04-26T11:24:01.514 INFO:tasks.workunit.client.0.smithi073.stdout:3/435: mknod d0/d11/d19/db/d3e/d3f/d4d/d8b/d8c/d90/c99 0 2024-04-26T11:24:01.517 INFO:tasks.workunit.client.0.smithi073.stdout:7/480: dread d1/d11/d5e/d8f/f91 [0,4194304] 0 2024-04-26T11:24:01.517 INFO:tasks.workunit.client.0.smithi073.stdout:3/436: link d0/d11/f6c d0/d11/d19/db/d3e/d47/f9a 0 2024-04-26T11:24:01.520 INFO:tasks.workunit.client.0.smithi073.stdout:8/482: dwrite d1/d4/f12 [0,4194304] 0 2024-04-26T11:24:01.520 INFO:tasks.workunit.client.0.smithi073.stdout:4/464: dwrite d8/d1a/d1b/d24/dac/f27 [0,4194304] 0 2024-04-26T11:24:01.522 INFO:tasks.workunit.client.0.smithi073.stdout:7/481: truncate d1/d33/d1b/f1e 1582292 0 2024-04-26T11:24:01.523 INFO:tasks.workunit.client.0.smithi073.stdout:8/483: creat d1/d4/d4c/d66/d8b/fa4 x:0 0 0 2024-04-26T11:24:01.523 INFO:tasks.workunit.client.0.smithi073.stdout:4/465: truncate d8/d15/f3e 772675 0 2024-04-26T11:24:01.523 INFO:tasks.workunit.client.0.smithi073.stdout:6/380: dwrite d0/d19/d20/f65 [0,4194304] 0 2024-04-26T11:24:01.523 INFO:tasks.workunit.client.0.smithi073.stdout:0/402: dwrite d2/d22/d51/d57/f76 [0,4194304] 0 2024-04-26T11:24:01.524 INFO:tasks.workunit.client.0.smithi073.stdout:7/482: chown d1/d11/d24/d26/d3d/d41/d64/l77 406 1 2024-04-26T11:24:01.524 INFO:tasks.workunit.client.0.smithi073.stdout:3/437: getdents d0/d11/d19/db/d3e/d3f 0 2024-04-26T11:24:01.524 INFO:tasks.workunit.client.0.smithi073.stdout:4/466: creat d8/d1a/d1b/d46/fb0 x:0 0 0 2024-04-26T11:24:01.524 INFO:tasks.workunit.client.0.smithi073.stdout:8/484: mkdir d1/d21/d50/d67/d81/da5 0 2024-04-26T11:24:01.525 INFO:tasks.workunit.client.0.smithi073.stdout:8/485: rmdir d1/d4/d15 39 2024-04-26T11:24:01.525 INFO:tasks.workunit.client.0.smithi073.stdout:3/438: unlink d0/d11/d19/d1d/f8a 0 2024-04-26T11:24:01.527 INFO:tasks.workunit.client.0.smithi073.stdout:8/486: fsync d1/d4/d4c/d59/f82 0 2024-04-26T11:24:01.528 INFO:tasks.workunit.client.0.smithi073.stdout:7/483: fdatasync d1/d33/d1b/f1e 0 2024-04-26T11:24:01.529 INFO:tasks.workunit.client.0.smithi073.stdout:0/403: creat d2/d37/d3c/d73/f90 x:0 0 0 2024-04-26T11:24:01.529 INFO:tasks.workunit.client.0.smithi073.stdout:0/404: stat d2/d37/d3c 0 2024-04-26T11:24:01.531 INFO:tasks.workunit.client.0.smithi073.stdout:0/405: mknod d2/d22/d51/c91 0 2024-04-26T11:24:01.531 INFO:tasks.workunit.client.0.smithi073.stdout:7/484: rename d1/d11/d24/d26/d67 to d1/d33/d68/d78/daf 0 2024-04-26T11:24:01.532 INFO:tasks.workunit.client.0.smithi073.stdout:0/406: write d2/f21 [3432041,76445] 0 2024-04-26T11:24:01.534 INFO:tasks.workunit.client.0.smithi073.stdout:6/381: dwrite d0/d1a/d26/d4b/f5b [0,4194304] 0 2024-04-26T11:24:01.536 INFO:tasks.workunit.client.0.smithi073.stdout:8/487: dwrite d1/d4/d4c/d66/fa0 [0,4194304] 0 2024-04-26T11:24:01.536 INFO:tasks.workunit.client.0.smithi073.stdout:8/488: stat d1/d21/d2c/f8c 0 2024-04-26T11:24:01.538 INFO:tasks.workunit.client.0.smithi073.stdout:6/382: rename d0/d19/d4d/l6d to d0/d1a/d4e/d67/l72 0 2024-04-26T11:24:01.538 INFO:tasks.workunit.client.0.smithi073.stdout:8/489: creat d1/d21/d50/d67/fa6 x:0 0 0 2024-04-26T11:24:01.538 INFO:tasks.workunit.client.0.smithi073.stdout:2/436: sync 2024-04-26T11:24:01.538 INFO:tasks.workunit.client.0.smithi073.stdout:7/485: sync 2024-04-26T11:24:01.538 INFO:tasks.workunit.client.0.smithi073.stdout:2/437: fsync dd/de/d38/d53/d60/f7d 0 2024-04-26T11:24:01.539 INFO:tasks.workunit.client.0.smithi073.stdout:4/467: read d8/d1a/f2b [341105,61710] 0 2024-04-26T11:24:01.542 INFO:tasks.workunit.client.0.smithi073.stdout:7/486: mknod d1/d11/d5e/cb0 0 2024-04-26T11:24:01.542 INFO:tasks.workunit.client.0.smithi073.stdout:6/383: rename d0/f58 to d0/d1a/d26/d4b/d63/f73 0 2024-04-26T11:24:01.542 INFO:tasks.workunit.client.0.smithi073.stdout:0/407: truncate d2/fb 370157 0 2024-04-26T11:24:01.543 INFO:tasks.workunit.client.0.smithi073.stdout:2/438: getdents dd/de/d29 0 2024-04-26T11:24:01.544 INFO:tasks.workunit.client.0.smithi073.stdout:6/384: creat d0/d1a/d26/d4b/d49/f74 x:0 0 0 2024-04-26T11:24:01.544 INFO:tasks.workunit.client.0.smithi073.stdout:0/408: write d2/d37/d3c/f88 [3241,60621] 0 2024-04-26T11:24:01.544 INFO:tasks.workunit.client.0.smithi073.stdout:2/439: fsync dd/d4c/d48/f7f 0 2024-04-26T11:24:01.545 INFO:tasks.workunit.client.0.smithi073.stdout:7/487: dread d1/d33/d1b/f1e [0,4194304] 0 2024-04-26T11:24:01.545 INFO:tasks.workunit.client.0.smithi073.stdout:2/440: readlink dd/d4c/d48/l64 0 2024-04-26T11:24:01.546 INFO:tasks.workunit.client.0.smithi073.stdout:7/488: chown d1/d11/d24/d71 83021 1 2024-04-26T11:24:01.546 INFO:tasks.workunit.client.0.smithi073.stdout:2/441: mknod dd/d4c/d48/c85 0 2024-04-26T11:24:01.546 INFO:tasks.workunit.client.0.smithi073.stdout:4/468: dwrite d8/d1a/d1b/d24/dac/d49/f91 [0,4194304] 0 2024-04-26T11:24:01.547 INFO:tasks.workunit.client.0.smithi073.stdout:6/385: fdatasync d0/d19/f60 0 2024-04-26T11:24:01.547 INFO:tasks.workunit.client.0.smithi073.stdout:7/489: chown d1/d33/d68/d78/l96 151 1 2024-04-26T11:24:01.547 INFO:tasks.workunit.client.0.smithi073.stdout:2/442: rmdir dd/de/d38/d4e 39 2024-04-26T11:24:01.548 INFO:tasks.workunit.client.0.smithi073.stdout:3/439: dread d0/d11/d23/d3b/f46 [0,4194304] 0 2024-04-26T11:24:01.549 INFO:tasks.workunit.client.0.smithi073.stdout:2/443: unlink dd/d4c/d48/f7f 0 2024-04-26T11:24:01.549 INFO:tasks.workunit.client.0.smithi073.stdout:7/490: write d1/d11/d24/d71/d90/f9f [553023,26111] 0 2024-04-26T11:24:01.549 INFO:tasks.workunit.client.0.smithi073.stdout:4/469: mkdir d8/d1a/d1b/d46/d57/db1 0 2024-04-26T11:24:01.550 INFO:tasks.workunit.client.0.smithi073.stdout:3/440: write d0/d11/f6f [2143776,116508] 0 2024-04-26T11:24:01.550 INFO:tasks.workunit.client.0.smithi073.stdout:4/470: chown d8/d14/f93 27137 1 2024-04-26T11:24:01.550 INFO:tasks.workunit.client.0.smithi073.stdout:3/441: stat d0/d11/d19/f6 0 2024-04-26T11:24:01.551 INFO:tasks.workunit.client.0.smithi073.stdout:7/491: unlink d1/d33/c60 0 2024-04-26T11:24:01.551 INFO:tasks.workunit.client.0.smithi073.stdout:2/444: rmdir dd/de/d38/d4e 39 2024-04-26T11:24:01.551 INFO:tasks.workunit.client.0.smithi073.stdout:4/471: chown d8/d1a/d1b/d46/f81 1577 1 2024-04-26T11:24:01.552 INFO:tasks.workunit.client.0.smithi073.stdout:0/409: dwrite d2/ff [0,4194304] 0 2024-04-26T11:24:01.552 INFO:tasks.workunit.client.0.smithi073.stdout:2/445: unlink dd/de/f18 0 2024-04-26T11:24:01.552 INFO:tasks.workunit.client.0.smithi073.stdout:3/442: unlink d0/d2d/c6e 0 2024-04-26T11:24:01.552 INFO:tasks.workunit.client.0.smithi073.stdout:0/410: readlink d2/l6f 0 2024-04-26T11:24:01.553 INFO:tasks.workunit.client.0.smithi073.stdout:3/443: fdatasync d0/d2d/f6b 0 2024-04-26T11:24:01.553 INFO:tasks.workunit.client.0.smithi073.stdout:0/411: truncate d2/d1f/d40/f82 166694 0 2024-04-26T11:24:01.555 INFO:tasks.workunit.client.0.smithi073.stdout:7/492: mknod d1/d11/d24/d26/d3d/d7b/d8a/cb1 0 2024-04-26T11:24:01.555 INFO:tasks.workunit.client.0.smithi073.stdout:4/472: mkdir d8/d1a/db2 0 2024-04-26T11:24:01.555 INFO:tasks.workunit.client.0.smithi073.stdout:3/444: creat d0/d11/d19/db/d3e/d47/f9b x:0 0 0 2024-04-26T11:24:01.555 INFO:tasks.workunit.client.0.smithi073.stdout:3/445: dread - d0/d2d/f89 zero size 2024-04-26T11:24:01.556 INFO:tasks.workunit.client.0.smithi073.stdout:2/446: getdents dd/d4c/d48/d77 0 2024-04-26T11:24:01.556 INFO:tasks.workunit.client.0.smithi073.stdout:7/493: write d1/d33/d1b/d66/d50/f7d [162051,47887] 0 2024-04-26T11:24:01.556 INFO:tasks.workunit.client.0.smithi073.stdout:4/473: unlink d8/d1a/d1b/l89 0 2024-04-26T11:24:01.556 INFO:tasks.workunit.client.0.smithi073.stdout:0/412: creat d2/f92 x:0 0 0 2024-04-26T11:24:01.557 INFO:tasks.workunit.client.0.smithi073.stdout:8/490: sync 2024-04-26T11:24:01.557 INFO:tasks.workunit.client.0.smithi073.stdout:2/447: mknod dd/d4c/d48/d77/d80/c86 0 2024-04-26T11:24:01.557 INFO:tasks.workunit.client.0.smithi073.stdout:7/494: chown d1/d11/d24/d26/d3d/d41/d64/f4c 1833 1 2024-04-26T11:24:01.557 INFO:tasks.workunit.client.0.smithi073.stdout:3/446: creat d0/d11/d19/db/d3e/d3f/d4d/d7a/f9c x:0 0 0 2024-04-26T11:24:01.558 INFO:tasks.workunit.client.0.smithi073.stdout:8/491: write d1/d4/d4c/f6c [665801,57913] 0 2024-04-26T11:24:01.558 INFO:tasks.workunit.client.0.smithi073.stdout:7/495: chown d1/d33/d68/fad 0 1 2024-04-26T11:24:01.562 INFO:tasks.workunit.client.0.smithi073.stdout:2/448: truncate dd/de/d29/f58 825233 0 2024-04-26T11:24:01.563 INFO:tasks.workunit.client.0.smithi073.stdout:3/447: symlink d0/d11/l9d 0 2024-04-26T11:24:01.563 INFO:tasks.workunit.client.0.smithi073.stdout:8/492: rmdir d1/d4/d4c/d66 39 2024-04-26T11:24:01.563 INFO:tasks.workunit.client.0.smithi073.stdout:1/556: dread d1/d6/db3/d9f/faf [0,4194304] 0 2024-04-26T11:24:01.563 INFO:tasks.workunit.client.0.smithi073.stdout:4/474: chown d8/d1a/d1b/d24/dac/d72/d77/f7a 829980 1 2024-04-26T11:24:01.563 INFO:tasks.workunit.client.0.smithi073.stdout:2/449: fsync dd/d4c/d48/d46/f84 0 2024-04-26T11:24:01.564 INFO:tasks.workunit.client.0.smithi073.stdout:7/496: rename d1/d33/d68/d78/l96 to d1/d11/d24/d26/d3d/d41/lb2 0 2024-04-26T11:24:01.564 INFO:tasks.workunit.client.0.smithi073.stdout:1/557: unlink d1/d8/l69 0 2024-04-26T11:24:01.564 INFO:tasks.workunit.client.0.smithi073.stdout:1/558: fdatasync d1/d16/d4f/f79 0 2024-04-26T11:24:01.564 INFO:tasks.workunit.client.0.smithi073.stdout:3/448: rename d0/d11/d19/d1d/f5d to d0/d34/f9e 0 2024-04-26T11:24:01.565 INFO:tasks.workunit.client.0.smithi073.stdout:7/497: write d1/d11/d24/d26/d3d/d41/d64/f5f [893928,91855] 0 2024-04-26T11:24:01.566 INFO:tasks.workunit.client.0.smithi073.stdout:0/413: dwrite d2/f11 [4194304,4194304] 0 2024-04-26T11:24:01.566 INFO:tasks.workunit.client.0.smithi073.stdout:1/559: read - d1/d16/d4f/f9b zero size 2024-04-26T11:24:01.567 INFO:tasks.workunit.client.0.smithi073.stdout:7/498: creat d1/d33/d1b/fb3 x:0 0 0 2024-04-26T11:24:01.567 INFO:tasks.workunit.client.0.smithi073.stdout:9/480: dread d0/d83/fa1 [0,4194304] 0 2024-04-26T11:24:01.567 INFO:tasks.workunit.client.0.smithi073.stdout:8/493: dread d1/d4/f12 [0,4194304] 0 2024-04-26T11:24:01.568 INFO:tasks.workunit.client.0.smithi073.stdout:1/560: chown d1/d8/cc 0 1 2024-04-26T11:24:01.568 INFO:tasks.workunit.client.0.smithi073.stdout:1/561: dread - d1/fb5 zero size 2024-04-26T11:24:01.570 INFO:tasks.workunit.client.0.smithi073.stdout:5/450: dread d4/de/d15/d33/f4b [0,4194304] 0 2024-04-26T11:24:01.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/386: dread d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:01.573 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:01.568+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:01.573 INFO:tasks.workunit.client.0.smithi073.stdout:2/450: dwrite dd/de/d29/f58 [0,4194304] 0 2024-04-26T11:24:01.573 INFO:tasks.workunit.client.0.smithi073.stdout:4/475: dwrite d8/d15/f17 [0,4194304] 0 2024-04-26T11:24:01.574 INFO:tasks.workunit.client.0.smithi073.stdout:2/451: fsync dd/d1c/f43 0 2024-04-26T11:24:01.574 INFO:tasks.workunit.client.0.smithi073.stdout:4/476: truncate d8/d1f/f22 9139155 0 2024-04-26T11:24:01.574 INFO:tasks.workunit.client.0.smithi073.stdout:0/414: rename d2/l2e to d2/d84/l93 0 2024-04-26T11:24:01.575 INFO:tasks.workunit.client.0.smithi073.stdout:9/481: creat d0/d1a/d4e/d70/faa x:0 0 0 2024-04-26T11:24:01.577 INFO:tasks.workunit.client.0.smithi073.stdout:3/449: dwrite d0/d11/d19/db/f82 [0,4194304] 0 2024-04-26T11:24:01.577 INFO:tasks.workunit.client.0.smithi073.stdout:1/562: write d1/d6/f29 [2737677,70407] 0 2024-04-26T11:24:01.577 INFO:tasks.workunit.client.0.smithi073.stdout:8/494: creat d1/d4/d4c/fa7 x:0 0 0 2024-04-26T11:24:01.577 INFO:tasks.workunit.client.0.smithi073.stdout:2/452: unlink dd/d1c/f25 0 2024-04-26T11:24:01.578 INFO:tasks.workunit.client.0.smithi073.stdout:8/495: fdatasync d1/d21/d50/d67/d81/f84 0 2024-04-26T11:24:01.578 INFO:tasks.workunit.client.0.smithi073.stdout:0/415: fdatasync d2/d1f/d40/d48/f52 0 2024-04-26T11:24:01.578 INFO:tasks.workunit.client.0.smithi073.stdout:3/450: rmdir d0/d11/d23/d3b/d3c 39 2024-04-26T11:24:01.579 INFO:tasks.workunit.client.0.smithi073.stdout:8/496: stat d1/d21/d2c/f3b 0 2024-04-26T11:24:01.580 INFO:tasks.workunit.client.0.smithi073.stdout:3/451: stat d0/d11/d19/l32 0 2024-04-26T11:24:01.580 INFO:tasks.workunit.client.0.smithi073.stdout:1/563: rename d1/d8/f15 to d1/d16/d4f/d55/d5a/dc6/fca 0 2024-04-26T11:24:01.581 INFO:tasks.workunit.client.0.smithi073.stdout:0/416: creat d2/d22/d51/d57/d78/f94 x:0 0 0 2024-04-26T11:24:01.581 INFO:tasks.workunit.client.0.smithi073.stdout:8/497: creat d1/d4/d37/d5b/fa8 x:0 0 0 2024-04-26T11:24:01.581 INFO:tasks.workunit.client.0.smithi073.stdout:6/387: dwrite d0/d15/d2d/d3f/d59/f6b [0,4194304] 0 2024-04-26T11:24:01.581 INFO:tasks.workunit.client.0.smithi073.stdout:1/564: stat d1/d16/d4f/d84/fa5 0 2024-04-26T11:24:01.581 INFO:tasks.workunit.client.0.smithi073.stdout:3/452: read - d0/d11/d19/db/d3e/d47/f79 zero size 2024-04-26T11:24:01.583 INFO:tasks.workunit.client.0.smithi073.stdout:4/477: dwrite d8/d1a/d1b/d41/f58 [0,4194304] 0 2024-04-26T11:24:01.583 INFO:tasks.workunit.client.0.smithi073.stdout:8/498: truncate d1/d4/d37/d5b/f7c 1258661 0 2024-04-26T11:24:01.583 INFO:tasks.workunit.client.0.smithi073.stdout:6/388: symlink d0/d1a/d26/d27/l75 0 2024-04-26T11:24:01.584 INFO:tasks.workunit.client.0.smithi073.stdout:4/478: unlink d8/d1a/d9c/fa5 0 2024-04-26T11:24:01.584 INFO:tasks.workunit.client.0.smithi073.stdout:3/453: creat d0/d11/d19/db/d3e/d3f/d69/d96/f9f x:0 0 0 2024-04-26T11:24:01.584 INFO:tasks.workunit.client.0.smithi073.stdout:6/389: chown d0/d1a/d26/d4b/d38 26626544 1 2024-04-26T11:24:01.585 INFO:tasks.workunit.client.0.smithi073.stdout:6/390: chown d0/dc/f66 4520924 1 2024-04-26T11:24:01.585 INFO:tasks.workunit.client.0.smithi073.stdout:8/499: rename d1/d4/d4c/d59 to d1/d4/da9 0 2024-04-26T11:24:01.586 INFO:tasks.workunit.client.0.smithi073.stdout:4/479: mknod d8/d1a/d1b/d24/dac/d72/cb3 0 2024-04-26T11:24:01.586 INFO:tasks.workunit.client.0.smithi073.stdout:3/454: fdatasync d0/d11/d19/db/d3e/d3f/d4d/d7a/f9c 0 2024-04-26T11:24:01.586 INFO:tasks.workunit.client.0.smithi073.stdout:6/391: chown d0/dc/f66 284235879 1 2024-04-26T11:24:01.586 INFO:tasks.workunit.client.0.smithi073.stdout:9/482: dread d0/d1a/d4e/d70/d46/f8b [0,4194304] 0 2024-04-26T11:24:01.587 INFO:tasks.workunit.client.0.smithi073.stdout:6/392: chown d0/d1a/d4e/f51 0 1 2024-04-26T11:24:01.588 INFO:tasks.workunit.client.0.smithi073.stdout:3/455: fsync d0/f7 0 2024-04-26T11:24:01.588 INFO:tasks.workunit.client.0.smithi073.stdout:8/500: symlink d1/d4/d4c/laa 0 2024-04-26T11:24:01.588 INFO:tasks.workunit.client.0.smithi073.stdout:0/417: dwrite d2/d1f/d40/f5b [0,4194304] 0 2024-04-26T11:24:01.588 INFO:tasks.workunit.client.0.smithi073.stdout:6/393: creat d0/d1a/d26/d4b/d2b/d2c/f76 x:0 0 0 2024-04-26T11:24:01.588 INFO:tasks.workunit.client.0.smithi073.stdout:0/418: stat d2/d84/c89 0 2024-04-26T11:24:01.590 INFO:tasks.workunit.client.0.smithi073.stdout:3/456: rename d0/d26/f29 to d0/d11/d19/fa0 0 2024-04-26T11:24:01.590 INFO:tasks.workunit.client.0.smithi073.stdout:6/394: creat d0/d19/d4d/f77 x:0 0 0 2024-04-26T11:24:01.592 INFO:tasks.workunit.client.0.smithi073.stdout:3/457: mkdir d0/d11/d19/db/d3e/d3f/da1 0 2024-04-26T11:24:01.592 INFO:tasks.workunit.client.0.smithi073.stdout:3/458: fsync d0/d26/f2a 0 2024-04-26T11:24:01.593 INFO:tasks.workunit.client.0.smithi073.stdout:4/480: dwrite d8/d14/d60/f32 [0,4194304] 0 2024-04-26T11:24:01.594 INFO:tasks.workunit.client.0.smithi073.stdout:3/459: dread - d0/d11/d19/db/d3e/d47/f73 zero size 2024-04-26T11:24:01.595 INFO:tasks.workunit.client.0.smithi073.stdout:7/499: sync 2024-04-26T11:24:01.595 INFO:tasks.workunit.client.0.smithi073.stdout:2/453: sync 2024-04-26T11:24:01.596 INFO:tasks.workunit.client.0.smithi073.stdout:4/481: rename d8/fe to d8/d1a/d1b/d46/d57/db1/fb4 0 2024-04-26T11:24:01.596 INFO:tasks.workunit.client.0.smithi073.stdout:3/460: mkdir d0/d26/da2 0 2024-04-26T11:24:01.597 INFO:tasks.workunit.client.0.smithi073.stdout:2/454: write dd/d1c/f6f [327296,34285] 0 2024-04-26T11:24:01.597 INFO:tasks.workunit.client.0.smithi073.stdout:0/419: dwrite d2/d22/d51/d57/f85 [0,4194304] 0 2024-04-26T11:24:01.597 INFO:tasks.workunit.client.0.smithi073.stdout:3/461: read - d0/d34/f9e zero size 2024-04-26T11:24:01.597 INFO:tasks.workunit.client.0.smithi073.stdout:2/455: creat dd/de/d2a/f87 x:0 0 0 2024-04-26T11:24:01.597 INFO:tasks.workunit.client.0.smithi073.stdout:4/482: rename d8/d1a/d1b/f36 to d8/d1a/d1b/fb5 0 2024-04-26T11:24:01.600 INFO:tasks.workunit.client.0.smithi073.stdout:3/462: mkdir d0/d11/d19/db/d3e/d3f/d4d/d8b/d8c/da3 0 2024-04-26T11:24:01.601 INFO:tasks.workunit.client.0.smithi073.stdout:2/456: write dd/d1c/d1d/f20 [1947251,127015] 0 2024-04-26T11:24:01.601 INFO:tasks.workunit.client.0.smithi073.stdout:3/463: readlink d0/d11/d19/db/d3e/d3f/l95 0 2024-04-26T11:24:01.601 INFO:tasks.workunit.client.0.smithi073.stdout:2/457: chown dd/d1c/f22 6515671 1 2024-04-26T11:24:01.601 INFO:tasks.workunit.client.0.smithi073.stdout:9/483: write d0/d13/f20 [172637,11421] 0 2024-04-26T11:24:01.601 INFO:tasks.workunit.client.0.smithi073.stdout:6/395: truncate d0/dc/f64 1118941 0 2024-04-26T11:24:01.602 INFO:tasks.workunit.client.0.smithi073.stdout:2/458: write f0 [4555986,101451] 0 2024-04-26T11:24:01.602 INFO:tasks.workunit.client.0.smithi073.stdout:9/484: symlink d0/d83/lab 0 2024-04-26T11:24:01.602 INFO:tasks.workunit.client.0.smithi073.stdout:2/459: creat dd/d4c/d48/d46/f88 x:0 0 0 2024-04-26T11:24:01.602 INFO:tasks.workunit.client.0.smithi073.stdout:6/396: rename d0/d19/d20/c37 to d0/d1a/d4e/c78 0 2024-04-26T11:24:01.603 INFO:tasks.workunit.client.0.smithi073.stdout:9/485: write d0/d13/d5a/fa2 [113660,31457] 0 2024-04-26T11:24:01.603 INFO:tasks.workunit.client.0.smithi073.stdout:9/486: chown d0/d13/d25/d2c/c4c 90163 1 2024-04-26T11:24:01.604 INFO:tasks.workunit.client.0.smithi073.stdout:9/487: mknod d0/d13/cac 0 2024-04-26T11:24:01.607 INFO:tasks.workunit.client.0.smithi073.stdout:3/464: truncate d0/d26/f58 336449 0 2024-04-26T11:24:01.607 INFO:tasks.workunit.client.0.smithi073.stdout:9/488: truncate d0/d1a/d4e/d70/f76 284310 0 2024-04-26T11:24:01.607 INFO:tasks.workunit.client.0.smithi073.stdout:7/500: dwrite d1/d33/d1b/f1e [0,4194304] 0 2024-04-26T11:24:01.607 INFO:tasks.workunit.client.0.smithi073.stdout:5/451: sync 2024-04-26T11:24:01.608 INFO:tasks.workunit.client.0.smithi073.stdout:3/465: dread - d0/d26/f2a zero size 2024-04-26T11:24:01.608 INFO:tasks.workunit.client.0.smithi073.stdout:4/483: dread d8/d1a/d5e/d7c/f82 [0,4194304] 0 2024-04-26T11:24:01.608 INFO:tasks.workunit.client.0.smithi073.stdout:9/489: write d0/d13/d25/d2c/f53 [1996820,109050] 0 2024-04-26T11:24:01.609 INFO:tasks.workunit.client.0.smithi073.stdout:7/501: readlink d1/d33/d1b/d66/d50/l5a 0 2024-04-26T11:24:01.609 INFO:tasks.workunit.client.0.smithi073.stdout:4/484: readlink d8/l19 0 2024-04-26T11:24:01.611 INFO:tasks.workunit.client.0.smithi073.stdout:0/420: dwrite d2/fb [0,4194304] 0 2024-04-26T11:24:01.611 INFO:tasks.workunit.client.0.smithi073.stdout:5/452: mkdir d4/d8/d9/d7d/d84/da7 0 2024-04-26T11:24:01.612 INFO:tasks.workunit.client.0.smithi073.stdout:6/397: getdents d0/d19/d20 0 2024-04-26T11:24:01.612 INFO:tasks.workunit.client.0.smithi073.stdout:1/565: dread d1/d73/d40/f2c [0,4194304] 0 2024-04-26T11:24:01.612 INFO:tasks.workunit.client.0.smithi073.stdout:9/490: rename d0/d3c/f43 to d0/d1a/d4e/d70/d46/fad 0 2024-04-26T11:24:01.612 INFO:tasks.workunit.client.0.smithi073.stdout:5/453: write f2 [4869435,63476] 0 2024-04-26T11:24:01.613 INFO:tasks.workunit.client.0.smithi073.stdout:6/398: chown d0/f4 37544239 1 2024-04-26T11:24:01.613 INFO:tasks.workunit.client.0.smithi073.stdout:0/421: chown d2/d22/d51/l8d 1 1 2024-04-26T11:24:01.613 INFO:tasks.workunit.client.0.smithi073.stdout:6/399: fdatasync d0/d1a/d26/d27/f29 0 2024-04-26T11:24:01.614 INFO:tasks.workunit.client.0.smithi073.stdout:4/485: creat d8/d1a/d1b/d24/dac/d72/da3/fb6 x:0 0 0 2024-04-26T11:24:01.616 INFO:tasks.workunit.client.0.smithi073.stdout:5/454: getdents d4/d95 0 2024-04-26T11:24:01.616 INFO:tasks.workunit.client.0.smithi073.stdout:0/422: rename d2/f4b to d2/d22/f95 0 2024-04-26T11:24:01.616 INFO:tasks.workunit.client.0.smithi073.stdout:1/566: link d1/d16/d4f/d55/d5a/dc6/fca d1/d73/d40/d44/d80/fcb 0 2024-04-26T11:24:01.618 INFO:tasks.workunit.client.0.smithi073.stdout:7/502: dwrite d1/d33/f86 [0,4194304] 0 2024-04-26T11:24:01.618 INFO:tasks.workunit.client.0.smithi073.stdout:0/423: chown d2/d1f/d40/d48/d62 14 1 2024-04-26T11:24:01.619 INFO:tasks.workunit.client.0.smithi073.stdout:9/491: dwrite d0/fa7 [0,4194304] 0 2024-04-26T11:24:01.620 INFO:tasks.workunit.client.0.smithi073.stdout:7/503: write d1/d33/d68/d78/daf/f28 [4747697,24887] 0 2024-04-26T11:24:01.621 INFO:tasks.workunit.client.0.smithi073.stdout:6/400: dread d0/d1a/d26/d27/d52/f56 [0,4194304] 0 2024-04-26T11:24:01.621 INFO:tasks.workunit.client.0.smithi073.stdout:4/486: creat d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/fb7 x:0 0 0 2024-04-26T11:24:01.622 INFO:tasks.workunit.client.0.smithi073.stdout:9/492: mkdir d0/d1a/d4e/d70/dae 0 2024-04-26T11:24:01.623 INFO:tasks.workunit.client.0.smithi073.stdout:1/567: getdents d1/d73 0 2024-04-26T11:24:01.623 INFO:tasks.workunit.client.0.smithi073.stdout:9/493: dread - d0/d1a/f74 zero size 2024-04-26T11:24:01.624 INFO:tasks.workunit.client.0.smithi073.stdout:3/466: truncate d0/d11/d19/d1d/f50 1428007 0 2024-04-26T11:24:01.626 INFO:tasks.workunit.client.0.smithi073.stdout:9/494: write d0/d13/d25/d2c/f3a [2569628,40299] 0 2024-04-26T11:24:01.626 INFO:tasks.workunit.client.0.smithi073.stdout:1/568: creat d1/d16/d4f/fcc x:0 0 0 2024-04-26T11:24:01.626 INFO:tasks.workunit.client.0.smithi073.stdout:0/424: dwrite d2/d22/f2f [0,4194304] 0 2024-04-26T11:24:01.628 INFO:tasks.workunit.client.0.smithi073.stdout:7/504: dwrite d1/d33/d68/faa [0,4194304] 0 2024-04-26T11:24:01.628 INFO:tasks.workunit.client.0.smithi073.stdout:9/495: truncate d0/d1a/d4e/d70/d46/f8a 777824 0 2024-04-26T11:24:01.629 INFO:tasks.workunit.client.0.smithi073.stdout:8/501: dread d1/d4/f5a [0,4194304] 0 2024-04-26T11:24:01.630 INFO:tasks.workunit.client.0.smithi073.stdout:8/502: mknod d1/d21/cab 0 2024-04-26T11:24:01.630 INFO:tasks.workunit.client.0.smithi073.stdout:9/496: link d0/d1a/d4e/d70/d3b/f4d d0/d1a/d4e/d70/d46/faf 0 2024-04-26T11:24:01.631 INFO:tasks.workunit.client.0.smithi073.stdout:9/497: fsync d0/d13/f1f 0 2024-04-26T11:24:01.631 INFO:tasks.workunit.client.0.smithi073.stdout:4/487: getdents d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d 0 2024-04-26T11:24:01.631 INFO:tasks.workunit.client.0.smithi073.stdout:8/503: mknod d1/d21/d2a/cac 0 2024-04-26T11:24:01.634 INFO:tasks.workunit.client.0.smithi073.stdout:1/569: dwrite d1/d73/d34/f78 [0,4194304] 0 2024-04-26T11:24:01.635 INFO:tasks.workunit.client.0.smithi073.stdout:0/425: write d2/f1d [1851314,65807] 0 2024-04-26T11:24:01.636 INFO:tasks.workunit.client.0.smithi073.stdout:9/498: creat d0/d13/d25/d75/d8e/fb0 x:0 0 0 2024-04-26T11:24:01.636 INFO:tasks.workunit.client.0.smithi073.stdout:2/460: dread dd/d4c/d48/d46/f84 [0,4194304] 0 2024-04-26T11:24:01.637 INFO:tasks.workunit.client.0.smithi073.stdout:6/401: dwrite d0/d1a/d4e/f51 [0,4194304] 0 2024-04-26T11:24:01.638 INFO:tasks.workunit.client.0.smithi073.stdout:9/499: stat d0/d1a/f8c 0 2024-04-26T11:24:01.638 INFO:tasks.workunit.client.0.smithi073.stdout:0/426: chown d2/d37/c7e 1 1 2024-04-26T11:24:01.639 INFO:tasks.workunit.client.0.smithi073.stdout:3/467: dwrite d0/d11/d19/fa0 [0,4194304] 0 2024-04-26T11:24:01.639 INFO:tasks.workunit.client.0.smithi073.stdout:1/570: getdents d1/d6 0 2024-04-26T11:24:01.639 INFO:tasks.workunit.client.0.smithi073.stdout:9/500: chown d0/d13/db/f85 13784386 1 2024-04-26T11:24:01.640 INFO:tasks.workunit.client.0.smithi073.stdout:0/427: truncate d2/d1f/d40/d48/d62/f71 404561 0 2024-04-26T11:24:01.640 INFO:tasks.workunit.client.0.smithi073.stdout:1/571: stat d1/d8/d5d/f8a 0 2024-04-26T11:24:01.640 INFO:tasks.workunit.client.0.smithi073.stdout:0/428: stat d2/f1d 0 2024-04-26T11:24:01.641 INFO:tasks.workunit.client.0.smithi073.stdout:4/488: dwrite d8/d1a/d1b/d24/dac/d49/d85/f79 [0,4194304] 0 2024-04-26T11:24:01.641 INFO:tasks.workunit.client.0.smithi073.stdout:1/572: write d1/d16/d61/f90 [1942598,129233] 0 2024-04-26T11:24:01.642 INFO:tasks.workunit.client.0.smithi073.stdout:6/402: truncate d0/d1a/d26/d4b/d2b/d2c/f76 234811 0 2024-04-26T11:24:01.643 INFO:tasks.workunit.client.0.smithi073.stdout:4/489: creat d8/d1a/d9c/fb8 x:0 0 0 2024-04-26T11:24:01.643 INFO:tasks.workunit.client.0.smithi073.stdout:9/501: link d0/d13/d25/d75/f89 d0/d83/fb1 0 2024-04-26T11:24:01.643 INFO:tasks.workunit.client.0.smithi073.stdout:6/403: fsync d0/d19/d20/f65 0 2024-04-26T11:24:01.643 INFO:tasks.workunit.client.0.smithi073.stdout:1/573: mkdir d1/d16/d4f/d55/da2/dcd 0 2024-04-26T11:24:01.643 INFO:tasks.workunit.client.0.smithi073.stdout:1/574: chown d1/d73/d40/f3a 354002 1 2024-04-26T11:24:01.644 INFO:tasks.workunit.client.0.smithi073.stdout:9/502: truncate d0/d3c/f7a 4373081 0 2024-04-26T11:24:01.644 INFO:tasks.workunit.client.0.smithi073.stdout:1/575: mkdir d1/d73/d34/d98/dce 0 2024-04-26T11:24:01.644 INFO:tasks.workunit.client.0.smithi073.stdout:9/503: stat d0/d1a/d4e/d70/d51/c69 0 2024-04-26T11:24:01.645 INFO:tasks.workunit.client.0.smithi073.stdout:9/504: mkdir d0/d13/d5a/db2 0 2024-04-26T11:24:01.646 INFO:tasks.workunit.client.0.smithi073.stdout:9/505: rmdir d0/d1a/d4e/d70/d3b 39 2024-04-26T11:24:01.648 INFO:tasks.workunit.client.0.smithi073.stdout:0/429: truncate d2/d22/d51/d57/f85 3248984 0 2024-04-26T11:24:01.652 INFO:tasks.workunit.client.0.smithi073.stdout:9/506: rename d0/d13/f32 to d0/d1a/d4e/d70/d3b/fb3 0 2024-04-26T11:24:01.652 INFO:tasks.workunit.client.0.smithi073.stdout:6/404: dwrite d0/f61 [0,4194304] 0 2024-04-26T11:24:01.652 INFO:tasks.workunit.client.0.smithi073.stdout:0/430: rmdir d2/d84/d8f 0 2024-04-26T11:24:01.652 INFO:tasks.workunit.client.0.smithi073.stdout:4/490: dwrite d8/d1a/d1b/d24/dac/d49/f6c [0,4194304] 0 2024-04-26T11:24:01.653 INFO:tasks.workunit.client.0.smithi073.stdout:1/576: dwrite d1/d6/db3/d9f/faf [0,4194304] 0 2024-04-26T11:24:01.654 INFO:tasks.workunit.client.0.smithi073.stdout:0/431: mknod d2/d22/c96 0 2024-04-26T11:24:01.654 INFO:tasks.workunit.client.0.smithi073.stdout:6/405: write d0/d19/d4d/f6c [1127169,50978] 0 2024-04-26T11:24:01.655 INFO:tasks.workunit.client.0.smithi073.stdout:1/577: creat d1/d16/d4f/d55/d5a/fcf x:0 0 0 2024-04-26T11:24:01.655 INFO:tasks.workunit.client.0.smithi073.stdout:9/507: fdatasync d0/d6c/f97 0 2024-04-26T11:24:01.655 INFO:tasks.workunit.client.0.smithi073.stdout:4/491: rename d8/d1a/d1b/d46/c4b to d8/d1a/d1b/d24/dac/d49/cb9 0 2024-04-26T11:24:01.655 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:01.655 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:01.656 INFO:tasks.workunit.client.0.smithi073.stdout:1/578: chown d1/d73 7359 1 2024-04-26T11:24:01.656 INFO:tasks.workunit.client.0.smithi073.stdout:6/406: mkdir d0/dc/d55/d79 0 2024-04-26T11:24:01.656 INFO:tasks.workunit.client.0.smithi073.stdout:0/432: rename d2/f21 to d2/d1f/d40/d48/f97 0 2024-04-26T11:24:01.656 INFO:tasks.workunit.client.0.smithi073.stdout:1/579: dread - d1/fb5 zero size 2024-04-26T11:24:01.656 INFO:tasks.workunit.client.0.smithi073.stdout:0/433: stat d2/d37/d3c/d6a 0 2024-04-26T11:24:01.657 INFO:tasks.workunit.client.0.smithi073.stdout:1/580: chown d1/d16/d61/la0 224 1 2024-04-26T11:24:01.657 INFO:tasks.workunit.client.0.smithi073.stdout:0/434: creat d2/d37/d3c/d6a/f98 x:0 0 0 2024-04-26T11:24:01.658 INFO:tasks.workunit.client.0.smithi073.stdout:9/508: fdatasync d0/d1a/d2f/f3e 0 2024-04-26T11:24:01.659 INFO:tasks.workunit.client.0.smithi073.stdout:0/435: write d2/d22/d51/d57/f5e [828794,5795] 0 2024-04-26T11:24:01.660 INFO:tasks.workunit.client.0.smithi073.stdout:0/436: dread - d2/d37/d3c/d73/f90 zero size 2024-04-26T11:24:01.662 INFO:tasks.workunit.client.0.smithi073.stdout:4/492: dwrite d8/d1a/d1b/d24/f2d [4194304,4194304] 0 2024-04-26T11:24:01.662 INFO:tasks.workunit.client.0.smithi073.stdout:0/437: creat d2/d1f/d40/d48/f99 x:0 0 0 2024-04-26T11:24:01.662 INFO:tasks.workunit.client.0.smithi073.stdout:6/407: write d0/dc/f64 [1058847,110217] 0 2024-04-26T11:24:01.663 INFO:tasks.workunit.client.0.smithi073.stdout:4/493: truncate d8/d1a/d9c/fb8 698479 0 2024-04-26T11:24:01.664 INFO:tasks.workunit.client.0.smithi073.stdout:6/408: mkdir d0/d1a/d7a 0 2024-04-26T11:24:01.664 INFO:tasks.workunit.client.0.smithi073.stdout:4/494: chown d8/d1a/d1b/d24/dac/d72/f80 3 1 2024-04-26T11:24:01.665 INFO:tasks.workunit.client.0.smithi073.stdout:4/495: rename d8/d1a/d1b/d24/f3d to d8/d1a/d1b/d24/dac/da7/fba 0 2024-04-26T11:24:01.666 INFO:tasks.workunit.client.0.smithi073.stdout:0/438: write d2/d22/f95 [3095057,128545] 0 2024-04-26T11:24:01.667 INFO:tasks.workunit.client.0.smithi073.stdout:0/439: mknod d2/d37/d8b/c9a 0 2024-04-26T11:24:01.667 INFO:tasks.workunit.client.0.smithi073.stdout:4/496: rename d8/d1a/d1b/d24/f2d to d8/d1a/d1b/d24/dac/fbb 0 2024-04-26T11:24:01.669 INFO:tasks.workunit.client.0.smithi073.stdout:4/497: truncate d8/d1a/d1b/d24/dac/d49/f62 463089 0 2024-04-26T11:24:01.669 INFO:tasks.workunit.client.0.smithi073.stdout:6/409: dwrite d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:01.670 INFO:tasks.workunit.client.0.smithi073.stdout:4/498: mknod d8/d1a/d1b/d46/d57/cbc 0 2024-04-26T11:24:01.670 INFO:tasks.workunit.client.0.smithi073.stdout:4/499: chown d8/d1a/f2b 0 1 2024-04-26T11:24:01.672 INFO:tasks.workunit.client.0.smithi073.stdout:4/500: write d8/d1a/d1b/d46/f81 [8250647,125483] 0 2024-04-26T11:24:01.673 INFO:tasks.workunit.client.0.smithi073.stdout:9/509: dread d0/d13/d5a/fa2 [0,4194304] 0 2024-04-26T11:24:01.674 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:01.668+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:01.674 INFO:tasks.workunit.client.0.smithi073.stdout:4/501: truncate d8/d1a/d86/fa8 872425 0 2024-04-26T11:24:01.674 INFO:tasks.workunit.client.0.smithi073.stdout:9/510: stat d0/d1a/d4e/d70/d46 0 2024-04-26T11:24:01.675 INFO:tasks.workunit.client.0.smithi073.stdout:4/502: write d8/d1a/d1b/d24/dac/d49/d85/f5d [1006049,101330] 0 2024-04-26T11:24:01.676 INFO:tasks.workunit.client.0.smithi073.stdout:0/440: dwrite d2/d37/f83 [0,4194304] 0 2024-04-26T11:24:01.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:01.678 INFO:tasks.workunit.client.0.smithi073.stdout:6/410: dwrite d0/d19/f60 [0,4194304] 0 2024-04-26T11:24:01.678 INFO:tasks.workunit.client.0.smithi073.stdout:0/441: rename d2/d22/d51/d57/d78 to d2/d22/d51/d57/d78/d9b 22 2024-04-26T11:24:01.678 INFO:tasks.workunit.client.0.smithi073.stdout:4/503: write d8/d1a/d1b/d24/dac/d49/d84/f6e [4161577,49884] 0 2024-04-26T11:24:01.678 INFO:tasks.workunit.client.0.smithi073.stdout:4/504: truncate d8/d14/f2a 4479638 0 2024-04-26T11:24:01.679 INFO:tasks.workunit.client.0.smithi073.stdout:4/505: mknod d8/d1a/d1b/d46/d57/d37/cbd 0 2024-04-26T11:24:01.679 INFO:tasks.workunit.client.0.smithi073.stdout:6/411: fdatasync d0/d19/d4d/f6c 0 2024-04-26T11:24:01.681 INFO:tasks.workunit.client.0.smithi073.stdout:6/412: rename d0/d19/d4d to d0/d1a/d26/d4b/d63/d7b 0 2024-04-26T11:24:01.682 INFO:tasks.workunit.client.0.smithi073.stdout:6/413: readlink d0/d19/l35 0 2024-04-26T11:24:01.682 INFO:tasks.workunit.client.0.smithi073.stdout:8/504: sync 2024-04-26T11:24:01.683 INFO:tasks.workunit.client.0.smithi073.stdout:0/442: dwrite d2/d22/f4e [0,4194304] 0 2024-04-26T11:24:01.684 INFO:tasks.workunit.client.0.smithi073.stdout:6/414: mkdir d0/d1a/d26/d27/d52/d7c 0 2024-04-26T11:24:01.684 INFO:tasks.workunit.client.0.smithi073.stdout:0/443: write d2/d22/f39 [135485,119824] 0 2024-04-26T11:24:01.685 INFO:tasks.workunit.client.0.smithi073.stdout:8/505: getdents d1/d21/d50/d67/d81/da5 0 2024-04-26T11:24:01.686 INFO:tasks.workunit.client.0.smithi073.stdout:6/415: write d0/d19/f21 [2159389,33777] 0 2024-04-26T11:24:01.686 INFO:tasks.workunit.client.0.smithi073.stdout:8/506: rmdir d1/d21/d2c 39 2024-04-26T11:24:01.687 INFO:tasks.workunit.client.0.smithi073.stdout:4/506: dwrite d8/d1a/d1b/d24/dac/d49/f6c [0,4194304] 0 2024-04-26T11:24:01.688 INFO:tasks.workunit.client.0.smithi073.stdout:4/507: dread - d8/d1a/d86/f98 zero size 2024-04-26T11:24:01.688 INFO:tasks.workunit.client.0.smithi073.stdout:8/507: creat d1/d21/d50/d67/d81/fad x:0 0 0 2024-04-26T11:24:01.689 INFO:tasks.workunit.client.0.smithi073.stdout:8/508: write d1/d21/d50/d67/fa6 [771531,32936] 0 2024-04-26T11:24:01.690 INFO:tasks.workunit.client.0.smithi073.stdout:7/505: dread d1/d11/d24/d29/f74 [0,4194304] 0 2024-04-26T11:24:01.690 INFO:tasks.workunit.client.0.smithi073.stdout:4/508: creat d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/fbe x:0 0 0 2024-04-26T11:24:01.692 INFO:tasks.workunit.client.0.smithi073.stdout:7/506: creat d1/d11/fb4 x:0 0 0 2024-04-26T11:24:01.692 INFO:tasks.workunit.client.0.smithi073.stdout:2/461: dread dd/de/d6b/f5f [0,4194304] 0 2024-04-26T11:24:01.693 INFO:tasks.workunit.client.0.smithi073.stdout:0/444: write d2/d22/d51/d57/f85 [1242312,90738] 0 2024-04-26T11:24:01.693 INFO:tasks.workunit.client.0.smithi073.stdout:8/509: link d1/d4/d37/f4f d1/d21/d50/d67/d81/da5/fae 0 2024-04-26T11:24:01.693 INFO:tasks.workunit.client.0.smithi073.stdout:4/509: chown d8/d1a/d1b/d24/dac/d49/f62 2 1 2024-04-26T11:24:01.695 INFO:tasks.workunit.client.0.smithi073.stdout:5/455: dread d4/de/f10 [0,4194304] 0 2024-04-26T11:24:01.696 INFO:tasks.workunit.client.0.smithi073.stdout:4/510: mknod d8/d1a/d1b/d24/dac/d72/cbf 0 2024-04-26T11:24:01.696 INFO:tasks.workunit.client.0.smithi073.stdout:2/462: link dd/de/d6b/c76 dd/de/c89 0 2024-04-26T11:24:01.696 INFO:tasks.workunit.client.0.smithi073.stdout:6/416: dwrite d0/d1a/d26/d27/d52/f56 [0,4194304] 0 2024-04-26T11:24:01.696 INFO:tasks.workunit.client.0.smithi073.stdout:2/463: readlink dd/d1c/l6d 0 2024-04-26T11:24:01.696 INFO:tasks.workunit.client.0.smithi073.stdout:4/511: dread - d8/d1a/d9c/d9d/fae zero size 2024-04-26T11:24:01.697 INFO:tasks.workunit.client.0.smithi073.stdout:6/417: fdatasync d0/d1a/d26/d4b/d2b/d2c/f76 0 2024-04-26T11:24:01.698 INFO:tasks.workunit.client.0.smithi073.stdout:6/418: truncate d0/d19/d20/f22 5090950 0 2024-04-26T11:24:01.699 INFO:tasks.workunit.client.0.smithi073.stdout:5/456: creat d4/d95/da5/fa8 x:0 0 0 2024-04-26T11:24:01.699 INFO:tasks.workunit.client.0.smithi073.stdout:4/512: creat d8/d1f/fc0 x:0 0 0 2024-04-26T11:24:01.700 INFO:tasks.workunit.client.0.smithi073.stdout:6/419: rename d0/f71 to d0/d1a/d26/d4b/f7d 0 2024-04-26T11:24:01.701 INFO:tasks.workunit.client.0.smithi073.stdout:5/457: fsync d4/d8/d9/d42/f99 0 2024-04-26T11:24:01.701 INFO:tasks.workunit.client.0.smithi073.stdout:4/513: write d8/d14/d60/f6f [2844236,81298] 0 2024-04-26T11:24:01.701 INFO:tasks.workunit.client.0.smithi073.stdout:6/420: rename d0/l34 to d0/dc/d2e/l7e 0 2024-04-26T11:24:01.702 INFO:tasks.workunit.client.0.smithi073.stdout:5/458: creat d4/d8/d8e/fa9 x:0 0 0 2024-04-26T11:24:01.702 INFO:tasks.workunit.client.0.smithi073.stdout:6/421: chown d0/d1a/d26/d4b/d2b 7648824 1 2024-04-26T11:24:01.703 INFO:tasks.workunit.client.0.smithi073.stdout:2/464: dwrite dd/d4c/f7c [0,4194304] 0 2024-04-26T11:24:01.703 INFO:tasks.workunit.client.0.smithi073.stdout:6/422: stat d0/d1a/d4e/c78 0 2024-04-26T11:24:01.703 INFO:tasks.workunit.client.0.smithi073.stdout:5/459: truncate d4/d8/d9/d42/f4a 4278370 0 2024-04-26T11:24:01.704 INFO:tasks.workunit.client.0.smithi073.stdout:2/465: fsync dd/de/f11 0 2024-04-26T11:24:01.704 INFO:tasks.workunit.client.0.smithi073.stdout:5/460: chown d4/de/c1e 1605416 1 2024-04-26T11:24:01.705 INFO:tasks.workunit.client.0.smithi073.stdout:7/507: dwrite d1/d33/d68/d78/daf/f23 [0,4194304] 0 2024-04-26T11:24:01.705 INFO:tasks.workunit.client.0.smithi073.stdout:8/510: truncate d1/d4/d37/f48 3640255 0 2024-04-26T11:24:01.705 INFO:tasks.workunit.client.0.smithi073.stdout:3/468: sync 2024-04-26T11:24:01.705 INFO:tasks.workunit.client.0.smithi073.stdout:9/511: sync 2024-04-26T11:24:01.706 INFO:tasks.workunit.client.0.smithi073.stdout:5/461: symlink d4/d8/d9/d42/d68/laa 0 2024-04-26T11:24:01.707 INFO:tasks.workunit.client.0.smithi073.stdout:8/511: readlink d1/d4/d37/d5b/d83/l85 0 2024-04-26T11:24:01.708 INFO:tasks.workunit.client.0.smithi073.stdout:7/508: getdents d1/d11/d24/d26/d3d/d7c 0 2024-04-26T11:24:01.710 INFO:tasks.workunit.client.0.smithi073.stdout:4/514: dwrite d8/d1a/d1b/d46/fb0 [0,4194304] 0 2024-04-26T11:24:01.710 INFO:tasks.workunit.client.0.smithi073.stdout:4/515: fdatasync f7 0 2024-04-26T11:24:01.711 INFO:tasks.workunit.client.0.smithi073.stdout:6/423: dwrite d0/dc/d55/f46 [4194304,4194304] 0 2024-04-26T11:24:01.711 INFO:tasks.workunit.client.0.smithi073.stdout:8/512: mknod d1/d21/d2c/caf 0 2024-04-26T11:24:01.713 INFO:tasks.workunit.client.0.smithi073.stdout:6/424: fdatasync d0/d1a/d26/d4b/d2b/d2c/f3b 0 2024-04-26T11:24:01.714 INFO:tasks.workunit.client.0.smithi073.stdout:8/513: chown d1/d21/d50/f2e 0 1 2024-04-26T11:24:01.714 INFO:tasks.workunit.client.0.smithi073.stdout:1/581: dread d1/d6/fb [0,4194304] 0 2024-04-26T11:24:01.714 INFO:tasks.workunit.client.0.smithi073.stdout:4/516: mknod d8/d1a/d9c/d9d/cc1 0 2024-04-26T11:24:01.715 INFO:tasks.workunit.client.0.smithi073.stdout:1/582: fdatasync d1/d16/d61/f92 0 2024-04-26T11:24:01.715 INFO:tasks.workunit.client.0.smithi073.stdout:6/425: symlink d0/d1a/d26/l7f 0 2024-04-26T11:24:01.716 INFO:tasks.workunit.client.0.smithi073.stdout:3/469: link d0/d11/d23/d3b/d3c/c40 d0/d26/ca4 0 2024-04-26T11:24:01.716 INFO:tasks.workunit.client.0.smithi073.stdout:4/517: write d8/d1a/d1b/d41/f48 [746462,120922] 0 2024-04-26T11:24:01.717 INFO:tasks.workunit.client.0.smithi073.stdout:5/462: dwrite d4/f20 [0,4194304] 0 2024-04-26T11:24:01.717 INFO:tasks.workunit.client.0.smithi073.stdout:1/583: creat d1/d73/d40/d44/d80/fd0 x:0 0 0 2024-04-26T11:24:01.717 INFO:tasks.workunit.client.0.smithi073.stdout:3/470: mknod d0/d2d/ca5 0 2024-04-26T11:24:01.717 INFO:tasks.workunit.client.0.smithi073.stdout:7/509: write f0 [1228356,51403] 0 2024-04-26T11:24:01.719 INFO:tasks.workunit.client.0.smithi073.stdout:4/518: mkdir d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/dc2 0 2024-04-26T11:24:01.719 INFO:tasks.workunit.client.0.smithi073.stdout:6/426: rename d0/d1a/d26/d4b/d63/d7b to d0/dc/d80 0 2024-04-26T11:24:01.719 INFO:tasks.workunit.client.0.smithi073.stdout:8/514: link d1/d21/d50/d67/d81/fad d1/d21/d2a/fb0 0 2024-04-26T11:24:01.720 INFO:tasks.workunit.client.0.smithi073.stdout:9/512: read d0/d1a/d4e/d70/f76 [57401,90780] 0 2024-04-26T11:24:01.720 INFO:tasks.workunit.client.0.smithi073.stdout:3/471: rename d0/d11/d19/db/d3e/d3f/d4d to d0/d11/d19/db/da6 0 2024-04-26T11:24:01.722 INFO:tasks.workunit.client.0.smithi073.stdout:8/515: write d1/d21/f29 [3900340,18056] 0 2024-04-26T11:24:01.722 INFO:tasks.workunit.client.0.smithi073.stdout:6/427: chown d0/d15/d2d/l68 2081 1 2024-04-26T11:24:01.725 INFO:tasks.workunit.client.0.smithi073.stdout:2/466: dwrite dd/de/d38/d53/f74 [0,4194304] 0 2024-04-26T11:24:01.725 INFO:tasks.workunit.client.0.smithi073.stdout:7/510: rename d1/l4e to d1/d11/d24/d26/d3d/d41/d64/lb5 0 2024-04-26T11:24:01.726 INFO:tasks.workunit.client.0.smithi073.stdout:5/463: dwrite d4/d8/d9/d42/f9c [4194304,4194304] 0 2024-04-26T11:24:01.727 INFO:tasks.workunit.client.0.smithi073.stdout:9/513: creat d0/d13/d25/d75/d98/fb4 x:0 0 0 2024-04-26T11:24:01.728 INFO:tasks.workunit.client.0.smithi073.stdout:1/584: dwrite d1/d73/d53/f59 [0,4194304] 0 2024-04-26T11:24:01.729 INFO:tasks.workunit.client.0.smithi073.stdout:0/445: dread d2/f31 [0,4194304] 0 2024-04-26T11:24:01.730 INFO:tasks.workunit.client.0.smithi073.stdout:0/446: write d2/f17 [451958,28042] 0 2024-04-26T11:24:01.730 INFO:tasks.workunit.client.0.smithi073.stdout:0/447: chown d2/d37/d8b 4 1 2024-04-26T11:24:01.731 INFO:tasks.workunit.client.0.smithi073.stdout:8/516: link d1/d21/d50/l23 d1/d4/d7b/lb1 0 2024-04-26T11:24:01.733 INFO:tasks.workunit.client.0.smithi073.stdout:2/467: rmdir dd/de/d6b 39 2024-04-26T11:24:01.733 INFO:tasks.workunit.client.0.smithi073.stdout:6/428: dwrite d0/d19/d20/f22 [0,4194304] 0 2024-04-26T11:24:01.733 INFO:tasks.workunit.client.0.smithi073.stdout:9/514: symlink d0/d13/lb5 0 2024-04-26T11:24:01.734 INFO:tasks.workunit.client.0.smithi073.stdout:2/468: chown dd 787302544 1 2024-04-26T11:24:01.736 INFO:tasks.workunit.client.0.smithi073.stdout:7/511: dwrite d1/d11/d24/d26/d3d/f7e [0,4194304] 0 2024-04-26T11:24:01.742 INFO:tasks.workunit.client.0.smithi073.stdout:5/464: truncate d4/d8/d9/f21 3229462 0 2024-04-26T11:24:01.742 INFO:tasks.workunit.client.0.smithi073.stdout:0/448: mkdir d2/d1f/d9c 0 2024-04-26T11:24:01.743 INFO:tasks.workunit.client.0.smithi073.stdout:7/512: creat d1/d11/d24/d71/d90/fb6 x:0 0 0 2024-04-26T11:24:01.743 INFO:tasks.workunit.client.0.smithi073.stdout:8/517: fdatasync d1/d4/d4c/d66/f78 0 2024-04-26T11:24:01.743 INFO:tasks.workunit.client.0.smithi073.stdout:5/465: dread - d4/d8/d9/d42/d68/f71 zero size 2024-04-26T11:24:01.744 INFO:tasks.workunit.client.0.smithi073.stdout:0/449: getdents d2/d1f/d9c 0 2024-04-26T11:24:01.744 INFO:tasks.workunit.client.0.smithi073.stdout:7/513: symlink d1/d11/d24/d29/lb7 0 2024-04-26T11:24:01.745 INFO:tasks.workunit.client.0.smithi073.stdout:2/469: read dd/d1c/d1d/f35 [93797,85419] 0 2024-04-26T11:24:01.745 INFO:tasks.workunit.client.0.smithi073.stdout:7/514: symlink d1/d33/d1b/d66/d50/lb8 0 2024-04-26T11:24:01.746 INFO:tasks.workunit.client.0.smithi073.stdout:2/470: chown dd/de/d38/c6c 117 1 2024-04-26T11:24:01.746 INFO:tasks.workunit.client.0.smithi073.stdout:8/518: rename d1/d4/d4c/l5c to d1/d21/lb2 0 2024-04-26T11:24:01.746 INFO:tasks.workunit.client.0.smithi073.stdout:7/515: mknod d1/d33/d1b/cb9 0 2024-04-26T11:24:01.746 INFO:tasks.workunit.client.0.smithi073.stdout:2/471: mknod dd/d4c/d48/d77/c8a 0 2024-04-26T11:24:01.747 INFO:tasks.workunit.client.0.smithi073.stdout:5/466: rename d4/de/d15/f19 to d4/d8/d8e/fab 0 2024-04-26T11:24:01.747 INFO:tasks.workunit.client.0.smithi073.stdout:7/516: unlink d1/d33/l18 0 2024-04-26T11:24:01.749 INFO:tasks.workunit.client.0.smithi073.stdout:5/467: fdatasync d4/f1f 0 2024-04-26T11:24:01.749 INFO:tasks.workunit.client.0.smithi073.stdout:8/519: truncate d1/d4/d37/f48 3621192 0 2024-04-26T11:24:01.749 INFO:tasks.workunit.client.0.smithi073.stdout:2/472: truncate dd/d1c/d1d/f73 79394 0 2024-04-26T11:24:01.749 INFO:tasks.workunit.client.0.smithi073.stdout:7/517: write d1/d11/d24/d26/d3d/d41/d64/fa6 [818711,90887] 0 2024-04-26T11:24:01.749 INFO:tasks.workunit.client.0.smithi073.stdout:2/473: truncate f9 585289 0 2024-04-26T11:24:01.749 INFO:tasks.workunit.client.0.smithi073.stdout:5/468: getdents d4/de/d15/d60 0 2024-04-26T11:24:01.749 INFO:tasks.workunit.client.0.smithi073.stdout:8/520: getdents d1/d21/d50/d67/d81/da5 0 2024-04-26T11:24:01.750 INFO:tasks.workunit.client.0.smithi073.stdout:5/469: dread - d4/d8/d9/d42/d68/f71 zero size 2024-04-26T11:24:01.750 INFO:tasks.workunit.client.0.smithi073.stdout:2/474: link dd/de/d38/c3a dd/d4c/d48/c8b 0 2024-04-26T11:24:01.750 INFO:tasks.workunit.client.0.smithi073.stdout:5/470: rename d4/d8/d8e/l75 to d4/de/d15/d67/lac 0 2024-04-26T11:24:01.750 INFO:tasks.workunit.client.0.smithi073.stdout:2/475: mkdir dd/d1c/d1d/d8c 0 2024-04-26T11:24:01.751 INFO:tasks.workunit.client.0.smithi073.stdout:5/471: fsync d4/de/d23/d4f/f59 0 2024-04-26T11:24:01.752 INFO:tasks.workunit.client.0.smithi073.stdout:5/472: creat d4/de/d15/d67/fad x:0 0 0 2024-04-26T11:24:01.752 INFO:tasks.workunit.client.0.smithi073.stdout:2/476: creat dd/de/d38/d4e/f8d x:0 0 0 2024-04-26T11:24:01.755 INFO:tasks.workunit.client.0.smithi073.stdout:8/521: rmdir d1/d21/d50 39 2024-04-26T11:24:01.756 INFO:tasks.workunit.client.0.smithi073.stdout:1/585: truncate d1/d73/d40/f3a 272819 0 2024-04-26T11:24:01.756 INFO:tasks.workunit.client.0.smithi073.stdout:9/515: truncate d0/d6c/f90 2976522 0 2024-04-26T11:24:01.757 INFO:tasks.workunit.client.0.smithi073.stdout:1/586: symlink d1/d73/d40/d54/ld1 0 2024-04-26T11:24:01.758 INFO:tasks.workunit.client.0.smithi073.stdout:2/477: read dd/d4c/d48/d46/f82 [67052,35423] 0 2024-04-26T11:24:01.758 INFO:tasks.workunit.client.0.smithi073.stdout:9/516: truncate d0/f8 283975 0 2024-04-26T11:24:01.758 INFO:tasks.workunit.client.0.smithi073.stdout:2/478: chown dd/d1c/f6f 737 1 2024-04-26T11:24:01.759 INFO:tasks.workunit.client.0.smithi073.stdout:5/473: getdents d4/d8/d8e 0 2024-04-26T11:24:01.763 INFO:tasks.workunit.client.0.smithi073.stdout:2/479: stat dd/de/d29/f58 0 2024-04-26T11:24:01.763 INFO:tasks.workunit.client.0.smithi073.stdout:9/517: read - d0/d1a/f74 zero size 2024-04-26T11:24:01.763 INFO:tasks.workunit.client.0.smithi073.stdout:5/474: stat d4/de/d15/d33/c8b 0 2024-04-26T11:24:01.763 INFO:tasks.workunit.client.0.smithi073.stdout:3/472: dread d0/d11/d19/f6 [0,4194304] 0 2024-04-26T11:24:01.763 INFO:tasks.workunit.client.0.smithi073.stdout:3/473: dread - d0/f61 zero size 2024-04-26T11:24:01.764 INFO:tasks.workunit.client.0.smithi073.stdout:5/475: symlink d4/de/d23/d4f/lae 0 2024-04-26T11:24:01.764 INFO:tasks.workunit.client.0.smithi073.stdout:0/450: dread d2/d22/f35 [0,4194304] 0 2024-04-26T11:24:01.764 INFO:tasks.workunit.client.0.smithi073.stdout:9/518: getdents d0/d13/d25/d9c 0 2024-04-26T11:24:01.764 INFO:tasks.workunit.client.0.smithi073.stdout:3/474: creat d0/d11/d23/fa7 x:0 0 0 2024-04-26T11:24:01.764 INFO:tasks.workunit.client.0.smithi073.stdout:5/476: mknod d4/de/d15/d60/caf 0 2024-04-26T11:24:01.764 INFO:tasks.workunit.client.0.smithi073.stdout:4/519: dread d8/d1a/d1b/d1d/f6a [0,4194304] 0 2024-04-26T11:24:01.764 INFO:tasks.workunit.client.0.smithi073.stdout:0/451: mkdir d2/d1f/d9d 0 2024-04-26T11:24:01.764 INFO:tasks.workunit.client.0.smithi073.stdout:3/475: stat d0/d11/d19/fa0 0 2024-04-26T11:24:01.764 INFO:tasks.workunit.client.0.smithi073.stdout:9/519: symlink d0/d1a/d4e/lb6 0 2024-04-26T11:24:01.764 INFO:tasks.workunit.client.0.smithi073.stdout:8/522: dread d1/d21/d50/d67/fa6 [0,4194304] 0 2024-04-26T11:24:01.764 INFO:tasks.workunit.client.0.smithi073.stdout:5/477: mknod d4/d73/cb0 0 2024-04-26T11:24:01.765 INFO:tasks.workunit.client.0.smithi073.stdout:9/520: mknod d0/d13/db/cb7 0 2024-04-26T11:24:01.765 INFO:tasks.workunit.client.0.smithi073.stdout:4/520: truncate d8/d1a/d86/f98 789086 0 2024-04-26T11:24:01.766 INFO:tasks.workunit.client.0.smithi073.stdout:2/480: dread dd/d4c/d48/d46/f84 [0,4194304] 0 2024-04-26T11:24:01.766 INFO:tasks.workunit.client.0.smithi073.stdout:0/452: rename d2/d22/d51/c91 to d2/d22/d51/d57/d78/c9e 0 2024-04-26T11:24:01.766 INFO:tasks.workunit.client.0.smithi073.stdout:5/478: creat d4/d73/d8a/da0/fb1 x:0 0 0 2024-04-26T11:24:01.766 INFO:tasks.workunit.client.0.smithi073.stdout:3/476: link d0/d26/f2a d0/d11/d19/db/fa8 0 2024-04-26T11:24:01.766 INFO:tasks.workunit.client.0.smithi073.stdout:0/453: chown d2/d22/d51/d57/d78 96806 1 2024-04-26T11:24:01.766 INFO:tasks.workunit.client.0.smithi073.stdout:2/481: write dd/d1c/d1d/f36 [2187936,130204] 0 2024-04-26T11:24:01.766 INFO:tasks.workunit.client.0.smithi073.stdout:5/479: unlink d4/de/d15/l51 0 2024-04-26T11:24:01.766 INFO:tasks.workunit.client.0.smithi073.stdout:3/477: symlink d0/d11/d19/d70/la9 0 2024-04-26T11:24:01.766 INFO:tasks.workunit.client.0.smithi073.stdout:4/521: getdents d8 0 2024-04-26T11:24:01.767 INFO:tasks.workunit.client.0.smithi073.stdout:3/478: chown d0/d11/d19/d1d/f4c 3804 1 2024-04-26T11:24:01.767 INFO:tasks.workunit.client.0.smithi073.stdout:2/482: write dd/de/d38/f75 [196387,93522] 0 2024-04-26T11:24:01.767 INFO:tasks.workunit.client.0.smithi073.stdout:3/479: readlink d0/lf 0 2024-04-26T11:24:01.767 INFO:tasks.workunit.client.0.smithi073.stdout:4/522: unlink d8/d1a/d1b/d46/d57/db1/fb4 0 2024-04-26T11:24:01.768 INFO:tasks.workunit.client.0.smithi073.stdout:4/523: chown d8/d1a/d1b/d1d 3067656 1 2024-04-26T11:24:01.768 INFO:tasks.workunit.client.0.smithi073.stdout:5/480: symlink d4/d8/d9/d7d/da3/lb2 0 2024-04-26T11:24:01.768 INFO:tasks.workunit.client.0.smithi073.stdout:3/480: mkdir d0/d11/d19/d70/daa 0 2024-04-26T11:24:01.768 INFO:tasks.workunit.client.0.smithi073.stdout:2/483: symlink dd/de/l8e 0 2024-04-26T11:24:01.769 INFO:tasks.workunit.client.0.smithi073.stdout:0/454: link d2/d37/f79 d2/d1f/d40/d48/d62/f9f 0 2024-04-26T11:24:01.769 INFO:tasks.workunit.client.0.smithi073.stdout:5/481: creat d4/d8/d9/d42/fb3 x:0 0 0 2024-04-26T11:24:01.769 INFO:tasks.workunit.client.0.smithi073.stdout:2/484: mknod dd/de/d49/c8f 0 2024-04-26T11:24:01.770 INFO:tasks.workunit.client.0.smithi073.stdout:4/524: mkdir d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/dc2/dc3 0 2024-04-26T11:24:01.770 INFO:tasks.workunit.client.0.smithi073.stdout:2/485: write dd/d4c/d48/f3c [1624072,86408] 0 2024-04-26T11:24:01.770 INFO:tasks.workunit.client.0.smithi073.stdout:4/525: chown f5 0 1 2024-04-26T11:24:01.770 INFO:tasks.workunit.client.0.smithi073.stdout:0/455: link d2/f13 d2/d1f/d9c/fa0 0 2024-04-26T11:24:01.771 INFO:tasks.workunit.client.0.smithi073.stdout:5/482: creat d4/d8/d9/d7d/fb4 x:0 0 0 2024-04-26T11:24:01.771 INFO:tasks.workunit.client.0.smithi073.stdout:0/456: mknod d2/d37/d3c/ca1 0 2024-04-26T11:24:01.771 INFO:tasks.workunit.client.0.smithi073.stdout:5/483: creat d4/d8/fb5 x:0 0 0 2024-04-26T11:24:01.772 INFO:tasks.workunit.client.0.smithi073.stdout:4/526: link d8/d1a/d5e/d7c/f7f d8/d1a/d1b/d24/dac/d49/d84/fc4 0 2024-04-26T11:24:01.772 INFO:tasks.workunit.client.0.smithi073.stdout:0/457: symlink d2/d22/d51/d57/la2 0 2024-04-26T11:24:01.772 INFO:tasks.workunit.client.0.smithi073.stdout:5/484: write d4/de/d23/f36 [2136504,68946] 0 2024-04-26T11:24:01.773 INFO:tasks.workunit.client.0.smithi073.stdout:3/481: dread d0/d11/d23/d3b/f7f [0,4194304] 0 2024-04-26T11:24:01.773 INFO:tasks.workunit.client.0.smithi073.stdout:8/523: chown d1/d4/d37/f48 24738855 1 2024-04-26T11:24:01.773 INFO:tasks.workunit.client.0.smithi073.stdout:9/521: rmdir d0 39 2024-04-26T11:24:01.774 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:01.768+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:01.775 INFO:tasks.workunit.client.0.smithi073.stdout:0/458: fsync d2/d37/d3c/f61 0 2024-04-26T11:24:01.775 INFO:tasks.workunit.client.0.smithi073.stdout:5/485: truncate d4/d8/f81 973136 0 2024-04-26T11:24:01.775 INFO:tasks.workunit.client.0.smithi073.stdout:8/524: fdatasync d1/d21/d50/d67/d81/f88 0 2024-04-26T11:24:01.775 INFO:tasks.workunit.client.0.smithi073.stdout:4/527: dread - d8/d1a/d1b/d46/d57/d37/f70 zero size 2024-04-26T11:24:01.775 INFO:tasks.workunit.client.0.smithi073.stdout:3/482: write d0/d11/d23/d3b/f46 [2786689,129517] 0 2024-04-26T11:24:01.775 INFO:tasks.workunit.client.0.smithi073.stdout:5/486: creat d4/d8/d8e/fb6 x:0 0 0 2024-04-26T11:24:01.776 INFO:tasks.workunit.client.0.smithi073.stdout:8/525: write d1/d4/d4c/fa7 [762340,73996] 0 2024-04-26T11:24:01.777 INFO:tasks.workunit.client.0.smithi073.stdout:3/483: mkdir d0/d11/d19/db/d3e/d3f/d69/dab 0 2024-04-26T11:24:01.777 INFO:tasks.workunit.client.0.smithi073.stdout:0/459: truncate d2/d37/d3c/d73/f90 161788 0 2024-04-26T11:24:01.777 INFO:tasks.workunit.client.0.smithi073.stdout:2/486: dwrite f0 [0,4194304] 0 2024-04-26T11:24:01.777 INFO:tasks.workunit.client.0.smithi073.stdout:5/487: mkdir d4/d8/d9/d7d/d84/da7/db7 0 2024-04-26T11:24:01.777 INFO:tasks.workunit.client.0.smithi073.stdout:0/460: stat d2/ff 0 2024-04-26T11:24:01.778 INFO:tasks.workunit.client.0.smithi073.stdout:5/488: write d4/de/d15/d33/f4e [219793,130443] 0 2024-04-26T11:24:01.780 INFO:tasks.workunit.client.0.smithi073.stdout:4/528: fsync d8/d1a/d1b/d24/dac/d49/d84/fc4 0 2024-04-26T11:24:01.782 INFO:tasks.workunit.client.0.smithi073.stdout:2/487: rename f9 to dd/d4c/d48/f90 0 2024-04-26T11:24:01.782 INFO:tasks.workunit.client.0.smithi073.stdout:4/529: rename d8/d1a/d1b/d46/d7e to d8/d1a/d5e/dc5 0 2024-04-26T11:24:01.783 INFO:tasks.workunit.client.0.smithi073.stdout:2/488: mkdir dd/d4c/d48/d46/d91 0 2024-04-26T11:24:01.783 INFO:tasks.workunit.client.0.smithi073.stdout:8/526: dwrite d1/d4/d15/f4d [0,4194304] 0 2024-04-26T11:24:01.783 INFO:tasks.workunit.client.0.smithi073.stdout:4/530: creat d8/d1a/d5e/dc5/fc6 x:0 0 0 2024-04-26T11:24:01.785 INFO:tasks.workunit.client.0.smithi073.stdout:8/527: mknod d1/d4/d7b/cb3 0 2024-04-26T11:24:01.786 INFO:tasks.workunit.client.0.smithi073.stdout:5/489: dwrite d4/de/d23/f44 [0,4194304] 0 2024-04-26T11:24:01.789 INFO:tasks.workunit.client.0.smithi073.stdout:2/489: dwrite dd/d1c/d1d/f81 [0,4194304] 0 2024-04-26T11:24:01.789 INFO:tasks.workunit.client.0.smithi073.stdout:5/490: rename d4/d8/c43 to d4/d8/d9/d7d/d84/da7/cb8 0 2024-04-26T11:24:01.790 INFO:tasks.workunit.client.0.smithi073.stdout:2/490: stat dd/d4c/d48/d46/d91 0 2024-04-26T11:24:01.790 INFO:tasks.workunit.client.0.smithi073.stdout:4/531: dwrite d8/d1a/d9c/d9d/fae [0,4194304] 0 2024-04-26T11:24:01.790 INFO:tasks.workunit.client.0.smithi073.stdout:5/491: mknod d4/de/d15/d33/cb9 0 2024-04-26T11:24:01.792 INFO:tasks.workunit.client.0.smithi073.stdout:5/492: creat d4/d8/d9/d7d/da3/fba x:0 0 0 2024-04-26T11:24:01.792 INFO:tasks.workunit.client.0.smithi073.stdout:4/532: symlink d8/d1a/d1b/d46/d57/d37/lc7 0 2024-04-26T11:24:01.792 INFO:tasks.workunit.client.0.smithi073.stdout:6/429: sync 2024-04-26T11:24:01.792 INFO:tasks.workunit.client.0.smithi073.stdout:5/493: stat d4/de/d23/d3b/l79 0 2024-04-26T11:24:01.793 INFO:tasks.workunit.client.0.smithi073.stdout:6/430: chown d0/dc/d2e/c2f 1 1 2024-04-26T11:24:01.793 INFO:tasks.workunit.client.0.smithi073.stdout:4/533: mknod d8/d1a/d1b/d41/cc8 0 2024-04-26T11:24:01.793 INFO:tasks.workunit.client.0.smithi073.stdout:5/494: truncate d4/f7a 603271 0 2024-04-26T11:24:01.793 INFO:tasks.workunit.client.0.smithi073.stdout:4/534: chown d8/l87 220380214 1 2024-04-26T11:24:01.794 INFO:tasks.workunit.client.0.smithi073.stdout:4/535: dread d8/d1a/d5e/d7c/f82 [0,4194304] 0 2024-04-26T11:24:01.794 INFO:tasks.workunit.client.0.smithi073.stdout:3/484: write d0/d11/d19/d1d/f50 [1609285,18680] 0 2024-04-26T11:24:01.798 INFO:tasks.workunit.client.0.smithi073.stdout:8/528: read d1/d4/d15/f1f [6019535,43921] 0 2024-04-26T11:24:01.799 INFO:tasks.workunit.client.0.smithi073.stdout:8/529: fdatasync d1/d21/f29 0 2024-04-26T11:24:01.800 INFO:tasks.workunit.client.0.smithi073.stdout:8/530: stat d1/d4/d15/f4d 0 2024-04-26T11:24:01.801 INFO:tasks.workunit.client.0.smithi073.stdout:4/536: dwrite f7 [4194304,4194304] 0 2024-04-26T11:24:01.801 INFO:tasks.workunit.client.0.smithi073.stdout:5/495: dwrite d4/d8/f30 [0,4194304] 0 2024-04-26T11:24:01.802 INFO:tasks.workunit.client.0.smithi073.stdout:3/485: dwrite d0/d11/d19/d1d/f4c [0,4194304] 0 2024-04-26T11:24:01.804 INFO:tasks.workunit.client.0.smithi073.stdout:6/431: read d0/d1a/d26/d4b/d2b/f3e [1806154,99293] 0 2024-04-26T11:24:01.804 INFO:tasks.workunit.client.0.smithi073.stdout:6/432: stat d0/d15/d2d/f33 0 2024-04-26T11:24:01.805 INFO:tasks.workunit.client.0.smithi073.stdout:8/531: rename d1/d4/d37/c46 to d1/d4/d4c/cb4 0 2024-04-26T11:24:01.805 INFO:tasks.workunit.client.0.smithi073.stdout:5/496: write d4/de/d23/f9a [2895436,73671] 0 2024-04-26T11:24:01.805 INFO:tasks.workunit.client.0.smithi073.stdout:6/433: symlink d0/dc/d80/l81 0 2024-04-26T11:24:01.805 INFO:tasks.workunit.client.0.smithi073.stdout:8/532: dread - d1/d21/d50/d67/d81/f88 zero size 2024-04-26T11:24:01.805 INFO:tasks.workunit.client.0.smithi073.stdout:5/497: fdatasync d4/d8/d9/d7d/da3/fba 0 2024-04-26T11:24:01.806 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:24:01.807 INFO:tasks.workunit.client.0.smithi073.stdout:6/434: mknod d0/d1a/d7a/c82 0 2024-04-26T11:24:01.807 INFO:tasks.workunit.client.0.smithi073.stdout:8/533: creat d1/d4/fb5 x:0 0 0 2024-04-26T11:24:01.807 INFO:tasks.workunit.client.0.smithi073.stdout:5/498: write d4/d8/d9/fa1 [457088,69917] 0 2024-04-26T11:24:01.807 INFO:tasks.workunit.client.0.smithi073.stdout:3/486: dread d0/d11/f6c [0,4194304] 0 2024-04-26T11:24:01.807 INFO:tasks.workunit.client.0.smithi073.stdout:6/435: creat d0/dc/d80/f83 x:0 0 0 2024-04-26T11:24:01.809 INFO:tasks.workunit.client.0.smithi073.stdout:5/499: write d4/de/d15/d33/f48 [395160,57849] 0 2024-04-26T11:24:01.809 INFO:tasks.workunit.client.0.smithi073.stdout:5/500: dread - d4/de/d23/d4f/f59 zero size 2024-04-26T11:24:01.809 INFO:tasks.workunit.client.0.smithi073.stdout:5/501: readlink d4/d8/d9/d42/d68/laa 0 2024-04-26T11:24:01.810 INFO:tasks.workunit.client.0.smithi073.stdout:6/436: mkdir d0/d1a/d26/d4b/d49/d84 0 2024-04-26T11:24:01.810 INFO:tasks.workunit.client.0.smithi073.stdout:8/534: creat d1/d4/d4c/fb6 x:0 0 0 2024-04-26T11:24:01.811 INFO:tasks.workunit.client.0.smithi073.stdout:5/502: creat d4/de/d23/d4f/fbb x:0 0 0 2024-04-26T11:24:01.811 INFO:tasks.workunit.client.0.smithi073.stdout:4/537: dwrite d8/d1a/d5e/d7c/f82 [0,4194304] 0 2024-04-26T11:24:01.811 INFO:tasks.workunit.client.0.smithi073.stdout:9/522: dread d0/d1a/d2f/f41 [0,4194304] 0 2024-04-26T11:24:01.812 INFO:tasks.workunit.client.0.smithi073.stdout:6/437: write d0/d1a/d26/d4b/d2b/d2c/f3b [1286544,73841] 0 2024-04-26T11:24:01.813 INFO:tasks.workunit.client.0.smithi073.stdout:9/523: chown d0/d13/d5a/d65/f77 536149388 1 2024-04-26T11:24:01.814 INFO:tasks.workunit.client.0.smithi073.stdout:5/503: creat d4/d8/d9/d42/fbc x:0 0 0 2024-04-26T11:24:01.814 INFO:tasks.workunit.client.0.smithi073.stdout:2/491: sync 2024-04-26T11:24:01.814 INFO:tasks.workunit.client.0.smithi073.stdout:1/587: sync 2024-04-26T11:24:01.814 INFO:tasks.workunit.client.0.smithi073.stdout:7/518: sync 2024-04-26T11:24:01.815 INFO:tasks.workunit.client.0.smithi073.stdout:0/461: sync 2024-04-26T11:24:01.815 INFO:tasks.workunit.client.0.smithi073.stdout:5/504: stat d4/d8/c7b 0 2024-04-26T11:24:01.820 INFO:tasks.workunit.client.0.smithi073.stdout:5/505: creat d4/d8/d9/d7d/d84/fbd x:0 0 0 2024-04-26T11:24:01.822 INFO:tasks.workunit.client.0.smithi073.stdout:7/519: dwrite d1/d11/fb4 [0,4194304] 0 2024-04-26T11:24:01.822 INFO:tasks.workunit.client.0.smithi073.stdout:5/506: mkdir d4/dbe 0 2024-04-26T11:24:01.823 INFO:tasks.workunit.client.0.smithi073.stdout:7/520: stat d1/d11 0 2024-04-26T11:24:01.824 INFO:tasks.workunit.client.0.smithi073.stdout:4/538: dwrite d8/d1a/d1b/d1d/f21 [0,4194304] 0 2024-04-26T11:24:01.825 INFO:tasks.workunit.client.0.smithi073.stdout:7/521: chown d1/d11/d24/d29/c8e 7502 1 2024-04-26T11:24:01.825 INFO:tasks.workunit.client.0.smithi073.stdout:4/539: fsync d8/d1f/f5f 0 2024-04-26T11:24:01.826 INFO:tasks.workunit.client.0.smithi073.stdout:4/540: fsync f7 0 2024-04-26T11:24:01.827 INFO:tasks.workunit.client.0.smithi073.stdout:9/524: dwrite d0/d1a/d4e/d70/f76 [0,4194304] 0 2024-04-26T11:24:01.828 INFO:tasks.workunit.client.0.smithi073.stdout:2/492: dwrite dd/d1c/f43 [0,4194304] 0 2024-04-26T11:24:01.828 INFO:tasks.workunit.client.0.smithi073.stdout:6/438: truncate d0/d15/f14 819727 0 2024-04-26T11:24:01.828 INFO:tasks.workunit.client.0.smithi073.stdout:4/541: unlink d8/d1a/d1b/d24/dac/fbb 0 2024-04-26T11:24:01.829 INFO:tasks.workunit.client.0.smithi073.stdout:6/439: rmdir d0/d15/d2d 39 2024-04-26T11:24:01.830 INFO:tasks.workunit.client.0.smithi073.stdout:8/535: read d1/d4/f74 [4164771,12064] 0 2024-04-26T11:24:01.830 INFO:tasks.workunit.client.0.smithi073.stdout:5/507: link d4/de/d15/d67/l9b d4/de/d23/lbf 0 2024-04-26T11:24:01.830 INFO:tasks.workunit.client.0.smithi073.stdout:9/525: getdents d0/d1a 0 2024-04-26T11:24:01.832 INFO:tasks.workunit.client.0.smithi073.stdout:4/542: symlink d8/d1a/d1b/d24/dac/d72/d77/lc9 0 2024-04-26T11:24:01.833 INFO:tasks.workunit.client.0.smithi073.stdout:8/536: mkdir d1/d4/d15/db7 0 2024-04-26T11:24:01.835 INFO:tasks.workunit.client.0.smithi073.stdout:7/522: dwrite d1/d11/fd [0,4194304] 0 2024-04-26T11:24:01.835 INFO:tasks.workunit.client.0.smithi073.stdout:0/462: dread d2/d22/d51/d57/f5e [0,4194304] 0 2024-04-26T11:24:01.837 INFO:tasks.workunit.client.0.smithi073.stdout:6/440: dread d0/d1a/d4e/f51 [0,4194304] 0 2024-04-26T11:24:01.838 INFO:tasks.workunit.client.0.smithi073.stdout:4/543: write d8/d1a/d1b/d1d/f6a [3734726,112494] 0 2024-04-26T11:24:01.838 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:01.839 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:01.839 INFO:tasks.workunit.client.0.smithi073.stdout:9/526: rename d0/d1a/d4e/d70/d51/c52 to d0/d13/d5a/db2/cb8 0 2024-04-26T11:24:01.839 INFO:tasks.workunit.client.0.smithi073.stdout:6/441: fdatasync d0/d1a/d26/f54 0 2024-04-26T11:24:01.839 INFO:tasks.workunit.client.0.smithi073.stdout:0/463: creat d2/d22/d51/d57/d78/fa3 x:0 0 0 2024-04-26T11:24:01.841 INFO:tasks.workunit.client.0.smithi073.stdout:5/508: dwrite d4/d8/d9/d7d/d84/f78 [0,4194304] 0 2024-04-26T11:24:01.841 INFO:tasks.workunit.client.0.smithi073.stdout:2/493: dwrite dd/d1c/d1d/f36 [0,4194304] 0 2024-04-26T11:24:01.842 INFO:tasks.workunit.client.0.smithi073.stdout:4/544: creat d8/d1a/d1b/d24/dac/d72/fca x:0 0 0 2024-04-26T11:24:01.842 INFO:tasks.workunit.client.0.smithi073.stdout:5/509: write d4/de/d23/f44 [3862084,63039] 0 2024-04-26T11:24:01.842 INFO:tasks.workunit.client.0.smithi073.stdout:9/527: rmdir d0/d1a/d4e/d70/d46 39 2024-04-26T11:24:01.844 INFO:tasks.workunit.client.0.smithi073.stdout:2/494: fdatasync dd/d4c/d48/d46/f88 0 2024-04-26T11:24:01.844 INFO:tasks.workunit.client.0.smithi073.stdout:1/588: sync 2024-04-26T11:24:01.845 INFO:tasks.workunit.client.0.smithi073.stdout:4/545: write d8/d1a/d1b/f26 [1870385,21084] 0 2024-04-26T11:24:01.845 INFO:tasks.workunit.client.0.smithi073.stdout:3/487: dread d0/d11/d19/fc [0,4194304] 0 2024-04-26T11:24:01.845 INFO:tasks.workunit.client.0.smithi073.stdout:8/537: dwrite d1/d21/d50/f2e [0,4194304] 0 2024-04-26T11:24:01.847 INFO:tasks.workunit.client.0.smithi073.stdout:8/538: truncate d1/f87 616365 0 2024-04-26T11:24:01.848 INFO:tasks.workunit.client.0.smithi073.stdout:0/464: dwrite d2/f11 [8388608,4194304] 0 2024-04-26T11:24:01.848 INFO:tasks.workunit.client.0.smithi073.stdout:0/465: fsync d2/d22/d51/d57/f5c 0 2024-04-26T11:24:01.849 INFO:tasks.workunit.client.0.smithi073.stdout:6/442: dread d0/d1a/d26/d4b/f7d [0,4194304] 0 2024-04-26T11:24:01.849 INFO:tasks.workunit.client.0.smithi073.stdout:9/528: mkdir d0/d13/d25/d75/d8e/db9 0 2024-04-26T11:24:01.849 INFO:tasks.workunit.client.0.smithi073.stdout:5/510: mknod d4/d8/d8e/cc0 0 2024-04-26T11:24:01.851 INFO:tasks.workunit.client.0.smithi073.stdout:2/495: symlink dd/d27/l92 0 2024-04-26T11:24:01.851 INFO:tasks.workunit.client.0.smithi073.stdout:1/589: mkdir d1/d16/d4f/d55/d5a/dc6/dd2 0 2024-04-26T11:24:01.851 INFO:tasks.workunit.client.0.smithi073.stdout:1/590: chown d1/d73/d40/f28 42261 1 2024-04-26T11:24:01.851 INFO:tasks.workunit.client.0.smithi073.stdout:4/546: dread f7 [4194304,4194304] 0 2024-04-26T11:24:01.854 INFO:tasks.workunit.client.0.smithi073.stdout:5/511: symlink d4/d8/d9/d42/lc1 0 2024-04-26T11:24:01.855 INFO:tasks.workunit.client.0.smithi073.stdout:8/539: dwrite d1/d4/d4c/d66/f78 [0,4194304] 0 2024-04-26T11:24:01.855 INFO:tasks.workunit.client.0.smithi073.stdout:1/591: creat d1/d8/d2e/d3c/fd3 x:0 0 0 2024-04-26T11:24:01.855 INFO:tasks.workunit.client.0.smithi073.stdout:4/547: symlink d8/d1a/d1b/d24/lcb 0 2024-04-26T11:24:01.855 INFO:tasks.workunit.client.0.smithi073.stdout:0/466: chown d2/d22/f33 1452102 1 2024-04-26T11:24:01.856 INFO:tasks.workunit.client.0.smithi073.stdout:3/488: creat d0/fac x:0 0 0 2024-04-26T11:24:01.856 INFO:tasks.workunit.client.0.smithi073.stdout:6/443: dwrite d0/dc/f64 [0,4194304] 0 2024-04-26T11:24:01.857 INFO:tasks.workunit.client.0.smithi073.stdout:0/467: fdatasync d2/f53 0 2024-04-26T11:24:01.857 INFO:tasks.workunit.client.0.smithi073.stdout:1/592: mkdir d1/d73/d53/dd4 0 2024-04-26T11:24:01.857 INFO:tasks.workunit.client.0.smithi073.stdout:7/523: fsync f0 0 2024-04-26T11:24:01.857 INFO:tasks.workunit.client.0.smithi073.stdout:8/540: creat d1/d21/d50/d67/fb8 x:0 0 0 2024-04-26T11:24:01.859 INFO:tasks.workunit.client.0.smithi073.stdout:1/593: write d1/d73/f23 [490477,59086] 0 2024-04-26T11:24:01.859 INFO:tasks.workunit.client.0.smithi073.stdout:2/496: dwrite dd/de/f11 [0,4194304] 0 2024-04-26T11:24:01.859 INFO:tasks.workunit.client.0.smithi073.stdout:8/541: dread - d1/d21/d2a/fb0 zero size 2024-04-26T11:24:01.859 INFO:tasks.workunit.client.0.smithi073.stdout:3/489: chown d0/d11/d19/l9 211799 1 2024-04-26T11:24:01.859 INFO:tasks.workunit.client.0.smithi073.stdout:0/468: fsync d2/d37/d3c/f47 0 2024-04-26T11:24:01.859 INFO:tasks.workunit.client.0.smithi073.stdout:1/594: chown d1/d16/fb4 2 1 2024-04-26T11:24:01.861 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:01.861 INFO:tasks.workunit.client.0.smithi073.stdout:2/497: chown dd/de/d49/f79 16694202 1 2024-04-26T11:24:01.862 INFO:tasks.workunit.client.0.smithi073.stdout:0/469: creat d2/d1f/d9d/fa4 x:0 0 0 2024-04-26T11:24:01.862 INFO:tasks.workunit.client.0.smithi073.stdout:2/498: fsync dd/de/f71 0 2024-04-26T11:24:01.862 INFO:tasks.workunit.client.0.smithi073.stdout:2/499: stat dd/d27/l92 0 2024-04-26T11:24:01.864 INFO:tasks.workunit.client.0.smithi073.stdout:2/500: creat dd/de/d38/f93 x:0 0 0 2024-04-26T11:24:01.865 INFO:tasks.workunit.client.0.smithi073.stdout:2/501: creat dd/de/d2a/f94 x:0 0 0 2024-04-26T11:24:01.868 INFO:tasks.workunit.client.0.smithi073.stdout:1/595: truncate d1/d16/d61/f90 2025903 0 2024-04-26T11:24:01.868 INFO:tasks.workunit.client.0.smithi073.stdout:8/542: write d1/d21/d2a/f43 [1351007,87022] 0 2024-04-26T11:24:01.869 INFO:tasks.workunit.client.0.smithi073.stdout:3/490: truncate d0/d11/d19/d1d/f4c 1366392 0 2024-04-26T11:24:01.869 INFO:tasks.workunit.client.0.smithi073.stdout:8/543: chown d1/f6 296 1 2024-04-26T11:24:01.869 INFO:tasks.workunit.client.0.smithi073.stdout:0/470: dwrite d2/d22/f68 [0,4194304] 0 2024-04-26T11:24:01.869 INFO:tasks.workunit.client.0.smithi073.stdout:3/491: truncate d0/d11/f91 826397 0 2024-04-26T11:24:01.870 INFO:tasks.workunit.client.0.smithi073.stdout:3/492: write d0/fac [262797,112000] 0 2024-04-26T11:24:01.872 INFO:tasks.workunit.client.0.smithi073.stdout:1/596: rename d1/d73/d40/d44/d80 to d1/d16/d4f/dd5 0 2024-04-26T11:24:01.873 INFO:tasks.workunit.client.0.smithi073.stdout:1/597: creat d1/d6/d62/fd6 x:0 0 0 2024-04-26T11:24:01.874 INFO:tasks.workunit.client.0.smithi073.stdout:1/598: chown d1/d73/d53/f59 46581 1 2024-04-26T11:24:01.874 INFO:tasks.workunit.client.0.smithi073.stdout:1/599: dread - d1/d16/d4f/f9b zero size 2024-04-26T11:24:01.875 INFO:tasks.workunit.client.0.smithi073.stdout:1/600: fsync d1/d16/d4f/dd5/f93 0 2024-04-26T11:24:01.876 INFO:tasks.workunit.client.0.smithi073.stdout:0/471: dwrite d2/d37/d3c/f47 [0,4194304] 0 2024-04-26T11:24:01.876 INFO:tasks.workunit.client.0.smithi073.stdout:6/444: read d0/d1a/d26/d4b/d2b/f3d [2023936,62078] 0 2024-04-26T11:24:01.876 INFO:tasks.workunit.client.0.smithi073.stdout:0/472: write d2/f8a [305151,82781] 0 2024-04-26T11:24:01.877 INFO:tasks.workunit.client.0.smithi073.stdout:6/445: link d0/d19/f6f d0/d1a/d7a/f85 0 2024-04-26T11:24:01.877 INFO:tasks.workunit.client.0.smithi073.stdout:0/473: chown d2/l36 33937 1 2024-04-26T11:24:01.884 INFO:tasks.workunit.client.0.smithi073.stdout:0/474: dwrite d2/d5f/f7d [0,4194304] 0 2024-04-26T11:24:01.884 INFO:tasks.workunit.client.0.smithi073.stdout:6/446: dwrite d0/d19/f44 [0,4194304] 0 2024-04-26T11:24:01.887 INFO:tasks.workunit.client.0.smithi073.stdout:3/493: truncate d0/d11/d19/d1d/f4c 527907 0 2024-04-26T11:24:01.887 INFO:tasks.workunit.client.0.smithi073.stdout:0/475: creat d2/d1f/d40/d48/fa5 x:0 0 0 2024-04-26T11:24:01.887 INFO:tasks.workunit.client.0.smithi073.stdout:6/447: mkdir d0/d15/d2d/d86 0 2024-04-26T11:24:01.887 INFO:tasks.workunit.client.0.smithi073.stdout:0/476: write d2/d37/d3c/f4c [1413520,79968] 0 2024-04-26T11:24:01.888 INFO:tasks.workunit.client.0.smithi073.stdout:0/477: symlink d2/d1f/la6 0 2024-04-26T11:24:01.888 INFO:tasks.workunit.client.0.smithi073.stdout:6/448: truncate d0/d1a/d26/d27/f29 1874495 0 2024-04-26T11:24:01.889 INFO:tasks.workunit.client.0.smithi073.stdout:3/494: truncate d0/d11/d19/db/d3e/d3f/d69/d96/f9f 331748 0 2024-04-26T11:24:01.889 INFO:tasks.workunit.client.0.smithi073.stdout:6/449: stat d0/d1a/d7a/f85 0 2024-04-26T11:24:01.889 INFO:tasks.workunit.client.0.smithi073.stdout:0/478: mknod d2/d84/ca7 0 2024-04-26T11:24:01.891 INFO:tasks.workunit.client.0.smithi073.stdout:0/479: creat d2/d1f/fa8 x:0 0 0 2024-04-26T11:24:01.893 INFO:tasks.workunit.client.0.smithi073.stdout:0/480: mkdir d2/d1f/d40/d48/da9 0 2024-04-26T11:24:01.893 INFO:tasks.workunit.client.0.smithi073.stdout:9/529: dread d0/d13/d25/d2c/f33 [0,4194304] 0 2024-04-26T11:24:01.894 INFO:tasks.workunit.client.0.smithi073.stdout:1/601: write d1/d16/d4f/fac [2343460,12572] 0 2024-04-26T11:24:01.895 INFO:tasks.workunit.client.0.smithi073.stdout:0/481: write d2/d37/f6e [265876,71612] 0 2024-04-26T11:24:01.895 INFO:tasks.workunit.client.0.smithi073.stdout:9/530: write d0/d1a/d4e/d70/f76 [905257,61507] 0 2024-04-26T11:24:01.896 INFO:tasks.workunit.client.0.smithi073.stdout:1/602: symlink d1/d73/d40/d54/dbb/ld7 0 2024-04-26T11:24:01.896 INFO:tasks.workunit.client.0.smithi073.stdout:3/495: dwrite d0/d11/d19/db/d3e/d47/f4f [0,4194304] 0 2024-04-26T11:24:01.897 INFO:tasks.workunit.client.0.smithi073.stdout:9/531: readlink d0/d1a/d4e/lb6 0 2024-04-26T11:24:01.899 INFO:tasks.workunit.client.0.smithi073.stdout:6/450: dwrite d0/d1a/d4e/f51 [0,4194304] 0 2024-04-26T11:24:01.899 INFO:tasks.workunit.client.0.smithi073.stdout:1/603: mknod d1/d6/d7f/cd8 0 2024-04-26T11:24:01.901 INFO:tasks.workunit.client.0.smithi073.stdout:9/532: rmdir d0/d13/db 39 2024-04-26T11:24:01.901 INFO:tasks.workunit.client.0.smithi073.stdout:6/451: write d0/d19/f44 [2248111,9190] 0 2024-04-26T11:24:01.902 INFO:tasks.workunit.client.0.smithi073.stdout:7/524: dread d1/d33/d1b/f1e [0,4194304] 0 2024-04-26T11:24:01.902 INFO:tasks.workunit.client.0.smithi073.stdout:1/604: fdatasync d1/d16/d4f/dd5/fd0 0 2024-04-26T11:24:01.903 INFO:tasks.workunit.client.0.smithi073.stdout:6/452: read d0/dc/f64 [1679688,43133] 0 2024-04-26T11:24:01.904 INFO:tasks.workunit.client.0.smithi073.stdout:7/525: mkdir d1/d11/d24/d26/d3d/dba 0 2024-04-26T11:24:01.905 INFO:tasks.workunit.client.0.smithi073.stdout:0/482: dwrite d2/d37/d3c/d6a/f98 [0,4194304] 0 2024-04-26T11:24:01.905 INFO:tasks.workunit.client.0.smithi073.stdout:6/453: chown d0/d1a/d26/c5e 12237674 1 2024-04-26T11:24:01.905 INFO:tasks.workunit.client.0.smithi073.stdout:3/496: dwrite d0/d26/f8f [0,4194304] 0 2024-04-26T11:24:01.906 INFO:tasks.workunit.client.0.smithi073.stdout:9/533: dread - d0/d13/db/f85 zero size 2024-04-26T11:24:01.906 INFO:tasks.workunit.client.0.smithi073.stdout:3/497: stat d0/d11/d19/db/d3e/d3f/d69/dab 0 2024-04-26T11:24:01.908 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:01.906+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:01.910 INFO:tasks.workunit.client.0.smithi073.stdout:6/454: symlink d0/d1a/d26/d27/l87 0 2024-04-26T11:24:01.911 INFO:tasks.workunit.client.0.smithi073.stdout:3/498: creat d0/d11/d19/db/d3e/d3f/fad x:0 0 0 2024-04-26T11:24:01.911 INFO:tasks.workunit.client.0.smithi073.stdout:0/483: creat d2/d1f/faa x:0 0 0 2024-04-26T11:24:01.911 INFO:tasks.workunit.client.0.smithi073.stdout:3/499: creat d0/d11/d23/fae x:0 0 0 2024-04-26T11:24:01.912 INFO:tasks.workunit.client.0.smithi073.stdout:3/500: chown d0/d26/c24 327329309 1 2024-04-26T11:24:01.913 INFO:tasks.workunit.client.0.smithi073.stdout:6/455: creat d0/d1a/d26/d4b/d2b/d43/f88 x:0 0 0 2024-04-26T11:24:01.913 INFO:tasks.workunit.client.0.smithi073.stdout:0/484: mknod d2/cab 0 2024-04-26T11:24:01.913 INFO:tasks.workunit.client.0.smithi073.stdout:6/456: rmdir d0/d1a 39 2024-04-26T11:24:01.913 INFO:tasks.workunit.client.0.smithi073.stdout:0/485: creat d2/fac x:0 0 0 2024-04-26T11:24:01.914 INFO:tasks.workunit.client.0.smithi073.stdout:4/548: sync 2024-04-26T11:24:01.914 INFO:tasks.workunit.client.0.smithi073.stdout:1/605: sync 2024-04-26T11:24:01.914 INFO:tasks.workunit.client.0.smithi073.stdout:5/512: dread d4/d8/d9/d42/f9c [0,4194304] 0 2024-04-26T11:24:01.915 INFO:tasks.workunit.client.0.smithi073.stdout:7/526: truncate d1/d11/d24/d29/f94 2354509 0 2024-04-26T11:24:01.917 INFO:tasks.workunit.client.0.smithi073.stdout:0/486: rename d2/d22/d51/d57/la2 to d2/d1f/d9d/lad 0 2024-04-26T11:24:01.917 INFO:tasks.workunit.client.0.smithi073.stdout:7/527: chown d1/d11/d24/d26/d3d 31460 1 2024-04-26T11:24:01.917 INFO:tasks.workunit.client.0.smithi073.stdout:4/549: readlink d8/d1a/d1b/d46/d57/d37/lc7 0 2024-04-26T11:24:01.917 INFO:tasks.workunit.client.0.smithi073.stdout:0/487: creat d2/d1f/d9d/fae x:0 0 0 2024-04-26T11:24:01.917 INFO:tasks.workunit.client.0.smithi073.stdout:1/606: getdents d1/d6/d7f/d47/db7 0 2024-04-26T11:24:01.917 INFO:tasks.workunit.client.0.smithi073.stdout:7/528: creat d1/d33/d1b/d95/fbb x:0 0 0 2024-04-26T11:24:01.918 INFO:tasks.workunit.client.0.smithi073.stdout:1/607: chown d1/d73/d40/d54/dbb/ld7 2 1 2024-04-26T11:24:01.918 INFO:tasks.workunit.client.0.smithi073.stdout:7/529: rename d1/c38 to d1/d11/d51/cbc 0 2024-04-26T11:24:01.919 INFO:tasks.workunit.client.0.smithi073.stdout:5/513: symlink d4/d8/d9/d7d/d84/da7/db7/lc2 0 2024-04-26T11:24:01.919 INFO:tasks.workunit.client.0.smithi073.stdout:0/488: getdents d2/d22/d51 0 2024-04-26T11:24:01.920 INFO:tasks.workunit.client.0.smithi073.stdout:5/514: write d4/de/f2c [3253413,38514] 0 2024-04-26T11:24:01.920 INFO:tasks.workunit.client.0.smithi073.stdout:7/530: rename d1/d11/d24/d26/d3d/d7b/d8a to d1/d11/d51/dbd 0 2024-04-26T11:24:01.921 INFO:tasks.workunit.client.0.smithi073.stdout:9/534: write d0/d6c/f90 [3752395,87408] 0 2024-04-26T11:24:01.921 INFO:tasks.workunit.client.0.smithi073.stdout:1/608: dread d1/d73/d53/f59 [0,4194304] 0 2024-04-26T11:24:01.921 INFO:tasks.workunit.client.0.smithi073.stdout:3/501: truncate d0/d11/f91 510796 0 2024-04-26T11:24:01.922 INFO:tasks.workunit.client.0.smithi073.stdout:0/489: rename d2/d22/f2a to d2/d37/d8b/faf 0 2024-04-26T11:24:01.923 INFO:tasks.workunit.client.0.smithi073.stdout:9/535: symlink d0/d1a/d4e/d8f/lba 0 2024-04-26T11:24:01.925 INFO:tasks.workunit.client.0.smithi073.stdout:0/490: creat d2/d1f/d9c/fb0 x:0 0 0 2024-04-26T11:24:01.926 INFO:tasks.workunit.client.0.smithi073.stdout:5/515: dread d4/d8/d9/f46 [0,4194304] 0 2024-04-26T11:24:01.926 INFO:tasks.workunit.client.0.smithi073.stdout:6/457: dread d0/d1a/d26/d27/f29 [0,4194304] 0 2024-04-26T11:24:01.927 INFO:tasks.workunit.client.0.smithi073.stdout:0/491: mkdir d2/d1f/d9c/db1 0 2024-04-26T11:24:01.927 INFO:tasks.workunit.client.0.smithi073.stdout:9/536: fsync d0/d13/d25/d2c/fa4 0 2024-04-26T11:24:01.928 INFO:tasks.workunit.client.0.smithi073.stdout:5/516: fdatasync d4/d8/d9/d7d/d84/fbd 0 2024-04-26T11:24:01.929 INFO:tasks.workunit.client.0.smithi073.stdout:1/609: dread d1/d73/f1c [0,4194304] 0 2024-04-26T11:24:01.929 INFO:tasks.workunit.client.0.smithi073.stdout:2/502: sync 2024-04-26T11:24:01.929 INFO:tasks.workunit.client.0.smithi073.stdout:8/544: sync 2024-04-26T11:24:01.930 INFO:tasks.workunit.client.0.smithi073.stdout:0/492: write d2/d1f/d40/f5b [1105902,106570] 0 2024-04-26T11:24:01.931 INFO:tasks.workunit.client.0.smithi073.stdout:4/550: dwrite d8/d1a/d1b/d24/dac/d72/d77/f7a [0,4194304] 0 2024-04-26T11:24:01.931 INFO:tasks.workunit.client.0.smithi073.stdout:0/493: sync 2024-04-26T11:24:01.933 INFO:tasks.workunit.client.0.smithi073.stdout:3/502: dwrite d0/d11/d23/d3b/f46 [0,4194304] 0 2024-04-26T11:24:01.933 INFO:tasks.workunit.client.0.smithi073.stdout:6/458: creat d0/d1a/d26/d4b/d63/f89 x:0 0 0 2024-04-26T11:24:01.933 INFO:tasks.workunit.client.0.smithi073.stdout:7/531: dwrite d1/f5 [0,4194304] 0 2024-04-26T11:24:01.933 INFO:tasks.workunit.client.0.smithi073.stdout:5/517: mkdir d4/d8/dc3 0 2024-04-26T11:24:01.933 INFO:tasks.workunit.client.0.smithi073.stdout:9/537: mknod d0/d13/d25/d9c/cbb 0 2024-04-26T11:24:01.933 INFO:tasks.workunit.client.0.smithi073.stdout:8/545: mknod d1/d4/d37/d90/cb9 0 2024-04-26T11:24:01.935 INFO:tasks.workunit.client.0.smithi073.stdout:0/494: write d2/d1f/d40/d48/f52 [1188848,5354] 0 2024-04-26T11:24:01.936 INFO:tasks.workunit.client.0.smithi073.stdout:6/459: creat d0/d1a/d26/d27/f8a x:0 0 0 2024-04-26T11:24:01.936 INFO:tasks.workunit.client.0.smithi073.stdout:0/495: rmdir d2/d1f/d40 39 2024-04-26T11:24:01.936 INFO:tasks.workunit.client.0.smithi073.stdout:9/538: write d0/d13/f22 [8161300,56945] 0 2024-04-26T11:24:01.937 INFO:tasks.workunit.client.0.smithi073.stdout:8/546: write d1/d21/d2c/f8c [941810,36571] 0 2024-04-26T11:24:01.938 INFO:tasks.workunit.client.0.smithi073.stdout:6/460: chown d0/d19/d20/l42 24722718 1 2024-04-26T11:24:01.939 INFO:tasks.workunit.client.0.smithi073.stdout:6/461: readlink d0/d19/d20/l50 0 2024-04-26T11:24:01.940 INFO:tasks.workunit.client.0.smithi073.stdout:2/503: dwrite dd/d1c/d1d/f35 [0,4194304] 0 2024-04-26T11:24:01.941 INFO:tasks.workunit.client.0.smithi073.stdout:2/504: readlink la 0 2024-04-26T11:24:01.942 INFO:tasks.workunit.client.0.smithi073.stdout:3/503: dread d0/d26/f58 [0,4194304] 0 2024-04-26T11:24:01.943 INFO:tasks.workunit.client.0.smithi073.stdout:5/518: dwrite d4/de/d15/f65 [0,4194304] 0 2024-04-26T11:24:01.943 INFO:tasks.workunit.client.0.smithi073.stdout:0/496: creat d2/fb2 x:0 0 0 2024-04-26T11:24:01.943 INFO:tasks.workunit.client.0.smithi073.stdout:8/547: rename d1/f2f to d1/d21/d50/d67/fba 0 2024-04-26T11:24:01.943 INFO:tasks.workunit.client.0.smithi073.stdout:8/548: sync 2024-04-26T11:24:01.943 INFO:tasks.workunit.client.0.smithi073.stdout:7/532: dwrite d1/d11/d24/d26/d4b/f6b [0,4194304] 0 2024-04-26T11:24:01.943 INFO:tasks.workunit.client.0.smithi073.stdout:2/505: dread - dd/de/d6b/f61 zero size 2024-04-26T11:24:01.944 INFO:tasks.workunit.client.0.smithi073.stdout:7/533: fsync d1/d11/d10/f9c 0 2024-04-26T11:24:01.946 INFO:tasks.workunit.client.0.smithi073.stdout:9/539: rename d0/d13/f60 to d0/d1a/d4e/d70/d3b/fbc 0 2024-04-26T11:24:01.946 INFO:tasks.workunit.client.0.smithi073.stdout:5/519: unlink d4/de/d15/d33/f4b 0 2024-04-26T11:24:01.946 INFO:tasks.workunit.client.0.smithi073.stdout:9/540: readlink d0/d13/d5a/l82 0 2024-04-26T11:24:01.946 INFO:tasks.workunit.client.0.smithi073.stdout:3/504: creat d0/faf x:0 0 0 2024-04-26T11:24:01.946 INFO:tasks.workunit.client.0.smithi073.stdout:9/541: readlink d0/d83/lab 0 2024-04-26T11:24:01.946 INFO:tasks.workunit.client.0.smithi073.stdout:7/534: stat d1/d11/d24/d26/d3d/d41/d64/f4c 0 2024-04-26T11:24:01.947 INFO:tasks.workunit.client.0.smithi073.stdout:3/505: readlink d0/d11/d19/l1b 0 2024-04-26T11:24:01.947 INFO:tasks.workunit.client.0.smithi073.stdout:6/462: rename d0/d1a/d26/d4b/l1e to d0/d15/l8b 0 2024-04-26T11:24:01.947 INFO:tasks.workunit.client.0.smithi073.stdout:9/542: unlink d0/d13/d25/d2c/c79 0 2024-04-26T11:24:01.947 INFO:tasks.workunit.client.0.smithi073.stdout:5/520: creat d4/de/d23/fc4 x:0 0 0 2024-04-26T11:24:01.947 INFO:tasks.workunit.client.0.smithi073.stdout:3/506: fdatasync d0/d11/d19/db/f37 0 2024-04-26T11:24:01.948 INFO:tasks.workunit.client.0.smithi073.stdout:7/535: mknod d1/d11/d24/d26/d3d/d7c/cbe 0 2024-04-26T11:24:01.949 INFO:tasks.workunit.client.0.smithi073.stdout:7/536: truncate d1/d11/d24/d26/d3d/f6d 247346 0 2024-04-26T11:24:01.949 INFO:tasks.workunit.client.0.smithi073.stdout:9/543: mkdir d0/d1a/d4e/d70/d3b/dbd 0 2024-04-26T11:24:01.950 INFO:tasks.workunit.client.0.smithi073.stdout:6/463: mkdir d0/dc/d8c 0 2024-04-26T11:24:01.950 INFO:tasks.workunit.client.0.smithi073.stdout:7/537: creat d1/d11/d24/d26/d4b/fbf x:0 0 0 2024-04-26T11:24:01.951 INFO:tasks.workunit.client.0.smithi073.stdout:6/464: stat d0/d1a/d26/d4b/d38 0 2024-04-26T11:24:01.951 INFO:tasks.workunit.client.0.smithi073.stdout:3/507: truncate d0/d11/d19/d1d/f4c 350693 0 2024-04-26T11:24:01.952 INFO:tasks.workunit.client.0.smithi073.stdout:7/538: mknod d1/d33/d68/d78/cc0 0 2024-04-26T11:24:01.953 INFO:tasks.workunit.client.0.smithi073.stdout:6/465: fdatasync d0/d1a/d26/d4b/d63/f73 0 2024-04-26T11:24:01.953 INFO:tasks.workunit.client.0.smithi073.stdout:3/508: fdatasync d0/d11/d19/db/d3e/d47/f9b 0 2024-04-26T11:24:01.953 INFO:tasks.workunit.client.0.smithi073.stdout:7/539: dread - d1/d11/f98 zero size 2024-04-26T11:24:01.953 INFO:tasks.workunit.client.0.smithi073.stdout:5/521: dread d4/d8/f30 [0,4194304] 0 2024-04-26T11:24:01.953 INFO:tasks.workunit.client.0.smithi073.stdout:1/610: dread d1/d51/f67 [0,4194304] 0 2024-04-26T11:24:01.954 INFO:tasks.workunit.client.0.smithi073.stdout:3/509: creat d0/d11/d19/d5b/fb0 x:0 0 0 2024-04-26T11:24:01.954 INFO:tasks.workunit.client.0.smithi073.stdout:8/549: creat d1/d4/d7b/fbb x:0 0 0 2024-04-26T11:24:01.954 INFO:tasks.workunit.client.0.smithi073.stdout:7/540: symlink d1/d11/d24/d26/d80/lc1 0 2024-04-26T11:24:01.957 INFO:tasks.workunit.client.0.smithi073.stdout:6/466: write d0/d1a/d26/d4b/d63/f73 [244976,95437] 0 2024-04-26T11:24:01.957 INFO:tasks.workunit.client.0.smithi073.stdout:8/550: mkdir d1/d4/d15/dbc 0 2024-04-26T11:24:01.957 INFO:tasks.workunit.client.0.smithi073.stdout:9/544: read d0/d13/f18 [2756408,82218] 0 2024-04-26T11:24:01.957 INFO:tasks.workunit.client.0.smithi073.stdout:3/510: creat d0/d11/d19/d52/fb1 x:0 0 0 2024-04-26T11:24:01.957 INFO:tasks.workunit.client.0.smithi073.stdout:6/467: fsync d0/d19/f60 0 2024-04-26T11:24:01.958 INFO:tasks.workunit.client.0.smithi073.stdout:8/551: dread - d1/d4/d7b/f7d zero size 2024-04-26T11:24:01.958 INFO:tasks.workunit.client.0.smithi073.stdout:3/511: write d0/f2e [3974923,32730] 0 2024-04-26T11:24:01.958 INFO:tasks.workunit.client.0.smithi073.stdout:8/552: mknod d1/d4/d4c/d66/cbd 0 2024-04-26T11:24:01.960 INFO:tasks.workunit.client.0.smithi073.stdout:3/512: dread - d0/d11/d19/db/d3e/d47/f73 zero size 2024-04-26T11:24:01.961 INFO:tasks.workunit.client.0.smithi073.stdout:8/553: readlink d1/d21/d50/d67/l97 0 2024-04-26T11:24:01.962 INFO:tasks.workunit.client.0.smithi073.stdout:0/497: dwrite d2/f15 [0,4194304] 0 2024-04-26T11:24:01.967 INFO:tasks.workunit.client.0.smithi073.stdout:1/611: dwrite d1/d73/d40/d44/f4e [0,4194304] 0 2024-04-26T11:24:01.967 INFO:tasks.workunit.client.0.smithi073.stdout:7/541: dwrite d1/d11/d24/d26/d3d/d41/d64/f42 [4194304,4194304] 0 2024-04-26T11:24:01.967 INFO:tasks.workunit.client.0.smithi073.stdout:2/506: truncate dd/d4c/d48/f3c 404373 0 2024-04-26T11:24:01.967 INFO:tasks.workunit.client.0.smithi073.stdout:9/545: dwrite d0/d83/f86 [0,4194304] 0 2024-04-26T11:24:01.967 INFO:tasks.workunit.client.0.smithi073.stdout:3/513: unlink d0/d11/d19/db/f82 0 2024-04-26T11:24:01.967 INFO:tasks.workunit.client.0.smithi073.stdout:2/507: write f6 [1128808,124924] 0 2024-04-26T11:24:01.970 INFO:tasks.workunit.client.0.smithi073.stdout:1/612: unlink d1/d16/d6a/lc3 0 2024-04-26T11:24:01.970 INFO:tasks.workunit.client.0.smithi073.stdout:8/554: dwrite d1/d4/d4c/fa7 [0,4194304] 0 2024-04-26T11:24:01.970 INFO:tasks.workunit.client.0.smithi073.stdout:0/498: creat d2/d1f/d40/d48/d62/fb3 x:0 0 0 2024-04-26T11:24:01.974 INFO:tasks.workunit.client.0.smithi073.stdout:2/508: creat dd/d1c/d1d/d8c/f95 x:0 0 0 2024-04-26T11:24:01.974 INFO:tasks.workunit.client.0.smithi073.stdout:3/514: link d0/d11/d23/f88 d0/d11/d23/fb2 0 2024-04-26T11:24:01.975 INFO:tasks.workunit.client.0.smithi073.stdout:1/613: rename d1/d6/l95 to d1/d73/d53/ld9 0 2024-04-26T11:24:01.975 INFO:tasks.workunit.client.0.smithi073.stdout:3/515: sync 2024-04-26T11:24:01.975 INFO:tasks.workunit.client.0.smithi073.stdout:2/509: creat dd/d1c/d1d/d8c/f96 x:0 0 0 2024-04-26T11:24:01.975 INFO:tasks.workunit.client.0.smithi073.stdout:3/516: creat d0/d11/d19/db/fb3 x:0 0 0 2024-04-26T11:24:01.976 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:01.972+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:01.977 INFO:tasks.workunit.client.0.smithi073.stdout:4/551: dread d8/d1a/d1b/d41/f58 [0,4194304] 0 2024-04-26T11:24:01.977 INFO:tasks.workunit.client.0.smithi073.stdout:4/552: fsync f7 0 2024-04-26T11:24:01.977 INFO:tasks.workunit.client.0.smithi073.stdout:6/468: dwrite d0/d1a/d7a/f85 [0,4194304] 0 2024-04-26T11:24:01.979 INFO:tasks.workunit.client.0.smithi073.stdout:4/553: read - d8/d14/f93 zero size 2024-04-26T11:24:01.980 INFO:tasks.workunit.client.0.smithi073.stdout:9/546: truncate d0/d83/f86 2392626 0 2024-04-26T11:24:01.980 INFO:tasks.workunit.client.0.smithi073.stdout:4/554: chown d8/d1f/f88 6102 1 2024-04-26T11:24:01.986 INFO:tasks.workunit.client.0.smithi073.stdout:2/510: write dd/d4c/d48/f3c [1173007,99242] 0 2024-04-26T11:24:01.986 INFO:tasks.workunit.client.0.smithi073.stdout:1/614: truncate d1/d73/d40/d44/f4e 3442593 0 2024-04-26T11:24:01.987 INFO:tasks.workunit.client.0.smithi073.stdout:4/555: dread d8/d1a/d9c/d9d/fae [0,4194304] 0 2024-04-26T11:24:01.991 INFO:tasks.workunit.client.0.smithi073.stdout:8/555: dwrite d1/d4/d37/f4f [0,4194304] 0 2024-04-26T11:24:01.991 INFO:tasks.workunit.client.0.smithi073.stdout:2/511: write dd/d1c/d1d/d8c/f96 [305624,4268] 0 2024-04-26T11:24:01.991 INFO:tasks.workunit.client.0.smithi073.stdout:4/556: truncate d8/d1a/d86/fa8 1442855 0 2024-04-26T11:24:01.991 INFO:tasks.workunit.client.0.smithi073.stdout:8/556: chown d1/d21/d50/d67/d81 0 1 2024-04-26T11:24:01.991 INFO:tasks.workunit.client.0.smithi073.stdout:4/557: write d8/d1a/d1b/d24/dac/d49/f62 [236669,37666] 0 2024-04-26T11:24:01.992 INFO:tasks.workunit.client.0.smithi073.stdout:1/615: write d1/d8/fba [2628477,17564] 0 2024-04-26T11:24:01.992 INFO:tasks.workunit.client.0.smithi073.stdout:2/512: rename dd/d1c/d1d/d8c/f96 to dd/de/d2a/f97 0 2024-04-26T11:24:01.993 INFO:tasks.workunit.client.0.smithi073.stdout:4/558: stat d8/d14/d60 0 2024-04-26T11:24:01.994 INFO:tasks.workunit.client.0.smithi073.stdout:8/557: creat d1/d4/d4c/fbe x:0 0 0 2024-04-26T11:24:01.996 INFO:tasks.workunit.client.0.smithi073.stdout:5/522: dread d4/de/d15/f9e [0,4194304] 0 2024-04-26T11:24:01.997 INFO:tasks.workunit.client.0.smithi073.stdout:6/469: dwrite d0/dc/f64 [0,4194304] 0 2024-04-26T11:24:01.997 INFO:tasks.workunit.client.0.smithi073.stdout:2/513: mkdir dd/de/d29/d98 0 2024-04-26T11:24:01.997 INFO:tasks.workunit.client.0.smithi073.stdout:6/470: fdatasync d0/d1a/d26/d4b/d2b/d2c/f3b 0 2024-04-26T11:24:01.998 INFO:tasks.workunit.client.0.smithi073.stdout:7/542: dread d1/d33/f86 [0,4194304] 0 2024-04-26T11:24:01.999 INFO:tasks.workunit.client.0.smithi073.stdout:5/523: rename d4/d8/d9/f46 to d4/de/d15/d67/fc5 0 2024-04-26T11:24:01.999 INFO:tasks.workunit.client.0.smithi073.stdout:8/558: link d1/d21/d50/d67/d81/f84 d1/d21/d50/d67/d81/fbf 0 2024-04-26T11:24:01.999 INFO:tasks.workunit.client.0.smithi073.stdout:2/514: creat dd/d1c/d1d/d8c/f99 x:0 0 0 2024-04-26T11:24:02.000 INFO:tasks.workunit.client.0.smithi073.stdout:4/559: rename d8/d14/c73 to d8/d1a/d1b/d24/dac/d49/d84/ccc 0 2024-04-26T11:24:02.000 INFO:tasks.workunit.client.0.smithi073.stdout:5/524: write d4/d8/d9/d7d/d84/f5d [4887957,29361] 0 2024-04-26T11:24:02.003 INFO:tasks.workunit.client.0.smithi073.stdout:6/471: dread d0/d1a/d26/d4b/f7d [0,4194304] 0 2024-04-26T11:24:02.005 INFO:tasks.workunit.client.0.smithi073.stdout:2/515: getdents dd/de/d38/d53 0 2024-04-26T11:24:02.005 INFO:tasks.workunit.client.0.smithi073.stdout:1/616: truncate d1/d16/d6a/fc8 1145479 0 2024-04-26T11:24:02.005 INFO:tasks.workunit.client.0.smithi073.stdout:3/517: dread d0/d11/d19/f28 [0,4194304] 0 2024-04-26T11:24:02.006 INFO:tasks.workunit.client.0.smithi073.stdout:6/472: rmdir d0/dc/d2e 39 2024-04-26T11:24:02.006 INFO:tasks.workunit.client.0.smithi073.stdout:0/499: dread d2/d1f/d40/d48/f5d [0,4194304] 0 2024-04-26T11:24:02.006 INFO:tasks.workunit.client.0.smithi073.stdout:5/525: rename d4/de/d23/d3b to d4/de/dc6 0 2024-04-26T11:24:02.008 INFO:tasks.workunit.client.0.smithi073.stdout:3/518: mkdir d0/d11/d19/db/da6/d8b/d8c/d90/db4 0 2024-04-26T11:24:02.010 INFO:tasks.workunit.client.0.smithi073.stdout:5/526: symlink d4/d8/d9/d7d/da3/lc7 0 2024-04-26T11:24:02.010 INFO:tasks.workunit.client.0.smithi073.stdout:8/559: dwrite d1/d4/d4c/f6c [0,4194304] 0 2024-04-26T11:24:02.010 INFO:tasks.workunit.client.0.smithi073.stdout:0/500: creat d2/d37/d3c/d73/fb4 x:0 0 0 2024-04-26T11:24:02.010 INFO:tasks.workunit.client.0.smithi073.stdout:7/543: dwrite d1/d11/d24/d26/d3d/f9e [0,4194304] 0 2024-04-26T11:24:02.011 INFO:tasks.workunit.client.0.smithi073.stdout:5/527: chown d4/d8/d9/f21 4297 1 2024-04-26T11:24:02.012 INFO:tasks.workunit.client.0.smithi073.stdout:6/473: dread d0/d1a/d7a/f85 [0,4194304] 0 2024-04-26T11:24:02.013 INFO:tasks.workunit.client.0.smithi073.stdout:6/474: write d0/f16 [3833480,55028] 0 2024-04-26T11:24:02.015 INFO:tasks.workunit.client.0.smithi073.stdout:8/560: creat d1/d4/da9/fc0 x:0 0 0 2024-04-26T11:24:02.015 INFO:tasks.workunit.client.0.smithi073.stdout:5/528: mkdir d4/d73/d8a/dc8 0 2024-04-26T11:24:02.016 INFO:tasks.workunit.client.0.smithi073.stdout:3/519: write d0/d11/d19/db/d3e/d47/f9a [4040355,77487] 0 2024-04-26T11:24:02.016 INFO:tasks.workunit.client.0.smithi073.stdout:0/501: symlink d2/lb5 0 2024-04-26T11:24:02.017 INFO:tasks.workunit.client.0.smithi073.stdout:6/475: write d0/d1a/d4e/f51 [2525910,71610] 0 2024-04-26T11:24:02.017 INFO:tasks.workunit.client.0.smithi073.stdout:3/520: fdatasync d0/f7 0 2024-04-26T11:24:02.017 INFO:tasks.workunit.client.0.smithi073.stdout:5/529: creat d4/d95/fc9 x:0 0 0 2024-04-26T11:24:02.017 INFO:tasks.workunit.client.0.smithi073.stdout:7/544: link d1/d33/d1b/c83 d1/d11/d24/cc2 0 2024-04-26T11:24:02.018 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:02.018 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:02.019 INFO:tasks.workunit.client.0.smithi073.stdout:0/502: mknod d2/d1f/d40/d48/d62/cb6 0 2024-04-26T11:24:02.019 INFO:tasks.workunit.client.0.smithi073.stdout:5/530: symlink d4/d73/d8a/dc8/lca 0 2024-04-26T11:24:02.019 INFO:tasks.workunit.client.0.smithi073.stdout:6/476: truncate d0/d19/d20/f65 2238639 0 2024-04-26T11:24:02.019 INFO:tasks.workunit.client.0.smithi073.stdout:3/521: mkdir d0/d11/d19/db/d3e/d47/db5 0 2024-04-26T11:24:02.019 INFO:tasks.workunit.client.0.smithi073.stdout:5/531: read - d4/de/d15/d60/f89 zero size 2024-04-26T11:24:02.019 INFO:tasks.workunit.client.0.smithi073.stdout:0/503: rename d2/d22/f2f to d2/d5f/fb7 0 2024-04-26T11:24:02.021 INFO:tasks.workunit.client.0.smithi073.stdout:6/477: write d0/f2 [5081741,128758] 0 2024-04-26T11:24:02.021 INFO:tasks.workunit.client.0.smithi073.stdout:5/532: fsync d4/d8/d8e/fb6 0 2024-04-26T11:24:02.021 INFO:tasks.workunit.client.0.smithi073.stdout:3/522: chown d0/d11/d19/d70/c7d 29 1 2024-04-26T11:24:02.021 INFO:tasks.workunit.client.0.smithi073.stdout:0/504: mknod d2/d37/d3c/d6a/cb8 0 2024-04-26T11:24:02.021 INFO:tasks.workunit.client.0.smithi073.stdout:6/478: mknod d0/d1a/d26/d27/c8d 0 2024-04-26T11:24:02.021 INFO:tasks.workunit.client.0.smithi073.stdout:5/533: creat d4/de/d15/d60/fcb x:0 0 0 2024-04-26T11:24:02.021 INFO:tasks.workunit.client.0.smithi073.stdout:0/505: getdents d2/d1f/d9d 0 2024-04-26T11:24:02.022 INFO:tasks.workunit.client.0.smithi073.stdout:2/516: dread dd/d4c/f42 [0,4194304] 0 2024-04-26T11:24:02.023 INFO:tasks.workunit.client.0.smithi073.stdout:5/534: creat d4/de/fcc x:0 0 0 2024-04-26T11:24:02.023 INFO:tasks.workunit.client.0.smithi073.stdout:2/517: rmdir dd/de/d38 39 2024-04-26T11:24:02.023 INFO:tasks.workunit.client.0.smithi073.stdout:6/479: symlink d0/d1a/d26/d4b/d49/d84/l8e 0 2024-04-26T11:24:02.023 INFO:tasks.workunit.client.0.smithi073.stdout:0/506: symlink d2/d37/lb9 0 2024-04-26T11:24:02.024 INFO:tasks.workunit.client.0.smithi073.stdout:7/545: dwrite d1/d33/d68/faa [0,4194304] 0 2024-04-26T11:24:02.024 INFO:tasks.workunit.client.0.smithi073.stdout:0/507: write d2/d22/f39 [1394009,22523] 0 2024-04-26T11:24:02.026 INFO:tasks.workunit.client.0.smithi073.stdout:2/518: mknod dd/de/d38/d53/d60/c9a 0 2024-04-26T11:24:02.027 INFO:tasks.workunit.client.0.smithi073.stdout:6/480: link d0/f2 d0/d1a/d4e/d67/f8f 0 2024-04-26T11:24:02.027 INFO:tasks.workunit.client.0.smithi073.stdout:8/561: write d1/d4/d15/f79 [3518757,8639] 0 2024-04-26T11:24:02.029 INFO:tasks.workunit.client.0.smithi073.stdout:2/519: fsync dd/d1c/d1d/d8c/f99 0 2024-04-26T11:24:02.029 INFO:tasks.workunit.client.0.smithi073.stdout:0/508: getdents d2/d22/d51/d57 0 2024-04-26T11:24:02.029 INFO:tasks.workunit.client.0.smithi073.stdout:6/481: unlink d0/d1a/d4e/l69 0 2024-04-26T11:24:02.030 INFO:tasks.workunit.client.0.smithi073.stdout:2/520: chown dd/d27/l92 3479003 1 2024-04-26T11:24:02.030 INFO:tasks.workunit.client.0.smithi073.stdout:8/562: symlink d1/d21/d2a/lc1 0 2024-04-26T11:24:02.030 INFO:tasks.workunit.client.0.smithi073.stdout:9/547: sync 2024-04-26T11:24:02.030 INFO:tasks.workunit.client.0.smithi073.stdout:2/521: symlink dd/de/d29/d98/l9b 0 2024-04-26T11:24:02.031 INFO:tasks.workunit.client.0.smithi073.stdout:8/563: unlink d1/d21/c33 0 2024-04-26T11:24:02.031 INFO:tasks.workunit.client.0.smithi073.stdout:2/522: readlink dd/l2e 0 2024-04-26T11:24:02.031 INFO:tasks.workunit.client.0.smithi073.stdout:9/548: write d0/d13/f5b [4549443,33800] 0 2024-04-26T11:24:02.032 INFO:tasks.workunit.client.0.smithi073.stdout:7/546: dwrite d1/d11/d24/d26/d4b/fa9 [0,4194304] 0 2024-04-26T11:24:02.033 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:02.034 INFO:tasks.workunit.client.0.smithi073.stdout:2/523: dread - dd/d1c/f5e zero size 2024-04-26T11:24:02.034 INFO:tasks.workunit.client.0.smithi073.stdout:9/549: write d0/d1a/f74 [433225,28328] 0 2024-04-26T11:24:02.034 INFO:tasks.workunit.client.0.smithi073.stdout:9/550: chown d0/d1a/l99 21745 1 2024-04-26T11:24:02.035 INFO:tasks.workunit.client.0.smithi073.stdout:3/523: dwrite d0/f45 [0,4194304] 0 2024-04-26T11:24:02.036 INFO:tasks.workunit.client.0.smithi073.stdout:3/524: chown d0/d11/l7b 5 1 2024-04-26T11:24:02.039 INFO:tasks.workunit.client.0.smithi073.stdout:5/535: dwrite d4/d8/d9/f21 [0,4194304] 0 2024-04-26T11:24:02.039 INFO:tasks.workunit.client.0.smithi073.stdout:8/564: dwrite d1/d4/d15/f4d [0,4194304] 0 2024-04-26T11:24:02.040 INFO:tasks.workunit.client.0.smithi073.stdout:1/617: dread d1/d16/d4f/dd5/f93 [0,4194304] 0 2024-04-26T11:24:02.042 INFO:tasks.workunit.client.0.smithi073.stdout:1/618: symlink d1/d73/lda 0 2024-04-26T11:24:02.045 INFO:tasks.workunit.client.0.smithi073.stdout:1/619: creat d1/d73/d34/d98/dce/fdb x:0 0 0 2024-04-26T11:24:02.046 INFO:tasks.workunit.client.0.smithi073.stdout:1/620: fdatasync d1/d16/d61/f9c 0 2024-04-26T11:24:02.046 INFO:tasks.workunit.client.0.smithi073.stdout:5/536: dwrite d4/de/d15/d60/f1a [4194304,4194304] 0 2024-04-26T11:24:02.046 INFO:tasks.workunit.client.0.smithi073.stdout:8/565: dwrite d1/d4/d37/f4b [0,4194304] 0 2024-04-26T11:24:02.047 INFO:tasks.workunit.client.0.smithi073.stdout:5/537: dread - d4/d8/d8e/fa9 zero size 2024-04-26T11:24:02.047 INFO:tasks.workunit.client.0.smithi073.stdout:1/621: unlink d1/d73/f1c 0 2024-04-26T11:24:02.047 INFO:tasks.workunit.client.0.smithi073.stdout:6/482: write d0/d19/d20/f65 [1128932,56768] 0 2024-04-26T11:24:02.047 INFO:tasks.workunit.client.0.smithi073.stdout:1/622: stat d1/d16/d4f/d55/f64 0 2024-04-26T11:24:02.047 INFO:tasks.workunit.client.0.smithi073.stdout:7/547: truncate d1/f5 3872816 0 2024-04-26T11:24:02.048 INFO:tasks.workunit.client.0.smithi073.stdout:8/566: mknod d1/cc2 0 2024-04-26T11:24:02.049 INFO:tasks.workunit.client.0.smithi073.stdout:6/483: readlink d0/d1a/l32 0 2024-04-26T11:24:02.049 INFO:tasks.workunit.client.0.smithi073.stdout:7/548: fdatasync d1/d11/d10/f9c 0 2024-04-26T11:24:02.052 INFO:tasks.workunit.client.0.smithi073.stdout:9/551: truncate d0/d13/f18 2466206 0 2024-04-26T11:24:02.052 INFO:tasks.workunit.client.0.smithi073.stdout:6/484: chown d0/d1a/d26/d27/c8d 48 1 2024-04-26T11:24:02.052 INFO:tasks.workunit.client.0.smithi073.stdout:5/538: mkdir d4/d8/d9/d7d/d84/da7/db7/dcd 0 2024-04-26T11:24:02.052 INFO:tasks.workunit.client.0.smithi073.stdout:9/552: write d0/d83/fa1 [1612276,75572] 0 2024-04-26T11:24:02.052 INFO:tasks.workunit.client.0.smithi073.stdout:5/539: rename d4/de/d23/c8d to d4/d8/d8e/cce 0 2024-04-26T11:24:02.053 INFO:tasks.workunit.client.0.smithi073.stdout:9/553: creat d0/d1a/d4e/d8f/fbe x:0 0 0 2024-04-26T11:24:02.053 INFO:tasks.workunit.client.0.smithi073.stdout:5/540: creat d4/d73/d8a/da0/fcf x:0 0 0 2024-04-26T11:24:02.055 INFO:tasks.workunit.client.0.smithi073.stdout:1/623: dwrite d1/d16/d4f/d55/f64 [0,4194304] 0 2024-04-26T11:24:02.055 INFO:tasks.workunit.client.0.smithi073.stdout:5/541: rename d4/de/d15/d33/f40 to d4/d95/fd0 0 2024-04-26T11:24:02.057 INFO:tasks.workunit.client.0.smithi073.stdout:7/549: dwrite d1/d33/d68/d78/daf/f28 [0,4194304] 0 2024-04-26T11:24:02.058 INFO:tasks.workunit.client.0.smithi073.stdout:1/624: fsync d1/d73/d40/d44/f4e 0 2024-04-26T11:24:02.058 INFO:tasks.workunit.client.0.smithi073.stdout:5/542: creat d4/d8/d9/d7d/fd1 x:0 0 0 2024-04-26T11:24:02.060 INFO:tasks.workunit.client.0.smithi073.stdout:7/550: write d1/d33/d1b/f1e [1070602,17256] 0 2024-04-26T11:24:02.060 INFO:tasks.workunit.client.0.smithi073.stdout:6/485: dwrite d0/dc/f66 [0,4194304] 0 2024-04-26T11:24:02.061 INFO:tasks.workunit.client.0.smithi073.stdout:6/486: chown d0/dc 16536012 1 2024-04-26T11:24:02.061 INFO:tasks.workunit.client.0.smithi073.stdout:9/554: dread d0/d1a/d4e/d70/f38 [0,4194304] 0 2024-04-26T11:24:02.061 INFO:tasks.workunit.client.0.smithi073.stdout:6/487: stat d0/d1a/d7a/f85 0 2024-04-26T11:24:02.062 INFO:tasks.workunit.client.0.smithi073.stdout:5/543: link d4/d8/d9/d7d/fb4 d4/d95/da5/fd2 0 2024-04-26T11:24:02.062 INFO:tasks.workunit.client.0.smithi073.stdout:9/555: mkdir d0/d13/d25/d2c/dbf 0 2024-04-26T11:24:02.063 INFO:tasks.workunit.client.0.smithi073.stdout:7/551: chown d1/d11/d51/cbc 3319047 1 2024-04-26T11:24:02.063 INFO:tasks.workunit.client.0.smithi073.stdout:4/560: sync 2024-04-26T11:24:02.063 INFO:tasks.workunit.client.0.smithi073.stdout:0/509: sync 2024-04-26T11:24:02.065 INFO:tasks.workunit.client.0.smithi073.stdout:9/556: truncate d0/d1a/d4e/d70/d3b/fb3 1460614 0 2024-04-26T11:24:02.065 INFO:tasks.workunit.client.0.smithi073.stdout:5/544: mknod d4/d95/cd3 0 2024-04-26T11:24:02.066 INFO:tasks.workunit.client.0.smithi073.stdout:6/488: symlink d0/d1a/d26/d27/l90 0 2024-04-26T11:24:02.068 INFO:tasks.workunit.client.0.smithi073.stdout:9/557: readlink d0/d1a/d4e/d70/l3d 0 2024-04-26T11:24:02.068 INFO:tasks.workunit.client.0.smithi073.stdout:7/552: mkdir d1/d11/d24/d26/d80/dc3 0 2024-04-26T11:24:02.068 INFO:tasks.workunit.client.0.smithi073.stdout:9/558: readlink d0/d1a/d4e/d70/l30 0 2024-04-26T11:24:02.068 INFO:tasks.workunit.client.0.smithi073.stdout:6/489: creat d0/dc/d2e/f91 x:0 0 0 2024-04-26T11:24:02.068 INFO:tasks.workunit.client.0.smithi073.stdout:7/553: creat d1/d11/d24/d26/d3d/dba/fc4 x:0 0 0 2024-04-26T11:24:02.069 INFO:tasks.workunit.client.0.smithi073.stdout:7/554: mkdir d1/d33/d68/d78/daf/dc5 0 2024-04-26T11:24:02.070 INFO:tasks.workunit.client.0.smithi073.stdout:5/545: dread d4/d8/d9/f21 [0,4194304] 0 2024-04-26T11:24:02.071 INFO:tasks.workunit.client.0.smithi073.stdout:6/490: write d0/d1a/d26/d27/d52/f56 [763137,94040] 0 2024-04-26T11:24:02.071 INFO:tasks.workunit.client.0.smithi073.stdout:7/555: rename d1/d11/d24/d26/d3d/d41/d64/l3e to d1/d11/d10/lc6 0 2024-04-26T11:24:02.071 INFO:tasks.workunit.client.0.smithi073.stdout:1/625: dread d1/d8/d57/fbe [0,4194304] 0 2024-04-26T11:24:02.072 INFO:tasks.workunit.client.0.smithi073.stdout:6/491: chown d0/f2 1362 1 2024-04-26T11:24:02.073 INFO:tasks.workunit.client.0.smithi073.stdout:4/561: dwrite d8/d15/f3f [0,4194304] 0 2024-04-26T11:24:02.073 INFO:tasks.workunit.client.0.smithi073.stdout:6/492: chown d0/dc/d80/l81 200222876 1 2024-04-26T11:24:02.074 INFO:tasks.workunit.client.0.smithi073.stdout:6/493: write d0/d19/f60 [554570,33841] 0 2024-04-26T11:24:02.075 INFO:tasks.workunit.client.0.smithi073.stdout:9/559: dwrite d0/d13/d25/d75/d8e/fb0 [0,4194304] 0 2024-04-26T11:24:02.076 INFO:tasks.workunit.client.0.smithi073.stdout:6/494: creat d0/d15/d2d/d3f/d59/f92 x:0 0 0 2024-04-26T11:24:02.077 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:02.074+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:02.077 INFO:tasks.workunit.client.0.smithi073.stdout:0/510: dread d2/d37/d3c/f88 [0,4194304] 0 2024-04-26T11:24:02.077 INFO:tasks.workunit.client.0.smithi073.stdout:1/626: rename d1/d73/d34/d98/lb2 to d1/d16/d61/ldc 0 2024-04-26T11:24:02.078 INFO:tasks.workunit.client.0.smithi073.stdout:6/495: write d0/d1a/d26/d27/d52/f56 [4067288,79984] 0 2024-04-26T11:24:02.081 INFO:tasks.workunit.client.0.smithi073.stdout:0/511: creat d2/d37/d8b/fba x:0 0 0 2024-04-26T11:24:02.081 INFO:tasks.workunit.client.0.smithi073.stdout:6/496: readlink d0/d1a/d26/d4b/d2b/l4a 0 2024-04-26T11:24:02.081 INFO:tasks.workunit.client.0.smithi073.stdout:1/627: write d1/d16/d4f/d55/d5a/f7a [1166787,92340] 0 2024-04-26T11:24:02.081 INFO:tasks.workunit.client.0.smithi073.stdout:0/512: fsync d2/d1f/d40/d48/f4a 0 2024-04-26T11:24:02.082 INFO:tasks.workunit.client.0.smithi073.stdout:6/497: write d0/dc/d80/f83 [580139,83747] 0 2024-04-26T11:24:02.082 INFO:tasks.workunit.client.0.smithi073.stdout:1/628: mkdir d1/d8/d5d/ddd 0 2024-04-26T11:24:02.083 INFO:tasks.workunit.client.0.smithi073.stdout:9/560: dwrite d0/d13/d5a/d5e/f94 [0,4194304] 0 2024-04-26T11:24:02.083 INFO:tasks.workunit.client.0.smithi073.stdout:7/556: dwrite d1/d11/d5e/d8f/f91 [0,4194304] 0 2024-04-26T11:24:02.084 INFO:tasks.workunit.client.0.smithi073.stdout:5/546: dread d4/d8/d9/fa1 [0,4194304] 0 2024-04-26T11:24:02.085 INFO:tasks.workunit.client.0.smithi073.stdout:5/547: dread - d4/de/d15/d60/f89 zero size 2024-04-26T11:24:02.086 INFO:tasks.workunit.client.0.smithi073.stdout:5/548: chown d4/de/l6d 1682191600 1 2024-04-26T11:24:02.087 INFO:tasks.workunit.client.0.smithi073.stdout:5/549: write d4/d8/d9/d42/fb3 [379345,116980] 0 2024-04-26T11:24:02.087 INFO:tasks.workunit.client.0.smithi073.stdout:8/567: dread d1/d4/d4c/d66/d8b/f94 [0,4194304] 0 2024-04-26T11:24:02.087 INFO:tasks.workunit.client.0.smithi073.stdout:6/498: symlink d0/d1a/d26/d4b/d2b/d43/l93 0 2024-04-26T11:24:02.088 INFO:tasks.workunit.client.0.smithi073.stdout:5/550: write d4/de/d15/d67/fad [145639,53532] 0 2024-04-26T11:24:02.088 INFO:tasks.workunit.client.0.smithi073.stdout:7/557: creat d1/d11/d24/d26/d3d/fc7 x:0 0 0 2024-04-26T11:24:02.089 INFO:tasks.workunit.client.0.smithi073.stdout:6/499: write d0/f2 [1406210,56781] 0 2024-04-26T11:24:02.089 INFO:tasks.workunit.client.0.smithi073.stdout:8/568: mkdir d1/d4/d15/dbc/dc3 0 2024-04-26T11:24:02.089 INFO:tasks.workunit.client.0.smithi073.stdout:7/558: chown d1/d33 263048958 1 2024-04-26T11:24:02.090 INFO:tasks.workunit.client.0.smithi073.stdout:6/500: dread - d0/d1a/d26/d27/f8a zero size 2024-04-26T11:24:02.090 INFO:tasks.workunit.client.0.smithi073.stdout:0/513: dwrite d2/d1f/d40/f82 [0,4194304] 0 2024-04-26T11:24:02.090 INFO:tasks.workunit.client.0.smithi073.stdout:8/569: fsync d1/d21/f29 0 2024-04-26T11:24:02.091 INFO:tasks.workunit.client.0.smithi073.stdout:3/525: sync 2024-04-26T11:24:02.091 INFO:tasks.workunit.client.0.smithi073.stdout:4/562: sync 2024-04-26T11:24:02.094 INFO:tasks.workunit.client.0.smithi073.stdout:3/526: write d0/faf [330937,84765] 0 2024-04-26T11:24:02.094 INFO:tasks.workunit.client.0.smithi073.stdout:6/501: rename d0/d1a/d26/d4b/d49/f74 to d0/d1a/d26/f94 0 2024-04-26T11:24:02.094 INFO:tasks.workunit.client.0.smithi073.stdout:0/514: chown d2/d22/d51/d57/d78/c9e 9235009 1 2024-04-26T11:24:02.095 INFO:tasks.workunit.client.0.smithi073.stdout:4/563: rename f7 to d8/d1a/d1b/d24/fcd 0 2024-04-26T11:24:02.095 INFO:tasks.workunit.client.0.smithi073.stdout:3/527: symlink d0/d11/d19/d52/lb6 0 2024-04-26T11:24:02.095 INFO:tasks.workunit.client.0.smithi073.stdout:0/515: fdatasync d2/d22/f68 0 2024-04-26T11:24:02.095 INFO:tasks.workunit.client.0.smithi073.stdout:6/502: unlink d0/d1a/d26/f3c 0 2024-04-26T11:24:02.095 INFO:tasks.workunit.client.0.smithi073.stdout:0/516: chown d2/d22/d51/d57/f5c 4150 1 2024-04-26T11:24:02.095 INFO:tasks.workunit.client.0.smithi073.stdout:4/564: unlink d8/d14/d60/f32 0 2024-04-26T11:24:02.096 INFO:tasks.workunit.client.0.smithi073.stdout:3/528: rename d0/d11/d19/f21 to d0/d11/d19/db/da6/d8b/fb7 0 2024-04-26T11:24:02.096 INFO:tasks.workunit.client.0.smithi073.stdout:6/503: fsync d0/d15/d2d/d3f/d59/f92 0 2024-04-26T11:24:02.102 INFO:tasks.workunit.client.0.smithi073.stdout:8/570: dwrite d1/d4/d4c/d66/d8b/fa4 [0,4194304] 0 2024-04-26T11:24:02.103 INFO:tasks.workunit.client.0.smithi073.stdout:1/629: read d1/d73/d40/d54/f87 [1348477,68260] 0 2024-04-26T11:24:02.103 INFO:tasks.workunit.client.0.smithi073.stdout:2/524: dread dd/de/f72 [0,4194304] 0 2024-04-26T11:24:02.105 INFO:tasks.workunit.client.0.smithi073.stdout:8/571: write d1/d4/da9/f82 [302578,57034] 0 2024-04-26T11:24:02.105 INFO:tasks.workunit.client.0.smithi073.stdout:2/525: stat dd/de/f28 0 2024-04-26T11:24:02.105 INFO:tasks.workunit.client.0.smithi073.stdout:8/572: chown d1/d21/d50/cf 69 1 2024-04-26T11:24:02.105 INFO:tasks.workunit.client.0.smithi073.stdout:9/561: write d0/d13/d25/d75/f89 [577901,111932] 0 2024-04-26T11:24:02.108 INFO:tasks.workunit.client.0.smithi073.stdout:7/559: dwrite d1/f75 [0,4194304] 0 2024-04-26T11:24:02.120 INFO:tasks.workunit.client.0.smithi073.stdout:1/630: stat d1/d73/d34/c94 0 2024-04-26T11:24:02.120 INFO:tasks.workunit.client.0.smithi073.stdout:0/517: rename d2/d1f/d40/d48/l49 to d2/d1f/d40/lbb 0 2024-04-26T11:24:02.120 INFO:tasks.workunit.client.0.smithi073.stdout:7/560: mknod d1/d11/d24/d26/d80/da0/cc8 0 2024-04-26T11:24:02.120 INFO:tasks.workunit.client.0.smithi073.stdout:8/573: mkdir d1/d4/d4c/dc4 0 2024-04-26T11:24:02.121 INFO:tasks.workunit.client.0.smithi073.stdout:1/631: stat d1/d16/d4f/d55/da2/dcd 0 2024-04-26T11:24:02.121 INFO:tasks.workunit.client.0.smithi073.stdout:3/529: rename d0/f2e to d0/d11/d19/d1d/fb8 0 2024-04-26T11:24:02.121 INFO:tasks.workunit.client.0.smithi073.stdout:4/565: getdents d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d 0 2024-04-26T11:24:02.121 INFO:tasks.workunit.client.0.smithi073.stdout:2/526: mknod dd/de/d38/d4e/c9c 0 2024-04-26T11:24:02.122 INFO:tasks.workunit.client.0.smithi073.stdout:0/518: truncate d2/d1f/f2c 798785 0 2024-04-26T11:24:02.122 INFO:tasks.workunit.client.0.smithi073.stdout:4/566: fsync d8/d1a/d86/fa8 0 2024-04-26T11:24:02.123 INFO:tasks.workunit.client.0.smithi073.stdout:8/574: truncate d1/d4/d15/f1f 8149844 0 2024-04-26T11:24:02.123 INFO:tasks.workunit.client.0.smithi073.stdout:2/527: mkdir dd/de/d38/d53/d9d 0 2024-04-26T11:24:02.124 INFO:tasks.workunit.client.0.smithi073.stdout:2/528: chown dd/d4c/l6a 28142338 1 2024-04-26T11:24:02.125 INFO:tasks.workunit.client.0.smithi073.stdout:0/519: creat d2/d84/fbc x:0 0 0 2024-04-26T11:24:02.125 INFO:tasks.workunit.client.0.smithi073.stdout:4/567: rmdir d8/d1a/d1b/d46 39 2024-04-26T11:24:02.125 INFO:tasks.workunit.client.0.smithi073.stdout:7/561: rename d1/d33/d68/l84 to d1/d11/d24/d26/d3d/d41/lc9 0 2024-04-26T11:24:02.126 INFO:tasks.workunit.client.0.smithi073.stdout:8/575: link d1/d4/d15/c3e d1/d4/da9/cc5 0 2024-04-26T11:24:02.127 INFO:tasks.workunit.client.0.smithi073.stdout:6/504: rename d0/d19/d20/l42 to d0/d19/l95 0 2024-04-26T11:24:02.127 INFO:tasks.workunit.client.0.smithi073.stdout:7/562: mkdir d1/d11/d51/dca 0 2024-04-26T11:24:02.127 INFO:tasks.workunit.client.0.smithi073.stdout:4/568: chown d8/d15/f76 18907 1 2024-04-26T11:24:02.127 INFO:tasks.workunit.client.0.smithi073.stdout:5/551: dread d4/d8/d9/d7d/d84/f5d [0,4194304] 0 2024-04-26T11:24:02.128 INFO:tasks.workunit.client.0.smithi073.stdout:7/563: creat d1/d11/d24/d26/d3d/d7b/fcb x:0 0 0 2024-04-26T11:24:02.129 INFO:tasks.workunit.client.0.smithi073.stdout:4/569: chown d8/d1a/d1b/d46/fb0 0 1 2024-04-26T11:24:02.129 INFO:tasks.workunit.client.0.smithi073.stdout:9/562: rename d0/d13/d25/d2c/fa4 to d0/d13/db/fc0 0 2024-04-26T11:24:02.130 INFO:tasks.workunit.client.0.smithi073.stdout:7/564: rmdir d1/d11/d24/d26/d4b 39 2024-04-26T11:24:02.131 INFO:tasks.workunit.client.0.smithi073.stdout:1/632: dwrite d1/d6/d7f/d47/fc2 [0,4194304] 0 2024-04-26T11:24:02.131 INFO:tasks.workunit.client.0.smithi073.stdout:6/505: rename d0/d1a/d26/d27/c48 to d0/dc/d80/c96 0 2024-04-26T11:24:02.131 INFO:tasks.workunit.client.0.smithi073.stdout:5/552: mkdir d4/d8/d9/d7d/d84/da7/db7/dcd/dd4 0 2024-04-26T11:24:02.134 INFO:tasks.workunit.client.0.smithi073.stdout:4/570: truncate d8/d1a/d1b/d24/dac/d49/d84/f97 359972 0 2024-04-26T11:24:02.135 INFO:tasks.workunit.client.0.smithi073.stdout:0/520: dwrite d2/d1f/d40/f5b [0,4194304] 0 2024-04-26T11:24:02.135 INFO:tasks.workunit.client.0.smithi073.stdout:7/565: stat d1/d11/d24/d26/d3d/l61 0 2024-04-26T11:24:02.135 INFO:tasks.workunit.client.0.smithi073.stdout:5/553: creat d4/d8/d9/d42/fd5 x:0 0 0 2024-04-26T11:24:02.135 INFO:tasks.workunit.client.0.smithi073.stdout:4/571: fsync d8/d1a/d5e/d7c/f82 0 2024-04-26T11:24:02.135 INFO:tasks.workunit.client.0.smithi073.stdout:1/633: write d1/d73/f1b [3351295,68028] 0 2024-04-26T11:24:02.136 INFO:tasks.workunit.client.0.smithi073.stdout:8/576: dread d1/d4/d37/f4b [0,4194304] 0 2024-04-26T11:24:02.136 INFO:tasks.workunit.client.0.smithi073.stdout:8/577: readlink d1/d21/l45 0 2024-04-26T11:24:02.137 INFO:tasks.workunit.client.0.smithi073.stdout:3/530: dread d0/d11/d19/db/f15 [0,4194304] 0 2024-04-26T11:24:02.137 INFO:tasks.workunit.client.0.smithi073.stdout:1/634: stat d1/d16/d61 0 2024-04-26T11:24:02.138 INFO:tasks.workunit.client.0.smithi073.stdout:7/566: symlink d1/d11/d51/lcc 0 2024-04-26T11:24:02.138 INFO:tasks.workunit.client.0.smithi073.stdout:8/578: mkdir d1/d4/d15/dbc/dc3/dc6 0 2024-04-26T11:24:02.138 INFO:tasks.workunit.client.0.smithi073.stdout:3/531: rename d0/c1c to d0/d11/d19/db/d3e/d3f/d69/cb9 0 2024-04-26T11:24:02.139 INFO:tasks.workunit.client.0.smithi073.stdout:1/635: write d1/d73/f35 [1901257,29441] 0 2024-04-26T11:24:02.139 INFO:tasks.workunit.client.0.smithi073.stdout:8/579: fdatasync d1/d21/d2a/f52 0 2024-04-26T11:24:02.139 INFO:tasks.workunit.client.0.smithi073.stdout:3/532: read - d0/d11/d19/db/fa8 zero size 2024-04-26T11:24:02.140 INFO:tasks.workunit.client.0.smithi073.stdout:4/572: read d8/d1a/d1b/d24/dac/d49/d85/f79 [4163024,116536] 0 2024-04-26T11:24:02.140 INFO:tasks.workunit.client.0.smithi073.stdout:7/567: mknod d1/d11/d24/d26/d4b/ccd 0 2024-04-26T11:24:02.140 INFO:tasks.workunit.client.0.smithi073.stdout:1/636: write d1/d8/f2d [1310194,107562] 0 2024-04-26T11:24:02.141 INFO:tasks.workunit.client.0.smithi073.stdout:4/573: readlink d8/d1a/d86/l99 0 2024-04-26T11:24:02.141 INFO:tasks.workunit.client.0.smithi073.stdout:7/568: unlink d1/d11/d24/c45 0 2024-04-26T11:24:02.141 INFO:tasks.workunit.client.0.smithi073.stdout:3/533: creat d0/d11/d23/d3b/d3c/fba x:0 0 0 2024-04-26T11:24:02.141 INFO:tasks.workunit.client.0.smithi073.stdout:5/554: dread d4/d8/d9/f21 [0,4194304] 0 2024-04-26T11:24:02.142 INFO:tasks.workunit.client.0.smithi073.stdout:8/580: write d1/d21/d50/d67/d81/f88 [700977,21800] 0 2024-04-26T11:24:02.142 INFO:tasks.workunit.client.0.smithi073.stdout:1/637: read - d1/d16/d4f/d55/fa3 zero size 2024-04-26T11:24:02.144 INFO:tasks.workunit.client.0.smithi073.stdout:5/555: write d4/d8/d9/d7d/fd1 [197694,68613] 0 2024-04-26T11:24:02.145 INFO:tasks.workunit.client.0.smithi073.stdout:1/638: readlink d1/l24 0 2024-04-26T11:24:02.145 INFO:tasks.workunit.client.0.smithi073.stdout:0/521: dread d2/d37/d3c/d73/f7c [0,4194304] 0 2024-04-26T11:24:02.152 INFO:tasks.workunit.client.0.smithi073.stdout:5/556: readlink d4/d8/d9/d7d/d84/l77 0 2024-04-26T11:24:02.154 INFO:tasks.workunit.client.0.smithi073.stdout:4/574: symlink d8/d1a/d1b/d24/dac/d49/dad/lce 0 2024-04-26T11:24:02.154 INFO:tasks.workunit.client.0.smithi073.stdout:7/569: creat d1/fce x:0 0 0 2024-04-26T11:24:02.156 INFO:tasks.workunit.client.0.smithi073.stdout:6/506: truncate d0/d19/f21 93379 0 2024-04-26T11:24:02.157 INFO:tasks.workunit.client.0.smithi073.stdout:5/557: creat d4/d73/fd6 x:0 0 0 2024-04-26T11:24:02.157 INFO:tasks.workunit.client.0.smithi073.stdout:7/570: chown d1/d11/d24/d26/d3d/d7b/fcb 1953367 1 2024-04-26T11:24:02.157 INFO:tasks.workunit.client.0.smithi073.stdout:8/581: creat d1/d21/fc7 x:0 0 0 2024-04-26T11:24:02.157 INFO:tasks.workunit.client.0.smithi073.stdout:4/575: dread - d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/fb7 zero size 2024-04-26T11:24:02.157 INFO:tasks.workunit.client.0.smithi073.stdout:0/522: rename d2/d22/d51/d57/f76 to d2/fbd 0 2024-04-26T11:24:02.158 INFO:tasks.workunit.client.0.smithi073.stdout:9/563: dread d0/d6c/f90 [0,4194304] 0 2024-04-26T11:24:02.158 INFO:tasks.workunit.client.0.smithi073.stdout:0/523: readlink d2/l3a 0 2024-04-26T11:24:02.158 INFO:tasks.workunit.client.0.smithi073.stdout:2/529: truncate dd/de/d38/d4e/f8d 987968 0 2024-04-26T11:24:02.159 INFO:tasks.workunit.client.0.smithi073.stdout:8/582: creat d1/d4/d7b/d8d/fc8 x:0 0 0 2024-04-26T11:24:02.159 INFO:tasks.workunit.client.0.smithi073.stdout:6/507: readlink d0/d1a/d4e/d67/l72 0 2024-04-26T11:24:02.159 INFO:tasks.workunit.client.0.smithi073.stdout:0/524: fsync d2/d37/d3c/d6a/f6d 0 2024-04-26T11:24:02.160 INFO:tasks.workunit.client.0.smithi073.stdout:6/508: unlink d0/l5 0 2024-04-26T11:24:02.160 INFO:tasks.workunit.client.0.smithi073.stdout:8/583: creat d1/d21/d50/fc9 x:0 0 0 2024-04-26T11:24:02.161 INFO:tasks.workunit.client.0.smithi073.stdout:2/530: creat dd/de/d38/f9e x:0 0 0 2024-04-26T11:24:02.161 INFO:tasks.workunit.client.0.smithi073.stdout:4/576: dread d8/d1a/d9c/fb8 [0,4194304] 0 2024-04-26T11:24:02.161 INFO:tasks.workunit.client.0.smithi073.stdout:6/509: stat d0/d1a/d26/d27 0 2024-04-26T11:24:02.161 INFO:tasks.workunit.client.0.smithi073.stdout:9/564: write d0/d1a/f36 [962909,51786] 0 2024-04-26T11:24:02.162 INFO:tasks.workunit.client.0.smithi073.stdout:0/525: symlink d2/d1f/d9c/db1/lbe 0 2024-04-26T11:24:02.162 INFO:tasks.workunit.client.0.smithi073.stdout:2/531: chown dd/d4c/d48/d77/d80/c86 9538 1 2024-04-26T11:24:02.162 INFO:tasks.workunit.client.0.smithi073.stdout:0/526: dread - d2/fb2 zero size 2024-04-26T11:24:02.163 INFO:tasks.workunit.client.0.smithi073.stdout:1/639: sync 2024-04-26T11:24:02.163 INFO:tasks.workunit.client.0.smithi073.stdout:4/577: sync 2024-04-26T11:24:02.163 INFO:tasks.workunit.client.0.smithi073.stdout:8/584: write d1/d21/d50/d67/fa6 [394826,61741] 0 2024-04-26T11:24:02.164 INFO:tasks.workunit.client.0.smithi073.stdout:0/527: write d2/f8a [148608,15679] 0 2024-04-26T11:24:02.165 INFO:tasks.workunit.client.0.smithi073.stdout:6/510: mkdir d0/dc/d80/d97 0 2024-04-26T11:24:02.165 INFO:tasks.workunit.client.0.smithi073.stdout:8/585: symlink d1/d4/d15/lca 0 2024-04-26T11:24:02.166 INFO:tasks.workunit.client.0.smithi073.stdout:1/640: read d1/d73/f1b [948636,119452] 0 2024-04-26T11:24:02.166 INFO:tasks.workunit.client.0.smithi073.stdout:7/571: dread d1/d11/d24/d26/d4b/fa9 [0,4194304] 0 2024-04-26T11:24:02.167 INFO:tasks.workunit.client.0.smithi073.stdout:3/534: dread d0/d11/f6c [0,4194304] 0 2024-04-26T11:24:02.167 INFO:tasks.workunit.client.0.smithi073.stdout:6/511: dread - d0/dc/d2e/d6e/f70 zero size 2024-04-26T11:24:02.168 INFO:tasks.workunit.client.0.smithi073.stdout:0/528: creat d2/d1f/d40/fbf x:0 0 0 2024-04-26T11:24:02.168 INFO:tasks.workunit.client.0.smithi073.stdout:9/565: dread d0/d13/d25/d75/f89 [0,4194304] 0 2024-04-26T11:24:02.168 INFO:tasks.workunit.client.0.smithi073.stdout:5/558: dwrite d4/d8/d9/d7d/d84/fbd [0,4194304] 0 2024-04-26T11:24:02.170 INFO:tasks.workunit.client.0.smithi073.stdout:5/559: chown d4/de/d23/d4f/l92 41121344 1 2024-04-26T11:24:02.171 INFO:tasks.workunit.client.0.smithi073.stdout:4/578: rename d8/d1a/d5e/d7c/c9f to d8/d14/ccf 0 2024-04-26T11:24:02.172 INFO:tasks.workunit.client.0.smithi073.stdout:3/535: rmdir d0/d11/d19/d1d 39 2024-04-26T11:24:02.172 INFO:tasks.workunit.client.0.smithi073.stdout:8/586: fsync d1/d21/d50/d67/fba 0 2024-04-26T11:24:02.172 INFO:tasks.workunit.client.0.smithi073.stdout:2/532: dwrite dd/de/d38/d53/f74 [0,4194304] 0 2024-04-26T11:24:02.172 INFO:tasks.workunit.client.0.smithi073.stdout:6/512: creat d0/d15/d2d/d3f/f98 x:0 0 0 2024-04-26T11:24:02.173 INFO:tasks.workunit.client.0.smithi073.stdout:7/572: symlink d1/d33/lcf 0 2024-04-26T11:24:02.173 INFO:tasks.workunit.client.0.smithi073.stdout:5/560: mknod d4/de/dc6/cd7 0 2024-04-26T11:24:02.173 INFO:tasks.workunit.client.0.smithi073.stdout:9/566: mknod d0/d6c/cc1 0 2024-04-26T11:24:02.174 INFO:tasks.workunit.client.0.smithi073.stdout:4/579: mknod d8/d1a/d1b/d24/dac/d72/da3/cd0 0 2024-04-26T11:24:02.174 INFO:tasks.workunit.client.0.smithi073.stdout:3/536: chown d0/d11/d19/db/d3e/d3f/d69/d96 96444 1 2024-04-26T11:24:02.179 INFO:tasks.workunit.client.0.smithi073.stdout:8/587: write d1/d21/d50/f2e [3218647,119220] 0 2024-04-26T11:24:02.179 INFO:tasks.workunit.client.0.smithi073.stdout:7/573: fdatasync d1/d33/d68/d78/daf/f40 0 2024-04-26T11:24:02.179 INFO:tasks.workunit.client.0.smithi073.stdout:9/567: chown d0/d13/l17 11423448 1 2024-04-26T11:24:02.179 INFO:tasks.workunit.client.0.smithi073.stdout:5/561: rmdir d4/dbe 0 2024-04-26T11:24:02.179 INFO:tasks.workunit.client.0.smithi073.stdout:4/580: fdatasync d8/d1a/d1b/d24/dac/d49/d85/d8b/f66 0 2024-04-26T11:24:02.180 INFO:tasks.workunit.client.0.smithi073.stdout:2/533: rename dd/d1c to dd/d4c/d48/d46/d91/d9f 0 2024-04-26T11:24:02.180 INFO:tasks.workunit.client.0.smithi073.stdout:1/641: dwrite d1/d73/d40/f28 [0,4194304] 0 2024-04-26T11:24:02.180 INFO:tasks.workunit.client.0.smithi073.stdout:6/513: rename d0/d1a/d7a/c82 to d0/d1a/d26/d4b/d63/c99 0 2024-04-26T11:24:02.180 INFO:tasks.workunit.client.0.smithi073.stdout:7/574: chown d1/d11/d24/d26/d3d/d7b/fcb 7 1 2024-04-26T11:24:02.180 INFO:tasks.workunit.client.0.smithi073.stdout:4/581: mknod d8/d15/da1/cd1 0 2024-04-26T11:24:02.181 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:02.176+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:02.182 INFO:tasks.workunit.client.0.smithi073.stdout:3/537: link d0/d11/d19/db/da6/d8b/d8c/d90/c93 d0/d11/d19/db/da6/d8b/d8c/d90/cbb 0 2024-04-26T11:24:02.182 INFO:tasks.workunit.client.0.smithi073.stdout:6/514: mkdir d0/d15/d9a 0 2024-04-26T11:24:02.182 INFO:tasks.workunit.client.0.smithi073.stdout:6/515: chown d0/dc/d55/d79 0 1 2024-04-26T11:24:02.182 INFO:tasks.workunit.client.0.smithi073.stdout:2/534: dread dd/d4c/f42 [0,4194304] 0 2024-04-26T11:24:02.182 INFO:tasks.workunit.client.0.smithi073.stdout:8/588: dread d1/d4/d37/f4b [0,4194304] 0 2024-04-26T11:24:02.182 INFO:tasks.workunit.client.0.smithi073.stdout:3/538: mkdir d0/d11/d19/db/da6/d7a/dbc 0 2024-04-26T11:24:02.183 INFO:tasks.workunit.client.0.smithi073.stdout:4/582: sync 2024-04-26T11:24:02.183 INFO:tasks.workunit.client.0.smithi073.stdout:3/539: unlink d0/d11/d19/db/da6/d7a/f9c 0 2024-04-26T11:24:02.183 INFO:tasks.workunit.client.0.smithi073.stdout:6/516: symlink d0/d15/l9b 0 2024-04-26T11:24:02.184 INFO:tasks.workunit.client.0.smithi073.stdout:4/583: mkdir d8/d1a/d1b/dd2 0 2024-04-26T11:24:02.184 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:02.184 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:02.185 INFO:tasks.workunit.client.0.smithi073.stdout:3/540: mknod d0/d11/d19/db/da6/d8b/cbd 0 2024-04-26T11:24:02.185 INFO:tasks.workunit.client.0.smithi073.stdout:6/517: creat d0/d1a/d26/d4b/d49/f9c x:0 0 0 2024-04-26T11:24:02.185 INFO:tasks.workunit.client.0.smithi073.stdout:4/584: write d8/d1a/d5e/f69 [3807481,16365] 0 2024-04-26T11:24:02.185 INFO:tasks.workunit.client.0.smithi073.stdout:5/562: read d4/de/d15/d33/f6c [4279689,6859] 0 2024-04-26T11:24:02.186 INFO:tasks.workunit.client.0.smithi073.stdout:9/568: truncate d0/d13/db/f4b 2682470 0 2024-04-26T11:24:02.186 INFO:tasks.workunit.client.0.smithi073.stdout:3/541: read - d0/d11/d23/d3b/f76 zero size 2024-04-26T11:24:02.186 INFO:tasks.workunit.client.0.smithi073.stdout:8/589: truncate d1/d21/d50/d67/d81/fad 627994 0 2024-04-26T11:24:02.187 INFO:tasks.workunit.client.0.smithi073.stdout:7/575: dread d1/d33/d1b/d66/d50/f7d [0,4194304] 0 2024-04-26T11:24:02.187 INFO:tasks.workunit.client.0.smithi073.stdout:9/569: rmdir d0/d13/d25/d2c 39 2024-04-26T11:24:02.188 INFO:tasks.workunit.client.0.smithi073.stdout:4/585: chown d8/d1a/d1b/d46/d57/cbc 1811159400 1 2024-04-26T11:24:02.188 INFO:tasks.workunit.client.0.smithi073.stdout:1/642: dwrite d1/d8/d2e/d3c/fc1 [0,4194304] 0 2024-04-26T11:24:02.190 INFO:tasks.workunit.client.0.smithi073.stdout:3/542: symlink d0/d11/d19/d1d/lbe 0 2024-04-26T11:24:02.196 INFO:tasks.workunit.client.0.smithi073.stdout:9/570: truncate d0/d1a/d4e/d70/faa 562336 0 2024-04-26T11:24:02.196 INFO:tasks.workunit.client.0.smithi073.stdout:5/563: link d4/de/d23/f36 d4/d8/d9/d7d/d84/da7/fd8 0 2024-04-26T11:24:02.198 INFO:tasks.workunit.client.0.smithi073.stdout:2/535: dwrite dd/de/d38/d4e/f51 [0,4194304] 0 2024-04-26T11:24:02.200 INFO:tasks.workunit.client.0.smithi073.stdout:5/564: rmdir d4/de/dc6 39 2024-04-26T11:24:02.200 INFO:tasks.workunit.client.0.smithi073.stdout:6/518: dwrite d0/f16 [4194304,4194304] 0 2024-04-26T11:24:02.206 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:02.207 INFO:tasks.workunit.client.0.smithi073.stdout:2/536: write dd/de/d38/f75 [755238,30845] 0 2024-04-26T11:24:02.207 INFO:tasks.workunit.client.0.smithi073.stdout:7/576: dwrite d1/d33/f86 [0,4194304] 0 2024-04-26T11:24:02.207 INFO:tasks.workunit.client.0.smithi073.stdout:5/565: chown d4/d8/f81 50351 1 2024-04-26T11:24:02.208 INFO:tasks.workunit.client.0.smithi073.stdout:8/590: dread d1/d4/d4c/f6c [0,4194304] 0 2024-04-26T11:24:02.209 INFO:tasks.workunit.client.0.smithi073.stdout:4/586: dwrite d8/d1a/d1b/d24/dac/d49/d85/d8b/f66 [0,4194304] 0 2024-04-26T11:24:02.209 INFO:tasks.workunit.client.0.smithi073.stdout:1/643: dwrite d1/d73/d40/f28 [4194304,4194304] 0 2024-04-26T11:24:02.209 INFO:tasks.workunit.client.0.smithi073.stdout:0/529: dread d2/fbd [0,4194304] 0 2024-04-26T11:24:02.209 INFO:tasks.workunit.client.0.smithi073.stdout:2/537: mkdir dd/d27/da0 0 2024-04-26T11:24:02.210 INFO:tasks.workunit.client.0.smithi073.stdout:6/519: rename d0/d19/d20/l50 to d0/dc/d2e/d6e/l9d 0 2024-04-26T11:24:02.210 INFO:tasks.workunit.client.0.smithi073.stdout:1/644: chown d1/d73/d40/c42 7651003 1 2024-04-26T11:24:02.211 INFO:tasks.workunit.client.0.smithi073.stdout:2/538: mknod dd/d4c/d48/ca1 0 2024-04-26T11:24:02.211 INFO:tasks.workunit.client.0.smithi073.stdout:0/530: fdatasync d2/d1f/d9c/fb0 0 2024-04-26T11:24:02.211 INFO:tasks.workunit.client.0.smithi073.stdout:3/543: dwrite d0/d11/d19/f6 [8388608,4194304] 0 2024-04-26T11:24:02.211 INFO:tasks.workunit.client.0.smithi073.stdout:8/591: creat d1/d4/d4c/fcb x:0 0 0 2024-04-26T11:24:02.211 INFO:tasks.workunit.client.0.smithi073.stdout:7/577: mknod d1/d11/d24/d26/d3d/cd0 0 2024-04-26T11:24:02.211 INFO:tasks.workunit.client.0.smithi073.stdout:0/531: sync 2024-04-26T11:24:02.212 INFO:tasks.workunit.client.0.smithi073.stdout:7/578: chown d1/d33/d1b/d95 0 1 2024-04-26T11:24:02.212 INFO:tasks.workunit.client.0.smithi073.stdout:5/566: rmdir d4 39 2024-04-26T11:24:02.213 INFO:tasks.workunit.client.0.smithi073.stdout:9/571: read d0/d13/db/fc0 [2820546,49750] 0 2024-04-26T11:24:02.214 INFO:tasks.workunit.client.0.smithi073.stdout:3/544: rmdir d0/d11/d19/db/d51 39 2024-04-26T11:24:02.216 INFO:tasks.workunit.client.0.smithi073.stdout:8/592: creat d1/d4/d4c/dc4/fcc x:0 0 0 2024-04-26T11:24:02.216 INFO:tasks.workunit.client.0.smithi073.stdout:0/532: mknod d2/d1f/d40/d48/da9/cc0 0 2024-04-26T11:24:02.216 INFO:tasks.workunit.client.0.smithi073.stdout:6/520: creat d0/d15/f9e x:0 0 0 2024-04-26T11:24:02.216 INFO:tasks.workunit.client.0.smithi073.stdout:3/545: creat d0/d11/d19/db/d3e/d3f/d69/fbf x:0 0 0 2024-04-26T11:24:02.219 INFO:tasks.workunit.client.0.smithi073.stdout:2/539: getdents dd/d4c/d48/d46 0 2024-04-26T11:24:02.219 INFO:tasks.workunit.client.0.smithi073.stdout:4/587: dwrite d8/d1a/d1b/d24/dac/f27 [0,4194304] 0 2024-04-26T11:24:02.219 INFO:tasks.workunit.client.0.smithi073.stdout:0/533: read - d2/d37/d8b/fba zero size 2024-04-26T11:24:02.220 INFO:tasks.workunit.client.0.smithi073.stdout:8/593: mknod d1/d21/d2c/ccd 0 2024-04-26T11:24:02.221 INFO:tasks.workunit.client.0.smithi073.stdout:5/567: dwrite d4/d8/d9/d42/d68/f71 [0,4194304] 0 2024-04-26T11:24:02.222 INFO:tasks.workunit.client.0.smithi073.stdout:5/568: read d4/d8/d9/fa1 [196751,51198] 0 2024-04-26T11:24:02.224 INFO:tasks.workunit.client.0.smithi073.stdout:0/534: mkdir d2/d1f/d40/d48/dc1 0 2024-04-26T11:24:02.224 INFO:tasks.workunit.client.0.smithi073.stdout:3/546: truncate d0/d11/f91 860356 0 2024-04-26T11:24:02.225 INFO:tasks.workunit.client.0.smithi073.stdout:4/588: mknod d8/d1a/d1b/d24/dac/d72/d77/cd3 0 2024-04-26T11:24:02.225 INFO:tasks.workunit.client.0.smithi073.stdout:8/594: mkdir d1/d21/d50/d67/d81/da5/dce 0 2024-04-26T11:24:02.225 INFO:tasks.workunit.client.0.smithi073.stdout:6/521: rename d0/d1a/d26/d4b/d63/f89 to d0/dc/f9f 0 2024-04-26T11:24:02.225 INFO:tasks.workunit.client.0.smithi073.stdout:0/535: mknod d2/d37/d8b/cc2 0 2024-04-26T11:24:02.225 INFO:tasks.workunit.client.0.smithi073.stdout:8/595: fdatasync d1/d21/d2a/f34 0 2024-04-26T11:24:02.225 INFO:tasks.workunit.client.0.smithi073.stdout:3/547: rmdir d0/d11/d19/db/d3e/d47 39 2024-04-26T11:24:02.225 INFO:tasks.workunit.client.0.smithi073.stdout:6/522: unlink d0/f4 0 2024-04-26T11:24:02.225 INFO:tasks.workunit.client.0.smithi073.stdout:8/596: dread - d1/d4/d4c/fcb zero size 2024-04-26T11:24:02.226 INFO:tasks.workunit.client.0.smithi073.stdout:0/536: write d2/d37/d3c/d6a/f98 [835033,48920] 0 2024-04-26T11:24:02.226 INFO:tasks.workunit.client.0.smithi073.stdout:3/548: creat d0/d11/d19/db/d3e/d3f/da1/fc0 x:0 0 0 2024-04-26T11:24:02.226 INFO:tasks.workunit.client.0.smithi073.stdout:0/537: creat d2/d84/fc3 x:0 0 0 2024-04-26T11:24:02.227 INFO:tasks.workunit.client.0.smithi073.stdout:6/523: rename d0/d1a/d26/d27/d52 to d0/d1a/d26/d4b/d63/da0 0 2024-04-26T11:24:02.229 INFO:tasks.workunit.client.0.smithi073.stdout:8/597: creat d1/fcf x:0 0 0 2024-04-26T11:24:02.229 INFO:tasks.workunit.client.0.smithi073.stdout:1/645: truncate d1/d73/d40/d54/f87 163419 0 2024-04-26T11:24:02.229 INFO:tasks.workunit.client.0.smithi073.stdout:8/598: write d1/d4/f12 [1746807,123062] 0 2024-04-26T11:24:02.230 INFO:tasks.workunit.client.0.smithi073.stdout:1/646: write d1/d8/d2e/d3c/fc1 [3678388,127311] 0 2024-04-26T11:24:02.231 INFO:tasks.workunit.client.0.smithi073.stdout:5/569: truncate d4/d8/d9/d42/f9c 6686479 0 2024-04-26T11:24:02.234 INFO:tasks.workunit.client.0.smithi073.stdout:8/599: write d1/d21/d2a/f39 [3118778,57733] 0 2024-04-26T11:24:02.235 INFO:tasks.workunit.client.0.smithi073.stdout:4/589: dwrite d8/d1a/d1b/d24/dac/f27 [0,4194304] 0 2024-04-26T11:24:02.235 INFO:tasks.workunit.client.0.smithi073.stdout:3/549: dwrite d0/d11/d19/db/d3e/d3f/f59 [0,4194304] 0 2024-04-26T11:24:02.235 INFO:tasks.workunit.client.0.smithi073.stdout:7/579: dwrite d1/d33/d1b/d66/d50/f6e [0,4194304] 0 2024-04-26T11:24:02.236 INFO:tasks.workunit.client.0.smithi073.stdout:1/647: rmdir d1/d16/d4f/d55/da2 39 2024-04-26T11:24:02.237 INFO:tasks.workunit.client.0.smithi073.stdout:7/580: creat d1/d33/d1b/d95/fd1 x:0 0 0 2024-04-26T11:24:02.237 INFO:tasks.workunit.client.0.smithi073.stdout:1/648: unlink d1/d73/f36 0 2024-04-26T11:24:02.238 INFO:tasks.workunit.client.0.smithi073.stdout:1/649: chown d1/d8/d2e/d3c/fc1 828 1 2024-04-26T11:24:02.239 INFO:tasks.workunit.client.0.smithi073.stdout:8/600: dread - d1/d4/d37/d5b/f69 zero size 2024-04-26T11:24:02.239 INFO:tasks.workunit.client.0.smithi073.stdout:6/524: dwrite d0/dc/d55/f46 [4194304,4194304] 0 2024-04-26T11:24:02.240 INFO:tasks.workunit.client.0.smithi073.stdout:1/650: chown d1/d6/l1f 0 1 2024-04-26T11:24:02.241 INFO:tasks.workunit.client.0.smithi073.stdout:0/538: getdents d2/d84 0 2024-04-26T11:24:02.241 INFO:tasks.workunit.client.0.smithi073.stdout:7/581: mkdir d1/d11/d24/d26/d80/da0/dd2 0 2024-04-26T11:24:02.241 INFO:tasks.workunit.client.0.smithi073.stdout:8/601: creat d1/d4/d4c/d66/d8b/fd0 x:0 0 0 2024-04-26T11:24:02.242 INFO:tasks.workunit.client.0.smithi073.stdout:1/651: mknod d1/d73/d40/d44/cde 0 2024-04-26T11:24:02.242 INFO:tasks.workunit.client.0.smithi073.stdout:4/590: write d8/d1a/d1b/d24/dac/da7/fba [5149613,2074] 0 2024-04-26T11:24:02.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/570: truncate d4/d8/d9/d42/d68/f71 2329147 0 2024-04-26T11:24:02.242 INFO:tasks.workunit.client.0.smithi073.stdout:4/591: readlink d8/l11 0 2024-04-26T11:24:02.242 INFO:tasks.workunit.client.0.smithi073.stdout:0/539: write d2/d37/d3c/f4c [6060077,26730] 0 2024-04-26T11:24:02.242 INFO:tasks.workunit.client.0.smithi073.stdout:8/602: symlink d1/d4/d7b/d8d/ld1 0 2024-04-26T11:24:02.242 INFO:tasks.workunit.client.0.smithi073.stdout:5/571: mkdir d4/d8/d8e/dd9 0 2024-04-26T11:24:02.243 INFO:tasks.workunit.client.0.smithi073.stdout:1/652: chown d1/d16/d61/ldc 1300 1 2024-04-26T11:24:02.243 INFO:tasks.workunit.client.0.smithi073.stdout:8/603: write d1/d4/f89 [775214,3582] 0 2024-04-26T11:24:02.243 INFO:tasks.workunit.client.0.smithi073.stdout:1/653: chown d1/d6/f22 11531 1 2024-04-26T11:24:02.244 INFO:tasks.workunit.client.0.smithi073.stdout:0/540: rename d2/f25 to d2/d1f/d40/d48/fc4 0 2024-04-26T11:24:02.244 INFO:tasks.workunit.client.0.smithi073.stdout:8/604: truncate d1/d4/d7b/d8d/fc8 36140 0 2024-04-26T11:24:02.245 INFO:tasks.workunit.client.0.smithi073.stdout:5/572: write d4/de/fcc [485565,108815] 0 2024-04-26T11:24:02.245 INFO:tasks.workunit.client.0.smithi073.stdout:7/582: getdents d1/d11/d24/d26/d80/dc3 0 2024-04-26T11:24:02.245 INFO:tasks.workunit.client.0.smithi073.stdout:6/525: symlink d0/d1a/d26/d4b/d2b/d2c/la1 0 2024-04-26T11:24:02.246 INFO:tasks.workunit.client.0.smithi073.stdout:8/605: creat d1/d21/d50/d67/fd2 x:0 0 0 2024-04-26T11:24:02.247 INFO:tasks.workunit.client.0.smithi073.stdout:0/541: mknod d2/d1f/cc5 0 2024-04-26T11:24:02.247 INFO:tasks.workunit.client.0.smithi073.stdout:6/526: dread - d0/d15/d2d/d3f/d59/f92 zero size 2024-04-26T11:24:02.247 INFO:tasks.workunit.client.0.smithi073.stdout:7/583: creat d1/d33/d1b/fd3 x:0 0 0 2024-04-26T11:24:02.250 INFO:tasks.workunit.client.0.smithi073.stdout:4/592: dwrite d8/d1a/d1b/fb5 [0,4194304] 0 2024-04-26T11:24:02.251 INFO:tasks.workunit.client.0.smithi073.stdout:8/606: mkdir d1/d4/d37/dd3 0 2024-04-26T11:24:02.252 INFO:tasks.workunit.client.0.smithi073.stdout:3/550: dwrite d0/d11/d23/d3b/f7f [0,4194304] 0 2024-04-26T11:24:02.255 INFO:tasks.workunit.client.0.smithi073.stdout:6/527: dwrite d0/dc/d80/f83 [0,4194304] 0 2024-04-26T11:24:02.258 INFO:tasks.workunit.client.0.smithi073.stdout:1/654: truncate d1/d16/d4f/d55/f64 2275047 0 2024-04-26T11:24:02.258 INFO:tasks.workunit.client.0.smithi073.stdout:7/584: dwrite d1/d11/d24/d26/d3d/d41/d64/fa6 [0,4194304] 0 2024-04-26T11:24:02.259 INFO:tasks.workunit.client.0.smithi073.stdout:0/542: creat d2/d1f/d40/d48/dc1/fc6 x:0 0 0 2024-04-26T11:24:02.259 INFO:tasks.workunit.client.0.smithi073.stdout:9/572: dread d0/d13/db/f4b [0,4194304] 0 2024-04-26T11:24:02.260 INFO:tasks.workunit.client.0.smithi073.stdout:1/655: mkdir d1/d8/d5d/ddf 0 2024-04-26T11:24:02.260 INFO:tasks.workunit.client.0.smithi073.stdout:6/528: rmdir d0/d1a/d26/d4b/d2b 39 2024-04-26T11:24:02.262 INFO:tasks.workunit.client.0.smithi073.stdout:4/593: dwrite d8/d1a/d5e/dc5/fc6 [0,4194304] 0 2024-04-26T11:24:02.263 INFO:tasks.workunit.client.0.smithi073.stdout:0/543: getdents d2/d1f/d9c 0 2024-04-26T11:24:02.263 INFO:tasks.workunit.client.0.smithi073.stdout:7/585: getdents d1/d33/d1b/d95 0 2024-04-26T11:24:02.264 INFO:tasks.workunit.client.0.smithi073.stdout:0/544: rmdir d2/d22 39 2024-04-26T11:24:02.264 INFO:tasks.workunit.client.0.smithi073.stdout:3/551: dwrite d0/d11/d19/f39 [0,4194304] 0 2024-04-26T11:24:02.264 INFO:tasks.workunit.client.0.smithi073.stdout:4/594: creat d8/d1a/d86/fd4 x:0 0 0 2024-04-26T11:24:02.265 INFO:tasks.workunit.client.0.smithi073.stdout:0/545: sync 2024-04-26T11:24:02.266 INFO:tasks.workunit.client.0.smithi073.stdout:7/586: mknod d1/d11/d24/d71/d90/cd4 0 2024-04-26T11:24:02.266 INFO:tasks.workunit.client.0.smithi073.stdout:3/552: creat d0/d2d/fc1 x:0 0 0 2024-04-26T11:24:02.267 INFO:tasks.workunit.client.0.smithi073.stdout:0/546: creat d2/d22/d51/fc7 x:0 0 0 2024-04-26T11:24:02.270 INFO:tasks.workunit.client.0.smithi073.stdout:3/553: mkdir d0/d11/d19/db/d3e/dc2 0 2024-04-26T11:24:02.270 INFO:tasks.workunit.client.0.smithi073.stdout:0/547: creat d2/d22/d51/fc8 x:0 0 0 2024-04-26T11:24:02.271 INFO:tasks.workunit.client.0.smithi073.stdout:6/529: dwrite d0/d1a/d26/d4b/f5b [4194304,4194304] 0 2024-04-26T11:24:02.272 INFO:tasks.workunit.client.0.smithi073.stdout:4/595: dwrite d8/d1a/d1b/f83 [0,4194304] 0 2024-04-26T11:24:02.275 INFO:tasks.workunit.client.0.smithi073.stdout:7/587: dwrite d1/d33/d1b/d95/fd1 [0,4194304] 0 2024-04-26T11:24:02.275 INFO:tasks.workunit.client.0.smithi073.stdout:1/656: write d1/d6/d7f/f76 [381089,115970] 0 2024-04-26T11:24:02.275 INFO:tasks.workunit.client.0.smithi073.stdout:6/530: rmdir d0/d15/d2d 39 2024-04-26T11:24:02.275 INFO:tasks.workunit.client.0.smithi073.stdout:4/596: symlink d8/d1a/d9c/ld5 0 2024-04-26T11:24:02.276 INFO:tasks.workunit.client.0.smithi073.stdout:1/657: fdatasync d1/d16/d4f/fac 0 2024-04-26T11:24:02.276 INFO:tasks.workunit.client.0.smithi073.stdout:5/573: dread d4/de/d15/d67/fc5 [0,4194304] 0 2024-04-26T11:24:02.277 INFO:tasks.workunit.client.0.smithi073.stdout:8/607: dread d1/d21/d50/f36 [0,4194304] 0 2024-04-26T11:24:02.277 INFO:tasks.workunit.client.0.smithi073.stdout:4/597: write d8/d1a/d1b/d24/dac/d72/da3/fb6 [720768,64666] 0 2024-04-26T11:24:02.279 INFO:tasks.workunit.client.0.smithi073.stdout:6/531: mkdir d0/dc/d80/d97/da2 0 2024-04-26T11:24:02.280 INFO:tasks.workunit.client.0.smithi073.stdout:6/532: stat d0/d1a/d4e/d67/l72 0 2024-04-26T11:24:02.280 INFO:tasks.workunit.client.0.smithi073.stdout:5/574: dread d4/de/d15/f9e [0,4194304] 0 2024-04-26T11:24:02.281 INFO:tasks.workunit.client.0.smithi073.stdout:0/548: dwrite d2/d22/d51/d57/d78/fa3 [0,4194304] 0 2024-04-26T11:24:02.281 INFO:tasks.workunit.client.0.smithi073.stdout:1/658: creat d1/d6/d7f/d47/fe0 x:0 0 0 2024-04-26T11:24:02.281 INFO:tasks.workunit.client.0.smithi073.stdout:4/598: symlink d8/d1a/d1b/d24/dac/d72/d77/ld6 0 2024-04-26T11:24:02.282 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:02.278+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:02.282 INFO:tasks.workunit.client.0.smithi073.stdout:0/549: write d2/d1f/d40/fbf [859933,10257] 0 2024-04-26T11:24:02.283 INFO:tasks.workunit.client.0.smithi073.stdout:2/540: dread f6 [4194304,4194304] 0 2024-04-26T11:24:02.284 INFO:tasks.workunit.client.0.smithi073.stdout:1/659: mknod d1/d73/d34/d98/dce/ce1 0 2024-04-26T11:24:02.284 INFO:tasks.workunit.client.0.smithi073.stdout:2/541: write dd/d4c/d48/d46/d91/d9f/d1d/f5c [980999,25551] 0 2024-04-26T11:24:02.285 INFO:tasks.workunit.client.0.smithi073.stdout:0/550: symlink d2/d1f/d40/d48/lc9 0 2024-04-26T11:24:02.285 INFO:tasks.workunit.client.0.smithi073.stdout:0/551: dread - d2/d1f/d9d/fa4 zero size 2024-04-26T11:24:02.285 INFO:tasks.workunit.client.0.smithi073.stdout:2/542: creat dd/de/d38/fa2 x:0 0 0 2024-04-26T11:24:02.286 INFO:tasks.workunit.client.0.smithi073.stdout:0/552: creat d2/d37/d3c/d6a/fca x:0 0 0 2024-04-26T11:24:02.287 INFO:tasks.workunit.client.0.smithi073.stdout:2/543: rename dd/de/d2a/f94 to dd/d4c/d48/d77/fa3 0 2024-04-26T11:24:02.287 INFO:tasks.workunit.client.0.smithi073.stdout:0/553: chown d2/d1f/d40/d48/c7f 6 1 2024-04-26T11:24:02.287 INFO:tasks.workunit.client.0.smithi073.stdout:0/554: unlink d2/d1f/d9d/fa4 0 2024-04-26T11:24:02.288 INFO:tasks.workunit.client.0.smithi073.stdout:2/544: write dd/d4c/d48/d46/d91/d9f/d1d/d8c/f99 [819889,11972] 0 2024-04-26T11:24:02.288 INFO:tasks.workunit.client.0.smithi073.stdout:0/555: write d2/d1f/d40/d48/f52 [2115509,84841] 0 2024-04-26T11:24:02.288 INFO:tasks.workunit.client.0.smithi073.stdout:2/545: write dd/de/d38/f93 [446098,101609] 0 2024-04-26T11:24:02.289 INFO:tasks.workunit.client.0.smithi073.stdout:0/556: mknod d2/d5f/ccb 0 2024-04-26T11:24:02.289 INFO:tasks.workunit.client.0.smithi073.stdout:2/546: creat dd/de/d38/fa4 x:0 0 0 2024-04-26T11:24:02.290 INFO:tasks.workunit.client.0.smithi073.stdout:0/557: write d2/d37/d3c/f88 [471617,34146] 0 2024-04-26T11:24:02.290 INFO:tasks.workunit.client.0.smithi073.stdout:2/547: getdents dd/d4c/d48/d46/d91 0 2024-04-26T11:24:02.291 INFO:tasks.workunit.client.0.smithi073.stdout:1/660: fsync d1/d6/d7f/d47/fe0 0 2024-04-26T11:24:02.292 INFO:tasks.workunit.client.0.smithi073.stdout:1/661: stat d1/d16/d6a/f72 0 2024-04-26T11:24:02.293 INFO:tasks.workunit.client.0.smithi073.stdout:1/662: creat d1/d6/fe2 x:0 0 0 2024-04-26T11:24:02.293 INFO:tasks.workunit.client.0.smithi073.stdout:5/575: write d4/d8/d9/d7d/d84/da7/fd8 [1270882,66015] 0 2024-04-26T11:24:02.294 INFO:tasks.workunit.client.0.smithi073.stdout:5/576: readlink d4/de/l8c 0 2024-04-26T11:24:02.295 INFO:tasks.workunit.client.0.smithi073.stdout:6/533: write d0/d19/f21 [1110916,96125] 0 2024-04-26T11:24:02.296 INFO:tasks.workunit.client.0.smithi073.stdout:8/608: dwrite d1/d21/d50/d67/d81/f84 [0,4194304] 0 2024-04-26T11:24:02.296 INFO:tasks.workunit.client.0.smithi073.stdout:2/548: read dd/d4c/d48/d46/f69 [2908131,58871] 0 2024-04-26T11:24:02.296 INFO:tasks.workunit.client.0.smithi073.stdout:5/577: dread - d4/d95/da5/fd2 zero size 2024-04-26T11:24:02.296 INFO:tasks.workunit.client.0.smithi073.stdout:0/558: dwrite d2/d1f/d40/d48/f5d [0,4194304] 0 2024-04-26T11:24:02.300 INFO:tasks.workunit.client.0.smithi073.stdout:4/599: truncate d8/d1a/d1b/d24/dac/d49/f6c 2861359 0 2024-04-26T11:24:02.301 INFO:tasks.workunit.client.0.smithi073.stdout:2/549: mkdir dd/d4c/d48/d46/d91/da5 0 2024-04-26T11:24:02.301 INFO:tasks.workunit.client.0.smithi073.stdout:6/534: creat d0/d1a/d26/d4b/d49/fa3 x:0 0 0 2024-04-26T11:24:02.301 INFO:tasks.workunit.client.0.smithi073.stdout:0/559: mknod d2/d1f/d40/d48/d62/ccc 0 2024-04-26T11:24:02.301 INFO:tasks.workunit.client.0.smithi073.stdout:4/600: readlink d8/d1a/d86/l95 0 2024-04-26T11:24:02.301 INFO:tasks.workunit.client.0.smithi073.stdout:6/535: dread - d0/d1a/d26/d27/f8a zero size 2024-04-26T11:24:02.301 INFO:tasks.workunit.client.0.smithi073.stdout:0/560: readlink d2/d22/d51/d57/l67 0 2024-04-26T11:24:02.302 INFO:tasks.workunit.client.0.smithi073.stdout:6/536: creat d0/d1a/d4e/fa4 x:0 0 0 2024-04-26T11:24:02.302 INFO:tasks.workunit.client.0.smithi073.stdout:0/561: write d2/d22/f35 [1869545,81360] 0 2024-04-26T11:24:02.302 INFO:tasks.workunit.client.0.smithi073.stdout:4/601: truncate d8/d1a/d86/fa8 778936 0 2024-04-26T11:24:02.304 INFO:tasks.workunit.client.0.smithi073.stdout:7/588: sync 2024-04-26T11:24:02.305 INFO:tasks.workunit.client.0.smithi073.stdout:7/589: unlink d1/d33/d1b/l6c 0 2024-04-26T11:24:02.306 INFO:tasks.workunit.client.0.smithi073.stdout:2/550: dwrite dd/de/d38/f75 [0,4194304] 0 2024-04-26T11:24:02.309 INFO:tasks.workunit.client.0.smithi073.stdout:0/562: dwrite d2/d37/d3c/d73/fb4 [0,4194304] 0 2024-04-26T11:24:02.309 INFO:tasks.workunit.client.0.smithi073.stdout:0/563: chown d2/d1f/d40/d48/da9 1 1 2024-04-26T11:24:02.310 INFO:tasks.workunit.client.0.smithi073.stdout:2/551: dread dd/de/d38/f75 [0,4194304] 0 2024-04-26T11:24:02.310 INFO:tasks.workunit.client.0.smithi073.stdout:0/564: creat d2/fcd x:0 0 0 2024-04-26T11:24:02.311 INFO:tasks.workunit.client.0.smithi073.stdout:1/663: read d1/d73/d53/f59 [3924986,130758] 0 2024-04-26T11:24:02.311 INFO:tasks.workunit.client.0.smithi073.stdout:0/565: chown d2/d1f/d40/d48/c7f 3865 1 2024-04-26T11:24:02.312 INFO:tasks.workunit.client.0.smithi073.stdout:4/602: dread d8/d15/f3e [0,4194304] 0 2024-04-26T11:24:02.312 INFO:tasks.workunit.client.0.smithi073.stdout:2/552: truncate dd/de/d38/d53/f74 4451488 0 2024-04-26T11:24:02.313 INFO:tasks.workunit.client.0.smithi073.stdout:1/664: symlink d1/d73/d53/dd4/le3 0 2024-04-26T11:24:02.313 INFO:tasks.workunit.client.0.smithi073.stdout:4/603: fsync d8/d1a/d1b/fb5 0 2024-04-26T11:24:02.314 INFO:tasks.workunit.client.0.smithi073.stdout:2/553: fsync dd/de/d38/d53/d60/f7d 0 2024-04-26T11:24:02.314 INFO:tasks.workunit.client.0.smithi073.stdout:0/566: read d2/d1f/d40/d48/f4a [1151789,62099] 0 2024-04-26T11:24:02.314 INFO:tasks.workunit.client.0.smithi073.stdout:6/537: truncate d0/d19/d20/f65 1061783 0 2024-04-26T11:24:02.315 INFO:tasks.workunit.client.0.smithi073.stdout:0/567: creat d2/d1f/d40/d48/da9/fce x:0 0 0 2024-04-26T11:24:02.316 INFO:tasks.workunit.client.0.smithi073.stdout:0/568: mknod d2/d1f/d9c/ccf 0 2024-04-26T11:24:02.317 INFO:tasks.workunit.client.0.smithi073.stdout:0/569: write d2/d37/d3c/d6a/f98 [228681,25830] 0 2024-04-26T11:24:02.317 INFO:tasks.workunit.client.0.smithi073.stdout:7/590: write d1/d11/d24/d26/d4b/f70 [179565,33675] 0 2024-04-26T11:24:02.318 INFO:tasks.workunit.client.0.smithi073.stdout:0/570: chown d2/d1f/d40/d48/d62/f71 31955 1 2024-04-26T11:24:02.319 INFO:tasks.workunit.client.0.smithi073.stdout:7/591: link d1/d11/d24/d26/d4b/fbf d1/d11/d51/fd5 0 2024-04-26T11:24:02.321 INFO:tasks.workunit.client.0.smithi073.stdout:1/665: dwrite d1/d16/d61/f9c [0,4194304] 0 2024-04-26T11:24:02.321 INFO:tasks.workunit.client.0.smithi073.stdout:4/604: dwrite d8/d1a/d9c/d9d/fae [0,4194304] 0 2024-04-26T11:24:02.321 INFO:tasks.workunit.client.0.smithi073.stdout:7/592: mknod d1/d11/d51/dca/cd6 0 2024-04-26T11:24:02.322 INFO:tasks.workunit.client.0.smithi073.stdout:1/666: write d1/d16/d61/f9c [3897125,81783] 0 2024-04-26T11:24:02.325 INFO:tasks.workunit.client.0.smithi073.stdout:0/571: dwrite d2/d37/d3c/d6a/fca [0,4194304] 0 2024-04-26T11:24:02.325 INFO:tasks.workunit.client.0.smithi073.stdout:0/572: readlink d2/l6f 0 2024-04-26T11:24:02.329 INFO:tasks.workunit.client.0.smithi073.stdout:3/554: dread d0/d11/d19/f6 [0,4194304] 0 2024-04-26T11:24:02.331 INFO:tasks.workunit.client.0.smithi073.stdout:9/573: dread d0/d1a/d4e/d70/d51/f67 [0,4194304] 0 2024-04-26T11:24:02.332 INFO:tasks.workunit.client.0.smithi073.stdout:1/667: mknod d1/d8/ce4 0 2024-04-26T11:24:02.332 INFO:tasks.workunit.client.0.smithi073.stdout:7/593: rename d1/d11/d24/d26 to d1/d11/d24/d29/dd7 0 2024-04-26T11:24:02.332 INFO:tasks.workunit.client.0.smithi073.stdout:4/605: creat d8/d14/fd7 x:0 0 0 2024-04-26T11:24:02.333 INFO:tasks.workunit.client.0.smithi073.stdout:9/574: creat d0/d13/d25/fc2 x:0 0 0 2024-04-26T11:24:02.333 INFO:tasks.workunit.client.0.smithi073.stdout:1/668: chown d1/d6/db3/d9f/faf 1667538 1 2024-04-26T11:24:02.333 INFO:tasks.workunit.client.0.smithi073.stdout:4/606: stat d8/d1a/c1e 0 2024-04-26T11:24:02.333 INFO:tasks.workunit.client.0.smithi073.stdout:7/594: write d1/f75 [610460,42384] 0 2024-04-26T11:24:02.333 INFO:tasks.workunit.client.0.smithi073.stdout:9/575: creat d0/d13/d5a/fc3 x:0 0 0 2024-04-26T11:24:02.334 INFO:tasks.workunit.client.0.smithi073.stdout:7/595: fdatasync d1/d33/d1b/fb3 0 2024-04-26T11:24:02.335 INFO:tasks.workunit.client.0.smithi073.stdout:1/669: getdents d1/d16/d6a 0 2024-04-26T11:24:02.335 INFO:tasks.workunit.client.0.smithi073.stdout:7/596: chown d1/d11/d24/d29/dd7/d3d/dba/fc4 155198 1 2024-04-26T11:24:02.336 INFO:tasks.workunit.client.0.smithi073.stdout:9/576: write d0/d13/d25/d2c/f33 [4781580,20693] 0 2024-04-26T11:24:02.336 INFO:tasks.workunit.client.0.smithi073.stdout:3/555: dwrite d0/d11/d23/d3b/f7f [4194304,4194304] 0 2024-04-26T11:24:02.337 INFO:tasks.workunit.client.0.smithi073.stdout:9/577: write d0/d3c/f7a [2698383,43958] 0 2024-04-26T11:24:02.339 INFO:tasks.workunit.client.0.smithi073.stdout:9/578: link d0/d13/db/f4b d0/d13/d25/d75/d8e/db9/fc4 0 2024-04-26T11:24:02.340 INFO:tasks.workunit.client.0.smithi073.stdout:3/556: unlink d0/d2d/ca5 0 2024-04-26T11:24:02.340 INFO:tasks.workunit.client.0.smithi073.stdout:3/557: symlink d0/d34/lc3 2 2024-04-26T11:24:02.340 INFO:tasks.workunit.client.0.smithi073.stdout:4/607: dwrite d8/d1a/d1b/d1d/faa [0,4194304] 0 2024-04-26T11:24:02.341 INFO:tasks.workunit.client.0.smithi073.stdout:3/558: chown d0/d11/d19/fa0 80778633 1 2024-04-26T11:24:02.341 INFO:tasks.workunit.client.0.smithi073.stdout:9/579: write d0/d1a/d4e/d70/f38 [1628600,40815] 0 2024-04-26T11:24:02.342 INFO:tasks.workunit.client.0.smithi073.stdout:2/554: dread dd/de/d38/f70 [0,4194304] 0 2024-04-26T11:24:02.342 INFO:tasks.workunit.client.0.smithi073.stdout:9/580: write d0/d13/d25/fc2 [187162,94036] 0 2024-04-26T11:24:02.343 INFO:tasks.workunit.client.0.smithi073.stdout:7/597: dwrite d1/d11/fd [0,4194304] 0 2024-04-26T11:24:02.343 INFO:tasks.workunit.client.0.smithi073.stdout:2/555: readlink dd/d4c/d48/d46/d91/d9f/l6d 0 2024-04-26T11:24:02.348 INFO:tasks.workunit.client.0.smithi073.stdout:4/608: dwrite d8/d1a/d1b/d41/f58 [0,4194304] 0 2024-04-26T11:24:02.350 INFO:tasks.workunit.client.0.smithi073.stdout:7/598: dwrite d1/d11/d24/d29/dd7/d3d/fc7 [0,4194304] 0 2024-04-26T11:24:02.350 INFO:tasks.workunit.client.0.smithi073.stdout:7/599: chown d1/d33/d1b/fd3 2813 1 2024-04-26T11:24:02.356 INFO:tasks.workunit.client.0.smithi073.stdout:0/573: sync 2024-04-26T11:24:02.356 INFO:tasks.workunit.client.0.smithi073.stdout:3/559: link d0/d11/d19/db/d3e/d3f/f55 d0/d11/d19/db/d3e/d47/fc4 0 2024-04-26T11:24:02.357 INFO:tasks.workunit.client.0.smithi073.stdout:4/609: mknod d8/d1a/d1b/d24/dac/cd8 0 2024-04-26T11:24:02.357 INFO:tasks.workunit.client.0.smithi073.stdout:0/574: chown d2/l6f 84 1 2024-04-26T11:24:02.357 INFO:tasks.workunit.client.0.smithi073.stdout:0/575: readlink d2/l6f 0 2024-04-26T11:24:02.358 INFO:tasks.workunit.client.0.smithi073.stdout:0/576: chown d2/l10 18273 1 2024-04-26T11:24:02.358 INFO:tasks.workunit.client.0.smithi073.stdout:5/578: dread d4/de/f2c [0,4194304] 0 2024-04-26T11:24:02.358 INFO:tasks.workunit.client.0.smithi073.stdout:4/610: creat d8/d1a/d1b/d24/dac/d72/fd9 x:0 0 0 2024-04-26T11:24:02.359 INFO:tasks.workunit.client.0.smithi073.stdout:3/560: symlink d0/d11/d19/db/da6/d8b/d8c/d90/db4/lc5 0 2024-04-26T11:24:02.359 INFO:tasks.workunit.client.0.smithi073.stdout:5/579: chown d4/c6 198 1 2024-04-26T11:24:02.359 INFO:tasks.workunit.client.0.smithi073.stdout:4/611: chown d8/d1a/d1b/d24/dac/d72 1440819 1 2024-04-26T11:24:02.359 INFO:tasks.workunit.client.0.smithi073.stdout:3/561: mknod d0/d11/d19/d70/cc6 0 2024-04-26T11:24:02.360 INFO:tasks.workunit.client.0.smithi073.stdout:0/577: symlink d2/d37/d3c/d73/ld0 0 2024-04-26T11:24:02.361 INFO:tasks.workunit.client.0.smithi073.stdout:1/670: truncate d1/d73/f35 5006492 0 2024-04-26T11:24:02.361 INFO:tasks.workunit.client.0.smithi073.stdout:2/556: dwrite f0 [0,4194304] 0 2024-04-26T11:24:02.361 INFO:tasks.workunit.client.0.smithi073.stdout:1/671: write d1/d8/f2d [1387353,34040] 0 2024-04-26T11:24:02.363 INFO:tasks.workunit.client.0.smithi073.stdout:0/578: rename d2/d37/d3c/d6a/f98 to d2/d22/d51/fd1 0 2024-04-26T11:24:02.364 INFO:tasks.workunit.client.0.smithi073.stdout:1/672: rmdir d1/d6/d7f/d47 39 2024-04-26T11:24:02.364 INFO:tasks.workunit.client.0.smithi073.stdout:2/557: symlink dd/de/la6 0 2024-04-26T11:24:02.364 INFO:tasks.workunit.client.0.smithi073.stdout:0/579: fsync d2/d1f/d40/f82 0 2024-04-26T11:24:02.365 INFO:tasks.workunit.client.0.smithi073.stdout:1/673: chown d1/d8/d57/f8d 3217901 1 2024-04-26T11:24:02.365 INFO:tasks.workunit.client.0.smithi073.stdout:0/580: mkdir d2/d84/dd2 0 2024-04-26T11:24:02.365 INFO:tasks.workunit.client.0.smithi073.stdout:2/558: truncate dd/d4c/d48/d77/fa3 374732 0 2024-04-26T11:24:02.365 INFO:tasks.workunit.client.0.smithi073.stdout:1/674: rename d1/d73/d40/f2c to d1/fe5 0 2024-04-26T11:24:02.366 INFO:tasks.workunit.client.0.smithi073.stdout:2/559: readlink dd/de/d38/d4e/l56 0 2024-04-26T11:24:02.371 INFO:tasks.workunit.client.0.smithi073.stdout:0/581: dwrite d2/d37/d3c/d6a/fca [0,4194304] 0 2024-04-26T11:24:02.371 INFO:tasks.workunit.client.0.smithi073.stdout:2/560: dread dd/de/d38/d4e/f51 [0,4194304] 0 2024-04-26T11:24:02.371 INFO:tasks.workunit.client.0.smithi073.stdout:8/609: dread d1/d4/d37/f48 [0,4194304] 0 2024-04-26T11:24:02.372 INFO:tasks.workunit.client.0.smithi073.stdout:1/675: dwrite d1/d6/d7f/f76 [0,4194304] 0 2024-04-26T11:24:02.376 INFO:tasks.workunit.client.0.smithi073.stdout:8/610: creat d1/d21/d50/d67/d81/da5/fd4 x:0 0 0 2024-04-26T11:24:02.376 INFO:tasks.workunit.client.0.smithi073.stdout:1/676: mkdir d1/d8/d5d/d89/de6 0 2024-04-26T11:24:02.376 INFO:tasks.workunit.client.0.smithi073.stdout:2/561: write dd/de/d38/f70 [1179122,49877] 0 2024-04-26T11:24:02.376 INFO:tasks.workunit.client.0.smithi073.stdout:0/582: creat d2/d37/fd3 x:0 0 0 2024-04-26T11:24:02.377 INFO:tasks.workunit.client.0.smithi073.stdout:2/562: stat dd/de/d6b/f5f 0 2024-04-26T11:24:02.377 INFO:tasks.workunit.client.0.smithi073.stdout:8/611: creat d1/fd5 x:0 0 0 2024-04-26T11:24:02.377 INFO:tasks.workunit.client.0.smithi073.stdout:1/677: symlink d1/d6/d7f/d47/le7 0 2024-04-26T11:24:02.377 INFO:tasks.workunit.client.0.smithi073.stdout:1/678: chown d1/d6/db3/d9f/fa1 8 1 2024-04-26T11:24:02.382 INFO:tasks.workunit.client.0.smithi073.stdout:8/612: dwrite d1/d4/d4c/d66/d8b/fa4 [0,4194304] 0 2024-04-26T11:24:02.382 INFO:tasks.workunit.client.0.smithi073.stdout:4/612: dread d8/d1a/d1b/d24/dac/d72/da3/fb6 [0,4194304] 0 2024-04-26T11:24:02.383 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:02.380+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:02.383 INFO:tasks.workunit.client.0.smithi073.stdout:4/613: write d8/d1a/d1b/f26 [1577875,72850] 0 2024-04-26T11:24:02.385 INFO:tasks.workunit.client.0.smithi073.stdout:0/583: read d2/d22/f33 [958574,14715] 0 2024-04-26T11:24:02.385 INFO:tasks.workunit.client.0.smithi073.stdout:0/584: readlink d2/d1f/d40/d48/l59 0 2024-04-26T11:24:02.386 INFO:tasks.workunit.client.0.smithi073.stdout:0/585: chown d2/c3b 49247632 1 2024-04-26T11:24:02.386 INFO:tasks.workunit.client.0.smithi073.stdout:7/600: truncate d1/d11/d24/d29/dd7/d4b/f70 667792 0 2024-04-26T11:24:02.388 INFO:tasks.workunit.client.0.smithi073.stdout:4/614: creat d8/d1a/d1b/dd2/fda x:0 0 0 2024-04-26T11:24:02.388 INFO:tasks.workunit.client.0.smithi073.stdout:6/538: dread d0/f2 [0,4194304] 0 2024-04-26T11:24:02.388 INFO:tasks.workunit.client.0.smithi073.stdout:0/586: rmdir d2/d37/d3c/d6a 39 2024-04-26T11:24:02.390 INFO:tasks.workunit.client.0.smithi073.stdout:4/615: symlink d8/d1a/d5e/dc5/ldb 0 2024-04-26T11:24:02.390 INFO:tasks.workunit.client.0.smithi073.stdout:7/601: unlink d1/d11/d10/lc6 0 2024-04-26T11:24:02.390 INFO:tasks.workunit.client.0.smithi073.stdout:8/613: dwrite d1/d4/d4c/d66/f78 [0,4194304] 0 2024-04-26T11:24:02.390 INFO:tasks.workunit.client.0.smithi073.stdout:0/587: chown d2/d1f/d40/d48/f97 15629 1 2024-04-26T11:24:02.391 INFO:tasks.workunit.client.0.smithi073.stdout:2/563: dread dd/de/f28 [0,4194304] 0 2024-04-26T11:24:02.391 INFO:tasks.workunit.client.0.smithi073.stdout:8/614: chown d1/d21/d2c/f57 28121448 1 2024-04-26T11:24:02.392 INFO:tasks.workunit.client.0.smithi073.stdout:7/602: creat d1/d11/d24/d29/dd7/d3d/d41/d64/dae/fd8 x:0 0 0 2024-04-26T11:24:02.392 INFO:tasks.workunit.client.0.smithi073.stdout:8/615: symlink d1/d21/d2c/ld6 0 2024-04-26T11:24:02.393 INFO:tasks.workunit.client.0.smithi073.stdout:6/539: dread d0/dc/d80/f83 [0,4194304] 0 2024-04-26T11:24:02.395 INFO:tasks.workunit.client.0.smithi073.stdout:6/540: creat d0/d1a/d26/d4b/d49/d84/fa5 x:0 0 0 2024-04-26T11:24:02.395 INFO:tasks.workunit.client.0.smithi073.stdout:4/616: dread d8/d1a/d1b/d24/dac/f27 [0,4194304] 0 2024-04-26T11:24:02.396 INFO:tasks.workunit.client.0.smithi073.stdout:4/617: chown d8/d1a/d1b/d24/dac/da7/fba 104 1 2024-04-26T11:24:02.397 INFO:tasks.workunit.client.0.smithi073.stdout:4/618: dread - d8/d1f/fc0 zero size 2024-04-26T11:24:02.397 INFO:tasks.workunit.client.0.smithi073.stdout:4/619: write d8/d1a/d1b/d41/f48 [92574,64883] 0 2024-04-26T11:24:02.398 INFO:tasks.workunit.client.0.smithi073.stdout:4/620: dread - d8/d1a/d1b/d46/d57/f8a zero size 2024-04-26T11:24:02.399 INFO:tasks.workunit.client.0.smithi073.stdout:4/621: mkdir d8/d1a/d4d/ddc 0 2024-04-26T11:24:02.399 INFO:tasks.workunit.client.0.smithi073.stdout:4/622: fdatasync d8/d1a/d1b/dd2/fda 0 2024-04-26T11:24:02.400 INFO:tasks.workunit.client.0.smithi073.stdout:9/581: dread d0/d13/d25/d75/d8e/fb0 [0,4194304] 0 2024-04-26T11:24:02.403 INFO:tasks.workunit.client.0.smithi073.stdout:3/562: dread d0/f45 [0,4194304] 0 2024-04-26T11:24:02.404 INFO:tasks.workunit.client.0.smithi073.stdout:3/563: symlink d0/d26/da2/lc7 0 2024-04-26T11:24:02.404 INFO:tasks.workunit.client.0.smithi073.stdout:3/564: write d0/d11/d19/fc [743146,66081] 0 2024-04-26T11:24:02.405 INFO:tasks.workunit.client.0.smithi073.stdout:0/588: truncate d2/f3f 232826 0 2024-04-26T11:24:02.405 INFO:tasks.workunit.client.0.smithi073.stdout:0/589: symlink d2/d1f/d40/ld4 0 2024-04-26T11:24:02.405 INFO:tasks.workunit.client.0.smithi073.stdout:2/564: write dd/d4c/d48/f90 [113269,26912] 0 2024-04-26T11:24:02.406 INFO:tasks.workunit.client.0.smithi073.stdout:3/565: dread d0/d26/f58 [0,4194304] 0 2024-04-26T11:24:02.406 INFO:tasks.workunit.client.0.smithi073.stdout:2/565: dread - dd/de/d2a/f5b zero size 2024-04-26T11:24:02.406 INFO:tasks.workunit.client.0.smithi073.stdout:0/590: creat d2/d22/d51/d57/d78/fd5 x:0 0 0 2024-04-26T11:24:02.407 INFO:tasks.workunit.client.0.smithi073.stdout:8/616: truncate d1/f26 2212478 0 2024-04-26T11:24:02.407 INFO:tasks.workunit.client.0.smithi073.stdout:2/566: write dd/d4c/d48/d46/d91/d9f/d1d/f20 [1710048,17582] 0 2024-04-26T11:24:02.408 INFO:tasks.workunit.client.0.smithi073.stdout:0/591: stat d2/d22/d51/d57/f85 0 2024-04-26T11:24:02.408 INFO:tasks.workunit.client.0.smithi073.stdout:3/566: creat d0/d11/d19/db/d51/fc8 x:0 0 0 2024-04-26T11:24:02.408 INFO:tasks.workunit.client.0.smithi073.stdout:0/592: fdatasync d2/d1f/d40/d48/fa5 0 2024-04-26T11:24:02.409 INFO:tasks.workunit.client.0.smithi073.stdout:3/567: truncate d0/d11/d19/db/fb3 1019633 0 2024-04-26T11:24:02.411 INFO:tasks.workunit.client.0.smithi073.stdout:2/567: mkdir dd/d27/da0/da7 0 2024-04-26T11:24:02.411 INFO:tasks.workunit.client.0.smithi073.stdout:4/623: write d8/d1a/d1b/d24/dac/d49/d84/fc4 [3022571,120833] 0 2024-04-26T11:24:02.412 INFO:tasks.workunit.client.0.smithi073.stdout:0/593: getdents d2/d1f 0 2024-04-26T11:24:02.412 INFO:tasks.workunit.client.0.smithi073.stdout:2/568: read - dd/de/d2a/f5b zero size 2024-04-26T11:24:02.413 INFO:tasks.workunit.client.0.smithi073.stdout:5/580: sync 2024-04-26T11:24:02.414 INFO:tasks.workunit.client.0.smithi073.stdout:5/581: fdatasync d4/de/d15/d60/f89 0 2024-04-26T11:24:02.414 INFO:tasks.workunit.client.0.smithi073.stdout:0/594: stat d2/d1f/d40/d48/c70 0 2024-04-26T11:24:02.414 INFO:tasks.workunit.client.0.smithi073.stdout:1/679: dread d1/d8/fba [0,4194304] 0 2024-04-26T11:24:02.415 INFO:tasks.workunit.client.0.smithi073.stdout:3/568: truncate d0/fac 39946 0 2024-04-26T11:24:02.415 INFO:tasks.workunit.client.0.smithi073.stdout:2/569: mknod dd/d4c/d48/d46/ca8 0 2024-04-26T11:24:02.416 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:02.416 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:02.416 INFO:tasks.workunit.client.0.smithi073.stdout:6/541: dread d0/d1a/d26/d4b/f7d [0,4194304] 0 2024-04-26T11:24:02.417 INFO:tasks.workunit.client.0.smithi073.stdout:8/617: dwrite d1/d4/d37/d5b/f7a [0,4194304] 0 2024-04-26T11:24:02.417 INFO:tasks.workunit.client.0.smithi073.stdout:5/582: unlink d4/de/d15/d60/l2f 0 2024-04-26T11:24:02.417 INFO:tasks.workunit.client.0.smithi073.stdout:3/569: fsync d0/d11/d23/d3b/d3c/fba 0 2024-04-26T11:24:02.417 INFO:tasks.workunit.client.0.smithi073.stdout:3/570: fdatasync d0/faf 0 2024-04-26T11:24:02.418 INFO:tasks.workunit.client.0.smithi073.stdout:6/542: chown d0/dc/d2e/l7e 12554097 1 2024-04-26T11:24:02.422 INFO:tasks.workunit.client.0.smithi073.stdout:8/618: rename d1/d21/l45 to d1/d4/d37/d90/ld7 0 2024-04-26T11:24:02.422 INFO:tasks.workunit.client.0.smithi073.stdout:5/583: creat d4/de/d15/d33/fda x:0 0 0 2024-04-26T11:24:02.422 INFO:tasks.workunit.client.0.smithi073.stdout:3/571: mkdir d0/d11/d19/db/da6/d8b/dc9 0 2024-04-26T11:24:02.422 INFO:tasks.workunit.client.0.smithi073.stdout:6/543: mknod d0/d1a/d26/d4b/d49/d84/ca6 0 2024-04-26T11:24:02.422 INFO:tasks.workunit.client.0.smithi073.stdout:4/624: dwrite d8/d1a/d1b/d24/dac/d72/da3/fb6 [0,4194304] 0 2024-04-26T11:24:02.422 INFO:tasks.workunit.client.0.smithi073.stdout:2/570: rename dd/de/c3b to dd/de/ca9 0 2024-04-26T11:24:02.422 INFO:tasks.workunit.client.0.smithi073.stdout:5/584: truncate d4/d8/f81 1733436 0 2024-04-26T11:24:02.422 INFO:tasks.workunit.client.0.smithi073.stdout:9/582: dread d0/fa7 [0,4194304] 0 2024-04-26T11:24:02.423 INFO:tasks.workunit.client.0.smithi073.stdout:2/571: creat dd/d4c/d48/d46/faa x:0 0 0 2024-04-26T11:24:02.423 INFO:tasks.workunit.client.0.smithi073.stdout:9/583: symlink d0/d13/d25/d75/lc5 0 2024-04-26T11:24:02.423 INFO:tasks.workunit.client.0.smithi073.stdout:3/572: creat d0/d11/d19/db/d3e/d3f/d69/dab/fca x:0 0 0 2024-04-26T11:24:02.425 INFO:tasks.workunit.client.0.smithi073.stdout:8/619: link d1/d21/c4e d1/d4/d15/db7/cd8 0 2024-04-26T11:24:02.425 INFO:tasks.workunit.client.0.smithi073.stdout:6/544: write d0/dc/f9f [37092,125709] 0 2024-04-26T11:24:02.425 INFO:tasks.workunit.client.0.smithi073.stdout:2/572: mkdir dd/d4c/d48/d77/d80/dab 0 2024-04-26T11:24:02.425 INFO:tasks.workunit.client.0.smithi073.stdout:6/545: symlink d0/d1a/d7a/la7 0 2024-04-26T11:24:02.426 INFO:tasks.workunit.client.0.smithi073.stdout:2/573: readlink dd/de/d38/d4e/l56 0 2024-04-26T11:24:02.426 INFO:tasks.workunit.client.0.smithi073.stdout:8/620: link d1/d4/d7b/d8d/fc8 d1/d21/fd9 0 2024-04-26T11:24:02.426 INFO:tasks.workunit.client.0.smithi073.stdout:6/546: rmdir d0/d1a/d26/d4b/d38 39 2024-04-26T11:24:02.427 INFO:tasks.workunit.client.0.smithi073.stdout:8/621: chown d1/d21/d50/d67/c7e 99 1 2024-04-26T11:24:02.427 INFO:tasks.workunit.client.0.smithi073.stdout:2/574: fdatasync dd/d4c/d48/d46/d91/d9f/d1d/d8c/f99 0 2024-04-26T11:24:02.427 INFO:tasks.workunit.client.0.smithi073.stdout:6/547: symlink d0/dc/d2e/la8 0 2024-04-26T11:24:02.427 INFO:tasks.workunit.client.0.smithi073.stdout:9/584: link d0/d13/d5a/d5e/f94 d0/d13/d25/d2c/dbf/fc6 0 2024-04-26T11:24:02.428 INFO:tasks.workunit.client.0.smithi073.stdout:4/625: dread d8/d1a/d86/fa8 [0,4194304] 0 2024-04-26T11:24:02.428 INFO:tasks.workunit.client.0.smithi073.stdout:8/622: chown d1/d21/d50/d67/l9a 92 1 2024-04-26T11:24:02.429 INFO:tasks.workunit.client.0.smithi073.stdout:9/585: chown d0/d83/fb1 0 1 2024-04-26T11:24:02.430 INFO:tasks.workunit.client.0.smithi073.stdout:5/585: dwrite d4/de/d15/d60/f16 [0,4194304] 0 2024-04-26T11:24:02.430 INFO:tasks.workunit.client.0.smithi073.stdout:7/603: sync 2024-04-26T11:24:02.430 INFO:tasks.workunit.client.0.smithi073.stdout:2/575: sync 2024-04-26T11:24:02.430 INFO:tasks.workunit.client.0.smithi073.stdout:8/623: write d1/d21/d2a/f39 [1101031,16013] 0 2024-04-26T11:24:02.432 INFO:tasks.workunit.client.0.smithi073.stdout:9/586: chown d0/d1a/d4e/d70/faa 9 1 2024-04-26T11:24:02.432 INFO:tasks.workunit.client.0.smithi073.stdout:3/573: dwrite d0/d11/d23/fae [0,4194304] 0 2024-04-26T11:24:02.433 INFO:tasks.workunit.client.0.smithi073.stdout:1/680: dread d1/d16/d4f/d55/d5a/f7a [0,4194304] 0 2024-04-26T11:24:02.433 INFO:tasks.workunit.client.0.smithi073.stdout:6/548: rename d0/dc/d80/f77 to d0/d1a/d26/d4b/d2b/d2c/fa9 0 2024-04-26T11:24:02.433 INFO:tasks.workunit.client.0.smithi073.stdout:1/681: fdatasync d1/d73/d34/f78 0 2024-04-26T11:24:02.434 INFO:tasks.workunit.client.0.smithi073.stdout:9/587: mkdir d0/d6c/dc7 0 2024-04-26T11:24:02.434 INFO:tasks.workunit.client.0.smithi073.stdout:3/574: creat d0/d11/d23/fcb x:0 0 0 2024-04-26T11:24:02.436 INFO:tasks.workunit.client.0.smithi073.stdout:6/549: chown d0/d1a/d4e 0 1 2024-04-26T11:24:02.436 INFO:tasks.workunit.client.0.smithi073.stdout:4/626: creat d8/d1a/d1b/d24/dac/fdd x:0 0 0 2024-04-26T11:24:02.436 INFO:tasks.workunit.client.0.smithi073.stdout:7/604: chown d1/d11/d24/d29/dd7/d3d/d41/lc9 1157 1 2024-04-26T11:24:02.436 INFO:tasks.workunit.client.0.smithi073.stdout:9/588: stat d0/d13/d25/d2c 0 2024-04-26T11:24:02.436 INFO:tasks.workunit.client.0.smithi073.stdout:1/682: truncate d1/d73/f1b 5045677 0 2024-04-26T11:24:02.436 INFO:tasks.workunit.client.0.smithi073.stdout:1/683: chown d1/d6/d7f/d47 217181 1 2024-04-26T11:24:02.437 INFO:tasks.workunit.client.0.smithi073.stdout:5/586: symlink d4/d8/ldb 0 2024-04-26T11:24:02.437 INFO:tasks.workunit.client.0.smithi073.stdout:3/575: mknod d0/d11/d19/db/d51/ccc 0 2024-04-26T11:24:02.437 INFO:tasks.workunit.client.0.smithi073.stdout:9/589: symlink d0/d13/d25/d9c/lc8 0 2024-04-26T11:24:02.437 INFO:tasks.workunit.client.0.smithi073.stdout:7/605: symlink d1/d33/ld9 0 2024-04-26T11:24:02.439 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:02.439 INFO:tasks.workunit.client.0.smithi073.stdout:5/587: write d4/de/fcc [389197,71714] 0 2024-04-26T11:24:02.440 INFO:tasks.workunit.client.0.smithi073.stdout:9/590: chown d0/d13/d25/l7c 134961605 1 2024-04-26T11:24:02.440 INFO:tasks.workunit.client.0.smithi073.stdout:8/624: link d1/l70 d1/lda 0 2024-04-26T11:24:02.441 INFO:tasks.workunit.client.0.smithi073.stdout:8/625: rmdir d1/d4/d15/dbc 39 2024-04-26T11:24:02.441 INFO:tasks.workunit.client.0.smithi073.stdout:3/576: getdents d0/d11/d19/db/d3e/d47 0 2024-04-26T11:24:02.441 INFO:tasks.workunit.client.0.smithi073.stdout:9/591: symlink d0/d13/d25/d2c/dbf/lc9 0 2024-04-26T11:24:02.441 INFO:tasks.workunit.client.0.smithi073.stdout:5/588: rename d4/de/d15/d60 to d4/d8/d9/d7d/da3/ddc 0 2024-04-26T11:24:02.441 INFO:tasks.workunit.client.0.smithi073.stdout:6/550: dwrite d0/d1a/d26/d4b/f5b [0,4194304] 0 2024-04-26T11:24:02.442 INFO:tasks.workunit.client.0.smithi073.stdout:8/626: fdatasync d1/d21/d50/d67/fb8 0 2024-04-26T11:24:02.443 INFO:tasks.workunit.client.0.smithi073.stdout:9/592: write d0/fa7 [3568318,75296] 0 2024-04-26T11:24:02.443 INFO:tasks.workunit.client.0.smithi073.stdout:5/589: chown d4/d8/d9/d7d/d84/fbd 130901 1 2024-04-26T11:24:02.444 INFO:tasks.workunit.client.0.smithi073.stdout:8/627: truncate d1/d21/d2a/f6b 1150919 0 2024-04-26T11:24:02.444 INFO:tasks.workunit.client.0.smithi073.stdout:8/628: write d1/d4/f89 [712345,53874] 0 2024-04-26T11:24:02.444 INFO:tasks.workunit.client.0.smithi073.stdout:9/593: rmdir d0/d13/d5a/d65 39 2024-04-26T11:24:02.444 INFO:tasks.workunit.client.0.smithi073.stdout:3/577: mkdir d0/d11/d19/db/da6/d60/dcd 0 2024-04-26T11:24:02.444 INFO:tasks.workunit.client.0.smithi073.stdout:6/551: mknod d0/d15/d9a/caa 0 2024-04-26T11:24:02.445 INFO:tasks.workunit.client.0.smithi073.stdout:8/629: mkdir d1/d4/d15/dbc/dc3/dc6/ddb 0 2024-04-26T11:24:02.445 INFO:tasks.workunit.client.0.smithi073.stdout:3/578: chown d0/d11/d19/f28 694 1 2024-04-26T11:24:02.445 INFO:tasks.workunit.client.0.smithi073.stdout:6/552: write d0/d19/f21 [1787267,92978] 0 2024-04-26T11:24:02.445 INFO:tasks.workunit.client.0.smithi073.stdout:0/595: dread d2/f13 [0,4194304] 0 2024-04-26T11:24:02.446 INFO:tasks.workunit.client.0.smithi073.stdout:9/594: symlink d0/d13/d25/d75/d8e/db9/lca 0 2024-04-26T11:24:02.446 INFO:tasks.workunit.client.0.smithi073.stdout:8/630: rename d1/d21/d50/f22 to d1/fdc 0 2024-04-26T11:24:02.447 INFO:tasks.workunit.client.0.smithi073.stdout:6/553: creat d0/d15/d2d/d86/fab x:0 0 0 2024-04-26T11:24:02.447 INFO:tasks.workunit.client.0.smithi073.stdout:3/579: rename d0/d11/d19/db/d3e/dc2 to d0/d11/d19/db/da6/d7a/dce 0 2024-04-26T11:24:02.447 INFO:tasks.workunit.client.0.smithi073.stdout:9/595: write d0/d1a/d4e/d70/faa [29895,119425] 0 2024-04-26T11:24:02.447 INFO:tasks.workunit.client.0.smithi073.stdout:6/554: stat d0/d15/d2d/l68 0 2024-04-26T11:24:02.448 INFO:tasks.workunit.client.0.smithi073.stdout:6/555: stat d0/dc/d55 0 2024-04-26T11:24:02.448 INFO:tasks.workunit.client.0.smithi073.stdout:9/596: write d0/d1a/f8c [221959,73169] 0 2024-04-26T11:24:02.449 INFO:tasks.workunit.client.0.smithi073.stdout:1/684: write d1/d6/f22 [338544,112051] 0 2024-04-26T11:24:02.451 INFO:tasks.workunit.client.0.smithi073.stdout:1/685: creat d1/d8/d2e/fe8 x:0 0 0 2024-04-26T11:24:02.451 INFO:tasks.workunit.client.0.smithi073.stdout:3/580: dread d0/d11/d19/f39 [0,4194304] 0 2024-04-26T11:24:02.452 INFO:tasks.workunit.client.0.smithi073.stdout:6/556: read d0/d19/d20/f22 [1163135,118101] 0 2024-04-26T11:24:02.452 INFO:tasks.workunit.client.0.smithi073.stdout:9/597: read d0/d13/d25/d2c/f33 [6593334,54365] 0 2024-04-26T11:24:02.453 INFO:tasks.workunit.client.0.smithi073.stdout:0/596: dwrite d2/d1f/d40/d48/f55 [0,4194304] 0 2024-04-26T11:24:02.453 INFO:tasks.workunit.client.0.smithi073.stdout:1/686: getdents d1/d16/d61 0 2024-04-26T11:24:02.454 INFO:tasks.workunit.client.0.smithi073.stdout:6/557: creat d0/d15/d2d/d86/fac x:0 0 0 2024-04-26T11:24:02.455 INFO:tasks.workunit.client.0.smithi073.stdout:9/598: rename d0/d1a/d4e/d70/d51/c95 to d0/d1a/ccb 0 2024-04-26T11:24:02.455 INFO:tasks.workunit.client.0.smithi073.stdout:9/599: fsync d0/f40 0 2024-04-26T11:24:02.455 INFO:tasks.workunit.client.0.smithi073.stdout:6/558: write d0/d1a/d26/d4b/d2b/d2c/f76 [964655,21575] 0 2024-04-26T11:24:02.456 INFO:tasks.workunit.client.0.smithi073.stdout:9/600: stat d0/d13/cac 0 2024-04-26T11:24:02.456 INFO:tasks.workunit.client.0.smithi073.stdout:6/559: fsync d0/d1a/d26/f54 0 2024-04-26T11:24:02.459 INFO:tasks.workunit.client.0.smithi073.stdout:9/601: unlink d0/d1a/d4e/d70/d46/fad 0 2024-04-26T11:24:02.460 INFO:tasks.workunit.client.0.smithi073.stdout:9/602: mkdir d0/d3c/dcc 0 2024-04-26T11:24:02.460 INFO:tasks.workunit.client.0.smithi073.stdout:6/560: link d0/c10 d0/d1a/d26/d27/cad 0 2024-04-26T11:24:02.460 INFO:tasks.workunit.client.0.smithi073.stdout:2/576: dread dd/d4c/d48/f2d [0,4194304] 0 2024-04-26T11:24:02.461 INFO:tasks.workunit.client.0.smithi073.stdout:2/577: unlink dd/de/d29/f58 0 2024-04-26T11:24:02.462 INFO:tasks.workunit.client.0.smithi073.stdout:2/578: mknod dd/de/d38/d53/d9d/cac 0 2024-04-26T11:24:02.463 INFO:tasks.workunit.client.0.smithi073.stdout:2/579: truncate dd/d4c/d48/d46/f88 647693 0 2024-04-26T11:24:02.465 INFO:tasks.workunit.client.0.smithi073.stdout:2/580: creat dd/de/d49/fad x:0 0 0 2024-04-26T11:24:02.466 INFO:tasks.workunit.client.0.smithi073.stdout:7/606: sync 2024-04-26T11:24:02.466 INFO:tasks.workunit.client.0.smithi073.stdout:6/561: sync 2024-04-26T11:24:02.467 INFO:tasks.workunit.client.0.smithi073.stdout:9/603: dwrite d0/d1a/d4e/d70/d3b/fb3 [0,4194304] 0 2024-04-26T11:24:02.468 INFO:tasks.workunit.client.0.smithi073.stdout:6/562: chown d0/d1a/d26/d27/c6a 0 1 2024-04-26T11:24:02.468 INFO:tasks.workunit.client.0.smithi073.stdout:4/627: dread d8/d1f/f88 [0,4194304] 0 2024-04-26T11:24:02.468 INFO:tasks.workunit.client.0.smithi073.stdout:9/604: dread - d0/d3c/fa3 zero size 2024-04-26T11:24:02.469 INFO:tasks.workunit.client.0.smithi073.stdout:4/628: write d8/d1a/d1b/d24/dac/da7/fba [2177514,35259] 0 2024-04-26T11:24:02.470 INFO:tasks.workunit.client.0.smithi073.stdout:1/687: dwrite d1/d8/d2e/d3c/f3e [0,4194304] 0 2024-04-26T11:24:02.471 INFO:tasks.workunit.client.0.smithi073.stdout:5/590: dread d4/d8/d9/d42/f99 [0,4194304] 0 2024-04-26T11:24:02.473 INFO:tasks.workunit.client.0.smithi073.stdout:3/581: dread d0/d26/f8f [0,4194304] 0 2024-04-26T11:24:02.475 INFO:tasks.workunit.client.0.smithi073.stdout:8/631: dread d1/d21/d2a/f39 [0,4194304] 0 2024-04-26T11:24:02.478 INFO:tasks.workunit.client.0.smithi073.stdout:2/581: rmdir dd 39 2024-04-26T11:24:02.478 INFO:tasks.workunit.client.0.smithi073.stdout:1/688: unlink d1/d6/f29 0 2024-04-26T11:24:02.479 INFO:tasks.workunit.client.0.smithi073.stdout:3/582: mknod d0/d34/ccf 0 2024-04-26T11:24:02.479 INFO:tasks.workunit.client.0.smithi073.stdout:5/591: fdatasync d4/d8/d9/fa1 0 2024-04-26T11:24:02.479 INFO:tasks.workunit.client.0.smithi073.stdout:4/629: mkdir d8/d1a/d4d/ddc/dde 0 2024-04-26T11:24:02.479 INFO:tasks.workunit.client.0.smithi073.stdout:6/563: link d0/d1a/d4e/d67/f8f d0/dc/d80/d97/da2/fae 0 2024-04-26T11:24:02.479 INFO:tasks.workunit.client.0.smithi073.stdout:3/583: chown d0/d34/f68 1406 1 2024-04-26T11:24:02.480 INFO:tasks.workunit.client.0.smithi073.stdout:7/607: getdents d1/d11/d24/d29/dd7/d3d/d41/d64/dae 0 2024-04-26T11:24:02.481 INFO:tasks.workunit.client.0.smithi073.stdout:6/564: fsync d0/d1a/d26/d4b/f5b 0 2024-04-26T11:24:02.481 INFO:tasks.workunit.client.0.smithi073.stdout:5/592: write d4/d8/d9/d7d/da3/ddc/f3f [349885,34873] 0 2024-04-26T11:24:02.481 INFO:tasks.workunit.client.0.smithi073.stdout:1/689: rename d1/d8/d5d/ddd to d1/d6/d7f/d8f/de9 0 2024-04-26T11:24:02.482 INFO:tasks.workunit.client.0.smithi073.stdout:2/582: mknod dd/de/d38/d4e/cae 0 2024-04-26T11:24:02.482 INFO:tasks.workunit.client.0.smithi073.stdout:3/584: creat d0/d11/d19/db/da6/d7a/dbc/fd0 x:0 0 0 2024-04-26T11:24:02.482 INFO:tasks.workunit.client.0.smithi073.stdout:9/605: dread d0/d13/f20 [0,4194304] 0 2024-04-26T11:24:02.484 INFO:tasks.workunit.client.0.smithi073.stdout:1/690: mknod d1/cea 0 2024-04-26T11:24:02.484 INFO:tasks.workunit.client.0.smithi073.stdout:8/632: dread d1/d21/d50/d67/d81/f88 [0,4194304] 0 2024-04-26T11:24:02.484 INFO:tasks.workunit.client.0.smithi073.stdout:5/593: unlink d4/de/d15/d67/lac 0 2024-04-26T11:24:02.484 INFO:tasks.workunit.client.0.smithi073.stdout:6/565: truncate d0/dc/d2e/f91 20765 0 2024-04-26T11:24:02.484 INFO:tasks.workunit.client.0.smithi073.stdout:7/608: unlink d1/d11/d24/d29/dd7/d3d/d41/d64/lb5 0 2024-04-26T11:24:02.485 INFO:tasks.workunit.client.0.smithi073.stdout:9/606: truncate d0/f8 499057 0 2024-04-26T11:24:02.485 INFO:tasks.workunit.client.0.smithi073.stdout:1/691: creat d1/d8/d5d/d89/feb x:0 0 0 2024-04-26T11:24:02.485 INFO:tasks.workunit.client.0.smithi073.stdout:2/583: unlink dd/de/d38/d4e/c4f 0 2024-04-26T11:24:02.485 INFO:tasks.workunit.client.0.smithi073.stdout:5/594: chown d4/d8/c7b 1011910299 1 2024-04-26T11:24:02.485 INFO:tasks.workunit.client.0.smithi073.stdout:3/585: symlink d0/d11/d19/db/d3e/d3f/ld1 0 2024-04-26T11:24:02.485 INFO:tasks.workunit.client.0.smithi073.stdout:9/607: stat d0/d13/f1f 0 2024-04-26T11:24:02.485 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:02.480+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:02.487 INFO:tasks.workunit.client.0.smithi073.stdout:1/692: rmdir d1/d6/d62 39 2024-04-26T11:24:02.487 INFO:tasks.workunit.client.0.smithi073.stdout:3/586: rmdir d0/d11/d19/d5b 39 2024-04-26T11:24:02.487 INFO:tasks.workunit.client.0.smithi073.stdout:9/608: readlink d0/d13/db/l92 0 2024-04-26T11:24:02.487 INFO:tasks.workunit.client.0.smithi073.stdout:1/693: write d1/d6/fbc [2120254,112702] 0 2024-04-26T11:24:02.487 INFO:tasks.workunit.client.0.smithi073.stdout:7/609: rename d1/d11/d24/d29/dd7/d3d/d41/d64/l77 to d1/d11/d24/d29/dd7/d4b/lda 0 2024-04-26T11:24:02.487 INFO:tasks.workunit.client.0.smithi073.stdout:9/609: creat d0/d1a/d2f/fcd x:0 0 0 2024-04-26T11:24:02.487 INFO:tasks.workunit.client.0.smithi073.stdout:7/610: chown d1/d33 325 1 2024-04-26T11:24:02.488 INFO:tasks.workunit.client.0.smithi073.stdout:3/587: getdents d0/d11/d19 0 2024-04-26T11:24:02.488 INFO:tasks.workunit.client.0.smithi073.stdout:9/610: chown d0/d13/d25/d2c/f53 4 1 2024-04-26T11:24:02.492 INFO:tasks.workunit.client.0.smithi073.stdout:5/595: dwrite d4/d8/d9/d7d/da3/fba [0,4194304] 0 2024-04-26T11:24:02.493 INFO:tasks.workunit.client.0.smithi073.stdout:5/596: dread - d4/d73/fd6 zero size 2024-04-26T11:24:02.495 INFO:tasks.workunit.client.0.smithi073.stdout:9/611: dwrite d0/d13/d25/fc2 [0,4194304] 0 2024-04-26T11:24:02.495 INFO:tasks.workunit.client.0.smithi073.stdout:3/588: dwrite d0/d11/d19/db/d3e/d47/f73 [0,4194304] 0 2024-04-26T11:24:02.495 INFO:tasks.workunit.client.0.smithi073.stdout:1/694: dread d1/d8/d57/fbe [0,4194304] 0 2024-04-26T11:24:02.496 INFO:tasks.workunit.client.0.smithi073.stdout:1/695: chown d1/d73/d34/d98/daa 10 1 2024-04-26T11:24:02.496 INFO:tasks.workunit.client.0.smithi073.stdout:9/612: fdatasync d0/d1a/d4e/d70/d51/f88 0 2024-04-26T11:24:02.497 INFO:tasks.workunit.client.0.smithi073.stdout:4/630: truncate d8/d1a/d1b/d46/fb0 1633308 0 2024-04-26T11:24:02.497 INFO:tasks.workunit.client.0.smithi073.stdout:3/589: truncate d0/d11/d19/d5b/fb0 573598 0 2024-04-26T11:24:02.497 INFO:tasks.workunit.client.0.smithi073.stdout:5/597: creat d4/d95/da5/fdd x:0 0 0 2024-04-26T11:24:02.497 INFO:tasks.workunit.client.0.smithi073.stdout:8/633: truncate d1/d4/d37/f4f 319556 0 2024-04-26T11:24:02.498 INFO:tasks.workunit.client.0.smithi073.stdout:5/598: readlink d4/de/d15/d33/l90 0 2024-04-26T11:24:02.498 INFO:tasks.workunit.client.0.smithi073.stdout:3/590: readlink d0/d11/d19/d1d/l4a 0 2024-04-26T11:24:02.498 INFO:tasks.workunit.client.0.smithi073.stdout:9/613: write d0/d13/d5a/d5e/f6d [2704140,27935] 0 2024-04-26T11:24:02.498 INFO:tasks.workunit.client.0.smithi073.stdout:8/634: chown d1/d4/da9/fc0 1 1 2024-04-26T11:24:02.499 INFO:tasks.workunit.client.0.smithi073.stdout:5/599: creat d4/d8/d9/d7d/d84/fde x:0 0 0 2024-04-26T11:24:02.499 INFO:tasks.workunit.client.0.smithi073.stdout:9/614: unlink d0/d1a/d4e/d70/d46/c4f 0 2024-04-26T11:24:02.499 INFO:tasks.workunit.client.0.smithi073.stdout:3/591: write d0/d11/d19/d1d/fb8 [3087009,108587] 0 2024-04-26T11:24:02.500 INFO:tasks.workunit.client.0.smithi073.stdout:5/600: mknod d4/de/dc6/cdf 0 2024-04-26T11:24:02.502 INFO:tasks.workunit.client.0.smithi073.stdout:3/592: read d0/d11/d19/db/d3e/d47/f73 [1272612,126660] 0 2024-04-26T11:24:02.502 INFO:tasks.workunit.client.0.smithi073.stdout:9/615: link d0/d13/f20 d0/d6c/dc7/fce 0 2024-04-26T11:24:02.502 INFO:tasks.workunit.client.0.smithi073.stdout:3/593: dread - d0/d11/d19/db/d3e/d47/f9b zero size 2024-04-26T11:24:02.502 INFO:tasks.workunit.client.0.smithi073.stdout:5/601: link d4/de/d23/f36 d4/d73/d8a/dc8/fe0 0 2024-04-26T11:24:02.503 INFO:tasks.workunit.client.0.smithi073.stdout:5/602: unlink d4/d8/d9/d7d/fb4 0 2024-04-26T11:24:02.503 INFO:tasks.workunit.client.0.smithi073.stdout:5/603: fdatasync d4/d73/fd6 0 2024-04-26T11:24:02.504 INFO:tasks.workunit.client.0.smithi073.stdout:5/604: stat d4/de/d15/d33/f4e 0 2024-04-26T11:24:02.504 INFO:tasks.workunit.client.0.smithi073.stdout:1/696: dread d1/d73/d40/f3a [0,4194304] 0 2024-04-26T11:24:02.505 INFO:tasks.workunit.client.0.smithi073.stdout:5/605: write d4/d8/d8e/fa9 [164754,59597] 0 2024-04-26T11:24:02.505 INFO:tasks.workunit.client.0.smithi073.stdout:1/697: fsync d1/d6/db3/d9f/fa1 0 2024-04-26T11:24:02.506 INFO:tasks.workunit.client.0.smithi073.stdout:1/698: stat d1/d16/d4f/f9b 0 2024-04-26T11:24:02.506 INFO:tasks.workunit.client.0.smithi073.stdout:1/699: chown d1/d6/d7f/d47 28 1 2024-04-26T11:24:02.507 INFO:tasks.workunit.client.0.smithi073.stdout:3/594: dwrite d0/d2d/f6b [0,4194304] 0 2024-04-26T11:24:02.509 INFO:tasks.workunit.client.0.smithi073.stdout:9/616: dwrite d0/d1a/d4e/d70/d51/f88 [0,4194304] 0 2024-04-26T11:24:02.512 INFO:tasks.workunit.client.0.smithi073.stdout:3/595: dwrite d0/d11/f18 [0,4194304] 0 2024-04-26T11:24:02.513 INFO:tasks.workunit.client.0.smithi073.stdout:3/596: chown d0/d26/f58 393021 1 2024-04-26T11:24:02.513 INFO:tasks.workunit.client.0.smithi073.stdout:7/611: sync 2024-04-26T11:24:02.513 INFO:tasks.workunit.client.0.smithi073.stdout:5/606: sync 2024-04-26T11:24:02.513 INFO:tasks.workunit.client.0.smithi073.stdout:7/612: stat d1/d33 0 2024-04-26T11:24:02.513 INFO:tasks.workunit.client.0.smithi073.stdout:1/700: rename d1/d73/d40/c42 to d1/d16/d6a/cec 0 2024-04-26T11:24:02.514 INFO:tasks.workunit.client.0.smithi073.stdout:5/607: write d4/d8/d9/d7d/da3/ddc/fcb [610740,7676] 0 2024-04-26T11:24:02.514 INFO:tasks.workunit.client.0.smithi073.stdout:1/701: chown d1/l24 2455 1 2024-04-26T11:24:02.515 INFO:tasks.workunit.client.0.smithi073.stdout:1/702: chown d1/d8/d5d/d89/feb 1909965 1 2024-04-26T11:24:02.515 INFO:tasks.workunit.client.0.smithi073.stdout:0/597: dread d2/f11 [8388608,4194304] 0 2024-04-26T11:24:02.516 INFO:tasks.workunit.client.0.smithi073.stdout:0/598: fdatasync d2/f8a 0 2024-04-26T11:24:02.516 INFO:tasks.workunit.client.0.smithi073.stdout:3/597: unlink d0/d11/d19/db/d3e/d47/c94 0 2024-04-26T11:24:02.516 INFO:tasks.workunit.client.0.smithi073.stdout:9/617: fsync d0/d1a/d4e/d70/d46/f8b 0 2024-04-26T11:24:02.516 INFO:tasks.workunit.client.0.smithi073.stdout:7/613: symlink d1/d33/d1b/ldb 0 2024-04-26T11:24:02.516 INFO:tasks.workunit.client.0.smithi073.stdout:5/608: creat d4/de/d15/d67/fe1 x:0 0 0 2024-04-26T11:24:02.517 INFO:tasks.workunit.client.0.smithi073.stdout:1/703: rename d1/d16/d4f/fcc to d1/d8/d5d/fed 0 2024-04-26T11:24:02.517 INFO:tasks.workunit.client.0.smithi073.stdout:0/599: write d2/d1f/f2b [2450469,104474] 0 2024-04-26T11:24:02.517 INFO:tasks.workunit.client.0.smithi073.stdout:3/598: mknod d0/d11/d19/d5b/cd2 0 2024-04-26T11:24:02.517 INFO:tasks.workunit.client.0.smithi073.stdout:9/618: creat d0/d13/d5a/d5e/fcf x:0 0 0 2024-04-26T11:24:02.518 INFO:tasks.workunit.client.0.smithi073.stdout:0/600: dread - d2/d37/d8b/fba zero size 2024-04-26T11:24:02.518 INFO:tasks.workunit.client.0.smithi073.stdout:5/609: chown d4/d8/d9/d7d/d84/fde 0 1 2024-04-26T11:24:02.518 INFO:tasks.workunit.client.0.smithi073.stdout:3/599: mkdir d0/d11/d19/db/da6/d7a/dce/dd3 0 2024-04-26T11:24:02.519 INFO:tasks.workunit.client.0.smithi073.stdout:5/610: symlink d4/d8/d9/d42/le2 0 2024-04-26T11:24:02.519 INFO:tasks.workunit.client.0.smithi073.stdout:0/601: unlink d2/d37/d3c/d6a/l72 0 2024-04-26T11:24:02.522 INFO:tasks.workunit.client.0.smithi073.stdout:1/704: dwrite d1/d8/d5d/f60 [0,4194304] 0 2024-04-26T11:24:02.523 INFO:tasks.workunit.client.0.smithi073.stdout:4/631: sync 2024-04-26T11:24:02.524 INFO:tasks.workunit.client.0.smithi073.stdout:1/705: mkdir d1/d73/d34/d98/daa/dee 0 2024-04-26T11:24:02.524 INFO:tasks.workunit.client.0.smithi073.stdout:4/632: rename d8/d14/d60/d64/c31 to d8/d1a/d1b/d46/d57/d37/cdf 0 2024-04-26T11:24:02.525 INFO:tasks.workunit.client.0.smithi073.stdout:2/584: dread dd/d4c/f42 [0,4194304] 0 2024-04-26T11:24:02.525 INFO:tasks.workunit.client.0.smithi073.stdout:1/706: mknod d1/d73/d40/d44/d8e/cef 0 2024-04-26T11:24:02.525 INFO:tasks.workunit.client.0.smithi073.stdout:4/633: creat d8/d1a/d5e/d7c/fe0 x:0 0 0 2024-04-26T11:24:02.525 INFO:tasks.workunit.client.0.smithi073.stdout:4/634: sync 2024-04-26T11:24:02.525 INFO:tasks.workunit.client.0.smithi073.stdout:0/602: read d2/d1f/d40/d48/d62/f9f [3270639,49941] 0 2024-04-26T11:24:02.526 INFO:tasks.workunit.client.0.smithi073.stdout:7/614: read d1/d11/d24/d29/f74 [2341450,40913] 0 2024-04-26T11:24:02.526 INFO:tasks.workunit.client.0.smithi073.stdout:1/707: rename d1/c30 to d1/d8/d57/cf0 0 2024-04-26T11:24:02.527 INFO:tasks.workunit.client.0.smithi073.stdout:2/585: write dd/d4c/d48/d46/d91/d9f/d1d/f5c [1412296,83212] 0 2024-04-26T11:24:02.527 INFO:tasks.workunit.client.0.smithi073.stdout:4/635: dread d8/d1a/d86/fa8 [0,4194304] 0 2024-04-26T11:24:02.528 INFO:tasks.workunit.client.0.smithi073.stdout:1/708: creat d1/d73/d34/ff1 x:0 0 0 2024-04-26T11:24:02.528 INFO:tasks.workunit.client.0.smithi073.stdout:1/709: sync 2024-04-26T11:24:02.528 INFO:tasks.workunit.client.0.smithi073.stdout:6/566: dread d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:02.528 INFO:tasks.workunit.client.0.smithi073.stdout:2/586: write dd/de/d49/f67 [5128345,129530] 0 2024-04-26T11:24:02.528 INFO:tasks.workunit.client.0.smithi073.stdout:3/600: read d0/f7 [607584,75116] 0 2024-04-26T11:24:02.529 INFO:tasks.workunit.client.0.smithi073.stdout:2/587: creat dd/d4c/faf x:0 0 0 2024-04-26T11:24:02.530 INFO:tasks.workunit.client.0.smithi073.stdout:6/567: chown d0/dc/l13 51890 1 2024-04-26T11:24:02.530 INFO:tasks.workunit.client.0.smithi073.stdout:1/710: symlink d1/d8/d57/db1/lf2 0 2024-04-26T11:24:02.530 INFO:tasks.workunit.client.0.smithi073.stdout:1/711: sync 2024-04-26T11:24:02.530 INFO:tasks.workunit.client.0.smithi073.stdout:2/588: symlink dd/d4c/d48/d46/lb0 0 2024-04-26T11:24:02.531 INFO:tasks.workunit.client.0.smithi073.stdout:6/568: creat d0/dc/faf x:0 0 0 2024-04-26T11:24:02.532 INFO:tasks.workunit.client.0.smithi073.stdout:3/601: read d0/d11/d19/f27 [3589190,117413] 0 2024-04-26T11:24:02.532 INFO:tasks.workunit.client.0.smithi073.stdout:1/712: write d1/d6/db3/f5c [1196326,72102] 0 2024-04-26T11:24:02.533 INFO:tasks.workunit.client.0.smithi073.stdout:6/569: write d0/dc/f64 [3226898,29866] 0 2024-04-26T11:24:02.535 INFO:tasks.workunit.client.0.smithi073.stdout:5/611: truncate d4/d8/d9/d7d/da3/ddc/f1a 530726 0 2024-04-26T11:24:02.535 INFO:tasks.workunit.client.0.smithi073.stdout:0/603: dwrite d2/d1f/d40/f66 [0,4194304] 0 2024-04-26T11:24:02.535 INFO:tasks.workunit.client.0.smithi073.stdout:1/713: fdatasync d1/f13 0 2024-04-26T11:24:02.535 INFO:tasks.workunit.client.0.smithi073.stdout:7/615: dwrite d1/d11/d24/d29/dd7/d4b/fa9 [0,4194304] 0 2024-04-26T11:24:02.536 INFO:tasks.workunit.client.0.smithi073.stdout:5/612: stat d4/d8/d9/d7d/d84/da7/db7/lc2 0 2024-04-26T11:24:02.538 INFO:tasks.workunit.client.0.smithi073.stdout:0/604: mkdir d2/d1f/d40/d48/dc1/dd6 0 2024-04-26T11:24:02.538 INFO:tasks.workunit.client.0.smithi073.stdout:1/714: symlink d1/d6/db3/lf3 0 2024-04-26T11:24:02.538 INFO:tasks.workunit.client.0.smithi073.stdout:5/613: fdatasync d4/d8/d9/d7d/da3/ddc/f1c 0 2024-04-26T11:24:02.539 INFO:tasks.workunit.client.0.smithi073.stdout:0/605: chown d2/f8a 706261345 1 2024-04-26T11:24:02.539 INFO:tasks.workunit.client.0.smithi073.stdout:6/570: write d0/d1a/d4e/f51 [257874,52294] 0 2024-04-26T11:24:02.539 INFO:tasks.workunit.client.0.smithi073.stdout:2/589: getdents dd/d4c/d48/d46/d91/d9f 0 2024-04-26T11:24:02.540 INFO:tasks.workunit.client.0.smithi073.stdout:6/571: rmdir d0/d1a/d7a 39 2024-04-26T11:24:02.540 INFO:tasks.workunit.client.0.smithi073.stdout:0/606: creat d2/d22/fd7 x:0 0 0 2024-04-26T11:24:02.540 INFO:tasks.workunit.client.0.smithi073.stdout:1/715: creat d1/d6/d7f/ff4 x:0 0 0 2024-04-26T11:24:02.540 INFO:tasks.workunit.client.0.smithi073.stdout:2/590: mknod dd/d27/da0/cb1 0 2024-04-26T11:24:02.541 INFO:tasks.workunit.client.0.smithi073.stdout:0/607: read - d2/d37/d3c/f61 zero size 2024-04-26T11:24:02.542 INFO:tasks.workunit.client.0.smithi073.stdout:3/602: fsync d0/d11/f18 0 2024-04-26T11:24:02.543 INFO:tasks.workunit.client.0.smithi073.stdout:6/572: read - d0/d1a/d26/d4b/d2b/d43/f88 zero size 2024-04-26T11:24:02.544 INFO:tasks.workunit.client.0.smithi073.stdout:2/591: unlink dd/de/d38/d53/d60/f7d 0 2024-04-26T11:24:02.545 INFO:tasks.workunit.client.0.smithi073.stdout:0/608: mkdir d2/d1f/d40/d48/da9/dd8 0 2024-04-26T11:24:02.545 INFO:tasks.workunit.client.0.smithi073.stdout:8/635: dread d1/f6 [0,4194304] 0 2024-04-26T11:24:02.546 INFO:tasks.workunit.client.0.smithi073.stdout:6/573: write d0/d1a/d26/d4b/f5b [2851707,46917] 0 2024-04-26T11:24:02.547 INFO:tasks.workunit.client.0.smithi073.stdout:0/609: read - d2/d22/d51/d57/d78/f94 zero size 2024-04-26T11:24:02.548 INFO:tasks.workunit.client.0.smithi073.stdout:7/616: dwrite d1/d33/d68/fad [0,4194304] 0 2024-04-26T11:24:02.548 INFO:tasks.workunit.client.0.smithi073.stdout:1/716: dwrite d1/d6/f22 [0,4194304] 0 2024-04-26T11:24:02.549 INFO:tasks.workunit.client.0.smithi073.stdout:5/614: dwrite d4/de/d15/f94 [0,4194304] 0 2024-04-26T11:24:02.549 INFO:tasks.workunit.client.0.smithi073.stdout:1/717: write d1/d16/fb4 [520024,128617] 0 2024-04-26T11:24:02.553 INFO:tasks.workunit.client.0.smithi073.stdout:3/603: dread d0/fac [0,4194304] 0 2024-04-26T11:24:02.554 INFO:tasks.workunit.client.0.smithi073.stdout:7/617: dwrite d1/d33/d1b/fd3 [0,4194304] 0 2024-04-26T11:24:02.559 INFO:tasks.workunit.client.0.smithi073.stdout:7/618: dwrite d1/f75 [4194304,4194304] 0 2024-04-26T11:24:02.559 INFO:tasks.workunit.client.0.smithi073.stdout:2/592: write fb [3515751,39359] 0 2024-04-26T11:24:02.561 INFO:tasks.workunit.client.0.smithi073.stdout:8/636: rename d1/d21/d50 to d1/d21/d2c/ddd 0 2024-04-26T11:24:02.561 INFO:tasks.workunit.client.0.smithi073.stdout:1/718: creat d1/d73/d40/d54/dbb/ff5 x:0 0 0 2024-04-26T11:24:02.562 INFO:tasks.workunit.client.0.smithi073.stdout:5/615: symlink d4/d8/le3 0 2024-04-26T11:24:02.562 INFO:tasks.workunit.client.0.smithi073.stdout:3/604: chown d0/d11/d23/d3b/d3c/c40 1550 1 2024-04-26T11:24:02.562 INFO:tasks.workunit.client.0.smithi073.stdout:7/619: mkdir d1/ddc 0 2024-04-26T11:24:02.563 INFO:tasks.workunit.client.0.smithi073.stdout:8/637: creat d1/d4/d4c/d66/d8b/fde x:0 0 0 2024-04-26T11:24:02.563 INFO:tasks.workunit.client.0.smithi073.stdout:7/620: chown d1/d11/d5e/cb0 178280073 1 2024-04-26T11:24:02.563 INFO:tasks.workunit.client.0.smithi073.stdout:5/616: write d4/d95/fd0 [402803,15869] 0 2024-04-26T11:24:02.563 INFO:tasks.workunit.client.0.smithi073.stdout:3/605: write d0/d11/f18 [6762309,103699] 0 2024-04-26T11:24:02.564 INFO:tasks.workunit.client.0.smithi073.stdout:0/610: truncate d2/f11 9968658 0 2024-04-26T11:24:02.565 INFO:tasks.workunit.client.0.smithi073.stdout:8/638: rename d1/d4/d4c/cb4 to d1/d4/d4c/d66/d8b/cdf 0 2024-04-26T11:24:02.565 INFO:tasks.workunit.client.0.smithi073.stdout:8/639: readlink d1/d4/d37/d90/ld7 0 2024-04-26T11:24:02.566 INFO:tasks.workunit.client.0.smithi073.stdout:8/640: chown d1/l70 1 1 2024-04-26T11:24:02.567 INFO:tasks.workunit.client.0.smithi073.stdout:6/574: dwrite d0/d1a/d26/d4b/d2b/d2c/fa9 [0,4194304] 0 2024-04-26T11:24:02.570 INFO:tasks.workunit.client.0.smithi073.stdout:0/611: dwrite d2/d22/f95 [0,4194304] 0 2024-04-26T11:24:02.576 INFO:tasks.workunit.client.0.smithi073.stdout:7/621: truncate d1/d33/f86 1087917 0 2024-04-26T11:24:02.576 INFO:tasks.workunit.client.0.smithi073.stdout:3/606: write d0/d26/f2a [353989,70259] 0 2024-04-26T11:24:02.576 INFO:tasks.workunit.client.0.smithi073.stdout:9/619: dread d0/d13/f1f [0,4194304] 0 2024-04-26T11:24:02.576 INFO:tasks.workunit.client.0.smithi073.stdout:0/612: creat d2/d37/d3c/d73/fd9 x:0 0 0 2024-04-26T11:24:02.576 INFO:tasks.workunit.client.0.smithi073.stdout:6/575: link d0/d15/d2d/d3f/d59/f92 d0/d1a/d26/d4b/d2b/d2c/fb0 0 2024-04-26T11:24:02.576 INFO:tasks.workunit.client.0.smithi073.stdout:8/641: rename d1/d21/d2c/ddd/d67/c77 to d1/d21/d2c/ddd/ce0 0 2024-04-26T11:24:02.577 INFO:tasks.workunit.client.0.smithi073.stdout:9/620: symlink d0/d13/d25/d75/ld0 0 2024-04-26T11:24:02.577 INFO:tasks.workunit.client.0.smithi073.stdout:4/636: dread d8/d14/f2a [0,4194304] 0 2024-04-26T11:24:02.577 INFO:tasks.workunit.client.0.smithi073.stdout:3/607: write d0/d11/d19/db/d3e/d3f/d69/d96/f9f [1154079,112313] 0 2024-04-26T11:24:02.579 INFO:tasks.workunit.client.0.smithi073.stdout:4/637: rename l4 to d8/d1a/d1b/d24/dac/d49/d85/le1 0 2024-04-26T11:24:02.579 INFO:tasks.workunit.client.0.smithi073.stdout:3/608: chown d0/d11/d19/db/da6/d8b/d8c/d90/cbb 935751 1 2024-04-26T11:24:02.579 INFO:tasks.workunit.client.0.smithi073.stdout:4/638: readlink d8/d1a/d1b/d24/l4c 0 2024-04-26T11:24:02.580 INFO:tasks.workunit.client.0.smithi073.stdout:3/609: symlink d0/d2d/ld4 0 2024-04-26T11:24:02.580 INFO:tasks.workunit.client.0.smithi073.stdout:7/622: dread d1/d11/d24/d29/fa4 [0,4194304] 0 2024-04-26T11:24:02.581 INFO:tasks.workunit.client.0.smithi073.stdout:9/621: read d0/d13/d5a/fa2 [67833,30318] 0 2024-04-26T11:24:02.582 INFO:tasks.workunit.client.0.smithi073.stdout:4/639: symlink d8/d1a/d1b/d24/dac/d49/d85/le2 0 2024-04-26T11:24:02.582 INFO:tasks.workunit.client.0.smithi073.stdout:3/610: chown d0/d11/d19/d1d/f8d 9040 1 2024-04-26T11:24:02.582 INFO:tasks.workunit.client.0.smithi073.stdout:0/613: dread d2/d37/d3c/f88 [0,4194304] 0 2024-04-26T11:24:02.587 INFO:tasks.workunit.client.0.smithi073.stdout:7/623: chown d1/d11/d24/d29/dd7/d3d/l61 3 1 2024-04-26T11:24:02.587 INFO:tasks.workunit.client.0.smithi073.stdout:9/622: creat d0/d13/d25/d75/d8e/db9/fd1 x:0 0 0 2024-04-26T11:24:02.587 INFO:tasks.workunit.client.0.smithi073.stdout:0/614: write d2/d37/d8b/fba [969895,39793] 0 2024-04-26T11:24:02.587 INFO:tasks.workunit.client.0.smithi073.stdout:8/642: dwrite d1/d21/d2c/ddd/d67/fd2 [0,4194304] 0 2024-04-26T11:24:02.587 INFO:tasks.workunit.client.0.smithi073.stdout:8/643: truncate d1/d4/d4c/d66/f8f 885950 0 2024-04-26T11:24:02.588 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:02.582+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:02.589 INFO:tasks.workunit.client.0.smithi073.stdout:0/615: rename d2/d1f/d40/d48/d62/f9f to d2/d1f/fda 0 2024-04-26T11:24:02.589 INFO:tasks.workunit.client.0.smithi073.stdout:8/644: creat d1/d4/d15/dbc/dc3/dc6/fe1 x:0 0 0 2024-04-26T11:24:02.589 INFO:tasks.workunit.client.0.smithi073.stdout:3/611: getdents d0/d11/d19/db/da6/d7a/dce 0 2024-04-26T11:24:02.589 INFO:tasks.workunit.client.0.smithi073.stdout:0/616: symlink d2/d84/ldb 0 2024-04-26T11:24:02.589 INFO:tasks.workunit.client.0.smithi073.stdout:2/593: dread dd/d4c/d48/d46/d91/d9f/d1d/f81 [0,4194304] 0 2024-04-26T11:24:02.589 INFO:tasks.workunit.client.0.smithi073.stdout:8/645: symlink d1/le2 0 2024-04-26T11:24:02.590 INFO:tasks.workunit.client.0.smithi073.stdout:2/594: dread - dd/d4c/faf zero size 2024-04-26T11:24:02.590 INFO:tasks.workunit.client.0.smithi073.stdout:0/617: write d2/d5f/f6c [811140,35782] 0 2024-04-26T11:24:02.590 INFO:tasks.workunit.client.0.smithi073.stdout:8/646: fsync d1/d21/d2a/f34 0 2024-04-26T11:24:02.590 INFO:tasks.workunit.client.0.smithi073.stdout:3/612: mknod d0/d11/d19/db/da6/d8b/cd5 0 2024-04-26T11:24:02.591 INFO:tasks.workunit.client.0.smithi073.stdout:1/719: dread d1/d73/d40/f28 [0,4194304] 0 2024-04-26T11:24:02.591 INFO:tasks.workunit.client.0.smithi073.stdout:3/613: unlink d0/d34/l75 0 2024-04-26T11:24:02.591 INFO:tasks.workunit.client.0.smithi073.stdout:2/595: mkdir dd/de/d38/d53/d60/db2 0 2024-04-26T11:24:02.591 INFO:tasks.workunit.client.0.smithi073.stdout:2/596: dread - dd/d4c/f78 zero size 2024-04-26T11:24:02.592 INFO:tasks.workunit.client.0.smithi073.stdout:1/720: chown d1/d8/d57/c97 0 1 2024-04-26T11:24:02.593 INFO:tasks.workunit.client.0.smithi073.stdout:4/640: dwrite d8/d1a/d1b/d46/fb0 [0,4194304] 0 2024-04-26T11:24:02.593 INFO:tasks.workunit.client.0.smithi073.stdout:2/597: chown dd/de/f72 1257 1 2024-04-26T11:24:02.595 INFO:tasks.workunit.client.0.smithi073.stdout:3/614: creat d0/d11/d19/db/d3e/d3f/d69/d96/fd6 x:0 0 0 2024-04-26T11:24:02.595 INFO:tasks.workunit.client.0.smithi073.stdout:8/647: dwrite d1/f6 [0,4194304] 0 2024-04-26T11:24:02.596 INFO:tasks.workunit.client.0.smithi073.stdout:3/615: chown d0/d11/d19/db/da6/d8b 25419 1 2024-04-26T11:24:02.596 INFO:tasks.workunit.client.0.smithi073.stdout:1/721: mknod d1/cf6 0 2024-04-26T11:24:02.596 INFO:tasks.workunit.client.0.smithi073.stdout:2/598: rename dd/de/d38/f75 to dd/de/d38/d53/d60/db2/fb3 0 2024-04-26T11:24:02.596 INFO:tasks.workunit.client.0.smithi073.stdout:4/641: write d8/d1f/f88 [561560,100468] 0 2024-04-26T11:24:02.597 INFO:tasks.workunit.client.0.smithi073.stdout:8/648: chown d1/d4/d7b/cb3 63 1 2024-04-26T11:24:02.597 INFO:tasks.workunit.client.0.smithi073.stdout:5/617: sync 2024-04-26T11:24:02.597 INFO:tasks.workunit.client.0.smithi073.stdout:2/599: write dd/de/d49/f67 [925853,6756] 0 2024-04-26T11:24:02.597 INFO:tasks.workunit.client.0.smithi073.stdout:2/600: stat dd/d4c/d48/d46/d91/d9f 0 2024-04-26T11:24:02.599 INFO:tasks.workunit.client.0.smithi073.stdout:1/722: mknod d1/d16/d4f/d84/cf7 0 2024-04-26T11:24:02.599 INFO:tasks.workunit.client.0.smithi073.stdout:5/618: rmdir d4/d73/d8a 39 2024-04-26T11:24:02.599 INFO:tasks.workunit.client.0.smithi073.stdout:4/642: symlink d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/le3 0 2024-04-26T11:24:02.599 INFO:tasks.workunit.client.0.smithi073.stdout:8/649: chown d1/d4/d37/f4f 393009351 1 2024-04-26T11:24:02.599 INFO:tasks.workunit.client.0.smithi073.stdout:1/723: fdatasync d1/d51/f7d 0 2024-04-26T11:24:02.600 INFO:tasks.workunit.client.0.smithi073.stdout:5/619: write d4/de/d23/d4f/f69 [808055,128667] 0 2024-04-26T11:24:02.601 INFO:tasks.workunit.client.0.smithi073.stdout:1/724: fdatasync d1/d8/d2e/d3c/fc1 0 2024-04-26T11:24:02.601 INFO:tasks.workunit.client.0.smithi073.stdout:5/620: chown d4/c6 3038 1 2024-04-26T11:24:02.602 INFO:tasks.workunit.client.0.smithi073.stdout:9/623: dread d0/d83/fb1 [0,4194304] 0 2024-04-26T11:24:02.603 INFO:tasks.workunit.client.0.smithi073.stdout:4/643: rmdir d8/d1a/d86 39 2024-04-26T11:24:02.603 INFO:tasks.workunit.client.0.smithi073.stdout:8/650: rmdir d1/d21/d2c 39 2024-04-26T11:24:02.603 INFO:tasks.workunit.client.0.smithi073.stdout:8/651: stat d1/d4/d4c/d66/fa0 0 2024-04-26T11:24:02.604 INFO:tasks.workunit.client.0.smithi073.stdout:1/725: link d1/d8/ce d1/d16/d4f/d84/cf8 0 2024-04-26T11:24:02.604 INFO:tasks.workunit.client.0.smithi073.stdout:2/601: write dd/d4c/d48/d46/d91/d9f/d1d/f15 [2661703,45299] 0 2024-04-26T11:24:02.604 INFO:tasks.workunit.client.0.smithi073.stdout:8/652: unlink d1/d21/d2c/ddd/l61 0 2024-04-26T11:24:02.605 INFO:tasks.workunit.client.0.smithi073.stdout:2/602: write dd/de/d2a/f83 [421650,81655] 0 2024-04-26T11:24:02.605 INFO:tasks.workunit.client.0.smithi073.stdout:8/653: creat d1/d4/d37/d90/fe3 x:0 0 0 2024-04-26T11:24:02.605 INFO:tasks.workunit.client.0.smithi073.stdout:1/726: truncate d1/d8/d5d/f70 755518 0 2024-04-26T11:24:02.606 INFO:tasks.workunit.client.0.smithi073.stdout:9/624: read d0/d6c/f90 [2951370,52239] 0 2024-04-26T11:24:02.606 INFO:tasks.workunit.client.0.smithi073.stdout:8/654: write d1/d21/d2a/f6b [348742,25495] 0 2024-04-26T11:24:02.607 INFO:tasks.workunit.client.0.smithi073.stdout:9/625: rmdir d0/d1a/d4e/d70/d46 39 2024-04-26T11:24:02.609 INFO:tasks.workunit.client.0.smithi073.stdout:9/626: mknod d0/d13/d5a/d5e/cd2 0 2024-04-26T11:24:02.609 INFO:tasks.workunit.client.0.smithi073.stdout:3/616: truncate d0/d34/f66 7269482 0 2024-04-26T11:24:02.609 INFO:tasks.workunit.client.0.smithi073.stdout:0/618: dwrite d2/d1f/d40/d48/fc4 [0,4194304] 0 2024-04-26T11:24:02.610 INFO:tasks.workunit.client.0.smithi073.stdout:5/621: dread d4/de/d15/f45 [0,4194304] 0 2024-04-26T11:24:02.611 INFO:tasks.workunit.client.0.smithi073.stdout:4/644: truncate d8/d1a/d1b/d24/dac/d72/da3/fb6 4051165 0 2024-04-26T11:24:02.612 INFO:tasks.workunit.client.0.smithi073.stdout:0/619: rename d2/l5 to d2/d84/dd2/ldc 0 2024-04-26T11:24:02.613 INFO:tasks.workunit.client.0.smithi073.stdout:6/576: dread d0/d1a/d26/d4b/d2b/d2c/f3b [0,4194304] 0 2024-04-26T11:24:02.613 INFO:tasks.workunit.client.0.smithi073.stdout:2/603: dwrite dd/d4c/d48/d46/d91/d9f/d1d/f20 [0,4194304] 0 2024-04-26T11:24:02.617 INFO:tasks.workunit.client.0.smithi073.stdout:8/655: truncate d1/d4/f55 492071 0 2024-04-26T11:24:02.618 INFO:tasks.workunit.client.0.smithi073.stdout:0/620: symlink d2/d37/d3c/d6a/ldd 0 2024-04-26T11:24:02.618 INFO:tasks.workunit.client.0.smithi073.stdout:3/617: dwrite d0/faf [0,4194304] 0 2024-04-26T11:24:02.618 INFO:tasks.workunit.client.0.smithi073.stdout:2/604: symlink dd/d4c/d48/d77/lb4 0 2024-04-26T11:24:02.620 INFO:tasks.workunit.client.0.smithi073.stdout:8/656: mkdir d1/d4/d15/de4 0 2024-04-26T11:24:02.621 INFO:tasks.workunit.client.0.smithi073.stdout:0/621: readlink d2/d37/d3c/d6a/ldd 0 2024-04-26T11:24:02.622 INFO:tasks.workunit.client.0.smithi073.stdout:9/627: dwrite d0/d1a/d4e/d70/d46/f8a [0,4194304] 0 2024-04-26T11:24:02.622 INFO:tasks.workunit.client.0.smithi073.stdout:2/605: chown dd/de/f28 1809 1 2024-04-26T11:24:02.624 INFO:tasks.workunit.client.0.smithi073.stdout:4/645: dwrite d8/d1a/d86/fd4 [0,4194304] 0 2024-04-26T11:24:02.624 INFO:tasks.workunit.client.0.smithi073.stdout:5/622: dwrite d4/d73/d8a/da0/fcf [0,4194304] 0 2024-04-26T11:24:02.625 INFO:tasks.workunit.client.0.smithi073.stdout:5/623: chown d4/de/d23/f36 0 1 2024-04-26T11:24:02.625 INFO:tasks.workunit.client.0.smithi073.stdout:1/727: dwrite d1/d73/d40/f3a [0,4194304] 0 2024-04-26T11:24:02.626 INFO:tasks.workunit.client.0.smithi073.stdout:9/628: mknod d0/d6c/cd3 0 2024-04-26T11:24:02.626 INFO:tasks.workunit.client.0.smithi073.stdout:4/646: mknod d8/d1a/d1b/d24/dac/d49/d84/ce4 0 2024-04-26T11:24:02.626 INFO:tasks.workunit.client.0.smithi073.stdout:2/606: rename dd/d4c/d48/d46/f82 to dd/de/d38/d53/d60/db2/fb5 0 2024-04-26T11:24:02.626 INFO:tasks.workunit.client.0.smithi073.stdout:1/728: write d1/d6/d7f/d47/fe0 [611160,69753] 0 2024-04-26T11:24:02.627 INFO:tasks.workunit.client.0.smithi073.stdout:0/622: mknod d2/d1f/d9c/cde 0 2024-04-26T11:24:02.627 INFO:tasks.workunit.client.0.smithi073.stdout:0/623: dread - d2/d22/d51/d57/d78/fd5 zero size 2024-04-26T11:24:02.628 INFO:tasks.workunit.client.0.smithi073.stdout:4/647: rmdir d8/d1a/d1b/d41 39 2024-04-26T11:24:02.630 INFO:tasks.workunit.client.0.smithi073.stdout:7/624: dread d1/f75 [0,4194304] 0 2024-04-26T11:24:02.631 INFO:tasks.workunit.client.0.smithi073.stdout:9/629: dread d0/d13/f1f [0,4194304] 0 2024-04-26T11:24:02.631 INFO:tasks.workunit.client.0.smithi073.stdout:3/618: write d0/d11/d19/db/d3e/d3f/f55 [780350,105972] 0 2024-04-26T11:24:02.632 INFO:tasks.workunit.client.0.smithi073.stdout:9/630: rmdir d0/d1a/d4e/d70/d59 39 2024-04-26T11:24:02.632 INFO:tasks.workunit.client.0.smithi073.stdout:7/625: chown d1/d11/d24/d29/dd7/d3d/d7c/cbe 6 1 2024-04-26T11:24:02.633 INFO:tasks.workunit.client.0.smithi073.stdout:4/648: rename d8/d1a/d1b/d24/dac/d72/d77/d96/fa4 to d8/d1a/d1b/d24/dac/fe5 0 2024-04-26T11:24:02.633 INFO:tasks.workunit.client.0.smithi073.stdout:9/631: readlink d0/d13/d5a/l82 0 2024-04-26T11:24:02.634 INFO:tasks.workunit.client.0.smithi073.stdout:2/607: dwrite f6 [4194304,4194304] 0 2024-04-26T11:24:02.635 INFO:tasks.workunit.client.0.smithi073.stdout:7/626: chown d1/d11/d51/dbd/cb1 803220261 1 2024-04-26T11:24:02.635 INFO:tasks.workunit.client.0.smithi073.stdout:0/624: dwrite d2/d1f/d40/f5b [0,4194304] 0 2024-04-26T11:24:02.635 INFO:tasks.workunit.client.0.smithi073.stdout:9/632: mkdir d0/d83/dd4 0 2024-04-26T11:24:02.637 INFO:tasks.workunit.client.0.smithi073.stdout:0/625: stat d2/d37/d3c/ca1 0 2024-04-26T11:24:02.637 INFO:tasks.workunit.client.0.smithi073.stdout:7/627: link d1/d33/d1b/fd3 d1/d11/d51/fdd 0 2024-04-26T11:24:02.637 INFO:tasks.workunit.client.0.smithi073.stdout:4/649: rename d8/d1a/d1b/d46/f81 to d8/d1a/fe6 0 2024-04-26T11:24:02.637 INFO:tasks.workunit.client.0.smithi073.stdout:2/608: mknod dd/de/d38/d53/cb6 0 2024-04-26T11:24:02.637 INFO:tasks.workunit.client.0.smithi073.stdout:9/633: write d0/d1a/d4e/d70/d51/f67 [3421935,109745] 0 2024-04-26T11:24:02.638 INFO:tasks.workunit.client.0.smithi073.stdout:0/626: rmdir d2/d1f/d40/d48 39 2024-04-26T11:24:02.639 INFO:tasks.workunit.client.0.smithi073.stdout:4/650: chown d8/d1a/d1b/d41/f58 2074112166 1 2024-04-26T11:24:02.639 INFO:tasks.workunit.client.0.smithi073.stdout:7/628: mknod d1/ddc/cde 0 2024-04-26T11:24:02.639 INFO:tasks.workunit.client.0.smithi073.stdout:0/627: creat d2/d1f/d9d/fdf x:0 0 0 2024-04-26T11:24:02.639 INFO:tasks.workunit.client.0.smithi073.stdout:4/651: write d8/f13 [1136013,80429] 0 2024-04-26T11:24:02.639 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:02.640 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:02.640 INFO:tasks.workunit.client.0.smithi073.stdout:0/628: mknod d2/d1f/d40/d48/da9/dd8/ce0 0 2024-04-26T11:24:02.641 INFO:tasks.workunit.client.0.smithi073.stdout:1/729: read d1/fe5 [1820119,14641] 0 2024-04-26T11:24:02.641 INFO:tasks.workunit.client.0.smithi073.stdout:1/730: rmdir d1/d6 39 2024-04-26T11:24:02.643 INFO:tasks.workunit.client.0.smithi073.stdout:1/731: creat d1/d73/d34/d98/ff9 x:0 0 0 2024-04-26T11:24:02.646 INFO:tasks.workunit.client.0.smithi073.stdout:7/629: dwrite d1/d33/d1b/d66/d50/f7d [0,4194304] 0 2024-04-26T11:24:02.647 INFO:tasks.workunit.client.0.smithi073.stdout:4/652: dwrite d8/d1a/d1b/d24/dac/d72/d77/f7a [0,4194304] 0 2024-04-26T11:24:02.647 INFO:tasks.workunit.client.0.smithi073.stdout:2/609: read dd/d4c/d48/d46/d91/d9f/d1d/f73 [30875,34496] 0 2024-04-26T11:24:02.649 INFO:tasks.workunit.client.0.smithi073.stdout:2/610: fdatasync dd/d4c/d48/f90 0 2024-04-26T11:24:02.649 INFO:tasks.workunit.client.0.smithi073.stdout:2/611: stat dd/de/d38/d53/f74 0 2024-04-26T11:24:02.649 INFO:tasks.workunit.client.0.smithi073.stdout:1/732: dread d1/d6/f22 [0,4194304] 0 2024-04-26T11:24:02.650 INFO:tasks.workunit.client.0.smithi073.stdout:4/653: mknod d8/d1a/d86/ce7 0 2024-04-26T11:24:02.651 INFO:tasks.workunit.client.0.smithi073.stdout:4/654: fdatasync d8/d1a/d1b/d24/dac/fe5 0 2024-04-26T11:24:02.652 INFO:tasks.workunit.client.0.smithi073.stdout:4/655: readlink d8/d15/l9e 0 2024-04-26T11:24:02.654 INFO:tasks.workunit.client.0.smithi073.stdout:7/630: dwrite d1/d33/d1b/f1e [0,4194304] 0 2024-04-26T11:24:02.655 INFO:tasks.workunit.client.0.smithi073.stdout:6/577: dread d0/d19/f60 [0,4194304] 0 2024-04-26T11:24:02.657 INFO:tasks.workunit.client.0.smithi073.stdout:6/578: rename d0 to d0/dc/d8c/db1 22 2024-04-26T11:24:02.658 INFO:tasks.workunit.client.0.smithi073.stdout:4/656: symlink d8/d1a/d1b/le8 0 2024-04-26T11:24:02.658 INFO:tasks.workunit.client.0.smithi073.stdout:6/579: readlink d0/d1a/d26/d27/l75 0 2024-04-26T11:24:02.658 INFO:tasks.workunit.client.0.smithi073.stdout:2/612: dwrite dd/d4c/d48/d46/f69 [4194304,4194304] 0 2024-04-26T11:24:02.659 INFO:tasks.workunit.client.0.smithi073.stdout:6/580: dread - d0/d1a/d26/d4b/d49/fa3 zero size 2024-04-26T11:24:02.661 INFO:tasks.workunit.client.0.smithi073.stdout:2/613: mknod dd/de/d38/d4e/cb7 0 2024-04-26T11:24:02.663 INFO:tasks.workunit.client.0.smithi073.stdout:7/631: dwrite d1/d11/d5e/fab [0,4194304] 0 2024-04-26T11:24:02.663 INFO:tasks.workunit.client.0.smithi073.stdout:2/614: write f6 [615557,45256] 0 2024-04-26T11:24:02.664 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:02.664 INFO:tasks.workunit.client.0.smithi073.stdout:7/632: dread - d1/d11/d24/d29/dd7/d3d/f93 zero size 2024-04-26T11:24:02.665 INFO:tasks.workunit.client.0.smithi073.stdout:2/615: rename dd/d27/f31 to dd/d27/fb8 0 2024-04-26T11:24:02.665 INFO:tasks.workunit.client.0.smithi073.stdout:7/633: mkdir d1/d11/d5e/d8f/ddf 0 2024-04-26T11:24:02.666 INFO:tasks.workunit.client.0.smithi073.stdout:6/581: dwrite d0/dc/faf [0,4194304] 0 2024-04-26T11:24:02.666 INFO:tasks.workunit.client.0.smithi073.stdout:2/616: chown dd/d4c/d48/d46/d91/d9f/d1d/d8c 41 1 2024-04-26T11:24:02.668 INFO:tasks.workunit.client.0.smithi073.stdout:2/617: symlink dd/de/d38/d53/d9d/lb9 0 2024-04-26T11:24:02.670 INFO:tasks.workunit.client.0.smithi073.stdout:5/624: dread d4/f1f [0,4194304] 0 2024-04-26T11:24:02.670 INFO:tasks.workunit.client.0.smithi073.stdout:3/619: dread d0/d11/d19/db/d3e/d3f/f59 [0,4194304] 0 2024-04-26T11:24:02.670 INFO:tasks.workunit.client.0.smithi073.stdout:8/657: dread d1/d21/d2c/ddd/f2e [0,4194304] 0 2024-04-26T11:24:02.671 INFO:tasks.workunit.client.0.smithi073.stdout:5/625: dread - d4/de/d15/d33/f9d zero size 2024-04-26T11:24:02.675 INFO:tasks.workunit.client.0.smithi073.stdout:6/582: dwrite d0/dc/d80/f83 [0,4194304] 0 2024-04-26T11:24:02.675 INFO:tasks.workunit.client.0.smithi073.stdout:5/626: fsync d4/d95/da5/fd2 0 2024-04-26T11:24:02.677 INFO:tasks.workunit.client.0.smithi073.stdout:6/583: creat d0/d15/d2d/fb2 x:0 0 0 2024-04-26T11:24:02.678 INFO:tasks.workunit.client.0.smithi073.stdout:5/627: creat d4/de/d15/d67/fe4 x:0 0 0 2024-04-26T11:24:02.680 INFO:tasks.workunit.client.0.smithi073.stdout:3/620: dwrite d0/d11/d19/db/d3e/d3f/f55 [0,4194304] 0 2024-04-26T11:24:02.680 INFO:tasks.workunit.client.0.smithi073.stdout:2/618: dwrite dd/de/d38/f70 [0,4194304] 0 2024-04-26T11:24:02.683 INFO:tasks.workunit.client.0.smithi073.stdout:9/634: dread d0/d13/db/f4b [0,4194304] 0 2024-04-26T11:24:02.683 INFO:tasks.workunit.client.0.smithi073.stdout:8/658: dwrite d1/d21/d2c/ddd/d67/fba [0,4194304] 0 2024-04-26T11:24:02.684 INFO:tasks.workunit.client.0.smithi073.stdout:3/621: mknod d0/d11/d19/db/da6/cd7 0 2024-04-26T11:24:02.684 INFO:tasks.workunit.client.0.smithi073.stdout:6/584: creat d0/d1a/d7a/fb3 x:0 0 0 2024-04-26T11:24:02.685 INFO:tasks.workunit.client.0.smithi073.stdout:6/585: fsync d0/d15/d2d/fb2 0 2024-04-26T11:24:02.686 INFO:tasks.workunit.client.0.smithi073.stdout:5/628: creat d4/d95/da5/fe5 x:0 0 0 2024-04-26T11:24:02.687 INFO:tasks.workunit.client.0.smithi073.stdout:3/622: fsync d0/fa 0 2024-04-26T11:24:02.688 INFO:tasks.workunit.client.0.smithi073.stdout:6/586: getdents d0/dc/d2e 0 2024-04-26T11:24:02.688 INFO:tasks.workunit.client.0.smithi073.stdout:3/623: write d0/d11/d19/f6 [4703194,13270] 0 2024-04-26T11:24:02.688 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:02.684+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:02.688 INFO:tasks.workunit.client.0.smithi073.stdout:6/587: creat d0/d19/d20/fb4 x:0 0 0 2024-04-26T11:24:02.689 INFO:tasks.workunit.client.0.smithi073.stdout:6/588: write d0/d15/d2d/d3f/f98 [977319,69820] 0 2024-04-26T11:24:02.692 INFO:tasks.workunit.client.0.smithi073.stdout:0/629: sync 2024-04-26T11:24:02.693 INFO:tasks.workunit.client.0.smithi073.stdout:0/630: mkdir d2/d22/d51/d57/d78/de1 0 2024-04-26T11:24:02.694 INFO:tasks.workunit.client.0.smithi073.stdout:3/624: truncate d0/d11/d19/db/f1a 707607 0 2024-04-26T11:24:02.695 INFO:tasks.workunit.client.0.smithi073.stdout:0/631: rename d2/d1f/d9c/cde to d2/d22/ce2 0 2024-04-26T11:24:02.695 INFO:tasks.workunit.client.0.smithi073.stdout:0/632: fdatasync d2/fcd 0 2024-04-26T11:24:02.697 INFO:tasks.workunit.client.0.smithi073.stdout:5/629: read d4/de/d15/f9e [2508565,17626] 0 2024-04-26T11:24:02.697 INFO:tasks.workunit.client.0.smithi073.stdout:5/630: chown d4/d73/d8a 14657300 1 2024-04-26T11:24:02.698 INFO:tasks.workunit.client.0.smithi073.stdout:5/631: mknod d4/de/d23/d4f/ce6 0 2024-04-26T11:24:02.698 INFO:tasks.workunit.client.0.smithi073.stdout:9/635: dread d0/d13/f1c [0,4194304] 0 2024-04-26T11:24:02.699 INFO:tasks.workunit.client.0.smithi073.stdout:5/632: mknod d4/de/d23/d4f/ce7 0 2024-04-26T11:24:02.700 INFO:tasks.workunit.client.0.smithi073.stdout:5/633: chown d4/de/d15/d33/l90 3086000 1 2024-04-26T11:24:02.700 INFO:tasks.workunit.client.0.smithi073.stdout:3/625: dread d0/d11/d19/d1d/f4c [0,4194304] 0 2024-04-26T11:24:02.701 INFO:tasks.workunit.client.0.smithi073.stdout:5/634: chown d4/d8/d9/d7d/d84/fbd 159 1 2024-04-26T11:24:02.701 INFO:tasks.workunit.client.0.smithi073.stdout:5/635: dread - d4/d95/fc9 zero size 2024-04-26T11:24:02.701 INFO:tasks.workunit.client.0.smithi073.stdout:5/636: readlink d4/d8/d9/d7d/d84/l57 0 2024-04-26T11:24:02.705 INFO:tasks.workunit.client.0.smithi073.stdout:4/657: dread f5 [4194304,4194304] 0 2024-04-26T11:24:02.706 INFO:tasks.workunit.client.0.smithi073.stdout:6/589: dread d0/dc/f64 [0,4194304] 0 2024-04-26T11:24:02.707 INFO:tasks.workunit.client.0.smithi073.stdout:4/658: write d8/d1a/d1b/d24/dac/f27 [2565420,71804] 0 2024-04-26T11:24:02.708 INFO:tasks.workunit.client.0.smithi073.stdout:3/626: dwrite d0/d11/d19/d52/fb1 [0,4194304] 0 2024-04-26T11:24:02.709 INFO:tasks.workunit.client.0.smithi073.stdout:1/733: sync 2024-04-26T11:24:02.709 INFO:tasks.workunit.client.0.smithi073.stdout:5/637: dwrite d4/de/d15/d67/fad [0,4194304] 0 2024-04-26T11:24:02.710 INFO:tasks.workunit.client.0.smithi073.stdout:5/638: stat d4/d8/d9/d7d/d84/l82 0 2024-04-26T11:24:02.715 INFO:tasks.workunit.client.0.smithi073.stdout:3/627: creat d0/d11/d19/db/d3e/d3f/d69/fd8 x:0 0 0 2024-04-26T11:24:02.715 INFO:tasks.workunit.client.0.smithi073.stdout:6/590: rename d0/d19/d20/f22 to d0/dc/fb5 0 2024-04-26T11:24:02.715 INFO:tasks.workunit.client.0.smithi073.stdout:5/639: truncate d4/d8/d9/d7d/d84/da7/fd8 3451013 0 2024-04-26T11:24:02.715 INFO:tasks.workunit.client.0.smithi073.stdout:1/734: creat d1/d6/d7f/ffa x:0 0 0 2024-04-26T11:24:02.716 INFO:tasks.workunit.client.0.smithi073.stdout:8/659: dread d1/d4/d37/d5b/f7a [0,4194304] 0 2024-04-26T11:24:02.716 INFO:tasks.workunit.client.0.smithi073.stdout:8/660: mknod d1/d4/d4c/ce5 0 2024-04-26T11:24:02.716 INFO:tasks.workunit.client.0.smithi073.stdout:4/659: dwrite d8/d1a/d1b/d24/dac/d49/d84/f6e [0,4194304] 0 2024-04-26T11:24:02.718 INFO:tasks.workunit.client.0.smithi073.stdout:6/591: dwrite d0/d1a/d26/d27/f8a [0,4194304] 0 2024-04-26T11:24:02.723 INFO:tasks.workunit.client.0.smithi073.stdout:4/660: getdents d8/d1a/d4d/ddc 0 2024-04-26T11:24:02.723 INFO:tasks.workunit.client.0.smithi073.stdout:6/592: dread d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:02.724 INFO:tasks.workunit.client.0.smithi073.stdout:6/593: stat d0/d1a/d26/d4b/d2b/d2c/fb0 0 2024-04-26T11:24:02.725 INFO:tasks.workunit.client.0.smithi073.stdout:6/594: mknod d0/dc/d55/d79/cb6 0 2024-04-26T11:24:02.726 INFO:tasks.workunit.client.0.smithi073.stdout:6/595: symlink d0/dc/d2e/lb7 0 2024-04-26T11:24:02.726 INFO:tasks.workunit.client.0.smithi073.stdout:3/628: dread d0/d11/d19/fc [0,4194304] 0 2024-04-26T11:24:02.727 INFO:tasks.workunit.client.0.smithi073.stdout:6/596: creat d0/d1a/d4e/fb8 x:0 0 0 2024-04-26T11:24:02.729 INFO:tasks.workunit.client.0.smithi073.stdout:6/597: write d0/dc/d55/f46 [3148379,102338] 0 2024-04-26T11:24:02.729 INFO:tasks.workunit.client.0.smithi073.stdout:3/629: creat d0/d11/d19/db/da6/d7a/dbc/fd9 x:0 0 0 2024-04-26T11:24:02.729 INFO:tasks.workunit.client.0.smithi073.stdout:8/661: dwrite d1/d21/d2c/ddd/d67/d81/f88 [0,4194304] 0 2024-04-26T11:24:02.729 INFO:tasks.workunit.client.0.smithi073.stdout:5/640: dread d4/de/d15/d33/f8f [0,4194304] 0 2024-04-26T11:24:02.730 INFO:tasks.workunit.client.0.smithi073.stdout:8/662: rmdir d1/d4/d37 39 2024-04-26T11:24:02.730 INFO:tasks.workunit.client.0.smithi073.stdout:4/661: dwrite d8/d1a/d1b/d1d/f21 [4194304,4194304] 0 2024-04-26T11:24:02.730 INFO:tasks.workunit.client.0.smithi073.stdout:3/630: read - d0/d11/d19/db/d3e/d47/f83 zero size 2024-04-26T11:24:02.730 INFO:tasks.workunit.client.0.smithi073.stdout:5/641: dread - d4/de/d15/d33/fda zero size 2024-04-26T11:24:02.732 INFO:tasks.workunit.client.0.smithi073.stdout:8/663: write d1/d21/d2c/ddd/f36 [1505302,99958] 0 2024-04-26T11:24:02.733 INFO:tasks.workunit.client.0.smithi073.stdout:5/642: readlink d4/d8/d9/d7d/d84/l57 0 2024-04-26T11:24:02.735 INFO:tasks.workunit.client.0.smithi073.stdout:6/598: symlink d0/dc/d55/lb9 0 2024-04-26T11:24:02.735 INFO:tasks.workunit.client.0.smithi073.stdout:4/662: rename d8/d1a/d1b/le8 to d8/d1a/d9c/le9 0 2024-04-26T11:24:02.735 INFO:tasks.workunit.client.0.smithi073.stdout:8/664: mknod d1/d21/d2c/ddd/d67/d81/da5/ce6 0 2024-04-26T11:24:02.735 INFO:tasks.workunit.client.0.smithi073.stdout:6/599: write d0/d1a/d4e/f51 [1178720,56332] 0 2024-04-26T11:24:02.736 INFO:tasks.workunit.client.0.smithi073.stdout:6/600: mknod d0/d15/d2d/d3f/d59/cba 0 2024-04-26T11:24:02.736 INFO:tasks.workunit.client.0.smithi073.stdout:9/636: dread d0/d6c/f97 [0,4194304] 0 2024-04-26T11:24:02.743 INFO:tasks.workunit.client.0.smithi073.stdout:9/637: mknod d0/d6c/dc7/cd5 0 2024-04-26T11:24:02.743 INFO:tasks.workunit.client.0.smithi073.stdout:4/663: dwrite d8/d1a/d1b/d24/dac/f50 [0,4194304] 0 2024-04-26T11:24:02.743 INFO:tasks.workunit.client.0.smithi073.stdout:6/601: dwrite d0/d19/f6f [0,4194304] 0 2024-04-26T11:24:02.744 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-26T11:24:02.745 INFO:tasks.workunit.client.0.smithi073.stdout:6/602: stat d0/d1a/d4e/fa4 0 2024-04-26T11:24:02.745 INFO:tasks.workunit.client.0.smithi073.stdout:7/634: sync 2024-04-26T11:24:02.745 INFO:tasks.workunit.client.0.smithi073.stdout:8/665: dread d1/d21/d2c/ddd/d67/d81/da5/fae [0,4194304] 0 2024-04-26T11:24:02.746 INFO:tasks.workunit.client.0.smithi073.stdout:6/603: dread - d0/d1a/d26/d4b/d2b/d43/f88 zero size 2024-04-26T11:24:02.746 INFO:tasks.workunit.client.0.smithi073.stdout:9/638: mkdir d0/d1a/d4e/d70/dd6 0 2024-04-26T11:24:02.746 INFO:tasks.workunit.client.0.smithi073.stdout:4/664: rmdir d8/d1a/d1b/d24/dac/d72/da3 39 2024-04-26T11:24:02.746 INFO:tasks.workunit.client.0.smithi073.stdout:7/635: mkdir d1/d11/d24/de0 0 2024-04-26T11:24:02.748 INFO:tasks.workunit.client.0.smithi073.stdout:6/604: chown d0/d1a/d26/d4b/d63/c99 1521 1 2024-04-26T11:24:02.748 INFO:tasks.workunit.client.0.smithi073.stdout:9/639: read d0/d13/db/fc0 [701932,84666] 0 2024-04-26T11:24:02.748 INFO:tasks.workunit.client.0.smithi073.stdout:7/636: rename d1/d33/d1b/d66/d50/l5a to d1/d11/d24/d29/dd7/d3d/d7b/le1 0 2024-04-26T11:24:02.748 INFO:tasks.workunit.client.0.smithi073.stdout:6/605: mknod d0/d1a/d26/d4b/cbb 0 2024-04-26T11:24:02.750 INFO:tasks.workunit.client.0.smithi073.stdout:9/640: write d0/d13/d25/d2c/f53 [4988855,128239] 0 2024-04-26T11:24:02.750 INFO:tasks.workunit.client.0.smithi073.stdout:7/637: unlink d1/d33/d68/f8b 0 2024-04-26T11:24:02.750 INFO:tasks.workunit.client.0.smithi073.stdout:9/641: rename d0/d1a to d0/d1a/d4e/d70/d3b/dd7 22 2024-04-26T11:24:02.750 INFO:tasks.workunit.client.0.smithi073.stdout:7/638: mkdir d1/d11/d24/d29/dd7/d3d/d7c/de2 0 2024-04-26T11:24:02.751 INFO:tasks.workunit.client.0.smithi073.stdout:7/639: readlink d1/d33/d68/l8c 0 2024-04-26T11:24:02.752 INFO:tasks.workunit.client.0.smithi073.stdout:4/665: dwrite d8/d1a/d86/fd4 [0,4194304] 0 2024-04-26T11:24:02.753 INFO:tasks.workunit.client.0.smithi073.stdout:7/640: rename d1/d11/d5e/cb0 to d1/d11/d24/d29/dd7/d3d/d41/d64/ce3 0 2024-04-26T11:24:02.757 INFO:tasks.workunit.client.0.smithi073.stdout:4/666: creat d8/d1a/d1b/d24/dac/d72/d77/d96/fea x:0 0 0 2024-04-26T11:24:02.757 INFO:tasks.workunit.client.0.smithi073.stdout:7/641: truncate d1/d11/d24/d71/d90/f9f 986671 0 2024-04-26T11:24:02.758 INFO:tasks.workunit.client.0.smithi073.stdout:4/667: write d8/d1a/d1b/d24/dac/d49/f91 [96748,89703] 0 2024-04-26T11:24:02.758 INFO:tasks.workunit.client.0.smithi073.stdout:7/642: dread - d1/d11/d24/d29/dd7/d3d/d7b/fcb zero size 2024-04-26T11:24:02.758 INFO:tasks.workunit.client.0.smithi073.stdout:5/643: sync 2024-04-26T11:24:02.758 INFO:tasks.workunit.client.0.smithi073.stdout:2/619: sync 2024-04-26T11:24:02.758 INFO:tasks.workunit.client.0.smithi073.stdout:0/633: sync 2024-04-26T11:24:02.758 INFO:tasks.workunit.client.0.smithi073.stdout:1/735: sync 2024-04-26T11:24:02.759 INFO:tasks.workunit.client.0.smithi073.stdout:4/668: truncate d8/d1f/fc0 122183 0 2024-04-26T11:24:02.761 INFO:tasks.workunit.client.0.smithi073.stdout:2/620: write dd/de/f12 [4204203,50793] 0 2024-04-26T11:24:02.761 INFO:tasks.workunit.client.0.smithi073.stdout:1/736: mkdir d1/d8/dfb 0 2024-04-26T11:24:02.761 INFO:tasks.workunit.client.0.smithi073.stdout:7/643: rename d1/d11/d24/d29/dd7/f2c to d1/d11/d24/fe4 0 2024-04-26T11:24:02.762 INFO:tasks.workunit.client.0.smithi073.stdout:1/737: fsync d1/d6/fe2 0 2024-04-26T11:24:02.763 INFO:tasks.workunit.client.0.smithi073.stdout:4/669: mknod d8/d1a/d1b/d24/dac/d72/d77/d96/ceb 0 2024-04-26T11:24:02.763 INFO:tasks.workunit.client.0.smithi073.stdout:5/644: link d4/d73/l88 d4/d73/le8 0 2024-04-26T11:24:02.763 INFO:tasks.workunit.client.0.smithi073.stdout:4/670: stat d8/d14/d60/d64/c7d 0 2024-04-26T11:24:02.764 INFO:tasks.workunit.client.0.smithi073.stdout:1/738: mkdir d1/d73/d34/dfc 0 2024-04-26T11:24:02.764 INFO:tasks.workunit.client.0.smithi073.stdout:1/739: dread - d1/fb6 zero size 2024-04-26T11:24:02.764 INFO:tasks.workunit.client.0.smithi073.stdout:5/645: symlink d4/d8/d9/d7d/da3/le9 0 2024-04-26T11:24:02.764 INFO:tasks.workunit.client.0.smithi073.stdout:7/644: write d1/d11/d24/d29/dd7/d3d/d41/d64/dae/fd8 [223878,128204] 0 2024-04-26T11:24:02.764 INFO:tasks.workunit.client.0.smithi073.stdout:4/671: dread - d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/fbe zero size 2024-04-26T11:24:02.766 INFO:tasks.workunit.client.0.smithi073.stdout:4/672: stat d8/d1a/d1b/d24 0 2024-04-26T11:24:02.766 INFO:tasks.workunit.client.0.smithi073.stdout:2/621: dread dd/de/d38/f70 [0,4194304] 0 2024-04-26T11:24:02.766 INFO:tasks.workunit.client.0.smithi073.stdout:1/740: write d1/d6/d7f/d47/fc2 [1203216,117160] 0 2024-04-26T11:24:02.766 INFO:tasks.workunit.client.0.smithi073.stdout:2/622: fsync dd/d4c/d48/d46/d91/d9f/d1d/d8c/f99 0 2024-04-26T11:24:02.766 INFO:tasks.workunit.client.0.smithi073.stdout:5/646: rename d4/d8/d9/d7d/d84/da7/db7/lc2 to d4/d8/d9/d7d/lea 0 2024-04-26T11:24:02.767 INFO:tasks.workunit.client.0.smithi073.stdout:9/642: dread d0/d1a/d4e/d70/f38 [0,4194304] 0 2024-04-26T11:24:02.767 INFO:tasks.workunit.client.0.smithi073.stdout:8/666: dread d1/d21/d2a/f43 [0,4194304] 0 2024-04-26T11:24:02.767 INFO:tasks.workunit.client.0.smithi073.stdout:5/647: write d4/d8/d8e/fa9 [522996,100541] 0 2024-04-26T11:24:02.767 INFO:tasks.workunit.client.0.smithi073.stdout:3/631: dread d0/f7 [0,4194304] 0 2024-04-26T11:24:02.768 INFO:tasks.workunit.client.0.smithi073.stdout:1/741: fdatasync d1/d73/d40/f2f 0 2024-04-26T11:24:02.769 INFO:tasks.workunit.client.0.smithi073.stdout:8/667: write d1/d21/d2a/f34 [820279,36488] 0 2024-04-26T11:24:02.769 INFO:tasks.workunit.client.0.smithi073.stdout:9/643: creat d0/d1a/d4e/fd8 x:0 0 0 2024-04-26T11:24:02.769 INFO:tasks.workunit.client.0.smithi073.stdout:5/648: dread - d4/d8/d9/d7d/da3/ddc/f89 zero size 2024-04-26T11:24:02.770 INFO:tasks.workunit.client.0.smithi073.stdout:0/634: truncate d2/fb 973685 0 2024-04-26T11:24:02.770 INFO:tasks.workunit.client.0.smithi073.stdout:4/673: dread d8/d1a/d86/f98 [0,4194304] 0 2024-04-26T11:24:02.770 INFO:tasks.workunit.client.0.smithi073.stdout:8/668: dread - d1/d21/fc7 zero size 2024-04-26T11:24:02.771 INFO:tasks.workunit.client.0.smithi073.stdout:0/635: readlink d2/d37/lb9 0 2024-04-26T11:24:02.771 INFO:tasks.workunit.client.0.smithi073.stdout:5/649: chown d4/d8/d9/d42/d68/laa 7816 1 2024-04-26T11:24:02.772 INFO:tasks.workunit.client.0.smithi073.stdout:6/606: dread d0/d1a/d4e/f51 [0,4194304] 0 2024-04-26T11:24:02.772 INFO:tasks.workunit.client.0.smithi073.stdout:5/650: fsync d4/de/f10 0 2024-04-26T11:24:02.772 INFO:tasks.workunit.client.0.smithi073.stdout:0/636: write d2/d22/f65 [698909,68114] 0 2024-04-26T11:24:02.773 INFO:tasks.workunit.client.0.smithi073.stdout:4/674: symlink d8/d1a/d1b/d24/lec 0 2024-04-26T11:24:02.773 INFO:tasks.workunit.client.0.smithi073.stdout:9/644: write d0/d13/d25/d2c/f3a [2253549,53] 0 2024-04-26T11:24:02.773 INFO:tasks.workunit.client.0.smithi073.stdout:8/669: truncate d1/d4/d4c/d66/f72 568058 0 2024-04-26T11:24:02.774 INFO:tasks.workunit.client.0.smithi073.stdout:2/623: dwrite f0 [4194304,4194304] 0 2024-04-26T11:24:02.775 INFO:tasks.workunit.client.0.smithi073.stdout:4/675: stat d8/d1a/d1b/d1d/c54 0 2024-04-26T11:24:02.776 INFO:tasks.workunit.client.0.smithi073.stdout:2/624: chown l4 12 1 2024-04-26T11:24:02.776 INFO:tasks.workunit.client.0.smithi073.stdout:1/742: getdents d1/d73/d34 0 2024-04-26T11:24:02.779 INFO:tasks.workunit.client.0.smithi073.stdout:9/645: creat d0/d13/d25/d2c/fd9 x:0 0 0 2024-04-26T11:24:02.779 INFO:tasks.workunit.client.0.smithi073.stdout:2/625: dread - dd/d4c/faf zero size 2024-04-26T11:24:02.780 INFO:tasks.workunit.client.0.smithi073.stdout:8/670: rename d1/d4/d37/f4b to d1/d21/d2c/ddd/fe7 0 2024-04-26T11:24:02.781 INFO:tasks.workunit.client.0.smithi073.stdout:4/676: creat d8/d1a/d1b/dd2/fed x:0 0 0 2024-04-26T11:24:02.782 INFO:tasks.workunit.client.0.smithi073.stdout:6/607: dread d0/d1a/d4e/f51 [0,4194304] 0 2024-04-26T11:24:02.782 INFO:tasks.workunit.client.0.smithi073.stdout:3/632: dwrite d0/d11/d23/f88 [0,4194304] 0 2024-04-26T11:24:02.782 INFO:tasks.workunit.client.0.smithi073.stdout:7/645: dwrite d1/d33/d1b/fd3 [0,4194304] 0 2024-04-26T11:24:02.785 INFO:tasks.workunit.client.0.smithi073.stdout:6/608: chown d0/d1a/d26/f94 147 1 2024-04-26T11:24:02.786 INFO:tasks.workunit.client.0.smithi073.stdout:7/646: chown d1/d11/d10 453442 1 2024-04-26T11:24:02.786 INFO:tasks.workunit.client.0.smithi073.stdout:0/637: dwrite d2/d22/d51/fd1 [0,4194304] 0 2024-04-26T11:24:02.786 INFO:tasks.workunit.client.0.smithi073.stdout:6/609: rename d0/d15/d2d/d86 to d0/d1a/d26/d27/dbc 0 2024-04-26T11:24:02.790 INFO:tasks.workunit.client.0.smithi073.stdout:5/651: dwrite d4/de/d15/d33/f9d [0,4194304] 0 2024-04-26T11:24:02.791 INFO:tasks.workunit.client.0.smithi073.stdout:5/652: stat d4/de/d15/d33/f4e 0 2024-04-26T11:24:02.791 INFO:tasks.workunit.client.0.smithi073.stdout:4/677: mkdir d8/d1a/d5e/d7c/dee 0 2024-04-26T11:24:02.791 INFO:tasks.workunit.client.0.smithi073.stdout:7/647: rename d1/d11/d24/d29/dd7/d3d/d41/d64/c7f to d1/d33/d1b/ce5 0 2024-04-26T11:24:02.792 INFO:tasks.workunit.client.0.smithi073.stdout:8/671: dwrite d1/d4/d4c/fbe [0,4194304] 0 2024-04-26T11:24:02.792 INFO:tasks.workunit.client.0.smithi073.stdout:2/626: dwrite dd/d4c/d48/d46/d91/d9f/d1d/f44 [0,4194304] 0 2024-04-26T11:24:02.792 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:02.786+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:02.792 INFO:tasks.workunit.client.0.smithi073.stdout:7/648: write d1/d11/d10/f2f [1349172,114176] 0 2024-04-26T11:24:02.793 INFO:tasks.workunit.client.0.smithi073.stdout:2/627: write dd/d4c/f7c [1284285,95499] 0 2024-04-26T11:24:02.794 INFO:tasks.workunit.client.0.smithi073.stdout:9/646: dwrite d0/d13/d5a/d5e/f94 [0,4194304] 0 2024-04-26T11:24:02.795 INFO:tasks.workunit.client.0.smithi073.stdout:8/672: stat d1/d4/d37/d90/ld7 0 2024-04-26T11:24:02.795 INFO:tasks.workunit.client.0.smithi073.stdout:2/628: unlink dd/d4c/faf 0 2024-04-26T11:24:02.795 INFO:tasks.workunit.client.0.smithi073.stdout:9/647: dread - d0/d13/d25/d75/d98/fb4 zero size 2024-04-26T11:24:02.795 INFO:tasks.workunit.client.0.smithi073.stdout:0/638: rename d2/d37/c4d to d2/ce3 0 2024-04-26T11:24:02.798 INFO:tasks.workunit.client.0.smithi073.stdout:2/629: unlink dd/de/d38/c3a 0 2024-04-26T11:24:02.799 INFO:tasks.workunit.client.0.smithi073.stdout:0/639: mknod d2/d1f/d9d/ce4 0 2024-04-26T11:24:02.799 INFO:tasks.workunit.client.0.smithi073.stdout:5/653: dwrite d4/d95/fd0 [0,4194304] 0 2024-04-26T11:24:02.800 INFO:tasks.workunit.client.0.smithi073.stdout:9/648: getdents d0/d1a/d4e/d70/dae 0 2024-04-26T11:24:02.801 INFO:tasks.workunit.client.0.smithi073.stdout:4/678: dwrite d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/fb7 [0,4194304] 0 2024-04-26T11:24:02.802 INFO:tasks.workunit.client.0.smithi073.stdout:2/630: fdatasync dd/d4c/d48/d46/d91/d9f/d1d/f73 0 2024-04-26T11:24:02.803 INFO:tasks.workunit.client.0.smithi073.stdout:2/631: chown dd/de 520 1 2024-04-26T11:24:02.803 INFO:tasks.workunit.client.0.smithi073.stdout:7/649: dwrite d1/d11/d24/d29/dd7/d3d/fc7 [0,4194304] 0 2024-04-26T11:24:02.803 INFO:tasks.workunit.client.0.smithi073.stdout:4/679: fdatasync d8/d1a/d1b/d24/dac/d49/d84/f97 0 2024-04-26T11:24:02.804 INFO:tasks.workunit.client.0.smithi073.stdout:5/654: link d4/de/d15/d67/fad d4/d73/feb 0 2024-04-26T11:24:02.804 INFO:tasks.workunit.client.0.smithi073.stdout:9/649: rename d0/d1a/d4e/d70/f76 to d0/d13/d25/d2c/dbf/fda 0 2024-04-26T11:24:02.805 INFO:tasks.workunit.client.0.smithi073.stdout:2/632: unlink dd/de/d6b/c76 0 2024-04-26T11:24:02.805 INFO:tasks.workunit.client.0.smithi073.stdout:7/650: symlink d1/d11/d24/d29/dd7/d3d/d7c/le6 0 2024-04-26T11:24:02.806 INFO:tasks.workunit.client.0.smithi073.stdout:9/650: creat d0/d13/d5a/d65/fdb x:0 0 0 2024-04-26T11:24:02.807 INFO:tasks.workunit.client.0.smithi073.stdout:7/651: readlink d1/d11/d24/d29/lb7 0 2024-04-26T11:24:02.807 INFO:tasks.workunit.client.0.smithi073.stdout:2/633: symlink dd/de/d29/lba 0 2024-04-26T11:24:02.807 INFO:tasks.workunit.client.0.smithi073.stdout:9/651: unlink d0/d1a/f74 0 2024-04-26T11:24:02.808 INFO:tasks.workunit.client.0.smithi073.stdout:5/655: creat d4/d8/d9/d7d/d84/da7/db7/dcd/dd4/fec x:0 0 0 2024-04-26T11:24:02.810 INFO:tasks.workunit.client.0.smithi073.stdout:2/634: mkdir dd/de/d49/dbb 0 2024-04-26T11:24:02.811 INFO:tasks.workunit.client.0.smithi073.stdout:0/640: dwrite d2/d1f/d40/d48/fa5 [0,4194304] 0 2024-04-26T11:24:02.811 INFO:tasks.workunit.client.0.smithi073.stdout:3/633: dread d0/d34/f66 [0,4194304] 0 2024-04-26T11:24:02.812 INFO:tasks.workunit.client.0.smithi073.stdout:0/641: write d2/d1f/d40/d48/da9/fce [372818,111488] 0 2024-04-26T11:24:02.812 INFO:tasks.workunit.client.0.smithi073.stdout:3/634: chown d0/d11/d19/db/da6/d8b/d8c/d90/c93 256074378 1 2024-04-26T11:24:02.814 INFO:tasks.workunit.client.0.smithi073.stdout:0/642: mkdir d2/d1f/d40/d48/d62/de5 0 2024-04-26T11:24:02.814 INFO:tasks.workunit.client.0.smithi073.stdout:9/652: creat d0/d1a/d4e/d70/dae/fdc x:0 0 0 2024-04-26T11:24:02.814 INFO:tasks.workunit.client.0.smithi073.stdout:7/652: dwrite d1/d11/d24/d29/dd7/d3d/f93 [0,4194304] 0 2024-04-26T11:24:02.815 INFO:tasks.workunit.client.0.smithi073.stdout:0/643: stat d2/d1f/d40/c46 0 2024-04-26T11:24:02.815 INFO:tasks.workunit.client.0.smithi073.stdout:3/635: mkdir d0/d11/d19/db/da6/d7a/dce/dd3/dda 0 2024-04-26T11:24:02.815 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:02.816 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:02.817 INFO:tasks.workunit.client.0.smithi073.stdout:7/653: creat d1/d33/d1b/fe7 x:0 0 0 2024-04-26T11:24:02.817 INFO:tasks.workunit.client.0.smithi073.stdout:7/654: chown d1/c5b 25 1 2024-04-26T11:24:02.818 INFO:tasks.workunit.client.0.smithi073.stdout:9/653: dread d0/d1a/d4e/d70/f38 [0,4194304] 0 2024-04-26T11:24:02.818 INFO:tasks.workunit.client.0.smithi073.stdout:3/636: mkdir d0/d11/d19/db/d3e/d3f/d69/ddb 0 2024-04-26T11:24:02.821 INFO:tasks.workunit.client.0.smithi073.stdout:3/637: getdents d0/d11/d19/d1d 0 2024-04-26T11:24:02.822 INFO:tasks.workunit.client.0.smithi073.stdout:5/656: dwrite d4/de/d15/d67/fad [0,4194304] 0 2024-04-26T11:24:02.823 INFO:tasks.workunit.client.0.smithi073.stdout:3/638: stat d0/d11/d19/db/da6/d7a/dce/dd3/dda 0 2024-04-26T11:24:02.824 INFO:tasks.workunit.client.0.smithi073.stdout:7/655: dwrite d1/d11/d24/d29/dd7/d3d/f9e [0,4194304] 0 2024-04-26T11:24:02.825 INFO:tasks.workunit.client.0.smithi073.stdout:7/656: creat d1/d11/d24/fe8 x:0 0 0 2024-04-26T11:24:02.826 INFO:tasks.workunit.client.0.smithi073.stdout:7/657: fsync d1/d33/d68/faa 0 2024-04-26T11:24:02.826 INFO:tasks.workunit.client.0.smithi073.stdout:3/639: rename d0/d11/d23/d3b to d0/d11/d19/db/ddc 0 2024-04-26T11:24:02.832 INFO:tasks.workunit.client.0.smithi073.stdout:7/658: dwrite d1/d33/d1b/fe7 [0,4194304] 0 2024-04-26T11:24:02.833 INFO:tasks.workunit.client.0.smithi073.stdout:4/680: read d8/d1a/d1b/d1d/f56 [422392,84545] 0 2024-04-26T11:24:02.833 INFO:tasks.workunit.client.0.smithi073.stdout:2/635: truncate dd/d4c/d48/f3c 622913 0 2024-04-26T11:24:02.835 INFO:tasks.workunit.client.0.smithi073.stdout:4/681: write d8/d1a/d1b/d24/dac/d49/f91 [1905799,48792] 0 2024-04-26T11:24:02.836 INFO:tasks.workunit.client.0.smithi073.stdout:0/644: dread d2/fbd [0,4194304] 0 2024-04-26T11:24:02.837 INFO:tasks.workunit.client.0.smithi073.stdout:0/645: mkdir d2/d1f/d40/d48/da9/de6 0 2024-04-26T11:24:02.838 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:02.842 INFO:tasks.workunit.client.0.smithi073.stdout:0/646: dwrite d2/d37/d8b/faf [4194304,4194304] 0 2024-04-26T11:24:02.843 INFO:tasks.workunit.client.0.smithi073.stdout:0/647: chown d2/d37/f79 14394 1 2024-04-26T11:24:02.844 INFO:tasks.workunit.client.0.smithi073.stdout:0/648: truncate d2/d1f/d40/d48/da9/fce 831803 0 2024-04-26T11:24:02.844 INFO:tasks.workunit.client.0.smithi073.stdout:0/649: symlink d2/d37/d8b/le7 0 2024-04-26T11:24:02.845 INFO:tasks.workunit.client.0.smithi073.stdout:0/650: truncate d2/d22/d51/d57/d78/f86 351533 0 2024-04-26T11:24:02.847 INFO:tasks.workunit.client.0.smithi073.stdout:9/654: truncate d0/d1a/d4e/d70/d46/f8a 2335917 0 2024-04-26T11:24:02.847 INFO:tasks.workunit.client.0.smithi073.stdout:3/640: write d0/fa [1447879,73194] 0 2024-04-26T11:24:02.849 INFO:tasks.workunit.client.0.smithi073.stdout:7/659: truncate d1/d33/d1b/fd3 2740967 0 2024-04-26T11:24:02.849 INFO:tasks.workunit.client.0.smithi073.stdout:9/655: unlink d0/d1a/d4e/la8 0 2024-04-26T11:24:02.849 INFO:tasks.workunit.client.0.smithi073.stdout:3/641: creat d0/d11/d19/db/da6/d7a/dbc/fdd x:0 0 0 2024-04-26T11:24:02.849 INFO:tasks.workunit.client.0.smithi073.stdout:0/651: getdents d2/d1f/d9d 0 2024-04-26T11:24:02.849 INFO:tasks.workunit.client.0.smithi073.stdout:2/636: write dd/de/d49/fad [875354,97387] 0 2024-04-26T11:24:02.850 INFO:tasks.workunit.client.0.smithi073.stdout:7/660: symlink d1/d33/d1b/le9 0 2024-04-26T11:24:02.850 INFO:tasks.workunit.client.0.smithi073.stdout:9/656: mknod d0/d1a/d4e/d70/dd6/cdd 0 2024-04-26T11:24:02.851 INFO:tasks.workunit.client.0.smithi073.stdout:4/682: dread d8/d1a/d86/fa8 [0,4194304] 0 2024-04-26T11:24:02.851 INFO:tasks.workunit.client.0.smithi073.stdout:2/637: mkdir dd/de/d2a/dbc 0 2024-04-26T11:24:02.852 INFO:tasks.workunit.client.0.smithi073.stdout:9/657: symlink d0/d1a/d4e/d70/d3b/lde 0 2024-04-26T11:24:02.852 INFO:tasks.workunit.client.0.smithi073.stdout:4/683: symlink d8/d1a/d5e/d7c/lef 0 2024-04-26T11:24:02.853 INFO:tasks.workunit.client.0.smithi073.stdout:2/638: creat dd/d4c/d48/d46/d91/d9f/d1d/fbd x:0 0 0 2024-04-26T11:24:02.854 INFO:tasks.workunit.client.0.smithi073.stdout:2/639: write dd/de/d6b/f61 [45160,73543] 0 2024-04-26T11:24:02.854 INFO:tasks.workunit.client.0.smithi073.stdout:4/684: dread d8/d14/f2a [4194304,4194304] 0 2024-04-26T11:24:02.855 INFO:tasks.workunit.client.0.smithi073.stdout:7/661: dread d1/d11/d24/d29/dd7/d3d/f9e [0,4194304] 0 2024-04-26T11:24:02.856 INFO:tasks.workunit.client.0.smithi073.stdout:7/662: write d1/d11/d24/d29/dd7/d3d/d41/d64/f42 [8925237,108540] 0 2024-04-26T11:24:02.857 INFO:tasks.workunit.client.0.smithi073.stdout:0/652: write d2/d37/f79 [574095,78322] 0 2024-04-26T11:24:02.858 INFO:tasks.workunit.client.0.smithi073.stdout:3/642: write d0/d11/d19/db/f1a [789552,37176] 0 2024-04-26T11:24:02.858 INFO:tasks.workunit.client.0.smithi073.stdout:7/663: rename d1/d33/d1b/f1e to d1/d11/d24/d29/dd7/d3d/d7c/fea 0 2024-04-26T11:24:02.858 INFO:tasks.workunit.client.0.smithi073.stdout:7/664: fdatasync d1/d33/d68/faa 0 2024-04-26T11:24:02.858 INFO:tasks.workunit.client.0.smithi073.stdout:3/643: unlink d0/f61 0 2024-04-26T11:24:02.858 INFO:tasks.workunit.client.0.smithi073.stdout:3/644: fsync d0/d2d/f89 0 2024-04-26T11:24:02.859 INFO:tasks.workunit.client.0.smithi073.stdout:9/658: write d0/d1a/d4e/d70/d3b/f4d [4732004,69687] 0 2024-04-26T11:24:02.859 INFO:tasks.workunit.client.0.smithi073.stdout:7/665: rename d1 to d1/d11/d24/d29/dd7/d3d/d7c/de2/deb 22 2024-04-26T11:24:02.860 INFO:tasks.workunit.client.0.smithi073.stdout:3/645: readlink d0/d11/d19/db/da6/d8b/d8c/d90/l98 0 2024-04-26T11:24:02.860 INFO:tasks.workunit.client.0.smithi073.stdout:9/659: link d0/d13/d5a/d5e/fcf d0/fdf 0 2024-04-26T11:24:02.861 INFO:tasks.workunit.client.0.smithi073.stdout:3/646: fdatasync d0/d11/d19/f39 0 2024-04-26T11:24:02.862 INFO:tasks.workunit.client.0.smithi073.stdout:9/660: rename d0/d1a/f8c to d0/d13/d5a/d65/fe0 0 2024-04-26T11:24:02.863 INFO:tasks.workunit.client.0.smithi073.stdout:4/685: dwrite d8/d15/f3e [0,4194304] 0 2024-04-26T11:24:02.863 INFO:tasks.workunit.client.0.smithi073.stdout:9/661: dread - d0/d1a/d4e/fd8 zero size 2024-04-26T11:24:02.867 INFO:tasks.workunit.client.0.smithi073.stdout:7/666: dwrite d1/d11/d24/d29/dd7/d3d/f7e [0,4194304] 0 2024-04-26T11:24:02.867 INFO:tasks.workunit.client.0.smithi073.stdout:0/653: dread d2/d37/d3c/d6a/f6d [0,4194304] 0 2024-04-26T11:24:02.867 INFO:tasks.workunit.client.0.smithi073.stdout:3/647: rename d0/d26/f2a to d0/d11/d19/db/da6/d60/dcd/fde 0 2024-04-26T11:24:02.868 INFO:tasks.workunit.client.0.smithi073.stdout:5/657: dread d4/de/f10 [0,4194304] 0 2024-04-26T11:24:02.870 INFO:tasks.workunit.client.0.smithi073.stdout:9/662: mkdir d0/d13/d5a/db2/de1 0 2024-04-26T11:24:02.871 INFO:tasks.workunit.client.0.smithi073.stdout:4/686: mknod d8/d14/cf0 0 2024-04-26T11:24:02.871 INFO:tasks.workunit.client.0.smithi073.stdout:0/654: rename d2/d37/d3c/ca1 to d2/d1f/d40/d48/dc1/dd6/ce8 0 2024-04-26T11:24:02.872 INFO:tasks.workunit.client.0.smithi073.stdout:5/658: write d4/de/d15/f65 [1744705,66185] 0 2024-04-26T11:24:02.872 INFO:tasks.workunit.client.0.smithi073.stdout:7/667: creat d1/d11/d24/d29/dd7/d3d/d41/fec x:0 0 0 2024-04-26T11:24:02.872 INFO:tasks.workunit.client.0.smithi073.stdout:3/648: creat d0/fdf x:0 0 0 2024-04-26T11:24:02.873 INFO:tasks.workunit.client.0.smithi073.stdout:4/687: creat d8/d15/da1/ff1 x:0 0 0 2024-04-26T11:24:02.873 INFO:tasks.workunit.client.0.smithi073.stdout:7/668: fsync d1/d11/d24/fe8 0 2024-04-26T11:24:02.874 INFO:tasks.workunit.client.0.smithi073.stdout:5/659: creat d4/fed x:0 0 0 2024-04-26T11:24:02.877 INFO:tasks.workunit.client.0.smithi073.stdout:3/649: rename d0/d2d/ld4 to d0/d11/d19/d52/le0 0 2024-04-26T11:24:02.877 INFO:tasks.workunit.client.0.smithi073.stdout:4/688: rename d8/d14/d60/d64 to d8/d15/da1/df2 0 2024-04-26T11:24:02.877 INFO:tasks.workunit.client.0.smithi073.stdout:5/660: getdents d4/d95/da5 0 2024-04-26T11:24:02.878 INFO:tasks.workunit.client.0.smithi073.stdout:4/689: mknod d8/d1a/d5e/d7c/dee/cf3 0 2024-04-26T11:24:02.878 INFO:tasks.workunit.client.0.smithi073.stdout:5/661: mkdir d4/d8/d9/d7d/da3/ddc/dee 0 2024-04-26T11:24:02.878 INFO:tasks.workunit.client.0.smithi073.stdout:0/655: dwrite d2/f92 [0,4194304] 0 2024-04-26T11:24:02.878 INFO:tasks.workunit.client.0.smithi073.stdout:5/662: chown d4/d73/l88 1 1 2024-04-26T11:24:02.878 INFO:tasks.workunit.client.0.smithi073.stdout:7/669: dwrite d1/d11/f1c [0,4194304] 0 2024-04-26T11:24:02.879 INFO:tasks.workunit.client.0.smithi073.stdout:7/670: write d1/d33/d68/d78/daf/f40 [823176,16013] 0 2024-04-26T11:24:02.879 INFO:tasks.workunit.client.0.smithi073.stdout:3/650: dwrite d0/d11/d19/db/d3e/d47/f9a [0,4194304] 0 2024-04-26T11:24:02.879 INFO:tasks.workunit.client.0.smithi073.stdout:0/656: mknod d2/d37/ce9 0 2024-04-26T11:24:02.879 INFO:tasks.workunit.client.0.smithi073.stdout:9/663: truncate d0/d13/d25/d2c/dbf/fda 772166 0 2024-04-26T11:24:02.880 INFO:tasks.workunit.client.0.smithi073.stdout:4/690: dwrite d8/d14/f93 [0,4194304] 0 2024-04-26T11:24:02.880 INFO:tasks.workunit.client.0.smithi073.stdout:7/671: fsync d1/d11/d24/fe4 0 2024-04-26T11:24:02.880 INFO:tasks.workunit.client.0.smithi073.stdout:5/663: rename d4/d8/d9/d42/c52 to d4/de/d23/cef 0 2024-04-26T11:24:02.881 INFO:tasks.workunit.client.0.smithi073.stdout:4/691: dread - d8/d15/da1/ff1 zero size 2024-04-26T11:24:02.881 INFO:tasks.workunit.client.0.smithi073.stdout:3/651: creat d0/d11/d19/db/d3e/d3f/fe1 x:0 0 0 2024-04-26T11:24:02.881 INFO:tasks.workunit.client.0.smithi073.stdout:0/657: truncate d2/d37/d3c/d6a/f6d 9176 0 2024-04-26T11:24:02.882 INFO:tasks.workunit.client.0.smithi073.stdout:4/692: mknod d8/d1a/d1b/cf4 0 2024-04-26T11:24:02.882 INFO:tasks.workunit.client.0.smithi073.stdout:9/664: dread d0/d1a/d4e/d70/f38 [0,4194304] 0 2024-04-26T11:24:02.884 INFO:tasks.workunit.client.0.smithi073.stdout:4/693: rmdir d8/d15/da1 39 2024-04-26T11:24:02.884 INFO:tasks.workunit.client.0.smithi073.stdout:9/665: symlink d0/d13/d25/d2c/dbf/le2 0 2024-04-26T11:24:02.885 INFO:tasks.workunit.client.0.smithi073.stdout:1/743: sync 2024-04-26T11:24:02.886 INFO:tasks.workunit.client.0.smithi073.stdout:4/694: mknod d8/d1a/d4d/ddc/dde/cf5 0 2024-04-26T11:24:02.887 INFO:tasks.workunit.client.0.smithi073.stdout:0/658: dread d2/d1f/d40/d48/fa5 [0,4194304] 0 2024-04-26T11:24:02.887 INFO:tasks.workunit.client.0.smithi073.stdout:7/672: dwrite d1/d11/fd [0,4194304] 0 2024-04-26T11:24:02.888 INFO:tasks.workunit.client.0.smithi073.stdout:1/744: creat d1/d16/d4f/d55/da2/dcd/ffd x:0 0 0 2024-04-26T11:24:02.889 INFO:tasks.workunit.client.0.smithi073.stdout:3/652: dwrite d0/d11/d19/f6 [4194304,4194304] 0 2024-04-26T11:24:02.889 INFO:tasks.workunit.client.0.smithi073.stdout:0/659: truncate d2/d1f/d40/f66 4421165 0 2024-04-26T11:24:02.890 INFO:tasks.workunit.client.0.smithi073.stdout:4/695: truncate d8/d1a/d1b/fb5 413822 0 2024-04-26T11:24:02.890 INFO:tasks.workunit.client.0.smithi073.stdout:7/673: write d1/d11/d24/d29/f74 [2880615,67574] 0 2024-04-26T11:24:02.890 INFO:tasks.workunit.client.0.smithi073.stdout:4/696: read - d8/d1a/d5e/d7c/fe0 zero size 2024-04-26T11:24:02.891 INFO:tasks.workunit.client.0.smithi073.stdout:4/697: fdatasync d8/d15/da1/ff1 0 2024-04-26T11:24:02.892 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:02.888+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:02.892 INFO:tasks.workunit.client.0.smithi073.stdout:3/653: link d0/d11/d19/d52/lb6 d0/d11/d19/db/da6/d7a/dbc/le2 0 2024-04-26T11:24:02.892 INFO:tasks.workunit.client.0.smithi073.stdout:7/674: link d1/d11/l20 d1/d11/d24/d29/dd7/d80/da0/dd2/led 0 2024-04-26T11:24:02.893 INFO:tasks.workunit.client.0.smithi073.stdout:7/675: readlink d1/d33/d68/d78/la1 0 2024-04-26T11:24:02.896 INFO:tasks.workunit.client.0.smithi073.stdout:0/660: dwrite d2/d1f/fda [0,4194304] 0 2024-04-26T11:24:02.898 INFO:tasks.workunit.client.0.smithi073.stdout:1/745: truncate d1/d6/fbc 495573 0 2024-04-26T11:24:02.899 INFO:tasks.workunit.client.0.smithi073.stdout:1/746: dread - d1/d73/d34/d98/dce/fdb zero size 2024-04-26T11:24:02.901 INFO:tasks.workunit.client.0.smithi073.stdout:3/654: dwrite d0/d2d/fc1 [0,4194304] 0 2024-04-26T11:24:02.902 INFO:tasks.workunit.client.0.smithi073.stdout:7/676: dwrite d1/fa7 [0,4194304] 0 2024-04-26T11:24:02.907 INFO:tasks.workunit.client.0.smithi073.stdout:7/677: creat d1/d11/d24/d29/fee x:0 0 0 2024-04-26T11:24:02.907 INFO:tasks.workunit.client.0.smithi073.stdout:7/678: stat d1/d11/d24/d29/dd7/d4b/fa9 0 2024-04-26T11:24:02.907 INFO:tasks.workunit.client.0.smithi073.stdout:7/679: chown d1/d33/f86 325085 1 2024-04-26T11:24:02.907 INFO:tasks.workunit.client.0.smithi073.stdout:7/680: symlink d1/d11/d24/d29/dd7/d4b/lef 0 2024-04-26T11:24:02.908 INFO:tasks.workunit.client.0.smithi073.stdout:7/681: chown d1/d11/d24/d29/dd7/d3d/dba 32 1 2024-04-26T11:24:02.909 INFO:tasks.workunit.client.0.smithi073.stdout:7/682: fsync d1/d33/d68/d78/daf/f28 0 2024-04-26T11:24:02.909 INFO:tasks.workunit.client.0.smithi073.stdout:4/698: dread d8/d1a/d1b/d24/dac/d49/f91 [0,4194304] 0 2024-04-26T11:24:02.910 INFO:tasks.workunit.client.0.smithi073.stdout:7/683: fdatasync d1/d33/d1b/fb3 0 2024-04-26T11:24:02.910 INFO:tasks.workunit.client.0.smithi073.stdout:1/747: dwrite d1/d8/d2e/d3c/f3e [0,4194304] 0 2024-04-26T11:24:02.910 INFO:tasks.workunit.client.0.smithi073.stdout:4/699: stat d8/d1a/d1b/d24/dac/f50 0 2024-04-26T11:24:02.910 INFO:tasks.workunit.client.0.smithi073.stdout:4/700: stat d8/d1a/db2 0 2024-04-26T11:24:02.912 INFO:tasks.workunit.client.0.smithi073.stdout:7/684: symlink d1/d33/d1b/lf0 0 2024-04-26T11:24:02.912 INFO:tasks.workunit.client.0.smithi073.stdout:0/661: truncate d2/d22/f33 1202917 0 2024-04-26T11:24:02.912 INFO:tasks.workunit.client.0.smithi073.stdout:4/701: rmdir d8/d1a/d1b/d24/dac/d72/d77/d96 39 2024-04-26T11:24:02.913 INFO:tasks.workunit.client.0.smithi073.stdout:0/662: creat d2/d1f/d40/d48/dc1/dd6/fea x:0 0 0 2024-04-26T11:24:02.914 INFO:tasks.workunit.client.0.smithi073.stdout:4/702: readlink d8/d15/l8f 0 2024-04-26T11:24:02.915 INFO:tasks.workunit.client.0.smithi073.stdout:4/703: stat d8/d1a/d5e/d7c/f82 0 2024-04-26T11:24:02.916 INFO:tasks.workunit.client.0.smithi073.stdout:4/704: symlink d8/d1a/d1b/d24/dac/d49/dad/lf6 0 2024-04-26T11:24:02.917 INFO:tasks.workunit.client.0.smithi073.stdout:4/705: creat d8/d1a/d1b/d24/dac/d49/d84/ff7 x:0 0 0 2024-04-26T11:24:02.917 INFO:tasks.workunit.client.0.smithi073.stdout:7/685: dwrite d1/d11/fd [0,4194304] 0 2024-04-26T11:24:02.918 INFO:tasks.workunit.client.0.smithi073.stdout:7/686: chown d1/d11/d24/d29/dd7/d3d/d41/d64/l9b 420141 1 2024-04-26T11:24:02.920 INFO:tasks.workunit.client.0.smithi073.stdout:7/687: truncate d1/d11/d51/fd5 134672 0 2024-04-26T11:24:02.920 INFO:tasks.workunit.client.0.smithi073.stdout:3/655: truncate d0/d11/d19/d52/f54 427055 0 2024-04-26T11:24:02.920 INFO:tasks.workunit.client.0.smithi073.stdout:7/688: write d1/d11/d24/d29/dd7/d4b/fa9 [4202833,54062] 0 2024-04-26T11:24:02.920 INFO:tasks.workunit.client.0.smithi073.stdout:7/689: chown d1/ddc 15572816 1 2024-04-26T11:24:02.921 INFO:tasks.workunit.client.0.smithi073.stdout:7/690: symlink d1/d11/d24/d29/dd7/d3d/d41/d64/dae/lf1 0 2024-04-26T11:24:02.922 INFO:tasks.workunit.client.0.smithi073.stdout:7/691: readlink d1/d33/d1b/ldb 0 2024-04-26T11:24:02.923 INFO:tasks.workunit.client.0.smithi073.stdout:4/706: dwrite d8/d1f/f5f [0,4194304] 0 2024-04-26T11:24:02.927 INFO:tasks.workunit.client.0.smithi073.stdout:4/707: dread d8/d1f/f5f [0,4194304] 0 2024-04-26T11:24:02.928 INFO:tasks.workunit.client.0.smithi073.stdout:7/692: dwrite f0 [0,4194304] 0 2024-04-26T11:24:02.928 INFO:tasks.workunit.client.0.smithi073.stdout:4/708: stat d8/d1a/d1b/d1d 0 2024-04-26T11:24:02.928 INFO:tasks.workunit.client.0.smithi073.stdout:7/693: fdatasync d1/d11/d24/d29/dd7/f6f 0 2024-04-26T11:24:02.929 INFO:tasks.workunit.client.0.smithi073.stdout:6/610: sync 2024-04-26T11:24:02.929 INFO:tasks.workunit.client.0.smithi073.stdout:4/709: write d8/d14/d60/f6f [3210804,23464] 0 2024-04-26T11:24:02.930 INFO:tasks.workunit.client.0.smithi073.stdout:8/673: sync 2024-04-26T11:24:02.930 INFO:tasks.workunit.client.0.smithi073.stdout:2/640: sync 2024-04-26T11:24:02.930 INFO:tasks.workunit.client.0.smithi073.stdout:0/663: sync 2024-04-26T11:24:02.930 INFO:tasks.workunit.client.0.smithi073.stdout:5/664: sync 2024-04-26T11:24:02.930 INFO:tasks.workunit.client.0.smithi073.stdout:3/656: sync 2024-04-26T11:24:02.930 INFO:tasks.workunit.client.0.smithi073.stdout:1/748: sync 2024-04-26T11:24:02.932 INFO:tasks.workunit.client.0.smithi073.stdout:3/657: chown d0/d11/d19/db/ddc/f5c 539 1 2024-04-26T11:24:02.932 INFO:tasks.workunit.client.0.smithi073.stdout:4/710: symlink d8/d1a/d1b/d1d/lf8 0 2024-04-26T11:24:02.932 INFO:tasks.workunit.client.0.smithi073.stdout:5/665: symlink d4/de/d23/d4f/lf0 0 2024-04-26T11:24:02.932 INFO:tasks.workunit.client.0.smithi073.stdout:3/658: readlink d0/d11/d19/db/ddc/d3c/l5f 0 2024-04-26T11:24:02.932 INFO:tasks.workunit.client.0.smithi073.stdout:0/664: creat d2/d1f/d40/feb x:0 0 0 2024-04-26T11:24:02.933 INFO:tasks.workunit.client.0.smithi073.stdout:6/611: getdents d0/d1a/d26/d27 0 2024-04-26T11:24:02.933 INFO:tasks.workunit.client.0.smithi073.stdout:6/612: readlink d0/d19/l1f 0 2024-04-26T11:24:02.934 INFO:tasks.workunit.client.0.smithi073.stdout:6/613: sync 2024-04-26T11:24:02.934 INFO:tasks.workunit.client.0.smithi073.stdout:3/659: fsync d0/d11/d19/db/f15 0 2024-04-26T11:24:02.934 INFO:tasks.workunit.client.0.smithi073.stdout:5/666: mkdir d4/d8/d9/d7d/d84/da7/db7/dcd/df1 0 2024-04-26T11:24:02.934 INFO:tasks.workunit.client.0.smithi073.stdout:0/665: fsync d2/d22/d51/d57/f85 0 2024-04-26T11:24:02.934 INFO:tasks.workunit.client.0.smithi073.stdout:6/614: rmdir d0/d1a/d26/d4b/d63 39 2024-04-26T11:24:02.934 INFO:tasks.workunit.client.0.smithi073.stdout:3/660: read - d0/d11/d19/db/d51/fc8 zero size 2024-04-26T11:24:02.935 INFO:tasks.workunit.client.0.smithi073.stdout:0/666: rename d2/d1f/fa8 to d2/d1f/d40/d48/da9/fec 0 2024-04-26T11:24:02.935 INFO:tasks.workunit.client.0.smithi073.stdout:0/667: write d2/d84/fbc [578647,40259] 0 2024-04-26T11:24:02.936 INFO:tasks.workunit.client.0.smithi073.stdout:0/668: symlink d2/d22/d51/d57/d78/led 0 2024-04-26T11:24:02.938 INFO:tasks.workunit.client.0.smithi073.stdout:7/694: write d1/d33/d1b/fd3 [1499864,98219] 0 2024-04-26T11:24:02.944 INFO:tasks.workunit.client.0.smithi073.stdout:1/749: write d1/d73/f35 [1478739,4518] 0 2024-04-26T11:24:02.944 INFO:tasks.workunit.client.0.smithi073.stdout:7/695: write d1/d11/d24/d29/dd7/d3d/f9e [232458,109819] 0 2024-04-26T11:24:02.944 INFO:tasks.workunit.client.0.smithi073.stdout:3/661: dwrite d0/d11/d19/db/d3e/d3f/fe1 [0,4194304] 0 2024-04-26T11:24:02.945 INFO:tasks.workunit.client.0.smithi073.stdout:2/641: truncate dd/de/d38/d4e/f8d 533127 0 2024-04-26T11:24:02.946 INFO:tasks.workunit.client.0.smithi073.stdout:1/750: stat d1/d73/f35 0 2024-04-26T11:24:02.951 INFO:tasks.workunit.client.0.smithi073.stdout:3/662: write d0/d2d/f89 [902481,72323] 0 2024-04-26T11:24:02.951 INFO:tasks.workunit.client.0.smithi073.stdout:7/696: truncate d1/d33/d68/d78/daf/f40 1675664 0 2024-04-26T11:24:02.952 INFO:tasks.workunit.client.0.smithi073.stdout:3/663: creat d0/d11/d19/fe3 x:0 0 0 2024-04-26T11:24:02.952 INFO:tasks.workunit.client.0.smithi073.stdout:2/642: mknod dd/de/d38/d4e/cbe 0 2024-04-26T11:24:02.952 INFO:tasks.workunit.client.0.smithi073.stdout:2/643: rmdir dd/d4c/d48/d46/d91/d9f/d1d/d8c 39 2024-04-26T11:24:02.952 INFO:tasks.workunit.client.0.smithi073.stdout:2/644: chown dd/de/d38/d4e 613 1 2024-04-26T11:24:02.953 INFO:tasks.workunit.client.0.smithi073.stdout:2/645: truncate dd/d4c/d48/d46/d91/d9f/d1d/fbd 262982 0 2024-04-26T11:24:02.953 INFO:tasks.workunit.client.0.smithi073.stdout:2/646: fsync f6 0 2024-04-26T11:24:02.954 INFO:tasks.workunit.client.0.smithi073.stdout:9/666: dread d0/d1a/d4e/d70/d51/f67 [0,4194304] 0 2024-04-26T11:24:02.954 INFO:tasks.workunit.client.0.smithi073.stdout:2/647: creat dd/de/d49/dbb/fbf x:0 0 0 2024-04-26T11:24:02.954 INFO:tasks.workunit.client.0.smithi073.stdout:5/667: dwrite d4/f1d [0,4194304] 0 2024-04-26T11:24:02.954 INFO:tasks.workunit.client.0.smithi073.stdout:3/664: dwrite d0/d11/d19/fe3 [0,4194304] 0 2024-04-26T11:24:02.954 INFO:tasks.workunit.client.0.smithi073.stdout:3/665: stat d0/d11/d19/d1d/fb8 0 2024-04-26T11:24:02.954 INFO:tasks.workunit.client.0.smithi073.stdout:6/615: truncate d0/d15/d2d/d3f/d59/f6b 2353118 0 2024-04-26T11:24:02.954 INFO:tasks.workunit.client.0.smithi073.stdout:0/669: rmdir d2/d22 39 2024-04-26T11:24:02.954 INFO:tasks.workunit.client.0.smithi073.stdout:3/666: write d0/d11/d19/db/d3e/d47/f9b [181801,98206] 0 2024-04-26T11:24:02.954 INFO:tasks.workunit.client.0.smithi073.stdout:5/668: rmdir d4 39 2024-04-26T11:24:02.954 INFO:tasks.workunit.client.0.smithi073.stdout:0/670: chown d2/d84/l93 863508 1 2024-04-26T11:24:02.954 INFO:tasks.workunit.client.0.smithi073.stdout:6/616: read - d0/d1a/d26/d4b/d2b/d43/f88 zero size 2024-04-26T11:24:02.955 INFO:tasks.workunit.client.0.smithi073.stdout:9/667: creat d0/d13/d25/d75/d8e/db9/fe3 x:0 0 0 2024-04-26T11:24:02.955 INFO:tasks.workunit.client.0.smithi073.stdout:2/648: creat dd/de/d49/dbb/fc0 x:0 0 0 2024-04-26T11:24:02.955 INFO:tasks.workunit.client.0.smithi073.stdout:5/669: readlink d4/d8/la 0 2024-04-26T11:24:02.955 INFO:tasks.workunit.client.0.smithi073.stdout:3/667: symlink d0/d11/d19/db/d51/le4 0 2024-04-26T11:24:02.955 INFO:tasks.workunit.client.0.smithi073.stdout:6/617: creat d0/dc/d2e/fbd x:0 0 0 2024-04-26T11:24:02.956 INFO:tasks.workunit.client.0.smithi073.stdout:2/649: chown dd/de/d38/f9e 1341313921 1 2024-04-26T11:24:02.956 INFO:tasks.workunit.client.0.smithi073.stdout:9/668: creat d0/d13/d25/fe4 x:0 0 0 2024-04-26T11:24:02.956 INFO:tasks.workunit.client.0.smithi073.stdout:3/668: unlink d0/d2d/fc1 0 2024-04-26T11:24:02.956 INFO:tasks.workunit.client.0.smithi073.stdout:5/670: chown d4/de/l5e 178 1 2024-04-26T11:24:02.956 INFO:tasks.workunit.client.0.smithi073.stdout:6/618: unlink d0/d15/l30 0 2024-04-26T11:24:02.957 INFO:tasks.workunit.client.0.smithi073.stdout:0/671: write d2/d1f/d9c/fa0 [198939,109571] 0 2024-04-26T11:24:02.957 INFO:tasks.workunit.client.0.smithi073.stdout:2/650: chown dd/d4c/d48/d77/d80/dab 10322565 1 2024-04-26T11:24:02.957 INFO:tasks.workunit.client.0.smithi073.stdout:9/669: mknod d0/d83/ce5 0 2024-04-26T11:24:02.957 INFO:tasks.workunit.client.0.smithi073.stdout:6/619: write d0/d1a/d26/f54 [135767,122273] 0 2024-04-26T11:24:02.959 INFO:tasks.workunit.client.0.smithi073.stdout:0/672: fdatasync d2/f31 0 2024-04-26T11:24:02.960 INFO:tasks.workunit.client.0.smithi073.stdout:3/669: rename d0/d11/d19/db/da6/d7a/dbc/fd9 to d0/d11/d23/fe5 0 2024-04-26T11:24:02.965 INFO:tasks.workunit.client.0.smithi073.stdout:6/620: read d0/d19/f21 [7150,67356] 0 2024-04-26T11:24:02.967 INFO:tasks.workunit.client.0.smithi073.stdout:1/751: dwrite d1/d51/f67 [0,4194304] 0 2024-04-26T11:24:02.967 INFO:tasks.workunit.client.0.smithi073.stdout:8/674: dread d1/d4/d4c/d66/fa0 [0,4194304] 0 2024-04-26T11:24:02.968 INFO:tasks.workunit.client.0.smithi073.stdout:6/621: read d0/d15/d2d/d3f/f98 [366710,92829] 0 2024-04-26T11:24:02.968 INFO:tasks.workunit.client.0.smithi073.stdout:5/671: dwrite d4/d8/d9/d7d/da3/ddc/fcb [0,4194304] 0 2024-04-26T11:24:02.968 INFO:tasks.workunit.client.0.smithi073.stdout:0/673: creat d2/d22/d51/d57/fee x:0 0 0 2024-04-26T11:24:02.969 INFO:tasks.workunit.client.0.smithi073.stdout:2/651: getdents dd/de/d38/d53/d60/db2 0 2024-04-26T11:24:02.969 INFO:tasks.workunit.client.0.smithi073.stdout:9/670: dwrite d0/d13/d25/d2c/dbf/fc6 [0,4194304] 0 2024-04-26T11:24:02.969 INFO:tasks.workunit.client.0.smithi073.stdout:8/675: dread d1/d4/d37/f4f [0,4194304] 0 2024-04-26T11:24:02.969 INFO:tasks.workunit.client.0.smithi073.stdout:4/711: dread d8/d14/d60/f6f [0,4194304] 0 2024-04-26T11:24:02.971 INFO:tasks.workunit.client.0.smithi073.stdout:1/752: mkdir d1/d16/d61/dfe 0 2024-04-26T11:24:02.971 INFO:tasks.workunit.client.0.smithi073.stdout:5/672: mkdir d4/d8/d9/d42/d68/df2 0 2024-04-26T11:24:02.971 INFO:tasks.workunit.client.0.smithi073.stdout:2/652: mkdir dd/de/d6b/dc1 0 2024-04-26T11:24:02.972 INFO:tasks.workunit.client.0.smithi073.stdout:7/697: dread d1/d11/d24/fe4 [0,4194304] 0 2024-04-26T11:24:02.972 INFO:tasks.workunit.client.0.smithi073.stdout:3/670: rename d0/d11/d19/db/da6/d60/dcd/fde to d0/d11/d19/db/fe6 0 2024-04-26T11:24:02.973 INFO:tasks.workunit.client.0.smithi073.stdout:5/673: truncate d4/d8/d9/d7d/d84/fde 999225 0 2024-04-26T11:24:02.974 INFO:tasks.workunit.client.0.smithi073.stdout:2/653: mknod dd/d4c/cc2 0 2024-04-26T11:24:02.974 INFO:tasks.workunit.client.0.smithi073.stdout:1/753: creat d1/d16/d4f/d55/d5a/dc6/fff x:0 0 0 2024-04-26T11:24:02.974 INFO:tasks.workunit.client.0.smithi073.stdout:0/674: creat d2/d1f/d40/fef x:0 0 0 2024-04-26T11:24:02.975 INFO:tasks.workunit.client.0.smithi073.stdout:9/671: link d0/d1a/d4e/d70/d46/f8a d0/d13/d5a/db2/de1/fe6 0 2024-04-26T11:24:02.975 INFO:tasks.workunit.client.0.smithi073.stdout:5/674: stat d4/d8/d9/d7d/d84/da7/db7/dcd/dd4 0 2024-04-26T11:24:02.975 INFO:tasks.workunit.client.0.smithi073.stdout:4/712: getdents d8/d1a/d1b/dd2 0 2024-04-26T11:24:02.976 INFO:tasks.workunit.client.0.smithi073.stdout:6/622: dwrite d0/d1a/d26/d4b/d2b/d2c/fa9 [0,4194304] 0 2024-04-26T11:24:02.976 INFO:tasks.workunit.client.0.smithi073.stdout:5/675: fsync d4/d95/da5/fdd 0 2024-04-26T11:24:02.976 INFO:tasks.workunit.client.0.smithi073.stdout:9/672: chown d0/d13/db/fc0 465 1 2024-04-26T11:24:02.977 INFO:tasks.workunit.client.0.smithi073.stdout:6/623: chown d0/d1a/d26/d27/f8a 1455039553 1 2024-04-26T11:24:02.978 INFO:tasks.workunit.client.0.smithi073.stdout:4/713: unlink d8/d1a/d1b/d24/dac/d49/d85/le2 0 2024-04-26T11:24:02.979 INFO:tasks.workunit.client.0.smithi073.stdout:0/675: creat d2/d22/d51/d57/d78/de1/ff0 x:0 0 0 2024-04-26T11:24:02.979 INFO:tasks.workunit.client.0.smithi073.stdout:5/676: mkdir d4/d8/d9/d7d/d84/da7/db7/dcd/df1/df3 0 2024-04-26T11:24:02.979 INFO:tasks.workunit.client.0.smithi073.stdout:9/673: symlink d0/d13/le7 0 2024-04-26T11:24:02.979 INFO:tasks.workunit.client.0.smithi073.stdout:4/714: fdatasync d8/d15/f3f 0 2024-04-26T11:24:02.979 INFO:tasks.workunit.client.0.smithi073.stdout:6/624: unlink d0/d15/l8b 0 2024-04-26T11:24:02.980 INFO:tasks.workunit.client.0.smithi073.stdout:5/677: unlink d4/d8/d9/d7d/da3/ddc/f1a 0 2024-04-26T11:24:02.980 INFO:tasks.workunit.client.0.smithi073.stdout:6/625: fsync d0/d1a/d26/f94 0 2024-04-26T11:24:02.983 INFO:tasks.workunit.client.0.smithi073.stdout:5/678: fdatasync d4/de/d15/d67/fc5 0 2024-04-26T11:24:02.983 INFO:tasks.workunit.client.0.smithi073.stdout:0/676: dread d2/d1f/f2c [0,4194304] 0 2024-04-26T11:24:02.983 INFO:tasks.workunit.client.0.smithi073.stdout:0/677: readlink d2/l10 0 2024-04-26T11:24:02.983 INFO:tasks.workunit.client.0.smithi073.stdout:5/679: stat d4/de/dc6/c91 0 2024-04-26T11:24:02.983 INFO:tasks.workunit.client.0.smithi073.stdout:6/626: truncate d0/d1a/d26/d4b/d2b/d2c/fb0 755846 0 2024-04-26T11:24:02.983 INFO:tasks.workunit.client.0.smithi073.stdout:1/754: dwrite d1/d6/d7f/ffa [0,4194304] 0 2024-04-26T11:24:02.984 INFO:tasks.workunit.client.0.smithi073.stdout:1/755: write d1/d73/d34/fc9 [481011,64248] 0 2024-04-26T11:24:02.985 INFO:tasks.workunit.client.0.smithi073.stdout:9/674: read d0/d1a/d4e/d70/d3b/fbc [215311,51936] 0 2024-04-26T11:24:02.986 INFO:tasks.workunit.client.0.smithi073.stdout:1/756: write d1/d16/d6a/fc8 [906366,5023] 0 2024-04-26T11:24:02.986 INFO:tasks.workunit.client.0.smithi073.stdout:6/627: write d0/d1a/d26/d27/f29 [2078651,43758] 0 2024-04-26T11:24:02.987 INFO:tasks.workunit.client.0.smithi073.stdout:9/675: truncate d0/d1a/d4e/fd8 425178 0 2024-04-26T11:24:02.987 INFO:tasks.workunit.client.0.smithi073.stdout:1/757: creat d1/d16/d6a/f100 x:0 0 0 2024-04-26T11:24:02.987 INFO:tasks.workunit.client.0.smithi073.stdout:2/654: truncate dd/de/d38/f70 2756314 0 2024-04-26T11:24:02.988 INFO:tasks.workunit.client.0.smithi073.stdout:9/676: unlink d0/d1a/d4e/fd8 0 2024-04-26T11:24:02.989 INFO:tasks.workunit.client.0.smithi073.stdout:1/758: readlink d1/d73/lda 0 2024-04-26T11:24:02.989 INFO:tasks.workunit.client.0.smithi073.stdout:2/655: mkdir dd/de/d38/d53/dc3 0 2024-04-26T11:24:02.989 INFO:tasks.workunit.client.0.smithi073.stdout:5/680: dwrite d4/de/d23/f86 [0,4194304] 0 2024-04-26T11:24:02.990 INFO:tasks.workunit.client.0.smithi073.stdout:9/677: write d0/d13/d25/d2c/fd9 [185598,113228] 0 2024-04-26T11:24:02.995 INFO:tasks.workunit.client.0.smithi073.stdout:7/698: dwrite d1/d11/d24/d29/dd7/d4b/f70 [0,4194304] 0 2024-04-26T11:24:02.995 INFO:tasks.workunit.client.0.smithi073.stdout:7/699: fsync d1/d33/d68/faa 0 2024-04-26T11:24:02.995 INFO:tasks.workunit.client.0.smithi073.stdout:7/700: sync 2024-04-26T11:24:02.995 INFO:tasks.workunit.client.0.smithi073.stdout:6/628: dread d0/dc/d80/f6c [0,4194304] 0 2024-04-26T11:24:02.996 INFO:tasks.workunit.client.0.smithi073.stdout:7/701: unlink d1/fce 0 2024-04-26T11:24:02.996 INFO:tasks.workunit.client.0.smithi073.stdout:2/656: creat dd/de/d38/d53/dc3/fc4 x:0 0 0 2024-04-26T11:24:02.996 INFO:tasks.workunit.client.0.smithi073.stdout:9/678: mkdir d0/d1a/d4e/d70/d59/de8 0 2024-04-26T11:24:02.997 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:02.990+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:02.997 INFO:tasks.workunit.client.0.smithi073.stdout:9/679: fdatasync d0/d1a/d4e/d70/d46/f8a 0 2024-04-26T11:24:02.997 INFO:tasks.workunit.client.0.smithi073.stdout:5/681: dwrite d4/d95/fc9 [0,4194304] 0 2024-04-26T11:24:02.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:24:03.000 INFO:tasks.workunit.client.0.smithi073.stdout:0/678: truncate d2/d5f/f6c 107728 0 2024-04-26T11:24:03.000 INFO:tasks.workunit.client.0.smithi073.stdout:0/679: creat d2/d1f/d9c/ff1 x:0 0 0 2024-04-26T11:24:03.000 INFO:tasks.workunit.client.0.smithi073.stdout:0/680: sync 2024-04-26T11:24:03.001 INFO:tasks.workunit.client.0.smithi073.stdout:6/629: dwrite d0/d1a/d26/d27/f8a [0,4194304] 0 2024-04-26T11:24:03.003 INFO:tasks.workunit.client.0.smithi073.stdout:5/682: dread d4/d8/d9/d42/fb3 [0,4194304] 0 2024-04-26T11:24:03.003 INFO:tasks.workunit.client.0.smithi073.stdout:0/681: mknod d2/d22/d51/d57/cf2 0 2024-04-26T11:24:03.004 INFO:tasks.workunit.client.0.smithi073.stdout:5/683: write d4/de/f2c [1934797,82305] 0 2024-04-26T11:24:03.009 INFO:tasks.workunit.client.0.smithi073.stdout:3/671: dread d0/d11/d19/db/d3e/d3f/d69/d96/f9f [0,4194304] 0 2024-04-26T11:24:03.009 INFO:tasks.workunit.client.0.smithi073.stdout:6/630: dwrite d0/d19/f6f [0,4194304] 0 2024-04-26T11:24:03.009 INFO:tasks.workunit.client.0.smithi073.stdout:9/680: dread d0/d13/d5a/db2/de1/fe6 [0,4194304] 0 2024-04-26T11:24:03.010 INFO:tasks.workunit.client.0.smithi073.stdout:9/681: dread - d0/d13/d25/d75/d8e/db9/fd1 zero size 2024-04-26T11:24:03.010 INFO:tasks.workunit.client.0.smithi073.stdout:5/684: dwrite d4/de/d23/fc4 [0,4194304] 0 2024-04-26T11:24:03.011 INFO:tasks.workunit.client.0.smithi073.stdout:9/682: readlink d0/d1a/d4e/d70/d3b/l96 0 2024-04-26T11:24:03.013 INFO:tasks.workunit.client.0.smithi073.stdout:7/702: truncate d1/f75 3079535 0 2024-04-26T11:24:03.013 INFO:tasks.workunit.client.0.smithi073.stdout:9/683: chown d0/d1a/d2f/f41 10 1 2024-04-26T11:24:03.013 INFO:tasks.workunit.client.0.smithi073.stdout:6/631: rmdir d0/dc/d55 39 2024-04-26T11:24:03.013 INFO:tasks.workunit.client.0.smithi073.stdout:3/672: fdatasync d0/d34/f66 0 2024-04-26T11:24:03.014 INFO:tasks.workunit.client.0.smithi073.stdout:5/685: write d4/d8/d9/f21 [3162638,110682] 0 2024-04-26T11:24:03.014 INFO:tasks.workunit.client.0.smithi073.stdout:7/703: fsync d1/d11/d24/d29/dd7/d3d/f9e 0 2024-04-26T11:24:03.014 INFO:tasks.workunit.client.0.smithi073.stdout:9/684: creat d0/d13/d25/fe9 x:0 0 0 2024-04-26T11:24:03.018 INFO:tasks.workunit.client.0.smithi073.stdout:2/657: dwrite dd/de/d38/d4e/f8d [0,4194304] 0 2024-04-26T11:24:03.018 INFO:tasks.workunit.client.0.smithi073.stdout:3/673: creat d0/d11/d19/db/ddc/d3c/fe7 x:0 0 0 2024-04-26T11:24:03.019 INFO:tasks.workunit.client.0.smithi073.stdout:5/686: rename d4/d8/f30 to d4/d95/ff4 0 2024-04-26T11:24:03.019 INFO:tasks.workunit.client.0.smithi073.stdout:7/704: symlink d1/d11/d24/d29/dd7/d4b/lf2 0 2024-04-26T11:24:03.019 INFO:tasks.workunit.client.0.smithi073.stdout:9/685: creat d0/d13/d25/d2c/dbf/fea x:0 0 0 2024-04-26T11:24:03.020 INFO:tasks.workunit.client.0.smithi073.stdout:3/674: rename d0/d11/d19/db/d3e/d47/f63 to d0/d11/d19/db/d3e/d3f/d69/d96/fe8 0 2024-04-26T11:24:03.020 INFO:tasks.workunit.client.0.smithi073.stdout:5/687: creat d4/ff5 x:0 0 0 2024-04-26T11:24:03.020 INFO:tasks.workunit.client.0.smithi073.stdout:9/686: creat d0/d1a/d4e/d70/feb x:0 0 0 2024-04-26T11:24:03.024 INFO:tasks.workunit.client.0.smithi073.stdout:3/675: mkdir d0/d26/da2/de9 0 2024-04-26T11:24:03.024 INFO:tasks.workunit.client.0.smithi073.stdout:5/688: write d4/d73/d8a/da0/fcf [2283320,95162] 0 2024-04-26T11:24:03.024 INFO:tasks.workunit.client.0.smithi073.stdout:9/687: symlink d0/d13/db/lec 0 2024-04-26T11:24:03.024 INFO:tasks.workunit.client.0.smithi073.stdout:9/688: fdatasync d0/d83/fa1 0 2024-04-26T11:24:03.024 INFO:tasks.workunit.client.0.smithi073.stdout:5/689: creat d4/d8/dc3/ff6 x:0 0 0 2024-04-26T11:24:03.024 INFO:tasks.workunit.client.0.smithi073.stdout:5/690: creat d4/d95/ff7 x:0 0 0 2024-04-26T11:24:03.024 INFO:tasks.workunit.client.0.smithi073.stdout:5/691: mkdir d4/df8 0 2024-04-26T11:24:03.027 INFO:tasks.workunit.client.0.smithi073.stdout:6/632: fsync d0/d15/d2d/d3f/d59/f92 0 2024-04-26T11:24:03.030 INFO:tasks.workunit.client.0.smithi073.stdout:6/633: mknod d0/d1a/d26/d4b/d63/da0/cbe 0 2024-04-26T11:24:03.030 INFO:tasks.workunit.client.0.smithi073.stdout:6/634: readlink d0/dc/d2e/d6e/l9d 0 2024-04-26T11:24:03.031 INFO:tasks.workunit.client.0.smithi073.stdout:6/635: mknod d0/dc/d80/d97/cbf 0 2024-04-26T11:24:03.031 INFO:tasks.workunit.client.0.smithi073.stdout:6/636: write d0/d1a/d26/d4b/d2b/d43/f88 [726720,115766] 0 2024-04-26T11:24:03.031 INFO:tasks.workunit.client.0.smithi073.stdout:6/637: chown d0/d1a/d26/d4b/d49 10172 1 2024-04-26T11:24:03.032 INFO:tasks.workunit.client.0.smithi073.stdout:8/676: dread d1/d21/d2c/ddd/d67/fd2 [0,4194304] 0 2024-04-26T11:24:03.034 INFO:tasks.workunit.client.0.smithi073.stdout:8/677: rename d1/d4/d4c/d66/d8b to d1/d4/d37/dd3/de8 0 2024-04-26T11:24:03.035 INFO:tasks.workunit.client.0.smithi073.stdout:8/678: creat d1/d4/d15/fe9 x:0 0 0 2024-04-26T11:24:03.036 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:03.036 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:03.037 INFO:tasks.workunit.client.0.smithi073.stdout:6/638: dread d0/dc/f9f [0,4194304] 0 2024-04-26T11:24:03.037 INFO:tasks.workunit.client.0.smithi073.stdout:4/715: dread d8/d1f/f88 [0,4194304] 0 2024-04-26T11:24:03.037 INFO:tasks.workunit.client.0.smithi073.stdout:8/679: chown d1/d4/d4c/fb6 2964 1 2024-04-26T11:24:03.038 INFO:tasks.workunit.client.0.smithi073.stdout:6/639: stat d0/d1a/d26/d4b/d49 0 2024-04-26T11:24:03.038 INFO:tasks.workunit.client.0.smithi073.stdout:8/680: fdatasync d1/d4/d15/fe9 0 2024-04-26T11:24:03.038 INFO:tasks.workunit.client.0.smithi073.stdout:4/716: dread - d8/d1a/d1b/d24/dac/d72/fca zero size 2024-04-26T11:24:03.041 INFO:tasks.workunit.client.0.smithi073.stdout:6/640: rename d0/dc/l13 to d0/lc0 0 2024-04-26T11:24:03.041 INFO:tasks.workunit.client.0.smithi073.stdout:2/658: dwrite dd/de/d38/f70 [0,4194304] 0 2024-04-26T11:24:03.042 INFO:tasks.workunit.client.0.smithi073.stdout:0/682: dread d2/d22/f39 [0,4194304] 0 2024-04-26T11:24:03.042 INFO:tasks.workunit.client.0.smithi073.stdout:6/641: truncate d0/dc/d80/f6c 2013490 0 2024-04-26T11:24:03.042 INFO:tasks.workunit.client.0.smithi073.stdout:6/642: chown d0/d1a/d26/c47 92377 1 2024-04-26T11:24:03.043 INFO:tasks.workunit.client.0.smithi073.stdout:1/759: dread d1/d8/d5d/f60 [0,4194304] 0 2024-04-26T11:24:03.049 INFO:tasks.workunit.client.0.smithi073.stdout:6/643: truncate d0/dc/d80/d97/da2/fae 5300178 0 2024-04-26T11:24:03.049 INFO:tasks.workunit.client.0.smithi073.stdout:4/717: truncate d8/d1a/d1b/d1d/f6a 1914060 0 2024-04-26T11:24:03.049 INFO:tasks.workunit.client.0.smithi073.stdout:2/659: rename dd/d4c/d48/d77/d80/c86 to dd/de/d38/d53/d60/db2/cc5 0 2024-04-26T11:24:03.049 INFO:tasks.workunit.client.0.smithi073.stdout:6/644: unlink d0/dc/faf 0 2024-04-26T11:24:03.049 INFO:tasks.workunit.client.0.smithi073.stdout:0/683: fdatasync d2/d22/f68 0 2024-04-26T11:24:03.049 INFO:tasks.workunit.client.0.smithi073.stdout:6/645: creat d0/d1a/d26/d4b/d38/fc1 x:0 0 0 2024-04-26T11:24:03.049 INFO:tasks.workunit.client.0.smithi073.stdout:0/684: chown d2/d22/d51/d57/cf2 317 1 2024-04-26T11:24:03.049 INFO:tasks.workunit.client.0.smithi073.stdout:0/685: creat d2/d1f/d40/d48/ff3 x:0 0 0 2024-04-26T11:24:03.049 INFO:tasks.workunit.client.0.smithi073.stdout:6/646: mkdir d0/dc/d8c/dc2 0 2024-04-26T11:24:03.049 INFO:tasks.workunit.client.0.smithi073.stdout:5/692: dread d4/d8/d9/d7d/da3/ddc/f3f [0,4194304] 0 2024-04-26T11:24:03.050 INFO:tasks.workunit.client.0.smithi073.stdout:6/647: readlink d0/d15/d2d/l53 0 2024-04-26T11:24:03.051 INFO:tasks.workunit.client.0.smithi073.stdout:5/693: unlink d4/d95/da5/fe5 0 2024-04-26T11:24:03.051 INFO:tasks.workunit.client.0.smithi073.stdout:0/686: creat d2/d84/dd2/ff4 x:0 0 0 2024-04-26T11:24:03.051 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:03.052 INFO:tasks.workunit.client.0.smithi073.stdout:5/694: creat d4/de/d15/ff9 x:0 0 0 2024-04-26T11:24:03.052 INFO:tasks.workunit.client.0.smithi073.stdout:1/760: dwrite d1/d73/d40/d44/f9e [0,4194304] 0 2024-04-26T11:24:03.054 INFO:tasks.workunit.client.0.smithi073.stdout:0/687: chown d2/d1f/d9d/fdf 9488243 1 2024-04-26T11:24:03.055 INFO:tasks.workunit.client.0.smithi073.stdout:0/688: read - d2/d1f/d9c/ff1 zero size 2024-04-26T11:24:03.056 INFO:tasks.workunit.client.0.smithi073.stdout:4/718: dwrite d8/d1a/d1b/d24/dac/d49/d85/d8b/f65 [0,4194304] 0 2024-04-26T11:24:03.056 INFO:tasks.workunit.client.0.smithi073.stdout:2/660: dwrite dd/d4c/d48/d46/d91/d9f/d1d/f15 [0,4194304] 0 2024-04-26T11:24:03.057 INFO:tasks.workunit.client.0.smithi073.stdout:7/705: dread d1/d11/d24/d29/f94 [0,4194304] 0 2024-04-26T11:24:03.058 INFO:tasks.workunit.client.0.smithi073.stdout:8/681: dread d1/d4/f55 [0,4194304] 0 2024-04-26T11:24:03.058 INFO:tasks.workunit.client.0.smithi073.stdout:4/719: chown d8/d1a/d1b/d24/dac/d49/f6c 1 1 2024-04-26T11:24:03.059 INFO:tasks.workunit.client.0.smithi073.stdout:6/648: truncate d0/d1a/d4e/f51 2590947 0 2024-04-26T11:24:03.060 INFO:tasks.workunit.client.0.smithi073.stdout:5/695: link d4/d8/ldb d4/d73/lfa 0 2024-04-26T11:24:03.061 INFO:tasks.workunit.client.0.smithi073.stdout:9/689: dread d0/d13/d25/d2c/f53 [0,4194304] 0 2024-04-26T11:24:03.066 INFO:tasks.workunit.client.0.smithi073.stdout:7/706: mkdir d1/d11/d51/dca/df3 0 2024-04-26T11:24:03.066 INFO:tasks.workunit.client.0.smithi073.stdout:4/720: creat d8/d1a/d5e/d7c/ff9 x:0 0 0 2024-04-26T11:24:03.066 INFO:tasks.workunit.client.0.smithi073.stdout:1/761: dread d1/d73/d40/d54/f5f [0,4194304] 0 2024-04-26T11:24:03.066 INFO:tasks.workunit.client.0.smithi073.stdout:4/721: dread - d8/d1a/d1b/dd2/fda zero size 2024-04-26T11:24:03.067 INFO:tasks.workunit.client.0.smithi073.stdout:0/689: dwrite d2/d1f/d9c/ff1 [0,4194304] 0 2024-04-26T11:24:03.067 INFO:tasks.workunit.client.0.smithi073.stdout:0/690: write d2/d1f/d40/feb [130713,126025] 0 2024-04-26T11:24:03.067 INFO:tasks.workunit.client.0.smithi073.stdout:4/722: creat d8/d1a/d1b/d46/d57/d37/ffa x:0 0 0 2024-04-26T11:24:03.068 INFO:tasks.workunit.client.0.smithi073.stdout:1/762: rename d1/d8/d2e/d3c/c9d to d1/d73/d34/dfc/c101 0 2024-04-26T11:24:03.068 INFO:tasks.workunit.client.0.smithi073.stdout:0/691: chown d2/d22/d51/fc7 95 1 2024-04-26T11:24:03.069 INFO:tasks.workunit.client.0.smithi073.stdout:7/707: rename d1/d11/d24/d29/dd7/d3d/d41/l88 to d1/d11/d24/d71/lf4 0 2024-04-26T11:24:03.069 INFO:tasks.workunit.client.0.smithi073.stdout:1/763: chown d1/d6 57889615 1 2024-04-26T11:24:03.070 INFO:tasks.workunit.client.0.smithi073.stdout:8/682: dwrite d1/d4/d15/dbc/dc3/dc6/fe1 [0,4194304] 0 2024-04-26T11:24:03.071 INFO:tasks.workunit.client.0.smithi073.stdout:4/723: unlink d8/d14/f2a 0 2024-04-26T11:24:03.071 INFO:tasks.workunit.client.0.smithi073.stdout:9/690: dwrite d0/d13/d25/d2c/f3a [4194304,4194304] 0 2024-04-26T11:24:03.071 INFO:tasks.workunit.client.0.smithi073.stdout:2/661: write dd/d4c/d48/f3c [26518,120236] 0 2024-04-26T11:24:03.073 INFO:tasks.workunit.client.0.smithi073.stdout:5/696: dwrite d4/f1f [0,4194304] 0 2024-04-26T11:24:03.073 INFO:tasks.workunit.client.0.smithi073.stdout:7/708: chown d1/d33/d68/d78/daf/f23 616 1 2024-04-26T11:24:03.073 INFO:tasks.workunit.client.0.smithi073.stdout:4/724: chown d8/d15/da1/df2/c33 16328 1 2024-04-26T11:24:03.074 INFO:tasks.workunit.client.0.smithi073.stdout:6/649: write d0/f2 [2107776,3994] 0 2024-04-26T11:24:03.074 INFO:tasks.workunit.client.0.smithi073.stdout:9/691: truncate d0/d1a/d4e/d70/feb 268662 0 2024-04-26T11:24:03.074 INFO:tasks.workunit.client.0.smithi073.stdout:6/650: write d0/d1a/d26/f94 [886506,30946] 0 2024-04-26T11:24:03.074 INFO:tasks.workunit.client.0.smithi073.stdout:5/697: truncate d4/d8/d9/d7d/da3/ddc/f3f 1531503 0 2024-04-26T11:24:03.074 INFO:tasks.workunit.client.0.smithi073.stdout:0/692: rmdir d2 39 2024-04-26T11:24:03.075 INFO:tasks.workunit.client.0.smithi073.stdout:8/683: mkdir d1/d4/d15/dbc/dc3/dc6/dea 0 2024-04-26T11:24:03.075 INFO:tasks.workunit.client.0.smithi073.stdout:1/764: mknod d1/d16/d6a/c102 0 2024-04-26T11:24:03.075 INFO:tasks.workunit.client.0.smithi073.stdout:2/662: fdatasync dd/de/d38/d53/d60/db2/fb5 0 2024-04-26T11:24:03.075 INFO:tasks.workunit.client.0.smithi073.stdout:1/765: write d1/d16/d4f/dd5/fd0 [975653,19308] 0 2024-04-26T11:24:03.076 INFO:tasks.workunit.client.0.smithi073.stdout:4/725: mkdir d8/d1a/d5e/dc5/dfb 0 2024-04-26T11:24:03.077 INFO:tasks.workunit.client.0.smithi073.stdout:7/709: dread d1/d11/f1c [0,4194304] 0 2024-04-26T11:24:03.077 INFO:tasks.workunit.client.0.smithi073.stdout:7/710: dread - d1/d11/d24/fe8 zero size 2024-04-26T11:24:03.080 INFO:tasks.workunit.client.0.smithi073.stdout:9/692: creat d0/d1a/d4e/d70/d59/de8/fed x:0 0 0 2024-04-26T11:24:03.080 INFO:tasks.workunit.client.0.smithi073.stdout:2/663: write dd/de/d38/f93 [261825,23879] 0 2024-04-26T11:24:03.081 INFO:tasks.workunit.client.0.smithi073.stdout:4/726: write d8/d1a/d1b/d24/fcd [6136197,84188] 0 2024-04-26T11:24:03.081 INFO:tasks.workunit.client.0.smithi073.stdout:7/711: rename d1/d11/d24/d29/dd7/d4b/fa9 to d1/d11/d51/dbd/ff5 0 2024-04-26T11:24:03.081 INFO:tasks.workunit.client.0.smithi073.stdout:2/664: symlink dd/de/d2a/lc6 0 2024-04-26T11:24:03.082 INFO:tasks.workunit.client.0.smithi073.stdout:1/766: getdents d1/d16/d4f/d55/d5a 0 2024-04-26T11:24:03.084 INFO:tasks.workunit.client.0.smithi073.stdout:7/712: symlink d1/d11/d24/d29/dd7/d3d/d7c/de2/lf6 0 2024-04-26T11:24:03.084 INFO:tasks.workunit.client.0.smithi073.stdout:0/693: dwrite d2/d84/fc3 [0,4194304] 0 2024-04-26T11:24:03.084 INFO:tasks.workunit.client.0.smithi073.stdout:8/684: read d1/d4/d15/f1f [6921665,5689] 0 2024-04-26T11:24:03.085 INFO:tasks.workunit.client.0.smithi073.stdout:6/651: dwrite d0/dc/d55/f46 [0,4194304] 0 2024-04-26T11:24:03.086 INFO:tasks.workunit.client.0.smithi073.stdout:1/767: getdents d1/d6/d7f/d8f/de9 0 2024-04-26T11:24:03.086 INFO:tasks.workunit.client.0.smithi073.stdout:0/694: dread - d2/d22/d51/d57/d78/f94 zero size 2024-04-26T11:24:03.087 INFO:tasks.workunit.client.0.smithi073.stdout:1/768: truncate d1/d8/d2e/fe8 729867 0 2024-04-26T11:24:03.088 INFO:tasks.workunit.client.0.smithi073.stdout:7/713: symlink d1/d11/d24/d29/dd7/d80/da0/dd2/lf7 0 2024-04-26T11:24:03.090 INFO:tasks.workunit.client.0.smithi073.stdout:3/676: sync 2024-04-26T11:24:03.092 INFO:tasks.workunit.client.0.smithi073.stdout:8/685: creat d1/d21/d2c/ddd/feb x:0 0 0 2024-04-26T11:24:03.093 INFO:tasks.workunit.client.0.smithi073.stdout:6/652: creat d0/d19/d20/fc3 x:0 0 0 2024-04-26T11:24:03.093 INFO:tasks.workunit.client.0.smithi073.stdout:1/769: rmdir d1/d51 39 2024-04-26T11:24:03.093 INFO:tasks.workunit.client.0.smithi073.stdout:5/698: write d4/d73/d8a/dc8/fe0 [1118760,104102] 0 2024-04-26T11:24:03.093 INFO:tasks.workunit.client.0.smithi073.stdout:4/727: write d8/d1a/d9c/fb8 [1724145,64901] 0 2024-04-26T11:24:03.093 INFO:tasks.workunit.client.0.smithi073.stdout:3/677: creat d0/d11/d19/db/da6/d60/dcd/fea x:0 0 0 2024-04-26T11:24:03.096 INFO:tasks.workunit.client.0.smithi073.stdout:5/699: fdatasync d4/f1f 0 2024-04-26T11:24:03.096 INFO:tasks.workunit.client.0.smithi073.stdout:8/686: chown d1/fdc 15350 1 2024-04-26T11:24:03.096 INFO:tasks.workunit.client.0.smithi073.stdout:0/695: creat d2/d1f/d40/ff5 x:0 0 0 2024-04-26T11:24:03.097 INFO:tasks.workunit.client.0.smithi073.stdout:4/728: symlink d8/d1a/d1b/dd2/lfc 0 2024-04-26T11:24:03.097 INFO:tasks.workunit.client.0.smithi073.stdout:8/687: mknod d1/d4/d37/dd3/cec 0 2024-04-26T11:24:03.097 INFO:tasks.workunit.client.0.smithi073.stdout:1/770: truncate d1/d73/d34/d98/ff9 205017 0 2024-04-26T11:24:03.097 INFO:tasks.workunit.client.0.smithi073.stdout:3/678: creat d0/d11/d19/db/d3e/d3f/d69/feb x:0 0 0 2024-04-26T11:24:03.098 INFO:tasks.workunit.client.0.smithi073.stdout:0/696: chown d2/d37/d3c/d73/fb4 2 1 2024-04-26T11:24:03.098 INFO:tasks.workunit.client.0.smithi073.stdout:7/714: dwrite d1/d33/d68/d78/daf/f23 [4194304,4194304] 0 2024-04-26T11:24:03.099 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:03.094+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:03.099 INFO:tasks.workunit.client.0.smithi073.stdout:4/729: mkdir d8/d1a/d5e/dc5/dfb/dfd 0 2024-04-26T11:24:03.099 INFO:tasks.workunit.client.0.smithi073.stdout:9/693: dwrite d0/d13/f20 [0,4194304] 0 2024-04-26T11:24:03.106 INFO:tasks.workunit.client.0.smithi073.stdout:7/715: write d1/d11/d5e/fab [3174418,65302] 0 2024-04-26T11:24:03.106 INFO:tasks.workunit.client.0.smithi073.stdout:4/730: readlink d8/d1a/d1b/d24/dac/d49/dad/lf6 0 2024-04-26T11:24:03.106 INFO:tasks.workunit.client.0.smithi073.stdout:1/771: unlink d1/d8/d5d/f60 0 2024-04-26T11:24:03.106 INFO:tasks.workunit.client.0.smithi073.stdout:5/700: dwrite d4/d8/d8e/fa9 [0,4194304] 0 2024-04-26T11:24:03.108 INFO:tasks.workunit.client.0.smithi073.stdout:0/697: fsync d2/f11 0 2024-04-26T11:24:03.108 INFO:tasks.workunit.client.0.smithi073.stdout:3/679: creat d0/d11/d19/db/d3e/d3f/da1/fec x:0 0 0 2024-04-26T11:24:03.108 INFO:tasks.workunit.client.0.smithi073.stdout:9/694: rmdir d0/d1a/d4e/d70/d59/de8 39 2024-04-26T11:24:03.109 INFO:tasks.workunit.client.0.smithi073.stdout:9/695: fsync d0/d13/d25/d75/d8e/db9/fe3 0 2024-04-26T11:24:03.110 INFO:tasks.workunit.client.0.smithi073.stdout:3/680: chown d0/d11/d19/db/da6/d7a/dbc/fd0 682 1 2024-04-26T11:24:03.111 INFO:tasks.workunit.client.0.smithi073.stdout:6/653: dread d0/d1a/d4e/f51 [0,4194304] 0 2024-04-26T11:24:03.112 INFO:tasks.workunit.client.0.smithi073.stdout:4/731: dwrite d8/d1f/fc0 [0,4194304] 0 2024-04-26T11:24:03.112 INFO:tasks.workunit.client.0.smithi073.stdout:0/698: read d2/d1f/d40/d48/fc4 [2999816,61616] 0 2024-04-26T11:24:03.117 INFO:tasks.workunit.client.0.smithi073.stdout:7/716: rename d1/d11/f36 to d1/d11/d24/d29/dd7/d4b/ff8 0 2024-04-26T11:24:03.119 INFO:tasks.workunit.client.0.smithi073.stdout:6/654: mknod d0/d1a/d4e/cc4 0 2024-04-26T11:24:03.119 INFO:tasks.workunit.client.0.smithi073.stdout:9/696: rename d0/d13/db/cb7 to d0/d13/d25/d75/cee 0 2024-04-26T11:24:03.119 INFO:tasks.workunit.client.0.smithi073.stdout:1/772: truncate d1/d8/d57/f65 2483245 0 2024-04-26T11:24:03.119 INFO:tasks.workunit.client.0.smithi073.stdout:5/701: symlink d4/d73/lfb 0 2024-04-26T11:24:03.119 INFO:tasks.workunit.client.0.smithi073.stdout:0/699: dwrite d2/d84/fbc [0,4194304] 0 2024-04-26T11:24:03.121 INFO:tasks.workunit.client.0.smithi073.stdout:5/702: readlink d4/de/d15/l17 0 2024-04-26T11:24:03.121 INFO:tasks.workunit.client.0.smithi073.stdout:1/773: readlink d1/d6/d7f/d47/lb8 0 2024-04-26T11:24:03.122 INFO:tasks.workunit.client.0.smithi073.stdout:4/732: dwrite d8/d15/da1/ff1 [0,4194304] 0 2024-04-26T11:24:03.122 INFO:tasks.workunit.client.0.smithi073.stdout:0/700: write d2/d1f/d40/d48/dc1/dd6/fea [341576,115955] 0 2024-04-26T11:24:03.122 INFO:tasks.workunit.client.0.smithi073.stdout:2/665: dread dd/d4c/d48/d46/d91/d9f/d1d/f36 [0,4194304] 0 2024-04-26T11:24:03.123 INFO:tasks.workunit.client.0.smithi073.stdout:3/681: rmdir d0/d11/d19/db/da6/d7a/dce/dd3/dda 0 2024-04-26T11:24:03.123 INFO:tasks.workunit.client.0.smithi073.stdout:7/717: mkdir d1/d11/d24/d29/dd7/d80/df9 0 2024-04-26T11:24:03.123 INFO:tasks.workunit.client.0.smithi073.stdout:9/697: symlink d0/d6c/dc7/lef 0 2024-04-26T11:24:03.123 INFO:tasks.workunit.client.0.smithi073.stdout:3/682: stat d0/d11/d19/l8e 0 2024-04-26T11:24:03.124 INFO:tasks.workunit.client.0.smithi073.stdout:5/703: rename d4/d8/d9/d7d/da3/ddc/fcb to d4/de/d15/d33/ffc 0 2024-04-26T11:24:03.124 INFO:tasks.workunit.client.0.smithi073.stdout:1/774: getdents d1/d73/d34/d98 0 2024-04-26T11:24:03.125 INFO:tasks.workunit.client.0.smithi073.stdout:5/704: fdatasync d4/d8/d9/f21 0 2024-04-26T11:24:03.125 INFO:tasks.workunit.client.0.smithi073.stdout:9/698: chown d0/d1a/d4e/d70/d3b/c80 455224044 1 2024-04-26T11:24:03.126 INFO:tasks.workunit.client.0.smithi073.stdout:9/699: write d0/d6c/dc7/fce [40308,18342] 0 2024-04-26T11:24:03.126 INFO:tasks.workunit.client.0.smithi073.stdout:4/733: truncate d8/d1a/d1b/d46/d57/f8a 846396 0 2024-04-26T11:24:03.127 INFO:tasks.workunit.client.0.smithi073.stdout:0/701: creat d2/d1f/d9d/ff6 x:0 0 0 2024-04-26T11:24:03.127 INFO:tasks.workunit.client.0.smithi073.stdout:1/775: rename d1/d73/d34/c46 to d1/d16/d4f/d84/c103 0 2024-04-26T11:24:03.127 INFO:tasks.workunit.client.0.smithi073.stdout:5/705: fdatasync d4/d95/da5/fa8 0 2024-04-26T11:24:03.127 INFO:tasks.workunit.client.0.smithi073.stdout:3/683: creat d0/d11/d19/db/ddc/fed x:0 0 0 2024-04-26T11:24:03.127 INFO:tasks.workunit.client.0.smithi073.stdout:1/776: stat d1/fe5 0 2024-04-26T11:24:03.128 INFO:tasks.workunit.client.0.smithi073.stdout:7/718: creat d1/d11/d24/d29/dd7/d3d/d41/ffa x:0 0 0 2024-04-26T11:24:03.129 INFO:tasks.workunit.client.0.smithi073.stdout:0/702: mkdir d2/d37/df7 0 2024-04-26T11:24:03.129 INFO:tasks.workunit.client.0.smithi073.stdout:4/734: write d8/d1a/d5e/d7c/fe0 [722529,56861] 0 2024-04-26T11:24:03.129 INFO:tasks.workunit.client.0.smithi073.stdout:0/703: read d2/d84/fc3 [1209500,74857] 0 2024-04-26T11:24:03.130 INFO:tasks.workunit.client.0.smithi073.stdout:1/777: mknod d1/d16/d61/c104 0 2024-04-26T11:24:03.131 INFO:tasks.workunit.client.0.smithi073.stdout:7/719: mkdir d1/d11/d51/dfb 0 2024-04-26T11:24:03.132 INFO:tasks.workunit.client.0.smithi073.stdout:4/735: unlink d8/d1a/d1b/d1d/lf8 0 2024-04-26T11:24:03.132 INFO:tasks.workunit.client.0.smithi073.stdout:5/706: rmdir d4/d8/d8e/dd9 0 2024-04-26T11:24:03.132 INFO:tasks.workunit.client.0.smithi073.stdout:0/704: symlink d2/d84/dd2/lf8 0 2024-04-26T11:24:03.132 INFO:tasks.workunit.client.0.smithi073.stdout:3/684: mknod d0/d11/d19/db/d3e/d3f/d69/ddb/cee 0 2024-04-26T11:24:03.132 INFO:tasks.workunit.client.0.smithi073.stdout:2/666: dwrite dd/de/d38/d53/f74 [0,4194304] 0 2024-04-26T11:24:03.143 INFO:tasks.workunit.client.0.smithi073.stdout:8/688: dread d1/d4/d15/f4d [0,4194304] 0 2024-04-26T11:24:03.144 INFO:tasks.workunit.client.0.smithi073.stdout:0/705: dread d2/d22/f35 [0,4194304] 0 2024-04-26T11:24:03.147 INFO:tasks.workunit.client.0.smithi073.stdout:9/700: dread d0/d13/f18 [0,4194304] 0 2024-04-26T11:24:03.147 INFO:tasks.workunit.client.0.smithi073.stdout:3/685: sync 2024-04-26T11:24:03.148 INFO:tasks.workunit.client.0.smithi073.stdout:8/689: sync 2024-04-26T11:24:03.148 INFO:tasks.workunit.client.0.smithi073.stdout:6/655: truncate d0/dc/fb5 4182575 0 2024-04-26T11:24:03.148 INFO:tasks.workunit.client.0.smithi073.stdout:2/667: mkdir dd/de/d38/d53/d60/db2/dc7 0 2024-04-26T11:24:03.149 INFO:tasks.workunit.client.0.smithi073.stdout:5/707: mknod d4/d8/d9/d42/d68/df2/cfd 0 2024-04-26T11:24:03.149 INFO:tasks.workunit.client.0.smithi073.stdout:7/720: rmdir d1/d11/d24/d29 39 2024-04-26T11:24:03.149 INFO:tasks.workunit.client.0.smithi073.stdout:0/706: creat d2/d1f/d40/d48/da9/ff9 x:0 0 0 2024-04-26T11:24:03.150 INFO:tasks.workunit.client.0.smithi073.stdout:4/736: creat d8/d1a/d1b/d24/dac/ffe x:0 0 0 2024-04-26T11:24:03.150 INFO:tasks.workunit.client.0.smithi073.stdout:3/686: creat d0/d11/d19/db/da6/fef x:0 0 0 2024-04-26T11:24:03.150 INFO:tasks.workunit.client.0.smithi073.stdout:2/668: mknod dd/d4c/cc8 0 2024-04-26T11:24:03.150 INFO:tasks.workunit.client.0.smithi073.stdout:5/708: creat d4/d8/d8e/ffe x:0 0 0 2024-04-26T11:24:03.150 INFO:tasks.workunit.client.0.smithi073.stdout:0/707: write d2/f3d [486134,130218] 0 2024-04-26T11:24:03.150 INFO:tasks.workunit.client.0.smithi073.stdout:6/656: link d0/d1a/d4e/fa4 d0/d1a/d26/d27/fc5 0 2024-04-26T11:24:03.151 INFO:tasks.workunit.client.0.smithi073.stdout:8/690: rmdir d1/d21/d2c/ddd/d67/d81/da5/dce 0 2024-04-26T11:24:03.152 INFO:tasks.workunit.client.0.smithi073.stdout:4/737: chown d8/d1a/d1b/d1d/faa 0 1 2024-04-26T11:24:03.152 INFO:tasks.workunit.client.0.smithi073.stdout:2/669: write dd/d4c/d48/f90 [434852,52266] 0 2024-04-26T11:24:03.153 INFO:tasks.workunit.client.0.smithi073.stdout:5/709: mkdir d4/d8/dff 0 2024-04-26T11:24:03.153 INFO:tasks.workunit.client.0.smithi073.stdout:8/691: fsync d1/d4/d4c/f6c 0 2024-04-26T11:24:03.155 INFO:tasks.workunit.client.0.smithi073.stdout:0/708: chown d2/d1f/d40/d48 521034057 1 2024-04-26T11:24:03.159 INFO:tasks.workunit.client.0.smithi073.stdout:1/778: dwrite d1/f1a [0,4194304] 0 2024-04-26T11:24:03.163 INFO:tasks.workunit.client.0.smithi073.stdout:2/670: creat dd/de/d29/d98/fc9 x:0 0 0 2024-04-26T11:24:03.163 INFO:tasks.workunit.client.0.smithi073.stdout:0/709: symlink d2/d84/dd2/lfa 0 2024-04-26T11:24:03.163 INFO:tasks.workunit.client.0.smithi073.stdout:8/692: dread d1/d4/d37/f4f [0,4194304] 0 2024-04-26T11:24:03.163 INFO:tasks.workunit.client.0.smithi073.stdout:9/701: dwrite d0/d13/d25/d2c/dbf/fc6 [0,4194304] 0 2024-04-26T11:24:03.163 INFO:tasks.workunit.client.0.smithi073.stdout:3/687: dwrite d0/d11/d19/d1d/f8d [0,4194304] 0 2024-04-26T11:24:03.163 INFO:tasks.workunit.client.0.smithi073.stdout:0/710: write d2/d22/f65 [2381821,128408] 0 2024-04-26T11:24:03.164 INFO:tasks.workunit.client.0.smithi073.stdout:8/693: unlink d1/l10 0 2024-04-26T11:24:03.164 INFO:tasks.workunit.client.0.smithi073.stdout:5/710: getdents d4/d8/d9/d7d/d84/da7/db7/dcd/df1 0 2024-04-26T11:24:03.165 INFO:tasks.workunit.client.0.smithi073.stdout:0/711: chown d2/d1f/d40/d48/f97 420403 1 2024-04-26T11:24:03.166 INFO:tasks.workunit.client.0.smithi073.stdout:4/738: dwrite d8/d15/f3f [0,4194304] 0 2024-04-26T11:24:03.166 INFO:tasks.workunit.client.0.smithi073.stdout:1/779: symlink d1/d16/d4f/d55/da2/l105 0 2024-04-26T11:24:03.168 INFO:tasks.workunit.client.0.smithi073.stdout:6/657: dwrite d0/d1a/d26/d4b/d2b/d2c/f3b [4194304,4194304] 0 2024-04-26T11:24:03.168 INFO:tasks.workunit.client.0.smithi073.stdout:7/721: dwrite d1/d11/d24/d29/dd7/d4b/ff8 [4194304,4194304] 0 2024-04-26T11:24:03.168 INFO:tasks.workunit.client.0.smithi073.stdout:3/688: unlink d0/d11/d19/d52/fb1 0 2024-04-26T11:24:03.169 INFO:tasks.workunit.client.0.smithi073.stdout:2/671: write dd/d4c/d48/d46/d91/d9f/d1d/d8c/f95 [124052,55021] 0 2024-04-26T11:24:03.172 INFO:tasks.workunit.client.0.smithi073.stdout:9/702: dwrite d0/d1a/d4e/d70/d3b/fb3 [0,4194304] 0 2024-04-26T11:24:03.172 INFO:tasks.workunit.client.0.smithi073.stdout:4/739: symlink d8/d1a/d1b/d24/lff 0 2024-04-26T11:24:03.172 INFO:tasks.workunit.client.0.smithi073.stdout:4/740: chown d8/d1a/d5e 88289203 1 2024-04-26T11:24:03.173 INFO:tasks.workunit.client.0.smithi073.stdout:4/741: stat d8/d1a/d1b/d24/dac/d72/fca 0 2024-04-26T11:24:03.174 INFO:tasks.workunit.client.0.smithi073.stdout:6/658: link d0/dc/d80/f83 d0/d1a/d26/fc6 0 2024-04-26T11:24:03.174 INFO:tasks.workunit.client.0.smithi073.stdout:7/722: symlink d1/d11/d24/d29/dd7/d80/df9/lfc 0 2024-04-26T11:24:03.174 INFO:tasks.workunit.client.0.smithi073.stdout:3/689: mkdir d0/d11/d19/db/df0 0 2024-04-26T11:24:03.174 INFO:tasks.workunit.client.0.smithi073.stdout:0/712: creat d2/d1f/d40/ffb x:0 0 0 2024-04-26T11:24:03.174 INFO:tasks.workunit.client.0.smithi073.stdout:9/703: rename d0/d13/d25/fc2 to d0/d1a/d4e/ff0 0 2024-04-26T11:24:03.174 INFO:tasks.workunit.client.0.smithi073.stdout:4/742: mkdir d8/d1a/d9c/d100 0 2024-04-26T11:24:03.174 INFO:tasks.workunit.client.0.smithi073.stdout:7/723: chown d1/ddc 390805 1 2024-04-26T11:24:03.176 INFO:tasks.workunit.client.0.smithi073.stdout:9/704: creat d0/d3c/ff1 x:0 0 0 2024-04-26T11:24:03.176 INFO:tasks.workunit.client.0.smithi073.stdout:3/690: rmdir d0/d11/d19/db/da6/d7a/dbc 39 2024-04-26T11:24:03.176 INFO:tasks.workunit.client.0.smithi073.stdout:4/743: creat d8/d1a/d1b/d24/dac/d49/f101 x:0 0 0 2024-04-26T11:24:03.176 INFO:tasks.workunit.client.0.smithi073.stdout:7/724: creat d1/ffd x:0 0 0 2024-04-26T11:24:03.177 INFO:tasks.workunit.client.0.smithi073.stdout:6/659: symlink d0/d1a/d26/d4b/lc7 0 2024-04-26T11:24:03.177 INFO:tasks.workunit.client.0.smithi073.stdout:9/705: chown d0/d13/d25/d2c/fd9 16447279 1 2024-04-26T11:24:03.177 INFO:tasks.workunit.client.0.smithi073.stdout:3/691: unlink d0/d11/d19/db/ddc/d3c/fba 0 2024-04-26T11:24:03.178 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:24:03.180 INFO:tasks.workunit.client.0.smithi073.stdout:6/660: truncate d0/d1a/d26/d4b/f7d 2399905 0 2024-04-26T11:24:03.180 INFO:tasks.workunit.client.0.smithi073.stdout:9/706: write d0/f10 [3455385,47405] 0 2024-04-26T11:24:03.180 INFO:tasks.workunit.client.0.smithi073.stdout:0/713: read d2/d1f/d40/d48/f4a [883603,12141] 0 2024-04-26T11:24:03.181 INFO:tasks.workunit.client.0.smithi073.stdout:2/672: write dd/d4c/d48/d46/d91/d9f/d1d/f73 [838680,16473] 0 2024-04-26T11:24:03.182 INFO:tasks.workunit.client.0.smithi073.stdout:2/673: fdatasync f0 0 2024-04-26T11:24:03.182 INFO:tasks.workunit.client.0.smithi073.stdout:9/707: read d0/d13/f18 [2391972,113598] 0 2024-04-26T11:24:03.182 INFO:tasks.workunit.client.0.smithi073.stdout:7/725: creat d1/d11/d24/d29/dd7/ffe x:0 0 0 2024-04-26T11:24:03.182 INFO:tasks.workunit.client.0.smithi073.stdout:5/711: sync 2024-04-26T11:24:03.183 INFO:tasks.workunit.client.0.smithi073.stdout:7/726: fdatasync d1/d11/d24/d29/f74 0 2024-04-26T11:24:03.183 INFO:tasks.workunit.client.0.smithi073.stdout:9/708: dread - d0/d13/d5a/d65/fdb zero size 2024-04-26T11:24:03.183 INFO:tasks.workunit.client.0.smithi073.stdout:5/712: write d4/d8/dc3/ff6 [444807,17462] 0 2024-04-26T11:24:03.184 INFO:tasks.workunit.client.0.smithi073.stdout:2/674: mknod dd/d4c/d48/d46/d91/d9f/cca 0 2024-04-26T11:24:03.184 INFO:tasks.workunit.client.0.smithi073.stdout:0/714: creat d2/d84/ffc x:0 0 0 2024-04-26T11:24:03.185 INFO:tasks.workunit.client.0.smithi073.stdout:7/727: chown d1/d33/d1b/fb3 15084265 1 2024-04-26T11:24:03.185 INFO:tasks.workunit.client.0.smithi073.stdout:9/709: mkdir d0/d1a/d4e/d70/d46/df2 0 2024-04-26T11:24:03.186 INFO:tasks.workunit.client.0.smithi073.stdout:6/661: getdents d0/d1a/d26/d4b/d38 0 2024-04-26T11:24:03.186 INFO:tasks.workunit.client.0.smithi073.stdout:4/744: dwrite d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/fbe [0,4194304] 0 2024-04-26T11:24:03.187 INFO:tasks.workunit.client.0.smithi073.stdout:7/728: chown d1/d11/d24/d29/dd7/d80/df9/lfc 11015713 1 2024-04-26T11:24:03.188 INFO:tasks.workunit.client.0.smithi073.stdout:3/692: dwrite d0/d2d/f6b [0,4194304] 0 2024-04-26T11:24:03.190 INFO:tasks.workunit.client.0.smithi073.stdout:9/710: truncate d0/f8 1169711 0 2024-04-26T11:24:03.191 INFO:tasks.workunit.client.0.smithi073.stdout:0/715: dread d2/d1f/d40/d48/d62/f71 [0,4194304] 0 2024-04-26T11:24:03.191 INFO:tasks.workunit.client.0.smithi073.stdout:7/729: rename d1/d11/d24/d71/l59 to d1/d11/d24/d29/dd7/d3d/dba/lff 0 2024-04-26T11:24:03.191 INFO:tasks.workunit.client.0.smithi073.stdout:4/745: link d8/d1a/d1b/d24/dac/d72/cbf d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/c102 0 2024-04-26T11:24:03.192 INFO:tasks.workunit.client.0.smithi073.stdout:7/730: chown d1/d11/d24/d29/dd7/d3d/d7c 785128515 1 2024-04-26T11:24:03.192 INFO:tasks.workunit.client.0.smithi073.stdout:0/716: creat d2/d1f/d9c/ffd x:0 0 0 2024-04-26T11:24:03.192 INFO:tasks.workunit.client.0.smithi073.stdout:3/693: creat d0/d11/d19/db/da6/d7a/ff1 x:0 0 0 2024-04-26T11:24:03.192 INFO:tasks.workunit.client.0.smithi073.stdout:9/711: rename d0/d1a/d4e/ff0 to d0/d1a/d4e/d70/d46/ff3 0 2024-04-26T11:24:03.193 INFO:tasks.workunit.client.0.smithi073.stdout:2/675: fsync dd/d4c/d48/d46/d91/d9f/d1d/fbd 0 2024-04-26T11:24:03.193 INFO:tasks.workunit.client.0.smithi073.stdout:0/717: fsync d2/d22/d51/d57/f5c 0 2024-04-26T11:24:03.194 INFO:tasks.workunit.client.0.smithi073.stdout:0/718: chown d2/f92 4997 1 2024-04-26T11:24:03.195 INFO:tasks.workunit.client.0.smithi073.stdout:9/712: dread d0/d13/f18 [0,4194304] 0 2024-04-26T11:24:03.198 INFO:tasks.workunit.client.0.smithi073.stdout:4/746: dwrite d8/d1f/f88 [0,4194304] 0 2024-04-26T11:24:03.203 INFO:tasks.workunit.client.0.smithi073.stdout:2/676: dwrite f0 [4194304,4194304] 0 2024-04-26T11:24:03.203 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:03.198+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:03.204 INFO:tasks.workunit.client.0.smithi073.stdout:2/677: rename dd/d4c/d48/d46/f84 to dd/de/d49/dbb/fcb 0 2024-04-26T11:24:03.204 INFO:tasks.workunit.client.0.smithi073.stdout:4/747: mknod d8/d1a/d1b/d24/dac/d72/da3/c103 0 2024-04-26T11:24:03.204 INFO:tasks.workunit.client.0.smithi073.stdout:7/731: dwrite d1/d11/d24/d29/fa4 [0,4194304] 0 2024-04-26T11:24:03.205 INFO:tasks.workunit.client.0.smithi073.stdout:4/748: symlink d8/d1a/d1b/d46/d57/db1/l104 0 2024-04-26T11:24:03.205 INFO:tasks.workunit.client.0.smithi073.stdout:7/732: chown d1/d11/d24/d29/c79 61487 1 2024-04-26T11:24:03.205 INFO:tasks.workunit.client.0.smithi073.stdout:4/749: dread - d8/d1a/d1b/d24/dac/d72/fd9 zero size 2024-04-26T11:24:03.206 INFO:tasks.workunit.client.0.smithi073.stdout:7/733: chown d1/d33/d68/d78/daf/c4a 135875769 1 2024-04-26T11:24:03.208 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:24:03.208 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:24:03.209 INFO:tasks.workunit.client.0.smithi073.stdout:4/750: getdents d8/d1a/d1b/d41 0 2024-04-26T11:24:03.209 INFO:tasks.workunit.client.0.smithi073.stdout:3/694: truncate d0/d11/d19/d1d/f8d 1284252 0 2024-04-26T11:24:03.209 INFO:tasks.workunit.client.0.smithi073.stdout:3/695: readlink d0/d11/d19/db/d51/l67 0 2024-04-26T11:24:03.214 INFO:tasks.workunit.client.0.smithi073.stdout:8/694: dread d1/f26 [0,4194304] 0 2024-04-26T11:24:03.214 INFO:tasks.workunit.client.0.smithi073.stdout:4/751: dwrite d8/d1a/d1b/d24/dac/d49/d85/f79 [4194304,4194304] 0 2024-04-26T11:24:03.215 INFO:tasks.workunit.client.0.smithi073.stdout:2/678: dwrite dd/de/d6b/f5f [0,4194304] 0 2024-04-26T11:24:03.217 INFO:tasks.workunit.client.0.smithi073.stdout:8/695: write d1/d4/f74 [4019003,16425] 0 2024-04-26T11:24:03.218 INFO:tasks.workunit.client.0.smithi073.stdout:4/752: creat d8/d15/da1/df2/f105 x:0 0 0 2024-04-26T11:24:03.218 INFO:tasks.workunit.client.0.smithi073.stdout:2/679: creat dd/de/d38/d53/d60/db2/dc7/fcc x:0 0 0 2024-04-26T11:24:03.218 INFO:tasks.workunit.client.0.smithi073.stdout:8/696: chown d1/d21/d2c/ddd/d67/fba 200 1 2024-04-26T11:24:03.220 INFO:tasks.workunit.client.0.smithi073.stdout:4/753: truncate d8/d1a/d9c/d9d/fae 4749556 0 2024-04-26T11:24:03.221 INFO:tasks.workunit.client.0.smithi073.stdout:2/680: mkdir dd/d27/dcd 0 2024-04-26T11:24:03.221 INFO:tasks.workunit.client.0.smithi073.stdout:4/754: rename d8/d1a/d1b/d24/dac/d49/d84/f6e to d8/d1a/d9c/f106 0 2024-04-26T11:24:03.221 INFO:tasks.workunit.client.0.smithi073.stdout:8/697: fsync d1/d4/d37/dd3/de8/f94 0 2024-04-26T11:24:03.222 INFO:tasks.workunit.client.0.smithi073.stdout:4/755: creat d8/d1a/d4d/ddc/f107 x:0 0 0 2024-04-26T11:24:03.222 INFO:tasks.workunit.client.0.smithi073.stdout:8/698: creat d1/d21/d2c/ddd/fed x:0 0 0 2024-04-26T11:24:03.223 INFO:tasks.workunit.client.0.smithi073.stdout:1/780: dread d1/d16/d4f/dd5/f93 [0,4194304] 0 2024-04-26T11:24:03.223 INFO:tasks.workunit.client.0.smithi073.stdout:8/699: mkdir d1/d4/d37/dd3/dee 0 2024-04-26T11:24:03.223 INFO:tasks.workunit.client.0.smithi073.stdout:4/756: symlink d8/d1a/d1b/d24/dac/d49/d84/l108 0 2024-04-26T11:24:03.224 INFO:tasks.workunit.client.0.smithi073.stdout:4/757: chown d8/d1a/d1b/d24/f43 58353 1 2024-04-26T11:24:03.224 INFO:tasks.workunit.client.0.smithi073.stdout:8/700: write d1/d4/d15/dbc/dc3/dc6/fe1 [834031,50425] 0 2024-04-26T11:24:03.224 INFO:tasks.workunit.client.0.smithi073.stdout:4/758: rename d8/d15/l9e to d8/l109 0 2024-04-26T11:24:03.225 INFO:tasks.workunit.client.0.smithi073.stdout:8/701: creat d1/d4/d37/dd3/de8/fef x:0 0 0 2024-04-26T11:24:03.225 INFO:tasks.workunit.client.0.smithi073.stdout:4/759: mknod d8/d1a/d1b/d24/dac/c10a 0 2024-04-26T11:24:03.226 INFO:tasks.workunit.client.0.smithi073.stdout:8/702: rename d1/d21/d2c/ddd/d67/fd2 to d1/d21/d2c/ddd/ff0 0 2024-04-26T11:24:03.227 INFO:tasks.workunit.client.0.smithi073.stdout:4/760: chown d8/d1a/d1b/d24/dac/f27 67313 1 2024-04-26T11:24:03.227 INFO:tasks.workunit.client.0.smithi073.stdout:2/681: dread dd/d27/fb8 [0,4194304] 0 2024-04-26T11:24:03.227 INFO:tasks.workunit.client.0.smithi073.stdout:8/703: mknod d1/d4/d37/d90/cf1 0 2024-04-26T11:24:03.228 INFO:tasks.workunit.client.0.smithi073.stdout:8/704: chown d1/d4/d15/lca 1830552 1 2024-04-26T11:24:03.229 INFO:tasks.workunit.client.0.smithi073.stdout:1/781: dwrite d1/d6/d7f/d47/fa9 [0,4194304] 0 2024-04-26T11:24:03.234 INFO:tasks.workunit.client.0.smithi073.stdout:3/696: rmdir d0/d11 39 2024-04-26T11:24:03.234 INFO:tasks.workunit.client.0.smithi073.stdout:1/782: mknod d1/d16/c106 0 2024-04-26T11:24:03.236 INFO:tasks.workunit.client.0.smithi073.stdout:3/697: chown d0/d11/d19/db/d3e 41 1 2024-04-26T11:24:03.236 INFO:tasks.workunit.client.0.smithi073.stdout:4/761: dwrite d8/d1a/d1b/d46/d57/d37/f70 [0,4194304] 0 2024-04-26T11:24:03.237 INFO:tasks.workunit.client.0.smithi073.stdout:6/662: dread d0/d1a/d26/d4b/f5b [0,4194304] 0 2024-04-26T11:24:03.237 INFO:tasks.workunit.client.0.smithi073.stdout:8/705: dwrite d1/d21/d2c/ddd/fed [0,4194304] 0 2024-04-26T11:24:03.238 INFO:tasks.workunit.client.0.smithi073.stdout:2/682: dwrite dd/de/d38/d53/dc3/fc4 [0,4194304] 0 2024-04-26T11:24:03.239 INFO:tasks.workunit.client.0.smithi073.stdout:3/698: unlink d0/d11/d19/db/fe6 0 2024-04-26T11:24:03.239 INFO:tasks.workunit.client.0.smithi073.stdout:4/762: mknod d8/d1a/d5e/c10b 0 2024-04-26T11:24:03.239 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:24:03.240 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:24:03.240 INFO:tasks.workunit.client.0.smithi073.stdout:6/663: mknod d0/d1a/d7a/cc8 0 2024-04-26T11:24:03.240 INFO:tasks.workunit.client.0.smithi073.stdout:4/763: chown d8/d1f/f5f 55164 1 2024-04-26T11:24:03.241 INFO:tasks.workunit.client.0.smithi073.stdout:6/664: creat d0/d1a/d26/d4b/d49/fc9 x:0 0 0 2024-04-26T11:24:03.241 INFO:tasks.workunit.client.0.smithi073.stdout:2/683: link dd/d27/l92 dd/de/d29/lce 0 2024-04-26T11:24:03.241 INFO:tasks.workunit.client.0.smithi073.stdout:6/665: stat d0/d15/d2d/fb2 0 2024-04-26T11:24:03.242 INFO:tasks.workunit.client.0.smithi073.stdout:4/764: link d8/d1a/d1b/d1d/c54 d8/d1a/d1b/d24/dac/d72/da3/c10c 0 2024-04-26T11:24:03.242 INFO:tasks.workunit.client.0.smithi073.stdout:2/684: chown dd/de/l8e 0 1 2024-04-26T11:24:03.243 INFO:tasks.workunit.client.0.smithi073.stdout:4/765: dread - d8/d1a/d1b/d24/dac/d72/fca zero size 2024-04-26T11:24:03.244 INFO:tasks.workunit.client.0.smithi073.stdout:1/783: dwrite d1/d8/d5d/d89/feb [0,4194304] 0 2024-04-26T11:24:03.244 INFO:tasks.workunit.client.0.smithi073.stdout:8/706: mknod d1/d21/d2c/ddd/d67/d81/cf2 0 2024-04-26T11:24:03.246 INFO:tasks.workunit.client.0.smithi073.stdout:2/685: creat dd/de/fcf x:0 0 0 2024-04-26T11:24:03.246 INFO:tasks.workunit.client.0.smithi073.stdout:5/713: dread d4/d8/d9/d42/f4a [0,4194304] 0 2024-04-26T11:24:03.248 INFO:tasks.workunit.client.0.smithi073.stdout:3/699: dwrite d0/d34/f68 [0,4194304] 0 2024-04-26T11:24:03.251 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:24:03.251 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:24:03.253 INFO:tasks.workunit.client.0.smithi073.stdout:5/714: dread - d4/d8/d9/d42/fbc zero size 2024-04-26T11:24:03.254 INFO:tasks.workunit.client.0.smithi073.stdout:0/719: sync 2024-04-26T11:24:03.254 INFO:tasks.workunit.client.0.smithi073.stdout:5/715: chown d4/d8/d9/d7d/d84/fbd 27839846 1 2024-04-26T11:24:03.255 INFO:tasks.workunit.client.0.smithi073.stdout:8/707: symlink d1/d4/d15/db7/lf3 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:4/766: getdents d8/d1a/d1b/d46 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:2/686: symlink dd/d27/da0/da7/ld0 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:1/784: getdents d1/d73/d34/d98/daa 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:4/767: creat d8/d1a/d4d/f10d x:0 0 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:5/716: creat d4/d8/d9/d7d/d84/da7/db7/dcd/df1/f100 x:0 0 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:8/708: getdents d1/d21 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:1/785: symlink d1/d6/db3/l107 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:5/717: write d4/de/fcc [1251906,57644] 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:1/786: fdatasync d1/d16/d4f/f9b 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:2/687: creat dd/de/d2a/dbc/fd1 x:0 0 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:3/700: creat d0/d11/d19/db/da6/d7a/dbc/ff2 x:0 0 0 2024-04-26T11:24:03.256 INFO:tasks.workunit.client.0.smithi073.stdout:3/701: dread - d0/d11/d19/db/d3e/d3f/d69/fd8 zero size 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:176 3.1d 3:bec1251c:::200.00000007:head [write 3873410~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8378992580000002, 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.049732789999999999, 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.258 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410918+0000", 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410916+0000", 2024-04-26T11:24:03.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410925+0000", 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1030000000000002e-06 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410943+0000", 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8139999999999999e-05 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410957+0000", 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3939e-05 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.453976+0000", 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043019730999999999 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.454179+0000", 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000202964 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460360+0000", 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0061803910000000004 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460473+0000", 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000113402 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460650+0000", 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000177236 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.262 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:177 3.1d 3:bec1251c:::200.00000007:head [write 3874807~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8378483820000007, 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.049989594999999998, 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410968+0000", 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410967+0000", 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.410985+0000", 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7580000000000001e-05 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411007+0000", 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1752000000000001e-05 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411021+0000", 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4749999999999999e-05 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455415+0000", 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044393763000000003 2024-04-26T11:24:03.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455544+0000", 2024-04-26T11:24:03.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012836299999999999 2024-04-26T11:24:03.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460672+0000", 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051280620000000001 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460775+0000", 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010309 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460958+0000", 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018335500000000001 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:178 3.1d 3:bec1251c:::200.00000007:head [write 3876210~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8377825140000006, 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050240140000000003, 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411034+0000", 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411033+0000", 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411042+0000", 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.7930000000000003e-06 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411064+0000", 2024-04-26T11:24:03.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1869999999999999e-05 2024-04-26T11:24:03.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411077+0000", 2024-04-26T11:24:03.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3003000000000001e-05 2024-04-26T11:24:03.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.456448+0000", 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.045371178999999998 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.456668+0000", 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00022021899999999999 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460979+0000", 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0043111490000000002 2024-04-26T11:24:03.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461088+0000", 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010888 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461274+0000", 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018618000000000001 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:179 3.1d 3:bec1251c:::200.00000007:head [write 3877613~1400 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8377285919999995, 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.052990624, 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411088+0000", 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411087+0000", 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411105+0000", 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7580000000000001e-05 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411124+0000", 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9108999999999999e-05 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411139+0000", 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4676e-05 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.458214+0000", 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.047075327 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.458359+0000", 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014537299999999999 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.463839+0000", 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054799050000000002 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.463918+0000", 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8887999999999994e-05 2024-04-26T11:24:03.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464079+0000", 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000160719 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:180 3.1d 3:bec1251c:::200.00000007:head [write 3879013~1406 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8376649230000002, 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053236793999999997, 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.277 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411152+0000", 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411151+0000", 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411160+0000", 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9760000000000001e-06 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411180+0000", 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9902999999999999e-05 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411196+0000", 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6129000000000001e-05 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459318+0000", 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048122047000000001 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459507+0000", 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189598 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464107+0000", 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0045994979999999996 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464199+0000", 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2083999999999995e-05 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464389+0000", 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000189662 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.281 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:181 3.1d 3:bec1251c:::200.00000007:head [write 3880419~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8376083619999992, 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.055882977, 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411208+0000", 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411207+0000", 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411215+0000", 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7100000000000007e-06 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411234+0000", 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8563000000000002e-05 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411248+0000", 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4499e-05 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461384+0000", 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050136067999999999 2024-04-26T11:24:03.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.461534+0000", 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014934400000000001 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.466771+0000", 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0052373610000000003 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.466900+0000", 2024-04-26T11:24:03.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012929200000000001 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467091+0000", 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000191153 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:182 3.1d 3:bec1251c:::200.00000007:head [write 3881822~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8375560829999991, 2024-04-26T11:24:03.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.057533475000000001, 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411261+0000", 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411260+0000", 2024-04-26T11:24:03.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411279+0000", 2024-04-26T11:24:03.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9055999999999998e-05 2024-04-26T11:24:03.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411300+0000", 2024-04-26T11:24:03.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1556000000000002e-05 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411315+0000", 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4307e-05 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.462268+0000", 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.050953713999999997 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.462480+0000", 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021157500000000001 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468480+0000", 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0059997169999999999 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468609+0000", 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012991700000000001 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468794+0000", 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000184766 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:183 3.1d 3:bec1251c:::200.00000007:head [write 3883227~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8374897780000001, 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.060065495000000003, 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.291 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411327+0000", 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411326+0000", 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411334+0000", 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7570000000000004e-06 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411351+0000", 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7523000000000001e-05 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411367+0000", 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5909e-05 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464493+0000", 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053126200999999998 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464716+0000", 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000222244 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471192+0000", 2024-04-26T11:24:03.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064765689999999997 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471299+0000", 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010697200000000001 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471393+0000", 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3399999999999993e-05 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:184 3.1d 3:bec1251c:::200.00000007:head [write 3884626~1397 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8374375960000009, 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.060192189, 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411379+0000", 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411378+0000", 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411394+0000", 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6047000000000001e-05 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411413+0000", 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9159000000000001e-05 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411428+0000", 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4543e-05 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465657+0000", 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.054228982000000002 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465838+0000", 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000180719 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471407+0000", 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055695709999999997 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471487+0000", 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9555999999999995e-05 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.471571+0000", 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.4635000000000005e-05 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:185 3.1d 3:bec1251c:::200.00000007:head [write 3886023~1403 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8373766099999997, 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064564381000000004, 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411440+0000", 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411439+0000", 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411449+0000", 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0056e-05 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411467+0000", 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7367000000000002e-05 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411484+0000", 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6949e-05 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467227+0000", 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.055743085999999997 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.467347+0000", 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012048999999999999 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.475804+0000", 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084571980000000008 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.475897+0000", 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.2601000000000003e-05 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476005+0000", 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010764099999999999 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:186 3.1d 3:bec1251c:::200.00000007:head [write 3887426~1399 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8373215290000005, 2024-04-26T11:24:03.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064774331000000004, 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411495+0000", 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411494+0000", 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411509+0000", 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4463e-05 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411526+0000", 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7226000000000001e-05 2024-04-26T11:24:03.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.411540+0000", 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4063000000000001e-05 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468882+0000", 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.057341548999999999 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.469023+0000", 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000141357 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476029+0000", 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0070060829999999998 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476132+0000", 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103045 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476270+0000", 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013762099999999999 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.308 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:8088 4.5 4:a3b551eb:::100000024d3.00000000:head [write 0~479] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.8285195020000007, 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.056313184000000002, 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 8088 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.309 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420297+0000", 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420295+0000", 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999971 2024-04-26T11:24:03.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420310+0000", 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.554e-05 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420344+0000", 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.4195e-05 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.420365+0000", 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0726000000000001e-05 2024-04-26T11:24:03.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.468869+0000", 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048503444 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.469179+0000", 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00030999599999999999 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476290+0000", 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071110239999999996 2024-04-26T11:24:03.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476425+0000", 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00013510200000000001 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.476611+0000", 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00018590699999999999 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.313 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:203 3.1d 3:bec1251c:::200.00000007:head [write 3985361~1405 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7936225720000003, 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048391816999999997, 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455194+0000", 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455192+0000", 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455205+0000", 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2816000000000001e-05 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455231+0000", 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.5643000000000002e-05 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455247+0000", 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6446000000000001e-05 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.495318+0000", 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.040070460000000002 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.495514+0000", 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019605800000000001 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503340+0000", 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0078268000000000001 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503478+0000", 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000137847 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503586+0000", 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0001078 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:204 3.1d 3:bec1251c:::200.00000007:head [write 3986766~8200 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7935408039999992, 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.048511780999999997, 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455276+0000", 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455275+0000", 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455295+0000", 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9556999999999999e-05 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455309+0000", 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4129e-05 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.455318+0000", 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9099999999999994e-06 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.497677+0000", 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.042359494999999997 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.497779+0000", 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101652 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503601+0000", 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0058225500000000001 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503667+0000", 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.6165000000000001e-05 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503788+0000", 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012043 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:207 3.1d 3:bec1251c:::200.00000007:head [write 4002753~2766 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.322 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7889605639999999, 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.051229524999999998, 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459856+0000", 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459855+0000", 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459863+0000", 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1429999999999998e-06 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459873+0000", 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:24:03.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459885+0000", 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.253e-05 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.501870+0000", 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.041984759000000003 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.502112+0000", 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000241387 2024-04-26T11:24:03.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510903+0000", 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0087910309999999995 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510975+0000", 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2683999999999997e-05 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511086+0000", 2024-04-26T11:24:03.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000110534 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:208 3.1d 3:bec1251c:::200.00000007:head [write 4005519~5851 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7889244580000003, 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.051351761000000003, 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459892+0000", 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459920+0000", 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8198999999999999e-05 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459931+0000", 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0896e-05 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459939+0000", 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8040000000000002e-06 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.503910+0000", 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.043971057000000001 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.504155+0000", 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00024487100000000002 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511096+0000", 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0069414660000000003 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511153+0000", 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.7126999999999997e-05 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.511244+0000", 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1044000000000004e-05 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:209 3.1d 3:bec1251c:::200.00000007:head [write 4011370~3881 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:24:03.331 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7888699460000002, 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053603985999999999, 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459947+0000", 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459946+0000", 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459963+0000", 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7090000000000001e-05 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459985+0000", 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.1889e-05 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.459998+0000", 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.344e-05 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.505665+0000", 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.045666292999999997 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.505878+0000", 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021291999999999999 2024-04-26T11:24:03.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513229+0000", 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0073514380000000001 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513355+0000", 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00012582000000000001 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513551+0000", 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019610600000000001 2024-04-26T11:24:03.335 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:210 3.1d 3:bec1251c:::200.00000007:head [write 4015251~1909 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7880801749999993, 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053137220999999998, 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460737+0000", 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460735+0000", 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460752+0000", 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.7016000000000001e-05 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460797+0000", 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5136000000000003e-05 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.460813+0000", 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6138999999999999e-05 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.508005+0000", 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0471923 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.508158+0000", 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000152096 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513572+0000", 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0054148490000000002 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513680+0000", 2024-04-26T11:24:03.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000107243 2024-04-26T11:24:03.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.513874+0000", 2024-04-26T11:24:03.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019425200000000001 2024-04-26T11:24:03.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.340 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.340 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:211 3.1d 3:bec1251c:::200.00000007:head [write 4017160~11347 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e61)", 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7846227769999992, 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.053850265000000001, 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464194+0000", 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464192+0000", 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464228+0000", 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6162999999999999e-05 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464256+0000", 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7665999999999999e-05 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.464276+0000", 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.0403000000000001e-05 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.509181+0000", 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044904685999999999 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.509391+0000", 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00021012299999999999 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.517888+0000", 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0084974600000000001 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.517941+0000", 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.2484000000000001e-05 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518044+0000", 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000103424 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:8119 4.5 4:a024dd33:::100000024f3.00000000:head [write 0~1435] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:24:03.345 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7831355139999996, 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.052532417999999997, 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 8119 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465681+0000", 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465679+0000", 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465695+0000", 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5287000000000001e-05 2024-04-26T11:24:03.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465725+0000", 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.0284999999999999e-05 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.465744+0000", 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.9414000000000001e-05 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510010+0000", 2024-04-26T11:24:03.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.044265697999999999 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.510296+0000", 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000286323 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518060+0000", 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0077638289999999999 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518111+0000", 2024-04-26T11:24:03.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1144999999999999e-05 2024-04-26T11:24:03.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:03.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:03.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:03.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:23:54.518214+0000", 2024-04-26T11:24:03.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000102564 2024-04-26T11:24:03.350 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.350 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.350 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.350 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:03.350 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:03.350 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:03.354 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:03.358 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:03.352+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:03.363 INFO:tasks.workunit.client.0.smithi073.stdout:1/787: dread - d1/d6/d62/fd6 zero size 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:8/709: link d1/d4/d37/d5b/d83/fa3 d1/d21/d2c/ddd/d67/d81/da5/ff4 0 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:6/666: write d0/d1a/d26/fc6 [3336961,107767] 0 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:2/688: creat dd/de/d49/dbb/fd2 x:0 0 0 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:9/713: dread d0/d13/d25/d75/d8e/fb0 [0,4194304] 0 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:2/689: fsync dd/d4c/d48/d46/d91/d9f/d1d/f44 0 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:6/667: mknod d0/d19/d20/cca 0 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:8/710: dread d1/d4/d7b/d8d/fc8 [0,4194304] 0 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:0/720: rename d2/d1f/la6 to d2/d1f/d40/lfe 0 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:5/718: dwrite d4/d8/d9/fa1 [0,4194304] 0 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:9/714: dread - d0/d13/d25/d75/d8e/db9/fe3 zero size 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:2/690: truncate dd/de/d2a/f83 1258332 0 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:4/768: dwrite d8/d1f/f5f [0,4194304] 0 2024-04-26T11:24:03.364 INFO:tasks.workunit.client.0.smithi073.stdout:1/788: dread d1/f1a [0,4194304] 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:5/719: mknod d4/d8/d9/d7d/c101 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:4/769: chown d8/d15/f76 347 1 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:9/715: creat d0/d1a/d4e/d70/d51/ff4 x:0 0 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:1/789: unlink d1/d6/f22 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:4/770: symlink d8/d1a/d1b/d24/dac/d49/d85/d8b/l10e 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:9/716: write d0/d13/d5a/d65/fe0 [961684,112657] 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:1/790: dread - d1/d6/d7f/ff4 zero size 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:2/691: dread dd/de/f28 [0,4194304] 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:6/668: dwrite d0/d1a/d26/f94 [0,4194304] 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:1/791: symlink d1/d6/db3/l108 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:7/734: dread f0 [0,4194304] 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:2/692: unlink dd/d4c/f7c 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:1/792: mkdir d1/d16/d61/d109 0 2024-04-26T11:24:03.365 INFO:tasks.workunit.client.0.smithi073.stdout:6/669: creat d0/d1a/d26/d4b/d2b/fcb x:0 0 0 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:1/793: readlink d1/d6/db3/lf3 0 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:6/670: chown d0/d1a/d26/d4b/d63/f73 761921 1 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:1/794: dread - d1/d16/d4f/fc7 zero size 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:3/702: dwrite d0/d11/d19/db/fa8 [0,4194304] 0 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/721: rmdir d2/d1f/d40 39 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:4/771: truncate d8/d1f/f22 7486879 0 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:3/703: rename d0/d11/l9d to d0/d11/d19/db/lf3 0 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/722: fsync d2/d37/d3c/d6a/f6b 0 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:3/704: mkdir d0/d2d/df4 0 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/723: creat d2/d1f/d40/d48/d62/fff x:0 0 0 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/724: creat d2/d1f/d9c/f100 x:0 0 0 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:4/772: dwrite d8/d1a/d1b/d46/fb0 [0,4194304] 0 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/725: dwrite d2/f31 [0,4194304] 0 2024-04-26T11:24:03.366 INFO:tasks.workunit.client.0.smithi073.stdout:0/726: rename d2/f4f to d2/d1f/d9c/db1/f101 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:7/735: dread d1/d33/d1b/fd3 [0,4194304] 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:4/773: getdents d8/d1a/db2 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:7/736: symlink d1/d11/d24/d29/dd7/d80/df9/l100 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:0/727: link d2/d1f/d40/d48/f99 d2/d5f/f102 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:3/705: getdents d0/d11/d19/db/d3e/d3f/d69 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:7/737: creat d1/d33/d68/d78/f101 x:0 0 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:4/774: dwrite d8/d1a/d4d/ddc/f107 [0,4194304] 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:0/728: dwrite d2/d1f/d9c/fb0 [0,4194304] 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:4/775: symlink d8/d15/da1/l10f 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:4/776: creat d8/d1a/d86/f110 x:0 0 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:0/729: dwrite d2/d1f/d9d/fae [0,4194304] 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:4/777: symlink d8/d1a/d1b/d24/dac/d49/dad/l111 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:1/795: dread d1/d6/d7f/ffa [0,4194304] 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:0/730: creat d2/d22/f103 x:0 0 0 2024-04-26T11:24:03.367 INFO:tasks.workunit.client.0.smithi073.stdout:4/778: mknod d8/d1a/d5e/dc5/dfb/dfd/c112 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:3/706: truncate d0/d11/d19/fe3 1696396 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:0/731: readlink d2/d22/d51/d57/l58 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:4/779: read - d8/d1a/d1b/dd2/fed zero size 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:3/707: creat d0/d11/d19/d1d/ff5 x:0 0 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:8/711: dread d1/d21/f29 [0,4194304] 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:0/732: getdents d2/d1f/d9c 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:8/712: dread - d1/d4/d37/dd3/de8/fd0 zero size 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:8/713: creat d1/d4/d7b/ff5 x:0 0 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:8/714: chown d1/c62 3066 1 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:4/780: mknod d8/d1a/d1b/d24/dac/da7/c113 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:8/715: mknod d1/d4/d15/dbc/dc3/dc6/dea/cf6 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:8/716: mkdir d1/d4/d15/db7/df7 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:3/708: dwrite d0/d11/d19/d5b/fb0 [0,4194304] 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:3/709: readlink d0/d11/d19/l9 0 2024-04-26T11:24:03.368 INFO:tasks.workunit.client.0.smithi073.stdout:7/738: dread d1/d11/d24/d29/f94 [0,4194304] 0 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:0/733: dwrite d2/d84/dd2/ff4 [0,4194304] 0 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:7/739: creat d1/d11/d51/dbd/f102 x:0 0 0 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:4/781: truncate d8/d1a/d1b/d24/dac/d72/f80 4038120 0 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:8/717: link d1/d21/d2c/ddd/l23 d1/d4/da9/lf8 0 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:4/782: dread - d8/d1a/d1b/d24/dac/d49/d84/ff7 zero size 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:8/718: rename d1/d4/d37/d90 to d1/d4/d37/dd3/dee/df9 0 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:4/783: mkdir d8/d1a/d1b/dd2/d114 0 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:0/734: dwrite d2/d37/d3c/f47 [0,4194304] 0 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:0/735: write d2/d1f/d40/f5b [4911040,6126] 0 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:8/719: truncate d1/d4/d15/f75 888158 0 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:8/720: mkdir d1/d4/d37/dfa 0 2024-04-26T11:24:03.369 INFO:tasks.workunit.client.0.smithi073.stdout:8/721: stat d1/d21/d2a 0 2024-04-26T11:24:03.370 INFO:tasks.workunit.client.0.smithi073.stdout:7/740: dwrite d1/d11/d51/dbd/ff5 [4194304,4194304] 0 2024-04-26T11:24:03.370 INFO:tasks.workunit.client.0.smithi073.stdout:8/722: creat d1/d4/d15/db7/df7/ffb x:0 0 0 2024-04-26T11:24:03.370 INFO:tasks.workunit.client.0.smithi073.stdout:8/723: dread - d1/d4/fb5 zero size 2024-04-26T11:24:03.370 INFO:tasks.workunit.client.0.smithi073.stdout:7/741: symlink d1/d11/d5e/d8f/l103 0 2024-04-26T11:24:03.370 INFO:tasks.workunit.client.0.smithi073.stdout:7/742: dwrite d1/d11/d5e/d8f/f91 [0,4194304] 0 2024-04-26T11:24:03.370 INFO:tasks.workunit.client.0.smithi073.stdout:1/796: dread d1/d73/d53/f59 [0,4194304] 0 2024-04-26T11:24:03.370 INFO:tasks.workunit.client.0.smithi073.stdout:1/797: stat d1/d6/db3/lf3 0 2024-04-26T11:24:03.370 INFO:tasks.workunit.client.0.smithi073.stdout:1/798: write d1/d6/fe2 [364134,39817] 0 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:8/724: rename d1/d21 to d1/d4/d15/de4/dfc 0 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:7/743: truncate d1/d33/d1b/fd3 1762392 0 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:1/799: rename d1/d8/d57/db1 to d1/d8/d2e/d3c/d10a 0 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:1/800: write d1/d73/d34/fc9 [74093,31091] 0 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:7/744: rename d1/d11/d24/l4d to d1/d11/d24/d29/dd7/d4b/l104 0 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:1/801: write d1/d8/d5d/d89/feb [91136,106008] 0 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:7/745: fsync d1/d11/d24/d29/dd7/d4b/f70 0 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:7/746: creat d1/d11/d51/dca/f105 x:0 0 0 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:7/747: creat d1/d11/d24/d71/d90/f106 x:0 0 0 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:5/720: sync 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:9/717: sync 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:4/784: sync 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:8/725: truncate d1/d4/f89 5790 0 2024-04-26T11:24:03.371 INFO:tasks.workunit.client.0.smithi073.stdout:9/718: read - d0/fdf zero size 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:4/785: fdatasync d8/d15/da1/fa9 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:9/719: stat d0/d1a/d4e/d8f/fbe 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:8/726: read - d1/d4/d15/de4/dfc/d2c/ddd/d67/d81/da5/fd4 zero size 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:4/786: mkdir d8/d1a/d1b/d24/dac/d49/d85/d115 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:5/721: link d4/d73/d8a/dc8/fe0 d4/d8/d9/d7d/d84/da7/db7/dcd/df1/df3/f102 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:9/720: mkdir d0/d13/d5a/db2/de1/df5 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:8/727: unlink d1/d4/d7b/lb1 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:9/721: chown d0/d13/d25/d75/d8e/db9 155281523 1 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:8/728: unlink d1/d4/d37/dd3/dee/df9/cb9 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:7/748: dwrite d1/d33/f97 [0,4194304] 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:4/787: write d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/fbe [855935,58476] 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:1/802: dread d1/d16/d4f/fac [0,4194304] 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:7/749: creat d1/d11/d24/d29/dd7/d80/da0/f107 x:0 0 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:4/788: unlink d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/fb7 0 2024-04-26T11:24:03.372 INFO:tasks.workunit.client.0.smithi073.stdout:1/803: symlink d1/d73/d34/d98/dce/l10b 0 2024-04-26T11:24:03.373 INFO:tasks.workunit.client.0.smithi073.stdout:4/789: mknod d8/d1a/d1b/d24/dac/da7/c116 0 2024-04-26T11:24:03.373 INFO:tasks.workunit.client.0.smithi073.stdout:7/750: read d1/d33/d1b/d66/d50/f7d [1234495,18941] 0 2024-04-26T11:24:03.373 INFO:tasks.workunit.client.0.smithi073.stdout:9/722: dwrite d0/d13/d25/d2c/dbf/fc6 [0,4194304] 0 2024-04-26T11:24:03.373 INFO:tasks.workunit.client.0.smithi073.stdout:5/722: dwrite d4/d73/fd6 [0,4194304] 0 2024-04-26T11:24:03.373 INFO:tasks.workunit.client.0.smithi073.stdout:7/751: fdatasync d1/d33/d68/d78/daf/f23 0 2024-04-26T11:24:03.373 INFO:tasks.workunit.client.0.smithi073.stdout:9/723: chown d0/d1a/c42 7 1 2024-04-26T11:24:03.373 INFO:tasks.workunit.client.0.smithi073.stdout:5/723: mkdir d4/de/d15/d67/d103 0 2024-04-26T11:24:03.375 INFO:tasks.workunit.client.0.smithi073.stdout:7/752: write d1/f5 [4652085,16763] 0 2024-04-26T11:24:03.375 INFO:tasks.workunit.client.0.smithi073.stdout:7/753: chown d1/d11/d24/d29/dd7/d3d/d7c 7046233 1 2024-04-26T11:24:03.375 INFO:tasks.workunit.client.0.smithi073.stdout:4/790: dwrite d8/f2e [8388608,4194304] 0 2024-04-26T11:24:03.375 INFO:tasks.workunit.client.0.smithi073.stdout:7/754: readlink d1/d11/d24/d29/dd7/d80/lc1 0 2024-04-26T11:24:03.375 INFO:tasks.workunit.client.0.smithi073.stdout:9/724: dwrite d0/d13/d25/fe9 [0,4194304] 0 2024-04-26T11:24:03.375 INFO:tasks.workunit.client.0.smithi073.stdout:4/791: rmdir d8/d1a/d5e/d7c/dee 39 2024-04-26T11:24:03.375 INFO:tasks.workunit.client.0.smithi073.stdout:7/755: truncate d1/d11/d24/d29/dd7/d3d/d41/f47 1871351 0 2024-04-26T11:24:03.375 INFO:tasks.workunit.client.0.smithi073.stdout:7/756: rmdir d1/d11/d24/d29/dd7/d80 39 2024-04-26T11:24:03.375 INFO:tasks.workunit.client.0.smithi073.stdout:9/725: dwrite d0/d1a/d2f/f41 [4194304,4194304] 0 2024-04-26T11:24:03.375 INFO:tasks.workunit.client.0.smithi073.stdout:9/726: stat d0/d83/ce5 0 2024-04-26T11:24:03.377 INFO:tasks.workunit.client.0.smithi073.stdout:8/729: write d1/d4/d15/de4/dfc/d2c/ddd/d67/d81/da5/fae [1193601,32499] 0 2024-04-26T11:24:03.377 INFO:tasks.workunit.client.0.smithi073.stdout:1/804: truncate d1/d16/d6a/fc8 1531809 0 2024-04-26T11:24:03.377 INFO:tasks.workunit.client.0.smithi073.stdout:4/792: truncate d8/d1a/d1b/d46/fb0 2640378 0 2024-04-26T11:24:03.377 INFO:tasks.workunit.client.0.smithi073.stdout:5/724: write d4/d8/d9/d42/f9c [5395328,87083] 0 2024-04-26T11:24:03.378 INFO:tasks.workunit.client.0.smithi073.stdout:8/730: stat d1/d4/d15/de4/dfc/d2c/ddd/f36 0 2024-04-26T11:24:03.379 INFO:tasks.workunit.client.0.smithi073.stdout:8/731: symlink d1/d4/d15/de4/dfc/d2c/ddd/d67/lfd 0 2024-04-26T11:24:03.379 INFO:tasks.workunit.client.0.smithi073.stdout:1/805: creat d1/d16/d4f/d55/f10c x:0 0 0 2024-04-26T11:24:03.380 INFO:tasks.workunit.client.0.smithi073.stdout:8/732: write d1/d4/d7b/ff5 [548762,23904] 0 2024-04-26T11:24:03.380 INFO:tasks.workunit.client.0.smithi073.stdout:8/733: dread - d1/d4/d37/dd3/de8/fde zero size 2024-04-26T11:24:03.381 INFO:tasks.workunit.client.0.smithi073.stdout:8/734: mkdir d1/d4/d15/dbc/dc3/dc6/ddb/dfe 0 2024-04-26T11:24:03.382 INFO:tasks.workunit.client.0.smithi073.stdout:3/710: sync 2024-04-26T11:24:03.382 INFO:tasks.workunit.client.0.smithi073.stdout:0/736: sync 2024-04-26T11:24:03.382 INFO:tasks.workunit.client.0.smithi073.stdout:6/671: sync 2024-04-26T11:24:03.382 INFO:tasks.workunit.client.0.smithi073.stdout:2/693: sync 2024-04-26T11:24:03.382 INFO:tasks.workunit.client.0.smithi073.stdout:8/735: symlink d1/d4/d37/d5b/lff 0 2024-04-26T11:24:03.383 INFO:tasks.workunit.client.0.smithi073.stdout:3/711: write d0/d11/d19/fa0 [2930812,42714] 0 2024-04-26T11:24:03.383 INFO:tasks.workunit.client.0.smithi073.stdout:3/712: mkdir d0/d2d/df6 0 2024-04-26T11:24:03.384 INFO:tasks.workunit.client.0.smithi073.stdout:0/737: creat d2/d37/d8b/f104 x:0 0 0 2024-04-26T11:24:03.384 INFO:tasks.workunit.client.0.smithi073.stdout:8/736: rename d1/d4/d15/de4/dfc/d2c/ddd/d67/d81/da5/ce6 to d1/d4/d4c/d66/c100 0 2024-04-26T11:24:03.386 INFO:tasks.workunit.client.0.smithi073.stdout:6/672: dread d0/d1a/d26/d4b/d2b/d2c/f3b [4194304,4194304] 0 2024-04-26T11:24:03.386 INFO:tasks.workunit.client.0.smithi073.stdout:8/737: dread - d1/d4/da9/fc0 zero size 2024-04-26T11:24:03.386 INFO:tasks.workunit.client.0.smithi073.stdout:0/738: rename d2/d1f/d40/d48/f5d to d2/d1f/d40/d48/da9/dd8/f105 0 2024-04-26T11:24:03.387 INFO:tasks.workunit.client.0.smithi073.stdout:6/673: write d0/f16 [1385081,69921] 0 2024-04-26T11:24:03.388 INFO:tasks.workunit.client.0.smithi073.stdout:0/739: creat d2/d1f/d40/d48/dc1/dd6/f106 x:0 0 0 2024-04-26T11:24:03.390 INFO:tasks.workunit.client.0.smithi073.stdout:6/674: getdents d0/d1a/d26/d4b/d63 0 2024-04-26T11:24:03.393 INFO:tasks.workunit.client.0.smithi073.stdout:3/713: dwrite d0/d11/d19/db/d3e/d47/fc4 [0,4194304] 0 2024-04-26T11:24:03.394 INFO:tasks.workunit.client.0.smithi073.stdout:8/738: dwrite d1/d4/f5a [0,4194304] 0 2024-04-26T11:24:03.395 INFO:tasks.workunit.client.0.smithi073.stdout:3/714: chown d0/d11/d19/d70 22 1 2024-04-26T11:24:03.397 INFO:tasks.workunit.client.0.smithi073.stdout:0/740: dwrite d2/f3f [0,4194304] 0 2024-04-26T11:24:03.399 INFO:tasks.workunit.client.0.smithi073.stdout:0/741: mknod d2/d1f/d40/d48/d62/c107 0 2024-04-26T11:24:03.399 INFO:tasks.workunit.client.0.smithi073.stdout:8/739: mkdir d1/d4/d4c/d101 0 2024-04-26T11:24:03.399 INFO:tasks.workunit.client.0.smithi073.stdout:0/742: fdatasync d2/d22/d51/d57/d78/fd5 0 2024-04-26T11:24:03.402 INFO:tasks.workunit.client.0.smithi073.stdout:3/715: dwrite d0/d11/d19/db/d3e/d3f/d69/fd8 [0,4194304] 0 2024-04-26T11:24:03.406 INFO:tasks.workunit.client.0.smithi073.stdout:3/716: getdents d0/d11/d19 0 2024-04-26T11:24:03.407 INFO:tasks.workunit.client.0.smithi073.stdout:3/717: fsync d0/d11/d19/db/d3e/d47/f9a 0 2024-04-26T11:24:03.409 INFO:tasks.workunit.client.0.smithi073.stdout:3/718: dread - d0/d11/d19/db/d51/fc8 zero size 2024-04-26T11:24:03.414 INFO:tasks.workunit.client.0.smithi073.stdout:1/806: dread d1/d16/d61/f9c [0,4194304] 0 2024-04-26T11:24:03.416 INFO:tasks.workunit.client.0.smithi073.stdout:2/694: dread dd/de/f12 [4194304,4194304] 0 2024-04-26T11:24:03.416 INFO:tasks.workunit.client.0.smithi073.stdout:9/727: dread d0/f10 [0,4194304] 0 2024-04-26T11:24:03.416 INFO:tasks.workunit.client.0.smithi073.stdout:8/740: dread d1/d4/d15/de4/dfc/d2a/fb0 [0,4194304] 0 2024-04-26T11:24:03.416 INFO:tasks.workunit.client.0.smithi073.stdout:1/807: write d1/d16/d4f/d84/fa5 [9030440,108471] 0 2024-04-26T11:24:03.416 INFO:tasks.workunit.client.0.smithi073.stdout:2/695: dread - dd/de/d49/dbb/fc0 zero size 2024-04-26T11:24:03.416 INFO:tasks.workunit.client.0.smithi073.stdout:9/728: write d0/d6c/f97 [4881599,72211] 0 2024-04-26T11:24:03.417 INFO:tasks.workunit.client.0.smithi073.stdout:1/808: mknod d1/d6/d7f/d8f/de9/c10d 0 2024-04-26T11:24:03.417 INFO:tasks.workunit.client.0.smithi073.stdout:8/741: creat d1/d4/d15/de4/dfc/d2a/f102 x:0 0 0 2024-04-26T11:24:03.417 INFO:tasks.workunit.client.0.smithi073.stdout:9/729: creat d0/d6c/dc7/ff6 x:0 0 0 2024-04-26T11:24:03.418 INFO:tasks.workunit.client.0.smithi073.stdout:1/809: symlink d1/d73/d53/dd4/l10e 0 2024-04-26T11:24:03.418 INFO:tasks.workunit.client.0.smithi073.stdout:9/730: dread - d0/d13/d25/d75/d8e/db9/fe3 zero size 2024-04-26T11:24:03.418 INFO:tasks.workunit.client.0.smithi073.stdout:8/742: write d1/d4/d15/de4/dfc/f29 [4077210,10527] 0 2024-04-26T11:24:03.419 INFO:tasks.workunit.client.0.smithi073.stdout:9/731: symlink d0/d1a/d4e/lf7 0 2024-04-26T11:24:03.419 INFO:tasks.workunit.client.0.smithi073.stdout:8/743: mknod d1/d4/d15/de4/dfc/d2c/c103 0 2024-04-26T11:24:03.421 INFO:tasks.workunit.client.0.smithi073.stdout:8/744: creat d1/d4/d37/d5b/f104 x:0 0 0 2024-04-26T11:24:03.421 INFO:tasks.workunit.client.0.smithi073.stdout:6/675: dread d0/f2 [0,4194304] 0 2024-04-26T11:24:03.421 INFO:tasks.workunit.client.0.smithi073.stdout:8/745: fsync d1/d4/d15/de4/dfc/d2a/f39 0 2024-04-26T11:24:03.423 INFO:tasks.workunit.client.0.smithi073.stdout:6/676: unlink d0/d1a/d26/d4b/lc7 0 2024-04-26T11:24:03.423 INFO:tasks.workunit.client.0.smithi073.stdout:2/696: dwrite dd/de/d38/f93 [0,4194304] 0 2024-04-26T11:24:03.424 INFO:tasks.workunit.client.0.smithi073.stdout:2/697: chown dd/d4c/d48/d46/d91/d9f/d1d/f35 702 1 2024-04-26T11:24:03.424 INFO:tasks.workunit.client.0.smithi073.stdout:6/677: truncate d0/d1a/d26/d27/dbc/fab 383665 0 2024-04-26T11:24:03.424 INFO:tasks.workunit.client.0.smithi073.stdout:4/793: sync 2024-04-26T11:24:03.425 INFO:tasks.workunit.client.0.smithi073.stdout:7/757: sync 2024-04-26T11:24:03.425 INFO:tasks.workunit.client.0.smithi073.stdout:5/725: sync 2024-04-26T11:24:03.425 INFO:tasks.workunit.client.0.smithi073.stdout:3/719: sync 2024-04-26T11:24:03.426 INFO:tasks.workunit.client.0.smithi073.stdout:7/758: symlink d1/d33/d1b/d95/l108 0 2024-04-26T11:24:03.426 INFO:tasks.workunit.client.0.smithi073.stdout:6/678: creat d0/d1a/d26/d4b/d2b/fcc x:0 0 0 2024-04-26T11:24:03.428 INFO:tasks.workunit.client.0.smithi073.stdout:3/720: write d0/d11/d19/db/da6/d60/dcd/fea [143604,31787] 0 2024-04-26T11:24:03.429 INFO:tasks.workunit.client.0.smithi073.stdout:6/679: creat d0/d15/d9a/fcd x:0 0 0 2024-04-26T11:24:03.429 INFO:tasks.workunit.client.0.smithi073.stdout:8/746: dread d1/d4/d15/de4/dfc/d2a/f34 [0,4194304] 0 2024-04-26T11:24:03.429 INFO:tasks.workunit.client.0.smithi073.stdout:3/721: dread - d0/d11/d19/db/da6/f7c zero size 2024-04-26T11:24:03.429 INFO:tasks.workunit.client.0.smithi073.stdout:7/759: rename d1/d33/d68/d78/daf/f9d to d1/d11/d24/d71/f109 0 2024-04-26T11:24:03.429 INFO:tasks.workunit.client.0.smithi073.stdout:6/680: mkdir d0/dc/d55/d79/dce 0 2024-04-26T11:24:03.429 INFO:tasks.workunit.client.0.smithi073.stdout:3/722: rmdir d0/d26/da2 39 2024-04-26T11:24:03.429 INFO:tasks.workunit.client.0.smithi073.stdout:6/681: chown d0/d1a/d26/d4b/d2b/d43/f88 91497 1 2024-04-26T11:24:03.430 INFO:tasks.workunit.client.0.smithi073.stdout:7/760: dread - d1/d11/d24/d29/dd7/ffe zero size 2024-04-26T11:24:03.430 INFO:tasks.workunit.client.0.smithi073.stdout:8/747: dread d1/f26 [0,4194304] 0 2024-04-26T11:24:03.430 INFO:tasks.workunit.client.0.smithi073.stdout:7/761: chown d1/d11/d24/d29/dd7/d4b/f70 253908 1 2024-04-26T11:24:03.431 INFO:tasks.workunit.client.0.smithi073.stdout:2/698: dread dd/de/d6b/f61 [0,4194304] 0 2024-04-26T11:24:03.431 INFO:tasks.workunit.client.0.smithi073.stdout:8/748: rename d1/d4/d37/dd3/dee/df9 to d1/d4/d37/dd3/d105 0 2024-04-26T11:24:03.432 INFO:tasks.workunit.client.0.smithi073.stdout:8/749: unlink d1/d4/d15/de4/dfc/d2c/ccd 0 2024-04-26T11:24:03.433 INFO:tasks.workunit.client.0.smithi073.stdout:3/723: truncate d0/d11/d23/fae 202271 0 2024-04-26T11:24:03.434 INFO:tasks.workunit.client.0.smithi073.stdout:8/750: write d1/d4/d15/de4/dfc/d2c/ddd/d67/d81/f84 [1474840,64413] 0 2024-04-26T11:24:03.435 INFO:tasks.workunit.client.0.smithi073.stdout:2/699: dread dd/de/d38/d53/d60/db2/fb5 [0,4194304] 0 2024-04-26T11:24:03.436 INFO:tasks.workunit.client.0.smithi073.stdout:2/700: chown dd/d4c/d48/d46/d91/d9f/cca 2 1 2024-04-26T11:24:03.436 INFO:tasks.workunit.client.0.smithi073.stdout:3/724: getdents d0/d11/d19/db/da6/d60 0 2024-04-26T11:24:03.437 INFO:tasks.workunit.client.0.smithi073.stdout:3/725: write d0/d34/f4e [779816,89139] 0 2024-04-26T11:24:03.437 INFO:tasks.workunit.client.0.smithi073.stdout:3/726: unlink d0/d11/f13 0 2024-04-26T11:24:03.439 INFO:tasks.workunit.client.0.smithi073.stdout:2/701: read dd/de/d49/fad [632532,112550] 0 2024-04-26T11:24:03.441 INFO:tasks.workunit.client.0.smithi073.stdout:2/702: rmdir dd/d27 39 2024-04-26T11:24:03.441 INFO:tasks.workunit.client.0.smithi073.stdout:5/726: dread d4/d95/fc9 [0,4194304] 0 2024-04-26T11:24:03.442 INFO:tasks.workunit.client.0.smithi073.stdout:2/703: chown dd/de/d38/d53/d60 49 1 2024-04-26T11:24:03.443 INFO:tasks.workunit.client.0.smithi073.stdout:2/704: rmdir dd/de/d29/d98 39 2024-04-26T11:24:03.443 INFO:tasks.workunit.client.0.smithi073.stdout:3/727: dwrite d0/d11/d19/d1d/f44 [4194304,4194304] 0 2024-04-26T11:24:03.449 INFO:tasks.workunit.client.0.smithi073.stdout:0/743: sync 2024-04-26T11:24:03.449 INFO:tasks.workunit.client.0.smithi073.stdout:8/751: sync 2024-04-26T11:24:03.450 INFO:tasks.workunit.client.0.smithi073.stdout:1/810: dread d1/d16/d4f/f79 [0,4194304] 0 2024-04-26T11:24:03.450 INFO:tasks.workunit.client.0.smithi073.stdout:9/732: dread d0/d1a/d4e/d70/f38 [0,4194304] 0 2024-04-26T11:24:03.450 INFO:tasks.workunit.client.0.smithi073.stdout:8/752: fdatasync d1/d4/f12 0 2024-04-26T11:24:03.450 INFO:tasks.workunit.client.0.smithi073.stdout:7/762: dread d1/d11/d24/d29/dd7/d4b/f70 [0,4194304] 0 2024-04-26T11:24:03.451 INFO:tasks.workunit.client.0.smithi073.stdout:1/811: dread - d1/d16/d4f/fc7 zero size 2024-04-26T11:24:03.453 INFO:tasks.workunit.client.0.smithi073.stdout:9/733: creat d0/d1a/d4e/ff8 x:0 0 0 2024-04-26T11:24:03.453 INFO:tasks.workunit.client.0.smithi073.stdout:2/705: write dd/de/f28 [936764,77911] 0 2024-04-26T11:24:03.453 INFO:tasks.workunit.client.0.smithi073.stdout:7/763: mknod d1/d11/d24/d71/d90/c10a 0 2024-04-26T11:24:03.453 INFO:tasks.workunit.client.0.smithi073.stdout:1/812: stat d1/d51/l56 0 2024-04-26T11:24:03.453 INFO:tasks.workunit.client.0.smithi073.stdout:8/753: symlink d1/d4/d37/dfa/l106 0 2024-04-26T11:24:03.454 INFO:tasks.workunit.client.0.smithi073.stdout:0/744: rename d2/d22/f4e to d2/d1f/d40/f108 0 2024-04-26T11:24:03.454 INFO:tasks.workunit.client.0.smithi073.stdout:4/794: dread d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/fbe [0,4194304] 0 2024-04-26T11:24:03.455 INFO:tasks.workunit.client.0.smithi073.stdout:6/682: dread d0/d1a/d7a/f85 [0,4194304] 0 2024-04-26T11:24:03.455 INFO:tasks.workunit.client.0.smithi073.stdout:2/706: write dd/d4c/d48/d46/d91/d9f/d1d/f15 [515387,1805] 0 2024-04-26T11:24:03.456 INFO:tasks.workunit.client.0.smithi073.stdout:1/813: symlink d1/d8/d2e/d3c/l10f 0 2024-04-26T11:24:03.456 INFO:tasks.workunit.client.0.smithi073.stdout:3/728: rename d0/d26/da2/lc7 to d0/d11/d19/db/da6/d8b/d8c/d90/lf7 0 2024-04-26T11:24:03.456 INFO:tasks.workunit.client.0.smithi073.stdout:8/754: mknod d1/d4/d7b/c107 0 2024-04-26T11:24:03.456 INFO:tasks.workunit.client.0.smithi073.stdout:9/734: creat d0/d1a/d4e/d70/dd6/ff9 x:0 0 0 2024-04-26T11:24:03.456 INFO:tasks.workunit.client.0.smithi073.stdout:9/735: sync 2024-04-26T11:24:03.456 INFO:tasks.workunit.client.0.smithi073.stdout:9/736: sync 2024-04-26T11:24:03.456 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:03.452+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:03.457 INFO:tasks.workunit.client.0.smithi073.stdout:2/707: mkdir dd/de/d38/d53/dc3/dd3 0 2024-04-26T11:24:03.457 INFO:tasks.workunit.client.0.smithi073.stdout:4/795: chown d8/d1a/d1b/d24/dac/d49/d84/fc4 3 1 2024-04-26T11:24:03.457 INFO:tasks.workunit.client.0.smithi073.stdout:7/764: link d1/d11/d24/fe8 d1/d11/d24/d29/dd7/d80/da0/dd2/f10b 0 2024-04-26T11:24:03.458 INFO:tasks.workunit.client.0.smithi073.stdout:9/737: creat d0/d1a/d4e/ffa x:0 0 0 2024-04-26T11:24:03.458 INFO:tasks.workunit.client.0.smithi073.stdout:1/814: dread d1/d8/d5d/f8a [0,4194304] 0 2024-04-26T11:24:03.459 INFO:tasks.workunit.client.0.smithi073.stdout:8/755: getdents d1/d4/d37/dd3 0 2024-04-26T11:24:03.459 INFO:tasks.workunit.client.0.smithi073.stdout:7/765: dread - d1/d11/d10/f9c zero size 2024-04-26T11:24:03.460 INFO:tasks.workunit.client.0.smithi073.stdout:9/738: write d0/d13/d5a/d5e/f94 [2445937,69886] 0 2024-04-26T11:24:03.461 INFO:tasks.workunit.client.0.smithi073.stdout:2/708: getdents dd/d4c/d48/d46 0 2024-04-26T11:24:03.461 INFO:tasks.workunit.client.0.smithi073.stdout:3/729: rename d0/d11/d19/d52/lb6 to d0/d11/d19/db/da6/d8b/d8c/d90/db4/lf8 0 2024-04-26T11:24:03.462 INFO:tasks.workunit.client.0.smithi073.stdout:1/815: rmdir d1/d73/d40/d54 39 2024-04-26T11:24:03.462 INFO:tasks.workunit.client.0.smithi073.stdout:8/756: dread d1/d4/d7b/d8d/fc8 [0,4194304] 0 2024-04-26T11:24:03.463 INFO:tasks.workunit.client.0.smithi073.stdout:7/766: chown d1/d11/d10/f2f 47 1 2024-04-26T11:24:03.465 INFO:tasks.workunit.client.0.smithi073.stdout:9/739: creat d0/d1a/d4e/ffb x:0 0 0 2024-04-26T11:24:03.465 INFO:tasks.workunit.client.0.smithi073.stdout:2/709: chown dd/de/fcf 7 1 2024-04-26T11:24:03.465 INFO:tasks.workunit.client.0.smithi073.stdout:4/796: getdents d8/d1a/d1b/d24/dac/d49/d85/d8b 0 2024-04-26T11:24:03.465 INFO:tasks.workunit.client.0.smithi073.stdout:6/683: dread d0/dc/d80/d97/da2/fae [0,4194304] 0 2024-04-26T11:24:03.465 INFO:tasks.workunit.client.0.smithi073.stdout:8/757: dread d1/d4/d7b/d8d/fc8 [0,4194304] 0 2024-04-26T11:24:03.465 INFO:tasks.workunit.client.0.smithi073.stdout:5/727: dread d4/de/f10 [0,4194304] 0 2024-04-26T11:24:03.466 INFO:tasks.workunit.client.0.smithi073.stdout:7/767: readlink d1/d11/d24/d29/dd7/d3d/d41/lb2 0 2024-04-26T11:24:03.466 INFO:tasks.workunit.client.0.smithi073.stdout:9/740: creat d0/d1a/d4e/ffc x:0 0 0 2024-04-26T11:24:03.466 INFO:tasks.workunit.client.0.smithi073.stdout:2/710: rename c3 to dd/d27/cd4 0 2024-04-26T11:24:03.466 INFO:tasks.workunit.client.0.smithi073.stdout:4/797: fdatasync d8/d1a/d1b/d46/d57/f8a 0 2024-04-26T11:24:03.466 INFO:tasks.workunit.client.0.smithi073.stdout:0/745: dwrite d2/d1f/d40/d48/dc1/dd6/fea [0,4194304] 0 2024-04-26T11:24:03.468 INFO:tasks.workunit.client.0.smithi073.stdout:5/728: symlink d4/d8/d9/d7d/da3/l104 0 2024-04-26T11:24:03.468 INFO:tasks.workunit.client.0.smithi073.stdout:1/816: write d1/d73/d40/f2f [1848284,75944] 0 2024-04-26T11:24:03.468 INFO:tasks.workunit.client.0.smithi073.stdout:4/798: chown d8/d1a/d1b/d24/lcb 20 1 2024-04-26T11:24:03.468 INFO:tasks.workunit.client.0.smithi073.stdout:6/684: link d0/d1a/d26/d4b/cbb d0/dc/d80/d97/ccf 0 2024-04-26T11:24:03.468 INFO:tasks.workunit.client.0.smithi073.stdout:5/729: write d4/de/d15/f9e [1832101,106216] 0 2024-04-26T11:24:03.469 INFO:tasks.workunit.client.0.smithi073.stdout:7/768: truncate d1/d11/d24/d29/dd7/d3d/d41/ffa 903943 0 2024-04-26T11:24:03.470 INFO:tasks.workunit.client.0.smithi073.stdout:8/758: rename d1/d4/d37/d5b/f7a to d1/d4/d15/dbc/dc3/dc6/ddb/dfe/f108 0 2024-04-26T11:24:03.470 INFO:tasks.workunit.client.0.smithi073.stdout:0/746: mkdir d2/d1f/d40/d48/da9/d109 0 2024-04-26T11:24:03.470 INFO:tasks.workunit.client.0.smithi073.stdout:4/799: creat d8/f117 x:0 0 0 2024-04-26T11:24:03.470 INFO:tasks.workunit.client.0.smithi073.stdout:3/730: dwrite d0/d11/d19/f39 [4194304,4194304] 0 2024-04-26T11:24:03.470 INFO:tasks.workunit.client.0.smithi073.stdout:8/759: dread - d1/fcf zero size 2024-04-26T11:24:03.471 INFO:tasks.workunit.client.0.smithi073.stdout:6/685: creat d0/d1a/d26/d4b/d63/da0/fd0 x:0 0 0 2024-04-26T11:24:03.472 INFO:tasks.workunit.client.0.smithi073.stdout:3/731: mknod d0/d11/d19/d5b/cf9 0 2024-04-26T11:24:03.472 INFO:tasks.workunit.client.0.smithi073.stdout:4/800: read d8/d1a/d1b/d24/dac/d49/d84/f97 [71674,69079] 0 2024-04-26T11:24:03.472 INFO:tasks.workunit.client.0.smithi073.stdout:7/769: stat d1/d11/d24/d29/dd7/d4b/l104 0 2024-04-26T11:24:03.473 INFO:tasks.workunit.client.0.smithi073.stdout:3/732: readlink d0/l36 0 2024-04-26T11:24:03.474 INFO:tasks.workunit.client.0.smithi073.stdout:8/760: write d1/d4/d37/dd3/de8/fde [1025016,3993] 0 2024-04-26T11:24:03.474 INFO:tasks.workunit.client.0.smithi073.stdout:9/741: dwrite d0/d13/f1f [4194304,4194304] 0 2024-04-26T11:24:03.475 INFO:tasks.workunit.client.0.smithi073.stdout:4/801: write d8/d1a/d1b/d24/dac/d72/fd9 [967094,61317] 0 2024-04-26T11:24:03.477 INFO:tasks.workunit.client.0.smithi073.stdout:9/742: chown d0/d6c/f97 1440003 1 2024-04-26T11:24:03.478 INFO:tasks.workunit.client.0.smithi073.stdout:8/761: write d1/d4/d15/de4/dfc/d2c/ddd/ff0 [1647986,26309] 0 2024-04-26T11:24:03.479 INFO:tasks.workunit.client.0.smithi073.stdout:4/802: link d8/d15/f3f d8/d1a/d5e/d7c/dee/f118 0 2024-04-26T11:24:03.481 INFO:tasks.workunit.client.0.smithi073.stdout:5/730: dwrite d4/d8/d9/d7d/d84/f78 [0,4194304] 0 2024-04-26T11:24:03.481 INFO:tasks.workunit.client.0.smithi073.stdout:7/770: truncate d1/d11/d24/d29/dd7/d3d/d7c/fea 345184 0 2024-04-26T11:24:03.481 INFO:tasks.workunit.client.0.smithi073.stdout:8/762: chown d1/d4/d4c/d66/l9e 26901756 1 2024-04-26T11:24:03.481 INFO:tasks.workunit.client.0.smithi073.stdout:4/803: mkdir d8/d1a/d5e/dc5/dfb/d119 0 2024-04-26T11:24:03.483 INFO:tasks.workunit.client.0.smithi073.stdout:0/747: dread d2/f3d [0,4194304] 0 2024-04-26T11:24:03.483 INFO:tasks.workunit.client.0.smithi073.stdout:6/686: dwrite d0/d1a/d26/fc6 [0,4194304] 0 2024-04-26T11:24:03.483 INFO:tasks.workunit.client.0.smithi073.stdout:5/731: dread - d4/de/d15/d33/fda zero size 2024-04-26T11:24:03.484 INFO:tasks.workunit.client.0.smithi073.stdout:7/771: write d1/d33/f97 [75561,65781] 0 2024-04-26T11:24:03.486 INFO:tasks.workunit.client.0.smithi073.stdout:3/733: dwrite d0/d11/d19/d5b/fb0 [0,4194304] 0 2024-04-26T11:24:03.486 INFO:tasks.workunit.client.0.smithi073.stdout:4/804: write d8/d1a/d5e/d7c/f90 [4836318,68126] 0 2024-04-26T11:24:03.486 INFO:tasks.workunit.client.0.smithi073.stdout:6/687: unlink d0/d15/l9b 0 2024-04-26T11:24:03.486 INFO:tasks.workunit.client.0.smithi073.stdout:8/763: symlink d1/d4/d15/de4/dfc/l109 0 2024-04-26T11:24:03.486 INFO:tasks.workunit.client.0.smithi073.stdout:5/732: chown d4/l27 5949 1 2024-04-26T11:24:03.487 INFO:tasks.workunit.client.0.smithi073.stdout:7/772: creat d1/ddc/f10c x:0 0 0 2024-04-26T11:24:03.488 INFO:tasks.workunit.client.0.smithi073.stdout:8/764: chown d1/fdc 174204232 1 2024-04-26T11:24:03.488 INFO:tasks.workunit.client.0.smithi073.stdout:4/805: dread - d8/d1a/d86/f110 zero size 2024-04-26T11:24:03.488 INFO:tasks.workunit.client.0.smithi073.stdout:9/743: dwrite d0/d1a/d4e/d70/d51/f88 [0,4194304] 0 2024-04-26T11:24:03.488 INFO:tasks.workunit.client.0.smithi073.stdout:7/773: write d1/ffd [761636,39582] 0 2024-04-26T11:24:03.488 INFO:tasks.workunit.client.0.smithi073.stdout:6/688: write d0/dc/d80/d97/da2/fae [2485261,60676] 0 2024-04-26T11:24:03.488 INFO:tasks.workunit.client.0.smithi073.stdout:7/774: readlink d1/d11/l32 0 2024-04-26T11:24:03.490 INFO:tasks.workunit.client.0.smithi073.stdout:5/733: mkdir d4/de/d15/d67/d103/d105 0 2024-04-26T11:24:03.490 INFO:tasks.workunit.client.0.smithi073.stdout:7/775: symlink d1/d11/l10d 0 2024-04-26T11:24:03.490 INFO:tasks.workunit.client.0.smithi073.stdout:8/765: unlink d1/d4/d15/de4/dfc/d2a/f6b 0 2024-04-26T11:24:03.490 INFO:tasks.workunit.client.0.smithi073.stdout:5/734: fdatasync d4/de/d23/fc4 0 2024-04-26T11:24:03.490 INFO:tasks.workunit.client.0.smithi073.stdout:6/689: getdents d0/d1a/d26/d27/dbc 0 2024-04-26T11:24:03.492 INFO:tasks.workunit.client.0.smithi073.stdout:8/766: chown d1/l27 12654 1 2024-04-26T11:24:03.493 INFO:tasks.workunit.client.0.smithi073.stdout:5/735: truncate d4/fed 351997 0 2024-04-26T11:24:03.493 INFO:tasks.workunit.client.0.smithi073.stdout:6/690: fdatasync d0/d1a/d26/d4b/d63/da0/fd0 0 2024-04-26T11:24:03.493 INFO:tasks.workunit.client.0.smithi073.stdout:6/691: write d0/d1a/d26/d4b/d49/fc9 [347381,16812] 0 2024-04-26T11:24:03.493 INFO:tasks.workunit.client.0.smithi073.stdout:7/776: mknod d1/d11/d24/d29/dd7/d80/da0/dd2/c10e 0 2024-04-26T11:24:03.493 INFO:tasks.workunit.client.0.smithi073.stdout:8/767: write d1/d4/d15/de4/dfc/d2c/ddd/d67/d81/f9c [73725,60705] 0 2024-04-26T11:24:03.494 INFO:tasks.workunit.client.0.smithi073.stdout:2/711: dread dd/d4c/d48/d46/d91/d9f/f22 [0,4194304] 0 2024-04-26T11:24:03.494 INFO:tasks.workunit.client.0.smithi073.stdout:2/712: mkdir dd/d27/da0/dd5 0 2024-04-26T11:24:03.495 INFO:tasks.workunit.client.0.smithi073.stdout:9/744: dread d0/d13/d25/d2c/dbf/fc6 [0,4194304] 0 2024-04-26T11:24:03.495 INFO:tasks.workunit.client.0.smithi073.stdout:2/713: mknod dd/d27/cd6 0 2024-04-26T11:24:03.496 INFO:tasks.workunit.client.0.smithi073.stdout:9/745: readlink d0/d13/d25/d9c/lc8 0 2024-04-26T11:24:03.496 INFO:tasks.workunit.client.0.smithi073.stdout:2/714: mknod dd/cd7 0 2024-04-26T11:24:03.496 INFO:tasks.workunit.client.0.smithi073.stdout:6/692: getdents d0/d1a/d26 0 2024-04-26T11:24:03.497 INFO:tasks.workunit.client.0.smithi073.stdout:9/746: truncate d0/d1a/d2f/f3e 2737914 0 2024-04-26T11:24:03.498 INFO:tasks.workunit.client.0.smithi073.stdout:2/715: link dd/d4c/d48/d46/d91/d9f/d1d/f36 dd/d27/da0/dd5/fd8 0 2024-04-26T11:24:03.499 INFO:tasks.workunit.client.0.smithi073.stdout:9/747: link d0/d13/d25/d2c/dbf/fea d0/d6c/ffd 0 2024-04-26T11:24:03.499 INFO:tasks.workunit.client.0.smithi073.stdout:2/716: write dd/de/f11 [1904586,74052] 0 2024-04-26T11:24:03.499 INFO:tasks.workunit.client.0.smithi073.stdout:9/748: stat d0/d1a/d4e/d70/c63 0 2024-04-26T11:24:03.500 INFO:tasks.workunit.client.0.smithi073.stdout:8/768: dwrite d1/d4/d37/dd3/de8/fde [0,4194304] 0 2024-04-26T11:24:03.501 INFO:tasks.workunit.client.0.smithi073.stdout:2/717: readlink dd/de/d38/d4e/l56 0 2024-04-26T11:24:03.501 INFO:tasks.workunit.client.0.smithi073.stdout:9/749: unlink d0/d13/d5a/d5e/ca9 0 2024-04-26T11:24:03.503 INFO:tasks.workunit.client.0.smithi073.stdout:2/718: unlink dd/de/d2a/f97 0 2024-04-26T11:24:03.503 INFO:tasks.workunit.client.0.smithi073.stdout:8/769: mkdir d1/d4/d37/dd3/de8/d10a 0 2024-04-26T11:24:03.503 INFO:tasks.workunit.client.0.smithi073.stdout:6/693: dwrite d0/dc/d80/f83 [4194304,4194304] 0 2024-04-26T11:24:03.503 INFO:tasks.workunit.client.0.smithi073.stdout:2/719: write dd/de/f28 [1896710,84109] 0 2024-04-26T11:24:03.505 INFO:tasks.workunit.client.0.smithi073.stdout:9/750: mkdir d0/d1a/d4e/d70/d59/de8/dfe 0 2024-04-26T11:24:03.506 INFO:tasks.workunit.client.0.smithi073.stdout:0/748: sync 2024-04-26T11:24:03.506 INFO:tasks.workunit.client.0.smithi073.stdout:5/736: sync 2024-04-26T11:24:03.508 INFO:tasks.workunit.client.0.smithi073.stdout:7/777: write d1/d11/d24/d29/dd7/d4b/fbf [1127712,14872] 0 2024-04-26T11:24:03.508 INFO:tasks.workunit.client.0.smithi073.stdout:5/737: creat d4/d8/d9/d7d/f106 x:0 0 0 2024-04-26T11:24:03.509 INFO:tasks.workunit.client.0.smithi073.stdout:2/720: link dd/d4c/cc8 dd/d4c/d48/d77/cd9 0 2024-04-26T11:24:03.509 INFO:tasks.workunit.client.0.smithi073.stdout:9/751: chown d0/l16 161214 1 2024-04-26T11:24:03.510 INFO:tasks.workunit.client.0.smithi073.stdout:2/721: rename dd/d27/da0/dd5 to dd/d27/da0/dd5/dda 22 2024-04-26T11:24:03.510 INFO:tasks.workunit.client.0.smithi073.stdout:9/752: creat d0/d1a/d4e/d70/d46/fff x:0 0 0 2024-04-26T11:24:03.511 INFO:tasks.workunit.client.0.smithi073.stdout:8/770: dwrite d1/d4/d15/de4/dfc/d2c/ddd/d67/d81/f88 [0,4194304] 0 2024-04-26T11:24:03.511 INFO:tasks.workunit.client.0.smithi073.stdout:5/738: symlink d4/d73/l107 0 2024-04-26T11:24:03.513 INFO:tasks.workunit.client.0.smithi073.stdout:8/771: dread - d1/d4/fb5 zero size 2024-04-26T11:24:03.513 INFO:tasks.workunit.client.0.smithi073.stdout:9/753: symlink d0/d13/d25/d75/d98/l100 0 2024-04-26T11:24:03.514 INFO:tasks.workunit.client.0.smithi073.stdout:5/739: rmdir d4/de/d15/d33 39 2024-04-26T11:24:03.514 INFO:tasks.workunit.client.0.smithi073.stdout:8/772: unlink d1/le2 0 2024-04-26T11:24:03.514 INFO:tasks.workunit.client.0.smithi073.stdout:7/778: read d1/d33/d68/fad [3081283,76293] 0 2024-04-26T11:24:03.514 INFO:tasks.workunit.client.0.smithi073.stdout:5/740: creat d4/d8/dff/f108 x:0 0 0 2024-04-26T11:24:03.514 INFO:tasks.workunit.client.0.smithi073.stdout:8/773: getdents d1/d4/d4c/d66 0 2024-04-26T11:24:03.514 INFO:tasks.workunit.client.0.smithi073.stdout:7/779: chown d1/d11/d24/d29/dd7/d3d/d7b/fcb 575649 1 2024-04-26T11:24:03.516 INFO:tasks.workunit.client.0.smithi073.stdout:8/774: rename d1/d4/d15/f79 to d1/d4/d15/dbc/dc3/dc6/ddb/f10b 0 2024-04-26T11:24:03.522 INFO:tasks.workunit.client.0.smithi073.stdout:5/741: dwrite d4/de/d23/d4f/f59 [0,4194304] 0 2024-04-26T11:24:03.522 INFO:tasks.workunit.client.0.smithi073.stdout:9/754: dread d0/d13/d25/d2c/fd9 [0,4194304] 0 2024-04-26T11:24:03.522 INFO:tasks.workunit.client.0.smithi073.stdout:7/780: dwrite d1/d11/d24/fe4 [0,4194304] 0 2024-04-26T11:24:03.523 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:03.523 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:03.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.523 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:14163 4.37 4:ece61a0d:::100000035fb.00000001:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:03.523 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:03.507763+0000", 2024-04-26T11:24:03.523 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.010182689, 2024-04-26T11:24:03.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010208414000000001, 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 14163 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.507763+0000", 2024-04-26T11:24:03.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.507763+0000", 2024-04-26T11:24:03.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.507762+0000", 2024-04-26T11:24:03.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512432+0000", 2024-04-26T11:24:03.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046691620000000001 2024-04-26T11:24:03.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512444+0000", 2024-04-26T11:24:03.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2135e-05 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512451+0000", 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9739999999999996e-06 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512506+0000", 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5139000000000002e-05 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512627+0000", 2024-04-26T11:24:03.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000121401 2024-04-26T11:24:03.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:03.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512752+0000", 2024-04-26T11:24:03.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012493899999999999 2024-04-26T11:24:03.528 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:14164 4.14 4:2b654b97:::100000031da.00000000:head [write 1896710~84109 [2@244349] in=84109b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:03.512466+0000", 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0054800300000000003, 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055632930000000004, 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:24:03.529 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 14164 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512466+0000", 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512466+0000", 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512465+0000", 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512522+0000", 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6830000000000003e-05 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512532+0000", 2024-04-26T11:24:03.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8190000000000003e-06 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512539+0000", 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7279999999999998e-06 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512615+0000", 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6693000000000006e-05 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512688+0000", 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2430999999999998e-05 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512815+0000", 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012769600000000001 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:14166 4.2b 4:d4915728:::10000003524.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:03.533 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:03.512587+0000", 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0053594200000000002, 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055170599999999998, 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 14166 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512587+0000", 2024-04-26T11:24:03.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512587+0000", 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512586+0000", 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512589+0000", 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6910000000000002e-06 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512598+0000", 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0580000000000004e-06 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512605+0000", 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.25e-06 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512661+0000", 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5940000000000003e-05 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512730+0000", 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9459e-05 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:14168 4.3a 4:5cf99e62:::10000003635.00000000:head [write 1127712~14872 in=14872b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:03.537 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:03.512629+0000", 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0053174499999999996, 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.005513792, 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 14168 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512629+0000", 2024-04-26T11:24:03.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512629+0000", 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512628+0000", 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512654+0000", 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5778e-05 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512662+0000", 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0660000000000004e-06 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512667+0000", 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5520000000000004e-06 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512703+0000", 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5129999999999997e-05 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512863+0000", 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000160211 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.541 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:2170 3.8 3:17051619:::200.0000000f:head [write 3663689~7692 [fadvise_dontneed] in=7692b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:03.512768+0000", 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0051784559999999997, 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054383310000000002, 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512768+0000", 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512768+0000", 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512767+0000", 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512777+0000", 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.043e-05 2024-04-26T11:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512786+0000", 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0890000000000006e-06 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.512793+0000", 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5089999999999999e-06 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.513382+0000", 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00058912899999999998 2024-04-26T11:24:03.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.513480+0000", 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7924999999999995e-05 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.513599+0000", 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011907499999999999 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.518164+0000", 2024-04-26T11:24:03.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045646439999999996 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:14176 4.29 4:9726b73d:::100000034fc.00000000:head [read 1048576~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:03.515198+0000", 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.002748314, 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0030491329999999999, 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:24:03.546 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 14176 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.515198+0000", 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.515198+0000", 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.515196+0000", 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.515203+0000", 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6050000000000003e-06 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.515215+0000", 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1612e-05 2024-04-26T11:24:03.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.515223+0000", 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6969999999999999e-06 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.515276+0000", 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3168999999999999e-05 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.515385+0000", 2024-04-26T11:24:03.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010888 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:14178 4.3a 4:5fc9800b:::100000034ce.00000000:head [read 131072~131072 [3@1061783] out=131072b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:03.516427+0000", 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.001519304, 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018584160000000001, 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:24:03.550 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 14178 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.516427+0000", 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.516427+0000", 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.516426+0000", 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.516431+0000", 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5700000000000003e-06 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.516440+0000", 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6649999999999998e-06 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.516445+0000", 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6299999999999997e-06 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.516473+0000", 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8348e-05 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.516516+0000", 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2329000000000001e-05 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:14180 4.1c 4:382a09f9:::10000003588.00000000:head [read 0~131072] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:03.517834+0000", 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.000111828, 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00050848199999999999, 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:24:03.554 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 14180 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.517834+0000", 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.517834+0000", 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.517834+0000", 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.517837+0000", 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8600000000000001e-06 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.517844+0000", 2024-04-26T11:24:03.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0639999999999996e-06 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.517857+0000", 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3164e-05 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.517900+0000", 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3619999999999999e-05 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:03.517994+0000", 2024-04-26T11:24:03.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3874000000000003e-05 2024-04-26T11:24:03.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.558 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.558 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-26T11:24:03.558 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 8 2024-04-26T11:24:03.558 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:03.560 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:03.565 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:03.556+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:03.569 INFO:tasks.workunit.client.0.smithi073.stdout:1/817: dread d1/d73/d40/d44/f9e [0,4194304] 0 2024-04-26T11:24:03.569 INFO:tasks.workunit.client.0.smithi073.stdout:9/755: mknod d0/d6c/c101 0 2024-04-26T11:24:03.569 INFO:tasks.workunit.client.0.smithi073.stdout:1/818: fsync d1/d16/d4f/d55/d5a/f7a 0 2024-04-26T11:24:03.569 INFO:tasks.workunit.client.0.smithi073.stdout:5/742: symlink d4/de/d23/l109 0 2024-04-26T11:24:03.569 INFO:tasks.workunit.client.0.smithi073.stdout:5/743: sync 2024-04-26T11:24:03.569 INFO:tasks.workunit.client.0.smithi073.stdout:9/756: fsync d0/d13/d25/d2c/f3a 0 2024-04-26T11:24:03.569 INFO:tasks.workunit.client.0.smithi073.stdout:2/722: write dd/de/d2a/f5b [740988,15764] 0 2024-04-26T11:24:03.569 INFO:tasks.workunit.client.0.smithi073.stdout:1/819: truncate d1/d16/d4f/d55/da2/dcd/ffd 581511 0 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:5/744: rename d4/d8/d9/d7d/da3/ddc/f16 to d4/de/d15/d67/d103/d105/f10a 0 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:2/723: unlink dd/d4c/d48/d77/c8a 0 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:1/820: rename d1/d6/c4b to d1/d8/dfb/c110 0 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:1/821: creat d1/d6/d7f/d47/f111 x:0 0 0 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:2/724: rename dd/de/d38/f70 to dd/de/d38/d53/d60/db2/fdb 0 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:7/781: dwrite d1/d33/ff [0,4194304] 0 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:5/745: link d4/de/fcc d4/d8/d9/d7d/d84/da7/db7/dcd/dd4/f10b 0 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:1/822: chown d1/d73/d34/f7e 2974 1 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:7/782: fsync d1/d11/d24/d29/dd7/d4b/f56 0 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:5/746: chown d4/d8/d9/d7d/d84/fde 11 1 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:6/694: dread d0/d19/d20/f65 [0,4194304] 0 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:2/725: creat dd/d4c/d48/d46/fdc x:0 0 0 2024-04-26T11:24:03.570 INFO:tasks.workunit.client.0.smithi073.stdout:9/757: dwrite d0/d13/d5a/d65/f77 [0,4194304] 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:4/806: dread d8/d14/f93 [0,4194304] 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:3/734: dread d0/d11/d19/db/d3e/d3f/f59 [0,4194304] 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:1/823: rename d1/d16/d4f/d84 to d1/d73/d40/d54/d112 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:5/747: fsync d4/de/d15/d33/f8f 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:4/807: unlink d8/d1a/d1b/d24/dac/c39 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:6/695: mknod d0/d1a/d26/d4b/cd1 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:9/758: mkdir d0/d13/d5a/d102 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:7/783: dwrite d1/d11/d24/d29/dd7/d3d/d41/d64/f4c [0,4194304] 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:9/759: readlink d0/d1a/d4e/lb6 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:5/748: write d4/de/f10 [2455441,106807] 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:1/824: unlink d1/d6/d7f/cd8 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:2/726: dwrite dd/d4c/f78 [0,4194304] 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:9/760: read d0/d13/d25/d2c/dbf/fc6 [1313084,43166] 0 2024-04-26T11:24:03.571 INFO:tasks.workunit.client.0.smithi073.stdout:6/696: mkdir d0/d1a/d26/d4b/d63/da0/dd2 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:4/808: creat d8/d1a/d1b/d24/dac/d49/f11a x:0 0 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:5/749: creat d4/d8/d8e/f10c x:0 0 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:2/727: mkdir dd/d27/da0/da7/ddd 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:7/784: link d1/d11/d5e/d8f/f91 d1/d11/d51/dfb/f10f 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:3/735: creat d0/d11/d19/db/da6/d8b/dc9/ffa x:0 0 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/697: readlink d0/d1a/d26/l7f 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:5/750: chown d4/de/d15/d67/fe1 24 1 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:7/785: dread - d1/d11/d24/d71/d90/fb6 zero size 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:4/809: readlink d8/d1a/d5e/d7c/lef 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:4/810: readlink d8/d15/l8f 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:6/698: creat d0/d15/d9a/fd3 x:0 0 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:5/751: mkdir d4/d73/d8a/dc8/d10d 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:2/728: link dd/d4c/f78 dd/fde 0 2024-04-26T11:24:03.572 INFO:tasks.workunit.client.0.smithi073.stdout:4/811: write d8/d14/fd7 [960822,13343] 0 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:7/786: getdents d1/d33 0 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:2/729: mknod dd/d4c/d48/d77/cdf 0 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:4/812: rmdir d8/d1a/d1b/d24/dac/d72 39 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:5/752: write d4/d8/d9/d42/fb3 [1430790,19808] 0 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:5/753: sync 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:7/787: write d1/d11/d24/d71/d90/fb6 [707442,57195] 0 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:2/730: mknod dd/d27/da0/da7/ddd/ce0 0 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:7/788: write d1/d11/f98 [610256,67664] 0 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:5/754: rename d4/d73/d8a/dc8/lca to d4/d8/d9/d7d/da3/l10e 0 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:3/736: dwrite d0/d11/d19/f71 [0,4194304] 0 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:2/731: mkdir dd/de/d2a/dbc/de1 0 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:2/732: fsync fb 0 2024-04-26T11:24:03.573 INFO:tasks.workunit.client.0.smithi073.stdout:3/737: mkdir d0/d11/d19/db/df0/dfb 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:3/738: mknod d0/d11/d19/cfc 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:3/739: stat d0/d34/f66 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:3/740: readlink d0/d11/d19/db/d3e/l2f 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:2/733: dread dd/d4c/d48/d46/d91/d9f/d1d/fbd [0,4194304] 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:1/825: dread d1/d8/d5d/f70 [0,4194304] 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:3/741: creat d0/d11/ffd x:0 0 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:0/749: dread d2/d1f/d40/f82 [0,4194304] 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:2/734: mknod dd/d4c/d48/d46/d91/da5/ce2 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:4/813: dwrite d8/d1a/d1b/d24/dac/d49/d85/d8b/f65 [0,4194304] 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:2/735: stat f6 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:3/742: creat d0/d11/d19/ffe x:0 0 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:1/826: mkdir d1/d16/d4f/d55/d5a/d113 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:0/750: mknod d2/d37/d3c/d73/c10a 0 2024-04-26T11:24:03.574 INFO:tasks.workunit.client.0.smithi073.stdout:3/743: stat d0/fa 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:1/827: unlink d1/d51/f7d 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:4/814: creat d8/d1a/d5e/dc5/f11b x:0 0 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:2/736: truncate dd/de/d2a/f87 30163 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:4/815: mknod d8/d1f/c11c 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:1/828: mknod d1/d73/d34/d98/daa/c114 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:5/755: dwrite d4/d8/d9/d7d/d84/da7/fd8 [0,4194304] 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:1/829: write d1/d73/d34/f78 [21614,114549] 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:8/775: dread d1/d4/d37/dd3/de8/fa4 [0,4194304] 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:2/737: getdents dd/de/d6b/dc1 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:1/830: chown d1/d73/d40/d44/d8e/f9a 154558 1 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:7/789: fsync d1/d11/d24/d29/dd7/d3d/d41/d64/f4c 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:4/816: mknod d8/d1a/d5e/dc5/dfb/dfd/c11d 0 2024-04-26T11:24:03.575 INFO:tasks.workunit.client.0.smithi073.stdout:8/776: symlink d1/d4/d4c/d66/l10c 0 2024-04-26T11:24:03.577 INFO:tasks.workunit.client.0.smithi073.stdout:7/790: write d1/f5 [4222163,69095] 0 2024-04-26T11:24:03.577 INFO:tasks.workunit.client.0.smithi073.stdout:1/831: creat d1/d16/d61/dfe/f115 x:0 0 0 2024-04-26T11:24:03.577 INFO:tasks.workunit.client.0.smithi073.stdout:0/751: dwrite d2/d37/d3c/d6a/fca [0,4194304] 0 2024-04-26T11:24:03.577 INFO:tasks.workunit.client.0.smithi073.stdout:2/738: creat dd/de/d38/d53/dc3/dd3/fe3 x:0 0 0 2024-04-26T11:24:03.577 INFO:tasks.workunit.client.0.smithi073.stdout:4/817: mknod d8/d1a/d5e/d7c/c11e 0 2024-04-26T11:24:03.578 INFO:tasks.workunit.client.0.smithi073.stdout:2/739: dread dd/de/d6b/f61 [0,4194304] 0 2024-04-26T11:24:03.578 INFO:tasks.workunit.client.0.smithi073.stdout:5/756: dwrite d4/d8/dff/f108 [0,4194304] 0 2024-04-26T11:24:03.578 INFO:tasks.workunit.client.0.smithi073.stdout:2/740: write dd/de/d49/dbb/fc0 [244930,10419] 0 2024-04-26T11:24:03.578 INFO:tasks.workunit.client.0.smithi073.stdout:7/791: write d1/d33/d68/fad [3354293,7586] 0 2024-04-26T11:24:03.578 INFO:tasks.workunit.client.0.smithi073.stdout:7/792: write d1/d33/d68/faa [1085780,92088] 0 2024-04-26T11:24:03.578 INFO:tasks.workunit.client.0.smithi073.stdout:8/777: truncate d1/d4/d7b/d8d/fc8 316208 0 2024-04-26T11:24:03.578 INFO:tasks.workunit.client.0.smithi073.stdout:0/752: rename d2/d37/f79 to d2/d1f/d40/d48/da9/dd8/f10b 0 2024-04-26T11:24:03.578 INFO:tasks.workunit.client.0.smithi073.stdout:2/741: unlink dd/de/d2a/f83 0 2024-04-26T11:24:03.578 INFO:tasks.workunit.client.0.smithi073.stdout:1/832: creat d1/d8/d5d/ddf/f116 x:0 0 0 2024-04-26T11:24:03.579 INFO:tasks.workunit.client.0.smithi073.stdout:7/793: creat d1/d11/d10/f110 x:0 0 0 2024-04-26T11:24:03.579 INFO:tasks.workunit.client.0.smithi073.stdout:0/753: mknod d2/d1f/d40/c10c 0 2024-04-26T11:24:03.579 INFO:tasks.workunit.client.0.smithi073.stdout:8/778: write d1/d4/d37/dd3/de8/fef [944314,80950] 0 2024-04-26T11:24:03.579 INFO:tasks.workunit.client.0.smithi073.stdout:1/833: write d1/d73/d34/f7e [4426594,52125] 0 2024-04-26T11:24:03.579 INFO:tasks.workunit.client.0.smithi073.stdout:5/757: write d4/d8/d9/d7d/d84/da7/db7/dcd/df1/df3/f102 [5057330,80184] 0 2024-04-26T11:24:03.579 INFO:tasks.workunit.client.0.smithi073.stdout:2/742: write dd/d4c/d48/d46/d91/d9f/d1d/f35 [1326365,126500] 0 2024-04-26T11:24:03.581 INFO:tasks.workunit.client.0.smithi073.stdout:9/761: dread d0/d13/d25/d2c/f33 [4194304,4194304] 0 2024-04-26T11:24:03.581 INFO:tasks.workunit.client.0.smithi073.stdout:6/699: dread d0/dc/f64 [0,4194304] 0 2024-04-26T11:24:03.581 INFO:tasks.workunit.client.0.smithi073.stdout:9/762: fdatasync d0/d1a/d4e/d70/dd6/ff9 0 2024-04-26T11:24:03.581 INFO:tasks.workunit.client.0.smithi073.stdout:0/754: mkdir d2/d22/d51/d57/d78/d10d 0 2024-04-26T11:24:03.583 INFO:tasks.workunit.client.0.smithi073.stdout:1/834: creat d1/d73/d40/d54/f117 x:0 0 0 2024-04-26T11:24:03.583 INFO:tasks.workunit.client.0.smithi073.stdout:8/779: creat d1/f10d x:0 0 0 2024-04-26T11:24:03.583 INFO:tasks.workunit.client.0.smithi073.stdout:9/763: truncate d0/d1a/f36 5119686 0 2024-04-26T11:24:03.583 INFO:tasks.workunit.client.0.smithi073.stdout:2/743: chown dd/d27/cd4 2497466 1 2024-04-26T11:24:03.583 INFO:tasks.workunit.client.0.smithi073.stdout:7/794: getdents d1/d33/d1b 0 2024-04-26T11:24:03.583 INFO:tasks.workunit.client.0.smithi073.stdout:9/764: unlink d0/d13/d25/d2c/c4c 0 2024-04-26T11:24:03.583 INFO:tasks.workunit.client.0.smithi073.stdout:1/835: creat d1/d8/d5d/d89/de6/f118 x:0 0 0 2024-04-26T11:24:03.584 INFO:tasks.workunit.client.0.smithi073.stdout:2/744: write dd/d4c/d48/d46/d91/d9f/d1d/d8c/f99 [905000,80614] 0 2024-04-26T11:24:03.584 INFO:tasks.workunit.client.0.smithi073.stdout:9/765: readlink d0/d1a/d4e/d8f/lba 0 2024-04-26T11:24:03.584 INFO:tasks.workunit.client.0.smithi073.stdout:7/795: mknod d1/d11/d24/d29/dd7/d3d/c111 0 2024-04-26T11:24:03.584 INFO:tasks.workunit.client.0.smithi073.stdout:1/836: creat d1/d6/db3/d9f/f119 x:0 0 0 2024-04-26T11:24:03.585 INFO:tasks.workunit.client.0.smithi073.stdout:7/796: symlink d1/d33/l112 0 2024-04-26T11:24:03.585 INFO:tasks.workunit.client.0.smithi073.stdout:1/837: rmdir d1/d6/d7f/d8f/de9 39 2024-04-26T11:24:03.585 INFO:tasks.workunit.client.0.smithi073.stdout:9/766: symlink d0/d13/d5a/d102/l103 0 2024-04-26T11:24:03.585 INFO:tasks.workunit.client.0.smithi073.stdout:5/758: dwrite d4/ff5 [0,4194304] 0 2024-04-26T11:24:03.586 INFO:tasks.workunit.client.0.smithi073.stdout:2/745: creat dd/d4c/d48/d46/d91/d9f/d1d/fe4 x:0 0 0 2024-04-26T11:24:03.586 INFO:tasks.workunit.client.0.smithi073.stdout:4/818: truncate d8/d1a/d1b/d24/f4a 4035302 0 2024-04-26T11:24:03.587 INFO:tasks.workunit.client.0.smithi073.stdout:7/797: symlink d1/d11/d5e/d8f/l113 0 2024-04-26T11:24:03.587 INFO:tasks.workunit.client.0.smithi073.stdout:5/759: rmdir d4/d95 39 2024-04-26T11:24:03.587 INFO:tasks.workunit.client.0.smithi073.stdout:9/767: mkdir d0/d3c/d104 0 2024-04-26T11:24:03.587 INFO:tasks.workunit.client.0.smithi073.stdout:2/746: chown la 336921917 1 2024-04-26T11:24:03.587 INFO:tasks.workunit.client.0.smithi073.stdout:1/838: mkdir d1/d6/d7f/d8f/de9/d11a 0 2024-04-26T11:24:03.588 INFO:tasks.workunit.client.0.smithi073.stdout:7/798: dread - d1/d11/d24/fe8 zero size 2024-04-26T11:24:03.588 INFO:tasks.workunit.client.0.smithi073.stdout:5/760: mkdir d4/de/d15/d67/d103/d105/d10f 0 2024-04-26T11:24:03.588 INFO:tasks.workunit.client.0.smithi073.stdout:9/768: write d0/d6c/dc7/fce [216996,126982] 0 2024-04-26T11:24:03.591 INFO:tasks.workunit.client.0.smithi073.stdout:9/769: symlink d0/d1a/d4e/d70/dd6/l105 0 2024-04-26T11:24:03.591 INFO:tasks.workunit.client.0.smithi073.stdout:5/761: creat d4/de/dc6/f110 x:0 0 0 2024-04-26T11:24:03.591 INFO:tasks.workunit.client.0.smithi073.stdout:1/839: creat d1/d8/f11b x:0 0 0 2024-04-26T11:24:03.593 INFO:tasks.workunit.client.0.smithi073.stdout:5/762: creat d4/d8/dff/f111 x:0 0 0 2024-04-26T11:24:03.596 INFO:tasks.workunit.client.0.smithi073.stdout:4/819: dwrite d8/d1a/d9c/d9d/fae [0,4194304] 0 2024-04-26T11:24:03.596 INFO:tasks.workunit.client.0.smithi073.stdout:2/747: dwrite dd/d4c/d48/f90 [0,4194304] 0 2024-04-26T11:24:03.598 INFO:tasks.workunit.client.0.smithi073.stdout:4/820: truncate d8/d1a/d1b/d24/dac/d49/d84/f97 1179458 0 2024-04-26T11:24:03.598 INFO:tasks.workunit.client.0.smithi073.stdout:5/763: rename d4/d95/da5/fa8 to d4/d73/d8a/dc8/f112 0 2024-04-26T11:24:03.598 INFO:tasks.workunit.client.0.smithi073.stdout:1/840: link d1/d16/d61/dfe/f115 d1/d6/d7f/d8f/de9/f11c 0 2024-04-26T11:24:03.598 INFO:tasks.workunit.client.0.smithi073.stdout:7/799: dwrite d1/d11/d24/d29/dd7/ffe [0,4194304] 0 2024-04-26T11:24:03.599 INFO:tasks.workunit.client.0.smithi073.stdout:2/748: link dd/de/d38/d4e/l56 dd/d4c/d48/d46/d91/d9f/d1d/le5 0 2024-04-26T11:24:03.599 INFO:tasks.workunit.client.0.smithi073.stdout:1/841: link d1/d73/d40/d54/d112/fa5 d1/d16/d4f/dd5/f11d 0 2024-04-26T11:24:03.600 INFO:tasks.workunit.client.0.smithi073.stdout:5/764: rename d4/d8/d9/d42/f4a to d4/d8/d9/d7d/d84/da7/db7/dcd/dd4/f113 0 2024-04-26T11:24:03.600 INFO:tasks.workunit.client.0.smithi073.stdout:7/800: mkdir d1/d33/d68/d78/daf/d114 0 2024-04-26T11:24:03.600 INFO:tasks.workunit.client.0.smithi073.stdout:5/765: mknod d4/de/dc6/c114 0 2024-04-26T11:24:03.601 INFO:tasks.workunit.client.0.smithi073.stdout:7/801: symlink d1/d11/d24/d29/dd7/d3d/d7c/l115 0 2024-04-26T11:24:03.609 INFO:tasks.workunit.client.0.smithi073.stdout:5/766: truncate d4/d8/d9/d42/fb3 835961 0 2024-04-26T11:24:03.614 INFO:tasks.workunit.client.0.smithi073.stdout:3/744: sync 2024-04-26T11:24:03.615 INFO:tasks.workunit.client.0.smithi073.stdout:3/745: creat d0/d2d/fff x:0 0 0 2024-04-26T11:24:03.617 INFO:tasks.workunit.client.0.smithi073.stdout:1/842: dread d1/d16/d4f/dd5/fd0 [0,4194304] 0 2024-04-26T11:24:03.618 INFO:tasks.workunit.client.0.smithi073.stdout:1/843: dread - d1/d6/db3/d9f/fa1 zero size 2024-04-26T11:24:03.618 INFO:tasks.workunit.client.0.smithi073.stdout:3/746: rename d0/d11/d19/db/ddc/f7f to d0/d11/d19/db/da6/d7a/dce/f100 0 2024-04-26T11:24:03.619 INFO:tasks.workunit.client.0.smithi073.stdout:9/770: dread d0/d83/f86 [0,4194304] 0 2024-04-26T11:24:03.623 INFO:tasks.workunit.client.0.smithi073.stdout:2/749: dread dd/d4c/d48/d46/d91/d9f/d1d/f81 [0,4194304] 0 2024-04-26T11:24:03.625 INFO:tasks.workunit.client.0.smithi073.stdout:4/821: dread d8/f13 [0,4194304] 0 2024-04-26T11:24:03.632 INFO:tasks.workunit.client.0.smithi073.stdout:5/767: dread d4/de/d15/f9e [0,4194304] 0 2024-04-26T11:24:03.632 INFO:tasks.workunit.client.0.smithi073.stdout:4/822: dwrite d8/d1a/d1b/d24/dac/d49/d85/d8b/f66 [0,4194304] 0 2024-04-26T11:24:03.632 INFO:tasks.workunit.client.0.smithi073.stdout:0/755: sync 2024-04-26T11:24:03.632 INFO:tasks.workunit.client.0.smithi073.stdout:8/780: sync 2024-04-26T11:24:03.633 INFO:tasks.workunit.client.0.smithi073.stdout:6/700: sync 2024-04-26T11:24:03.633 INFO:tasks.workunit.client.0.smithi073.stdout:5/768: fdatasync d4/d73/feb 0 2024-04-26T11:24:03.633 INFO:tasks.workunit.client.0.smithi073.stdout:4/823: stat d8/d14/d60 0 2024-04-26T11:24:03.634 INFO:tasks.workunit.client.0.smithi073.stdout:8/781: creat d1/d4/d37/f10e x:0 0 0 2024-04-26T11:24:03.634 INFO:tasks.workunit.client.0.smithi073.stdout:5/769: symlink d4/df8/l115 0 2024-04-26T11:24:03.635 INFO:tasks.workunit.client.0.smithi073.stdout:8/782: write d1/d4/d37/f10e [72753,120513] 0 2024-04-26T11:24:03.635 INFO:tasks.workunit.client.0.smithi073.stdout:4/824: chown d8/d1a/d1b/d24/dac/d72/fca 68129 1 2024-04-26T11:24:03.635 INFO:tasks.workunit.client.0.smithi073.stdout:7/802: dread d1/d11/d24/d29/dd7/d3d/f9e [0,4194304] 0 2024-04-26T11:24:03.635 INFO:tasks.workunit.client.0.smithi073.stdout:5/770: chown d4/de/d15/d33 62977932 1 2024-04-26T11:24:03.636 INFO:tasks.workunit.client.0.smithi073.stdout:5/771: creat d4/d8/d9/d7d/da3/ddc/dee/f116 x:0 0 0 2024-04-26T11:24:03.637 INFO:tasks.workunit.client.0.smithi073.stdout:8/783: getdents d1/d4/d15 0 2024-04-26T11:24:03.641 INFO:tasks.workunit.client.0.smithi073.stdout:0/756: truncate d2/d1f/d40/d48/f52 90860 0 2024-04-26T11:24:03.642 INFO:tasks.workunit.client.0.smithi073.stdout:5/772: dread d4/de/d15/d33/f4e [0,4194304] 0 2024-04-26T11:24:03.642 INFO:tasks.workunit.client.0.smithi073.stdout:7/803: dwrite d1/d11/d24/d71/d90/f9f [0,4194304] 0 2024-04-26T11:24:03.642 INFO:tasks.workunit.client.0.smithi073.stdout:9/771: dread d0/fa7 [0,4194304] 0 2024-04-26T11:24:03.643 INFO:tasks.workunit.client.0.smithi073.stdout:8/784: dread d1/d4/d7b/ff5 [0,4194304] 0 2024-04-26T11:24:03.643 INFO:tasks.workunit.client.0.smithi073.stdout:5/773: mkdir d4/d8/d9/d7d/da3/ddc/d117 0 2024-04-26T11:24:03.644 INFO:tasks.workunit.client.0.smithi073.stdout:8/785: write d1/d4/d37/dd3/de8/fef [1349694,37928] 0 2024-04-26T11:24:03.644 INFO:tasks.workunit.client.0.smithi073.stdout:5/774: creat d4/de/d15/d67/d103/d105/d10f/f118 x:0 0 0 2024-04-26T11:24:03.645 INFO:tasks.workunit.client.0.smithi073.stdout:5/775: chown d4/f1f 43510 1 2024-04-26T11:24:03.648 INFO:tasks.workunit.client.0.smithi073.stdout:1/844: dread d1/f1a [0,4194304] 0 2024-04-26T11:24:03.649 INFO:tasks.workunit.client.0.smithi073.stdout:5/776: symlink d4/d8/d9/d7d/d84/da7/db7/dcd/dd4/l119 0 2024-04-26T11:24:03.651 INFO:tasks.workunit.client.0.smithi073.stdout:8/786: truncate d1/d4/d15/de4/dfc/d2c/ddd/d67/fb8 124807 0 2024-04-26T11:24:03.658 INFO:tasks.workunit.client.0.smithi073.stdout:1/845: chown d1/d16/d6a/f100 533287550 1 2024-04-26T11:24:03.658 INFO:tasks.workunit.client.0.smithi073.stdout:7/804: dwrite d1/d11/fb4 [0,4194304] 0 2024-04-26T11:24:03.658 INFO:tasks.workunit.client.0.smithi073.stdout:9/772: dwrite d0/d13/d25/fe4 [0,4194304] 0 2024-04-26T11:24:03.659 INFO:tasks.workunit.client.0.smithi073.stdout:0/757: dwrite d2/d22/d51/d57/d78/fa3 [0,4194304] 0 2024-04-26T11:24:03.659 INFO:tasks.workunit.client.0.smithi073.stdout:4/825: dwrite d8/d1a/d1b/d24/dac/d49/f6c [0,4194304] 0 2024-04-26T11:24:03.659 INFO:tasks.workunit.client.0.smithi073.stdout:5/777: rename d4/de/l6d to d4/d95/l11a 0 2024-04-26T11:24:03.660 INFO:tasks.workunit.client.0.smithi073.stdout:8/787: chown d1/f18 20545 1 2024-04-26T11:24:03.660 INFO:tasks.workunit.client.0.smithi073.stdout:9/773: readlink d0/d13/db/le 0 2024-04-26T11:24:03.660 INFO:tasks.workunit.client.0.smithi073.stdout:7/805: rename d1/d11/d24/d29/dd7/d80/da0/dd2/led to d1/ddc/l116 0 2024-04-26T11:24:03.660 INFO:tasks.workunit.client.0.smithi073.stdout:5/778: creat d4/de/d15/d67/d103/f11b x:0 0 0 2024-04-26T11:24:03.660 INFO:tasks.workunit.client.0.smithi073.stdout:9/774: mknod d0/d13/d5a/c106 0 2024-04-26T11:24:03.661 INFO:tasks.workunit.client.0.smithi073.stdout:7/806: unlink d1/d11/d24/d29/dd7/d4b/l99 0 2024-04-26T11:24:03.661 INFO:tasks.workunit.client.0.smithi073.stdout:9/775: link d0/d13/db/fc0 d0/d13/d5a/db2/de1/f107 0 2024-04-26T11:24:03.661 INFO:tasks.workunit.client.0.smithi073.stdout:4/826: creat d8/d1a/d5e/dc5/dfb/f11f x:0 0 0 2024-04-26T11:24:03.661 INFO:tasks.workunit.client.0.smithi073.stdout:7/807: creat d1/d11/d5e/f117 x:0 0 0 2024-04-26T11:24:03.661 INFO:tasks.workunit.client.0.smithi073.stdout:9/776: rmdir d0/d3c 39 2024-04-26T11:24:03.662 INFO:tasks.workunit.client.0.smithi073.stdout:4/827: readlink d8/d1a/d1b/d24/lec 0 2024-04-26T11:24:03.666 INFO:tasks.workunit.client.0.smithi073.stdout:4/828: mknod d8/d1a/d5e/dc5/dfb/c120 0 2024-04-26T11:24:03.667 INFO:tasks.workunit.client.0.smithi073.stdout:9/777: symlink d0/d13/d25/d75/d8e/l108 0 2024-04-26T11:24:03.667 INFO:tasks.workunit.client.0.smithi073.stdout:7/808: creat d1/d11/d24/d29/dd7/d3d/d41/d64/dae/f118 x:0 0 0 2024-04-26T11:24:03.667 INFO:tasks.workunit.client.0.smithi073.stdout:4/829: creat d8/d1a/d1b/d46/d57/f121 x:0 0 0 2024-04-26T11:24:03.667 INFO:tasks.workunit.client.0.smithi073.stdout:0/758: dread d2/f53 [0,4194304] 0 2024-04-26T11:24:03.667 INFO:tasks.workunit.client.0.smithi073.stdout:1/846: dread d1/d8/d2e/fe8 [0,4194304] 0 2024-04-26T11:24:03.667 INFO:tasks.workunit.client.0.smithi073.stdout:0/759: creat d2/d22/d51/d57/d78/f10e x:0 0 0 2024-04-26T11:24:03.668 INFO:tasks.workunit.client.0.smithi073.stdout:1/847: mkdir d1/d16/d4f/d55/d5a/dc6/d11e 0 2024-04-26T11:24:03.668 INFO:tasks.workunit.client.0.smithi073.stdout:1/848: mkdir d1/d8/d5d/ddf/d11f 0 2024-04-26T11:24:03.668 INFO:tasks.workunit.client.0.smithi073.stdout:0/760: rename d2/d22/f95 to d2/d1f/d9c/db1/f10f 0 2024-04-26T11:24:03.668 INFO:tasks.workunit.client.0.smithi073.stdout:1/849: creat d1/d8/d5d/d89/de6/f120 x:0 0 0 2024-04-26T11:24:03.668 INFO:tasks.workunit.client.0.smithi073.stdout:0/761: mkdir d2/d110 0 2024-04-26T11:24:03.669 INFO:tasks.workunit.client.0.smithi073.stdout:0/762: mknod d2/d1f/d9c/c111 0 2024-04-26T11:24:03.671 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:03.660+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:03.672 INFO:tasks.workunit.client.0.smithi073.stdout:1/850: creat d1/d73/d34/d98/daa/f121 x:0 0 0 2024-04-26T11:24:03.672 INFO:tasks.workunit.client.0.smithi073.stdout:4/830: dwrite d8/d1a/d1b/d24/fcd [0,4194304] 0 2024-04-26T11:24:03.673 INFO:tasks.workunit.client.0.smithi073.stdout:1/851: truncate d1/d16/d4f/dd5/f93 1138958 0 2024-04-26T11:24:03.673 INFO:tasks.workunit.client.0.smithi073.stdout:4/831: creat d8/d1a/d1b/d24/f122 x:0 0 0 2024-04-26T11:24:03.673 INFO:tasks.workunit.client.0.smithi073.stdout:1/852: fsync d1/d8/f2d 0 2024-04-26T11:24:03.673 INFO:tasks.workunit.client.0.smithi073.stdout:4/832: write d8/d1a/d1b/d24/dac/d72/d77/d96/fea [283194,14936] 0 2024-04-26T11:24:03.674 INFO:tasks.workunit.client.0.smithi073.stdout:9/778: dread d0/f10 [0,4194304] 0 2024-04-26T11:24:03.675 INFO:tasks.workunit.client.0.smithi073.stdout:9/779: readlink d0/d6c/dc7/lef 0 2024-04-26T11:24:03.675 INFO:tasks.workunit.client.0.smithi073.stdout:9/780: rmdir d0/d13/d5a/db2 39 2024-04-26T11:24:03.677 INFO:tasks.workunit.client.0.smithi073.stdout:1/853: dwrite d1/d8/f2d [0,4194304] 0 2024-04-26T11:24:03.677 INFO:tasks.workunit.client.0.smithi073.stdout:9/781: write d0/d13/db/f85 [122933,129549] 0 2024-04-26T11:24:03.678 INFO:tasks.workunit.client.0.smithi073.stdout:9/782: stat d0/d13/d25/d2c/c9e 0 2024-04-26T11:24:03.679 INFO:tasks.workunit.client.0.smithi073.stdout:0/763: dwrite d2/d22/f68 [4194304,4194304] 0 2024-04-26T11:24:03.681 INFO:tasks.workunit.client.0.smithi073.stdout:9/783: mkdir d0/d13/d5a/db2/de1/df5/d109 0 2024-04-26T11:24:03.681 INFO:tasks.workunit.client.0.smithi073.stdout:0/764: creat d2/d22/f112 x:0 0 0 2024-04-26T11:24:03.681 INFO:tasks.workunit.client.0.smithi073.stdout:9/784: chown d0/d13/d5a/d65 6193 1 2024-04-26T11:24:03.681 INFO:tasks.workunit.client.0.smithi073.stdout:0/765: creat d2/d1f/d40/d48/da9/dd8/f113 x:0 0 0 2024-04-26T11:24:03.685 INFO:tasks.workunit.client.0.smithi073.stdout:9/785: rmdir d0/d1a/d4e/d70/d46 39 2024-04-26T11:24:03.686 INFO:tasks.workunit.client.0.smithi073.stdout:9/786: dread - d0/d1a/d4e/ffc zero size 2024-04-26T11:24:03.686 INFO:tasks.workunit.client.0.smithi073.stdout:0/766: creat d2/d110/f114 x:0 0 0 2024-04-26T11:24:03.686 INFO:tasks.workunit.client.0.smithi073.stdout:9/787: mkdir d0/d1a/d4e/d70/d59/d10a 0 2024-04-26T11:24:03.686 INFO:tasks.workunit.client.0.smithi073.stdout:0/767: creat d2/d1f/d40/d48/da9/dd8/f115 x:0 0 0 2024-04-26T11:24:03.686 INFO:tasks.workunit.client.0.smithi073.stdout:0/768: dread - d2/d84/ffc zero size 2024-04-26T11:24:03.687 INFO:tasks.workunit.client.0.smithi073.stdout:9/788: mkdir d0/d1a/d4e/d10b 0 2024-04-26T11:24:03.687 INFO:tasks.workunit.client.0.smithi073.stdout:0/769: chown d2/d22/fd7 0 1 2024-04-26T11:24:03.687 INFO:tasks.workunit.client.0.smithi073.stdout:0/770: unlink d2/d1f/d40/c10c 0 2024-04-26T11:24:03.687 INFO:tasks.workunit.client.0.smithi073.stdout:0/771: write d2/d1f/d40/feb [875092,107993] 0 2024-04-26T11:24:03.688 INFO:tasks.workunit.client.0.smithi073.stdout:0/772: mkdir d2/d37/d3c/d116 0 2024-04-26T11:24:03.688 INFO:tasks.workunit.client.0.smithi073.stdout:8/788: dread d1/d4/d15/f75 [0,4194304] 0 2024-04-26T11:24:03.689 INFO:tasks.workunit.client.0.smithi073.stdout:0/773: fdatasync d2/d1f/d40/f5b 0 2024-04-26T11:24:03.689 INFO:tasks.workunit.client.0.smithi073.stdout:8/789: rename d1/d4/d15/de4/dfc/d2c/ddd/l25 to d1/d4/d15/dbc/l10f 0 2024-04-26T11:24:03.689 INFO:tasks.workunit.client.0.smithi073.stdout:0/774: getdents d2/d22/d51/d57/d78/de1 0 2024-04-26T11:24:03.690 INFO:tasks.workunit.client.0.smithi073.stdout:9/789: dwrite d0/d13/db/f23 [4194304,4194304] 0 2024-04-26T11:24:03.690 INFO:tasks.workunit.client.0.smithi073.stdout:4/833: dread d8/d1a/fe6 [0,4194304] 0 2024-04-26T11:24:03.691 INFO:tasks.workunit.client.0.smithi073.stdout:2/750: sync 2024-04-26T11:24:03.691 INFO:tasks.workunit.client.0.smithi073.stdout:3/747: sync 2024-04-26T11:24:03.691 INFO:tasks.workunit.client.0.smithi073.stdout:6/701: sync 2024-04-26T11:24:03.693 INFO:tasks.workunit.client.0.smithi073.stdout:9/790: unlink d0/d1a/d2f/l64 0 2024-04-26T11:24:03.693 INFO:tasks.workunit.client.0.smithi073.stdout:8/790: getdents d1/d4/d4c/dc4 0 2024-04-26T11:24:03.693 INFO:tasks.workunit.client.0.smithi073.stdout:9/791: dread - d0/d1a/d4e/ffa zero size 2024-04-26T11:24:03.693 INFO:tasks.workunit.client.0.smithi073.stdout:6/702: getdents d0/d1a/d26/d4b/d38 0 2024-04-26T11:24:03.695 INFO:tasks.workunit.client.0.smithi073.stdout:3/748: read d0/d11/d19/db/f15 [3914394,123606] 0 2024-04-26T11:24:03.695 INFO:tasks.workunit.client.0.smithi073.stdout:0/775: dwrite d2/d1f/d40/fef [0,4194304] 0 2024-04-26T11:24:03.696 INFO:tasks.workunit.client.0.smithi073.stdout:0/776: readlink d2/l6f 0 2024-04-26T11:24:03.698 INFO:tasks.workunit.client.0.smithi073.stdout:2/751: dwrite dd/de/d29/d98/fc9 [0,4194304] 0 2024-04-26T11:24:03.700 INFO:tasks.workunit.client.0.smithi073.stdout:9/792: dwrite d0/d13/d25/d2c/f33 [0,4194304] 0 2024-04-26T11:24:03.700 INFO:tasks.workunit.client.0.smithi073.stdout:1/854: dread d1/d73/d40/f2f [0,4194304] 0 2024-04-26T11:24:03.700 INFO:tasks.workunit.client.0.smithi073.stdout:4/834: write d8/d1a/f4f [1589676,113183] 0 2024-04-26T11:24:03.704 INFO:tasks.workunit.client.0.smithi073.stdout:0/777: rmdir d2/d22/d51/d57/d78 39 2024-04-26T11:24:03.704 INFO:tasks.workunit.client.0.smithi073.stdout:2/752: symlink dd/de/d2a/le6 0 2024-04-26T11:24:03.704 INFO:tasks.workunit.client.0.smithi073.stdout:4/835: unlink d8/d1a/d86/f98 0 2024-04-26T11:24:03.704 INFO:tasks.workunit.client.0.smithi073.stdout:3/749: creat d0/d11/d19/d70/daa/f101 x:0 0 0 2024-04-26T11:24:03.704 INFO:tasks.workunit.client.0.smithi073.stdout:2/753: readlink dd/d27/da0/da7/ld0 0 2024-04-26T11:24:03.704 INFO:tasks.workunit.client.0.smithi073.stdout:4/836: readlink d8/d1a/d1b/l94 0 2024-04-26T11:24:03.704 INFO:tasks.workunit.client.0.smithi073.stdout:4/837: write d8/d14/fd7 [1230498,84846] 0 2024-04-26T11:24:03.707 INFO:tasks.workunit.client.0.smithi073.stdout:2/754: dread dd/fde [0,4194304] 0 2024-04-26T11:24:03.707 INFO:tasks.workunit.client.0.smithi073.stdout:1/855: creat d1/d8/f122 x:0 0 0 2024-04-26T11:24:03.708 INFO:tasks.workunit.client.0.smithi073.stdout:9/793: creat d0/d3c/d104/f10c x:0 0 0 2024-04-26T11:24:03.709 INFO:tasks.workunit.client.0.smithi073.stdout:4/838: chown d8/d1a/d1b/d24/dac/d72/f80 18553 1 2024-04-26T11:24:03.709 INFO:tasks.workunit.client.0.smithi073.stdout:1/856: mknod d1/d16/d4f/dae/c123 0 2024-04-26T11:24:03.710 INFO:tasks.workunit.client.0.smithi073.stdout:0/778: dwrite d2/d1f/d40/d48/ff3 [0,4194304] 0 2024-04-26T11:24:03.710 INFO:tasks.workunit.client.0.smithi073.stdout:4/839: rmdir d8/d1a/d5e 39 2024-04-26T11:24:03.711 INFO:tasks.workunit.client.0.smithi073.stdout:1/857: dread - d1/d6/db3/fb9 zero size 2024-04-26T11:24:03.711 INFO:tasks.workunit.client.0.smithi073.stdout:3/750: dwrite d0/d11/d19/db/da6/d7a/ff1 [0,4194304] 0 2024-04-26T11:24:03.711 INFO:tasks.workunit.client.0.smithi073.stdout:3/751: stat d0/d11/d19/db/d3e/d47 0 2024-04-26T11:24:03.712 INFO:tasks.workunit.client.0.smithi073.stdout:4/840: rmdir d8/d15/da1/df2 39 2024-04-26T11:24:03.712 INFO:tasks.workunit.client.0.smithi073.stdout:1/858: mkdir d1/d16/d4f/d55/d5a/dc6/d124 0 2024-04-26T11:24:03.713 INFO:tasks.workunit.client.0.smithi073.stdout:3/752: rename d0/d11/d19/db/da6 to d0/d11/d19/d52/d102 0 2024-04-26T11:24:03.713 INFO:tasks.workunit.client.0.smithi073.stdout:4/841: write d8/d1f/f88 [1513659,55056] 0 2024-04-26T11:24:03.713 INFO:tasks.workunit.client.0.smithi073.stdout:0/779: getdents d2/d1f/d40/d48/dc1/dd6 0 2024-04-26T11:24:03.715 INFO:tasks.workunit.client.0.smithi073.stdout:1/859: write d1/d73/f1b [4260151,5727] 0 2024-04-26T11:24:03.716 INFO:tasks.workunit.client.0.smithi073.stdout:3/753: symlink d0/d2d/df6/l103 0 2024-04-26T11:24:03.716 INFO:tasks.workunit.client.0.smithi073.stdout:4/842: link d8/d1a/d86/ca0 d8/d1a/d1b/d24/c123 0 2024-04-26T11:24:03.716 INFO:tasks.workunit.client.0.smithi073.stdout:0/780: creat d2/d22/d51/d57/d78/f117 x:0 0 0 2024-04-26T11:24:03.717 INFO:tasks.workunit.client.0.smithi073.stdout:7/809: sync 2024-04-26T11:24:03.717 INFO:tasks.workunit.client.0.smithi073.stdout:5/779: sync 2024-04-26T11:24:03.717 INFO:tasks.workunit.client.0.smithi073.stdout:1/860: sync 2024-04-26T11:24:03.717 INFO:tasks.workunit.client.0.smithi073.stdout:2/755: dwrite dd/d4c/d48/d46/d91/d9f/d1d/f44 [0,4194304] 0 2024-04-26T11:24:03.717 INFO:tasks.workunit.client.0.smithi073.stdout:4/843: write d8/d15/f3e [570434,111155] 0 2024-04-26T11:24:03.717 INFO:tasks.workunit.client.0.smithi073.stdout:1/861: write d1/d73/f1b [5799091,22865] 0 2024-04-26T11:24:03.718 INFO:tasks.workunit.client.0.smithi073.stdout:2/756: fsync dd/d4c/d48/d46/d91/d9f/d1d/f15 0 2024-04-26T11:24:03.720 INFO:tasks.workunit.client.0.smithi073.stdout:7/810: creat d1/d11/d24/d71/d90/f119 x:0 0 0 2024-04-26T11:24:03.720 INFO:tasks.workunit.client.0.smithi073.stdout:4/844: creat d8/d1a/d4d/ddc/dde/f124 x:0 0 0 2024-04-26T11:24:03.721 INFO:tasks.workunit.client.0.smithi073.stdout:7/811: fdatasync d1/d11/d10/f9c 0 2024-04-26T11:24:03.722 INFO:tasks.workunit.client.0.smithi073.stdout:2/757: rename dd/de/c89 to dd/d27/da0/ce7 0 2024-04-26T11:24:03.722 INFO:tasks.workunit.client.0.smithi073.stdout:7/812: fdatasync d1/d33/d1b/fd3 0 2024-04-26T11:24:03.722 INFO:tasks.workunit.client.0.smithi073.stdout:4/845: link d8/d1a/d1b/d24/dac/c10a d8/d1a/d1b/d41/c125 0 2024-04-26T11:24:03.723 INFO:tasks.workunit.client.0.smithi073.stdout:2/758: link dd/de/d2a/f87 dd/de/d49/fe8 0 2024-04-26T11:24:03.724 INFO:tasks.workunit.client.0.smithi073.stdout:7/813: write d1/d11/d24/d29/dd7/d3d/d41/d64/f5f [1835623,59679] 0 2024-04-26T11:24:03.724 INFO:tasks.workunit.client.0.smithi073.stdout:0/781: getdents d2/d22/d51/d57/d78 0 2024-04-26T11:24:03.726 INFO:tasks.workunit.client.0.smithi073.stdout:2/759: rmdir dd/d4c/d48/d46/d91/d9f/d1d/d8c 39 2024-04-26T11:24:03.728 INFO:tasks.workunit.client.0.smithi073.stdout:4/846: dread d8/d1a/fe6 [4194304,4194304] 0 2024-04-26T11:24:03.728 INFO:tasks.workunit.client.0.smithi073.stdout:7/814: symlink d1/d11/d24/d29/dd7/d3d/d7c/de2/l11a 0 2024-04-26T11:24:03.728 INFO:tasks.workunit.client.0.smithi073.stdout:6/703: dread d0/d1a/d26/d4b/f7d [0,4194304] 0 2024-04-26T11:24:03.728 INFO:tasks.workunit.client.0.smithi073.stdout:2/760: creat dd/d27/fe9 x:0 0 0 2024-04-26T11:24:03.730 INFO:tasks.workunit.client.0.smithi073.stdout:9/794: dwrite d0/fdf [0,4194304] 0 2024-04-26T11:24:03.731 INFO:tasks.workunit.client.0.smithi073.stdout:5/780: dread d4/de/d15/d33/f8f [0,4194304] 0 2024-04-26T11:24:03.731 INFO:tasks.workunit.client.0.smithi073.stdout:9/795: write d0/f40 [2351532,103971] 0 2024-04-26T11:24:03.731 INFO:tasks.workunit.client.0.smithi073.stdout:8/791: dread d1/d4/d15/dbc/dc3/dc6/ddb/dfe/f108 [0,4194304] 0 2024-04-26T11:24:03.731 INFO:tasks.workunit.client.0.smithi073.stdout:5/781: truncate d4/d73/d8a/dc8/f112 238651 0 2024-04-26T11:24:03.733 INFO:tasks.workunit.client.0.smithi073.stdout:5/782: chown d4/de/d23/c29 12010290 1 2024-04-26T11:24:03.733 INFO:tasks.workunit.client.0.smithi073.stdout:7/815: symlink d1/d11/d24/d29/dd7/d4b/l11b 0 2024-04-26T11:24:03.733 INFO:tasks.workunit.client.0.smithi073.stdout:5/783: fsync d4/de/d23/f44 0 2024-04-26T11:24:03.733 INFO:tasks.workunit.client.0.smithi073.stdout:8/792: creat d1/d4/d7b/d8d/f110 x:0 0 0 2024-04-26T11:24:03.733 INFO:tasks.workunit.client.0.smithi073.stdout:9/796: rename d0/d1a/d2f/l6e to d0/d13/d5a/d5e/l10d 0 2024-04-26T11:24:03.735 INFO:tasks.workunit.client.0.smithi073.stdout:7/816: symlink d1/d33/d68/d78/daf/l11c 0 2024-04-26T11:24:03.735 INFO:tasks.workunit.client.0.smithi073.stdout:2/761: dread dd/fde [0,4194304] 0 2024-04-26T11:24:03.735 INFO:tasks.workunit.client.0.smithi073.stdout:5/784: symlink d4/de/d15/d67/l11c 0 2024-04-26T11:24:03.735 INFO:tasks.workunit.client.0.smithi073.stdout:9/797: creat d0/d1a/d4e/d70/d46/f10e x:0 0 0 2024-04-26T11:24:03.735 INFO:tasks.workunit.client.0.smithi073.stdout:7/817: creat d1/d33/d68/d78/daf/d114/f11d x:0 0 0 2024-04-26T11:24:03.735 INFO:tasks.workunit.client.0.smithi073.stdout:9/798: stat d0/d13/d25/d75/d8e/fb0 0 2024-04-26T11:24:03.737 INFO:tasks.workunit.client.0.smithi073.stdout:7/818: unlink d1/d33/ld9 0 2024-04-26T11:24:03.737 INFO:tasks.workunit.client.0.smithi073.stdout:6/704: dwrite d0/d1a/d26/d27/f29 [0,4194304] 0 2024-04-26T11:24:03.737 INFO:tasks.workunit.client.0.smithi073.stdout:8/793: sync 2024-04-26T11:24:03.737 INFO:tasks.workunit.client.0.smithi073.stdout:9/799: rename d0/d1a/d4e/d70/d46/df2 to d0/d1a/d4e/d70/d46/df2/d10f 22 2024-04-26T11:24:03.738 INFO:tasks.workunit.client.0.smithi073.stdout:4/847: rmdir d8 39 2024-04-26T11:24:03.738 INFO:tasks.workunit.client.0.smithi073.stdout:2/762: truncate dd/d4c/d48/d46/d91/d9f/d1d/f36 3448204 0 2024-04-26T11:24:03.739 INFO:tasks.workunit.client.0.smithi073.stdout:8/794: rename d1/d4/d15/de4/dfc/d2c/ddd/l23 to d1/d4/d7b/l111 0 2024-04-26T11:24:03.739 INFO:tasks.workunit.client.0.smithi073.stdout:8/795: stat d1/d4/d37/dd3/de8/d10a 0 2024-04-26T11:24:03.740 INFO:tasks.workunit.client.0.smithi073.stdout:6/705: creat d0/d1a/d26/d4b/d63/da0/d7c/fd4 x:0 0 0 2024-04-26T11:24:03.740 INFO:tasks.workunit.client.0.smithi073.stdout:4/848: readlink d8/d15/da1/df2/l8d 0 2024-04-26T11:24:03.741 INFO:tasks.workunit.client.0.smithi073.stdout:5/785: read d4/de/fcc [1008757,93023] 0 2024-04-26T11:24:03.741 INFO:tasks.workunit.client.0.smithi073.stdout:8/796: stat d1/d4/d37/d5b/d83/l85 0 2024-04-26T11:24:03.742 INFO:tasks.workunit.client.0.smithi073.stdout:4/849: mknod d8/d1a/d1b/d24/dac/d72/c126 0 2024-04-26T11:24:03.742 INFO:tasks.workunit.client.0.smithi073.stdout:7/819: write d1/f75 [556745,25877] 0 2024-04-26T11:24:03.743 INFO:tasks.workunit.client.0.smithi073.stdout:8/797: write d1/d4/d15/de4/dfc/d2c/ddd/ff0 [1234727,114617] 0 2024-04-26T11:24:03.744 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:03.744 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:03.745 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:24:03.745 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:24:03.745 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:03.748 INFO:tasks.workunit.client.0.smithi073.stdout:5/786: dread d4/d8/f81 [0,4194304] 0 2024-04-26T11:24:03.749 INFO:tasks.workunit.client.0.smithi073.stdout:4/850: rmdir d8/d1a/d1b/d46/d57/d37 39 2024-04-26T11:24:03.749 INFO:tasks.workunit.client.0.smithi073.stdout:4/851: dread - d8/d1a/d4d/f10d zero size 2024-04-26T11:24:03.750 INFO:tasks.workunit.client.0.smithi073.stdout:7/820: dread d1/d11/d24/d29/dd7/ffe [0,4194304] 0 2024-04-26T11:24:03.752 INFO:tasks.workunit.client.0.smithi073.stdout:4/852: mkdir d8/d1a/d4d/ddc/d127 0 2024-04-26T11:24:03.752 INFO:tasks.workunit.client.0.smithi073.stdout:6/706: dwrite d0/d1a/d26/d4b/d2b/d2c/fa9 [0,4194304] 0 2024-04-26T11:24:03.753 INFO:tasks.workunit.client.0.smithi073.stdout:4/853: write d8/d1a/d1b/f26 [90283,39633] 0 2024-04-26T11:24:03.753 INFO:tasks.workunit.client.0.smithi073.stdout:3/754: dread d0/d11/d19/db/d3e/d3f/f55 [0,4194304] 0 2024-04-26T11:24:03.754 INFO:tasks.workunit.client.0.smithi073.stdout:3/755: chown d0/d11/d19/db/d3e/d47/f79 2570 1 2024-04-26T11:24:03.755 INFO:tasks.workunit.client.0.smithi073.stdout:7/821: rename d1/d33/d68/l8c to d1/d33/d68/d78/daf/d114/l11e 0 2024-04-26T11:24:03.755 INFO:tasks.workunit.client.0.smithi073.stdout:5/787: truncate d4/d8/d9/d7d/d84/f78 3404326 0 2024-04-26T11:24:03.755 INFO:tasks.workunit.client.0.smithi073.stdout:1/862: dread d1/d16/d4f/fac [0,4194304] 0 2024-04-26T11:24:03.755 INFO:tasks.workunit.client.0.smithi073.stdout:6/707: mkdir d0/dc/d55/d79/dd5 0 2024-04-26T11:24:03.756 INFO:tasks.workunit.client.0.smithi073.stdout:1/863: fsync d1/d73/d34/fc9 0 2024-04-26T11:24:03.757 INFO:tasks.workunit.client.0.smithi073.stdout:0/782: dread d2/d1f/d40/d48/dc1/dd6/fea [0,4194304] 0 2024-04-26T11:24:03.758 INFO:tasks.workunit.client.0.smithi073.stdout:1/864: write d1/d16/d4f/d55/fa3 [930053,103285] 0 2024-04-26T11:24:03.758 INFO:tasks.workunit.client.0.smithi073.stdout:7/822: readlink d1/d11/d10/l31 0 2024-04-26T11:24:03.759 INFO:tasks.workunit.client.0.smithi073.stdout:0/783: rename d2/d1f/d9c/fb0 to d2/d37/d8b/f118 0 2024-04-26T11:24:03.759 INFO:tasks.workunit.client.0.smithi073.stdout:6/708: write d0/d19/f6f [4647042,125877] 0 2024-04-26T11:24:03.759 INFO:tasks.workunit.client.0.smithi073.stdout:1/865: mknod d1/d73/d40/d54/d112/c125 0 2024-04-26T11:24:03.760 INFO:tasks.workunit.client.0.smithi073.stdout:7/823: stat d1/d11/d24/d29/dd7/d3d/c111 0 2024-04-26T11:24:03.761 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:03.762 INFO:tasks.workunit.client.0.smithi073.stdout:5/788: dread d4/ff5 [0,4194304] 0 2024-04-26T11:24:03.762 INFO:tasks.workunit.client.0.smithi073.stdout:6/709: mkdir d0/d15/d2d/d3f/dd6 0 2024-04-26T11:24:03.762 INFO:tasks.workunit.client.0.smithi073.stdout:6/710: fdatasync d0/f16 0 2024-04-26T11:24:03.762 INFO:tasks.workunit.client.0.smithi073.stdout:6/711: fdatasync d0/d1a/d26/d4b/d38/fc1 0 2024-04-26T11:24:03.764 INFO:tasks.workunit.client.0.smithi073.stdout:3/756: dwrite d0/d11/d19/fc [4194304,4194304] 0 2024-04-26T11:24:03.764 INFO:tasks.workunit.client.0.smithi073.stdout:5/789: link d4/d8/d9/d42/f9c d4/d8/dff/f11d 0 2024-04-26T11:24:03.764 INFO:tasks.workunit.client.0.smithi073.stdout:6/712: write d0/dc/d80/f83 [4534647,44229] 0 2024-04-26T11:24:03.764 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:03.758+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:03.765 INFO:tasks.workunit.client.0.smithi073.stdout:5/790: dread - d4/d95/da5/fd2 zero size 2024-04-26T11:24:03.766 INFO:tasks.workunit.client.0.smithi073.stdout:0/784: getdents d2/d1f/d9c 0 2024-04-26T11:24:03.766 INFO:tasks.workunit.client.0.smithi073.stdout:9/800: dread d0/d6c/dc7/fce [0,4194304] 0 2024-04-26T11:24:03.767 INFO:tasks.workunit.client.0.smithi073.stdout:5/791: mkdir d4/de/d23/d11e 0 2024-04-26T11:24:03.767 INFO:tasks.workunit.client.0.smithi073.stdout:1/866: dwrite d1/d16/d61/f92 [0,4194304] 0 2024-04-26T11:24:03.768 INFO:tasks.workunit.client.0.smithi073.stdout:5/792: chown d4/d8/d9/d42/lc1 355148721 1 2024-04-26T11:24:03.770 INFO:tasks.workunit.client.0.smithi073.stdout:7/824: write d1/d11/d24/fe8 [723724,125783] 0 2024-04-26T11:24:03.771 INFO:tasks.workunit.client.0.smithi073.stdout:3/757: truncate d0/d11/d19/f6 8305153 0 2024-04-26T11:24:03.771 INFO:tasks.workunit.client.0.smithi073.stdout:9/801: rename d0/d13/ld to d0/d1a/d4e/d8f/l110 0 2024-04-26T11:24:03.771 INFO:tasks.workunit.client.0.smithi073.stdout:5/793: mknod d4/de/d23/d4f/c11f 0 2024-04-26T11:24:03.771 INFO:tasks.workunit.client.0.smithi073.stdout:0/785: mknod d2/d37/df7/c119 0 2024-04-26T11:24:03.772 INFO:tasks.workunit.client.0.smithi073.stdout:5/794: write d4/de/d23/d4f/f69 [462751,57396] 0 2024-04-26T11:24:03.773 INFO:tasks.workunit.client.0.smithi073.stdout:8/798: dread d1/d4/d4c/f6c [0,4194304] 0 2024-04-26T11:24:03.773 INFO:tasks.workunit.client.0.smithi073.stdout:0/786: truncate d2/d1f/d40/f44 830014 0 2024-04-26T11:24:03.774 INFO:tasks.workunit.client.0.smithi073.stdout:0/787: readlink d2/d37/d3c/d73/ld0 0 2024-04-26T11:24:03.775 INFO:tasks.workunit.client.0.smithi073.stdout:1/867: dwrite d1/d6/d7f/d47/f111 [0,4194304] 0 2024-04-26T11:24:03.775 INFO:tasks.workunit.client.0.smithi073.stdout:9/802: link d0/d1a/d4e/d70/d46/faf d0/d1a/d4e/d70/f111 0 2024-04-26T11:24:03.775 INFO:tasks.workunit.client.0.smithi073.stdout:5/795: symlink d4/d8/d9/d7d/d84/da7/db7/dcd/l120 0 2024-04-26T11:24:03.775 INFO:tasks.workunit.client.0.smithi073.stdout:8/799: truncate d1/d4/d15/fe9 480648 0 2024-04-26T11:24:03.776 INFO:tasks.workunit.client.0.smithi073.stdout:0/788: chown d2/d22/f39 1476 1 2024-04-26T11:24:03.776 INFO:tasks.workunit.client.0.smithi073.stdout:5/796: chown d4/de/d23 1393 1 2024-04-26T11:24:03.776 INFO:tasks.workunit.client.0.smithi073.stdout:1/868: creat d1/d8/d5d/ddf/d11f/f126 x:0 0 0 2024-04-26T11:24:03.777 INFO:tasks.workunit.client.0.smithi073.stdout:8/800: write d1/d4/d15/de4/dfc/d2c/ddd/fe7 [2741085,53204] 0 2024-04-26T11:24:03.777 INFO:tasks.workunit.client.0.smithi073.stdout:5/797: getdents d4/d95/da5 0 2024-04-26T11:24:03.778 INFO:tasks.workunit.client.0.smithi073.stdout:1/869: write d1/d16/d6a/f71 [796880,89674] 0 2024-04-26T11:24:03.779 INFO:tasks.workunit.client.0.smithi073.stdout:3/758: dwrite d0/d11/d23/fb2 [0,4194304] 0 2024-04-26T11:24:03.779 INFO:tasks.workunit.client.0.smithi073.stdout:1/870: creat d1/d51/f127 x:0 0 0 2024-04-26T11:24:03.781 INFO:tasks.workunit.client.0.smithi073.stdout:8/801: rename d1/d4/d15/de4/dfc/d2c/ddd/d67/d81 to d1/d4/d7b/d8d/d112 0 2024-04-26T11:24:03.781 INFO:tasks.workunit.client.0.smithi073.stdout:1/871: creat d1/d73/d53/dd4/f128 x:0 0 0 2024-04-26T11:24:03.782 INFO:tasks.workunit.client.0.smithi073.stdout:2/763: dread dd/d4c/d48/d46/d91/d9f/d1d/f15 [0,4194304] 0 2024-04-26T11:24:03.782 INFO:tasks.workunit.client.0.smithi073.stdout:8/802: mkdir d1/d4/d37/dd3/d105/d113 0 2024-04-26T11:24:03.783 INFO:tasks.workunit.client.0.smithi073.stdout:1/872: creat d1/d6/d7f/d47/f129 x:0 0 0 2024-04-26T11:24:03.784 INFO:tasks.workunit.client.0.smithi073.stdout:2/764: rmdir dd/de/d49 39 2024-04-26T11:24:03.784 INFO:tasks.workunit.client.0.smithi073.stdout:8/803: creat d1/d4/d15/db7/f114 x:0 0 0 2024-04-26T11:24:03.785 INFO:tasks.workunit.client.0.smithi073.stdout:5/798: dwrite d4/f1f [0,4194304] 0 2024-04-26T11:24:03.785 INFO:tasks.workunit.client.0.smithi073.stdout:0/789: dread d2/f1d [0,4194304] 0 2024-04-26T11:24:03.786 INFO:tasks.workunit.client.0.smithi073.stdout:5/799: chown d4/f1f 9342766 1 2024-04-26T11:24:03.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/765: rename dd/de/d2a/dbc/fd1 to dd/de/d29/d98/fea 0 2024-04-26T11:24:03.787 INFO:tasks.workunit.client.0.smithi073.stdout:0/790: creat d2/d110/f11a x:0 0 0 2024-04-26T11:24:03.787 INFO:tasks.workunit.client.0.smithi073.stdout:2/766: chown dd/l2e 5937 1 2024-04-26T11:24:03.787 INFO:tasks.workunit.client.0.smithi073.stdout:0/791: rmdir d2/d1f/d40 39 2024-04-26T11:24:03.788 INFO:tasks.workunit.client.0.smithi073.stdout:2/767: chown dd/de/d2a/le6 7043297 1 2024-04-26T11:24:03.788 INFO:tasks.workunit.client.0.smithi073.stdout:5/800: mkdir d4/de/d15/d121 0 2024-04-26T11:24:03.789 INFO:tasks.workunit.client.0.smithi073.stdout:2/768: fsync dd/d27/da0/dd5/fd8 0 2024-04-26T11:24:03.789 INFO:tasks.workunit.client.0.smithi073.stdout:2/769: creat dd/d27/feb x:0 0 0 2024-04-26T11:24:03.789 INFO:tasks.workunit.client.0.smithi073.stdout:5/801: rename d4/d73/c76 to d4/d8/d9/d7d/d84/da7/db7/dcd/c122 0 2024-04-26T11:24:03.790 INFO:tasks.workunit.client.0.smithi073.stdout:0/792: read d2/d1f/d40/d48/da9/fce [639415,70537] 0 2024-04-26T11:24:03.790 INFO:tasks.workunit.client.0.smithi073.stdout:2/770: mkdir dd/de/d38/d4e/dec 0 2024-04-26T11:24:03.791 INFO:tasks.workunit.client.0.smithi073.stdout:9/803: truncate d0/d13/d25/d2c/dbf/fc6 155320 0 2024-04-26T11:24:03.792 INFO:tasks.workunit.client.0.smithi073.stdout:0/793: chown d2/d1f/f2b 1 1 2024-04-26T11:24:03.792 INFO:tasks.workunit.client.0.smithi073.stdout:5/802: symlink d4/de/d15/d121/l123 0 2024-04-26T11:24:03.792 INFO:tasks.workunit.client.0.smithi073.stdout:8/804: rmdir d1/d4/d37 39 2024-04-26T11:24:03.792 INFO:tasks.workunit.client.0.smithi073.stdout:3/759: truncate d0/d11/d19/db/d3e/d3f/fe1 2058564 0 2024-04-26T11:24:03.792 INFO:tasks.workunit.client.0.smithi073.stdout:2/771: mknod dd/de/d2a/dbc/ced 0 2024-04-26T11:24:03.792 INFO:tasks.workunit.client.0.smithi073.stdout:0/794: mkdir d2/d110/d11b 0 2024-04-26T11:24:03.793 INFO:tasks.workunit.client.0.smithi073.stdout:5/803: symlink d4/de/d15/d33/l124 0 2024-04-26T11:24:03.793 INFO:tasks.workunit.client.0.smithi073.stdout:9/804: creat d0/d1a/d4e/d70/d59/f112 x:0 0 0 2024-04-26T11:24:03.793 INFO:tasks.workunit.client.0.smithi073.stdout:2/772: creat dd/fee x:0 0 0 2024-04-26T11:24:03.793 INFO:tasks.workunit.client.0.smithi073.stdout:0/795: rename d2/d22/f35 to d2/d1f/d40/d48/da9/de6/f11c 0 2024-04-26T11:24:03.793 INFO:tasks.workunit.client.0.smithi073.stdout:9/805: fsync d0/d1a/f36 0 2024-04-26T11:24:03.794 INFO:tasks.workunit.client.0.smithi073.stdout:0/796: truncate d2/d37/d3c/d73/fd9 175232 0 2024-04-26T11:24:03.795 INFO:tasks.workunit.client.0.smithi073.stdout:2/773: mknod dd/d4c/d48/d77/d80/cef 0 2024-04-26T11:24:03.795 INFO:tasks.workunit.client.0.smithi073.stdout:9/806: symlink d0/d6c/dc7/l113 0 2024-04-26T11:24:03.795 INFO:tasks.workunit.client.0.smithi073.stdout:0/797: readlink d2/d1f/d40/lbb 0 2024-04-26T11:24:03.795 INFO:tasks.workunit.client.0.smithi073.stdout:5/804: write d4/de/d15/d33/fda [60101,56866] 0 2024-04-26T11:24:03.796 INFO:tasks.workunit.client.0.smithi073.stdout:9/807: chown d0/d13/f20 2 1 2024-04-26T11:24:03.796 INFO:tasks.workunit.client.0.smithi073.stdout:2/774: dread - dd/de/d29/d98/fea zero size 2024-04-26T11:24:03.797 INFO:tasks.workunit.client.0.smithi073.stdout:1/873: dread d1/d73/d40/d54/f5f [0,4194304] 0 2024-04-26T11:24:03.798 INFO:tasks.workunit.client.0.smithi073.stdout:0/798: mknod d2/d22/d51/d57/d78/c11d 0 2024-04-26T11:24:03.798 INFO:tasks.workunit.client.0.smithi073.stdout:5/805: write d4/d8/dc3/ff6 [1277765,15988] 0 2024-04-26T11:24:03.799 INFO:tasks.workunit.client.0.smithi073.stdout:2/775: unlink dd/de/l7a 0 2024-04-26T11:24:03.799 INFO:tasks.workunit.client.0.smithi073.stdout:1/874: symlink d1/d8/d2e/l12a 0 2024-04-26T11:24:03.800 INFO:tasks.workunit.client.0.smithi073.stdout:8/805: dwrite d1/d4/d7b/ff5 [0,4194304] 0 2024-04-26T11:24:03.800 INFO:tasks.workunit.client.0.smithi073.stdout:0/799: creat d2/d22/d51/d57/d78/de1/f11e x:0 0 0 2024-04-26T11:24:03.801 INFO:tasks.workunit.client.0.smithi073.stdout:3/760: dwrite d0/d11/d19/d52/d102/d8b/fb7 [0,4194304] 0 2024-04-26T11:24:03.801 INFO:tasks.workunit.client.0.smithi073.stdout:0/800: dread - d2/d22/d51/d57/d78/f10e zero size 2024-04-26T11:24:03.803 INFO:tasks.workunit.client.0.smithi073.stdout:9/808: write d0/d13/db/f4b [959124,42465] 0 2024-04-26T11:24:03.803 INFO:tasks.workunit.client.0.smithi073.stdout:2/776: write dd/de/d38/fa4 [493817,109159] 0 2024-04-26T11:24:03.804 INFO:tasks.workunit.client.0.smithi073.stdout:5/806: mkdir d4/d8/d9/d42/d68/df2/d125 0 2024-04-26T11:24:03.804 INFO:tasks.workunit.client.0.smithi073.stdout:1/875: creat d1/d16/d4f/d55/d5a/d113/f12b x:0 0 0 2024-04-26T11:24:03.804 INFO:tasks.workunit.client.0.smithi073.stdout:2/777: rmdir dd/d27/da0/da7/ddd 39 2024-04-26T11:24:03.804 INFO:tasks.workunit.client.0.smithi073.stdout:8/806: mkdir d1/d4/d115 0 2024-04-26T11:24:03.805 INFO:tasks.workunit.client.0.smithi073.stdout:1/876: write d1/d73/d53/dd4/f128 [519230,23057] 0 2024-04-26T11:24:03.805 INFO:tasks.workunit.client.0.smithi073.stdout:3/761: truncate d0/d11/d19/f39 1653362 0 2024-04-26T11:24:03.807 INFO:tasks.workunit.client.0.smithi073.stdout:3/762: write d0/d11/d19/db/d3e/d3f/d69/feb [854146,29113] 0 2024-04-26T11:24:03.807 INFO:tasks.workunit.client.0.smithi073.stdout:3/763: mkdir d0/d11/d19/d52/d102/d60/d104 0 2024-04-26T11:24:03.808 INFO:tasks.workunit.client.0.smithi073.stdout:3/764: stat d0/d11/d19/db/d3e/d47/f9b 0 2024-04-26T11:24:03.809 INFO:tasks.workunit.client.0.smithi073.stdout:9/809: dwrite d0/d1a/d4e/d70/d3b/fbc [0,4194304] 0 2024-04-26T11:24:03.811 INFO:tasks.workunit.client.0.smithi073.stdout:9/810: rename d0/d83/fb1 to d0/d1a/d4e/d70/d46/df2/f114 0 2024-04-26T11:24:03.811 INFO:tasks.workunit.client.0.smithi073.stdout:3/765: mkdir d0/d11/d19/d52/d102/d60/dcd/d105 0 2024-04-26T11:24:03.811 INFO:tasks.workunit.client.0.smithi073.stdout:3/766: chown d0/d11/d19/l9 3757951 1 2024-04-26T11:24:03.812 INFO:tasks.workunit.client.0.smithi073.stdout:3/767: getdents d0/d26/da2 0 2024-04-26T11:24:03.813 INFO:tasks.workunit.client.0.smithi073.stdout:3/768: chown d0/d11/d19/db/ddc/f46 116 1 2024-04-26T11:24:03.814 INFO:tasks.workunit.client.0.smithi073.stdout:3/769: mkdir d0/d11/d19/d52/d102/d8b/d8c/d106 0 2024-04-26T11:24:03.815 INFO:tasks.workunit.client.0.smithi073.stdout:9/811: truncate d0/d1a/d4e/d70/d51/f67 2476837 0 2024-04-26T11:24:03.815 INFO:tasks.workunit.client.0.smithi073.stdout:5/807: dread d4/de/d15/d67/fc5 [0,4194304] 0 2024-04-26T11:24:03.815 INFO:tasks.workunit.client.0.smithi073.stdout:3/770: write d0/d11/d19/fc [6858247,49717] 0 2024-04-26T11:24:03.816 INFO:tasks.workunit.client.0.smithi073.stdout:3/771: symlink d0/d11/d19/d52/d102/d8b/d8c/d90/db4/l107 0 2024-04-26T11:24:03.816 INFO:tasks.workunit.client.0.smithi073.stdout:9/812: rename d0/d1a/d4e/d70/d59/c6f to d0/d13/d25/c115 0 2024-04-26T11:24:03.817 INFO:tasks.workunit.client.0.smithi073.stdout:9/813: mkdir d0/d13/d5a/d116 0 2024-04-26T11:24:03.817 INFO:tasks.workunit.client.0.smithi073.stdout:3/772: link d0/d34/f66 d0/d11/d19/d1d/f108 0 2024-04-26T11:24:03.818 INFO:tasks.workunit.client.0.smithi073.stdout:3/773: mkdir d0/d11/d19/db/ddc/d109 0 2024-04-26T11:24:03.819 INFO:tasks.workunit.client.0.smithi073.stdout:4/854: sync 2024-04-26T11:24:03.819 INFO:tasks.workunit.client.0.smithi073.stdout:0/801: dread d2/f17 [0,4194304] 0 2024-04-26T11:24:03.819 INFO:tasks.workunit.client.0.smithi073.stdout:9/814: link d0/d13/db/c28 d0/d83/dd4/c117 0 2024-04-26T11:24:03.820 INFO:tasks.workunit.client.0.smithi073.stdout:1/877: dread d1/d16/d4f/d55/f64 [0,4194304] 0 2024-04-26T11:24:03.820 INFO:tasks.workunit.client.0.smithi073.stdout:3/774: getdents d0/d11/d19/d52/d102/d60/dcd/d105 0 2024-04-26T11:24:03.820 INFO:tasks.workunit.client.0.smithi073.stdout:9/815: mknod d0/d1a/d4e/d70/d46/df2/c118 0 2024-04-26T11:24:03.821 INFO:tasks.workunit.client.0.smithi073.stdout:0/802: getdents d2/d1f/d9c/db1 0 2024-04-26T11:24:03.821 INFO:tasks.workunit.client.0.smithi073.stdout:1/878: creat d1/d73/d40/d44/f12c x:0 0 0 2024-04-26T11:24:03.822 INFO:tasks.workunit.client.0.smithi073.stdout:3/775: link d0/d11/f6f d0/d11/d19/d52/d102/d7a/dce/dd3/f10a 0 2024-04-26T11:24:03.823 INFO:tasks.workunit.client.0.smithi073.stdout:1/879: creat d1/d6/d7f/d8f/de9/d11a/f12d x:0 0 0 2024-04-26T11:24:03.823 INFO:tasks.workunit.client.0.smithi073.stdout:1/880: creat d1/d73/d40/d44/d8e/f12e x:0 0 0 2024-04-26T11:24:03.824 INFO:tasks.workunit.client.0.smithi073.stdout:3/776: truncate d0/d11/d19/db/d3e/d3f/fad 759878 0 2024-04-26T11:24:03.825 INFO:tasks.workunit.client.0.smithi073.stdout:1/881: rename d1/d16 to d1/d16/d4f/d55/d5a/dc6/dd2/d12f 22 2024-04-26T11:24:03.826 INFO:tasks.workunit.client.0.smithi073.stdout:1/882: link d1/d16/d61/la0 d1/d8/d57/l130 0 2024-04-26T11:24:03.830 INFO:tasks.workunit.client.0.smithi073.stdout:8/807: dread d1/f18 [0,4194304] 0 2024-04-26T11:24:03.831 INFO:tasks.workunit.client.0.smithi073.stdout:3/777: dwrite d0/d11/d19/db/ddc/f5c [0,4194304] 0 2024-04-26T11:24:03.831 INFO:tasks.workunit.client.0.smithi073.stdout:8/808: read - d1/d4/d7b/f7d zero size 2024-04-26T11:24:03.833 INFO:tasks.workunit.client.0.smithi073.stdout:3/778: symlink d0/d11/l10b 0 2024-04-26T11:24:03.834 INFO:tasks.workunit.client.0.smithi073.stdout:3/779: mkdir d0/d11/d23/d86/d10c 0 2024-04-26T11:24:03.835 INFO:tasks.workunit.client.0.smithi073.stdout:3/780: chown d0/d26/c22 30638 1 2024-04-26T11:24:03.836 INFO:tasks.workunit.client.0.smithi073.stdout:8/809: link d1/d4/d7b/d8d/d112/da5/fd4 d1/d4/d15/dbc/dc3/dc6/ddb/dfe/f116 0 2024-04-26T11:24:03.836 INFO:tasks.workunit.client.0.smithi073.stdout:5/808: dread d4/d95/fc9 [0,4194304] 0 2024-04-26T11:24:03.836 INFO:tasks.workunit.client.0.smithi073.stdout:3/781: creat d0/d11/d19/d52/d102/d7a/dbc/f10d x:0 0 0 2024-04-26T11:24:03.837 INFO:tasks.workunit.client.0.smithi073.stdout:8/810: creat d1/d4/d15/dbc/dc3/dc6/ddb/dfe/f117 x:0 0 0 2024-04-26T11:24:03.837 INFO:tasks.workunit.client.0.smithi073.stdout:3/782: read d0/d11/d23/fb2 [1937594,80076] 0 2024-04-26T11:24:03.839 INFO:tasks.workunit.client.0.smithi073.stdout:3/783: truncate d0/d26/f58 908467 0 2024-04-26T11:24:03.840 INFO:tasks.workunit.client.0.smithi073.stdout:9/816: dread d0/d1a/d4e/d70/d46/f8a [0,4194304] 0 2024-04-26T11:24:03.842 INFO:tasks.workunit.client.0.smithi073.stdout:8/811: dwrite d1/d4/d7b/ff5 [4194304,4194304] 0 2024-04-26T11:24:03.846 INFO:tasks.workunit.client.0.smithi073.stdout:9/817: symlink d0/d83/dd4/l119 0 2024-04-26T11:24:03.846 INFO:tasks.workunit.client.0.smithi073.stdout:8/812: getdents d1/d4/d115 0 2024-04-26T11:24:03.846 INFO:tasks.workunit.client.0.smithi073.stdout:0/803: dread d2/f15 [0,4194304] 0 2024-04-26T11:24:03.847 INFO:tasks.workunit.client.0.smithi073.stdout:0/804: readlink d2/d1f/d9d/lad 0 2024-04-26T11:24:03.847 INFO:tasks.workunit.client.0.smithi073.stdout:0/805: chown d2/d22 1213073 1 2024-04-26T11:24:03.847 INFO:tasks.workunit.client.0.smithi073.stdout:0/806: write d2/d22/f103 [736310,127384] 0 2024-04-26T11:24:03.848 INFO:tasks.workunit.client.0.smithi073.stdout:0/807: chown d2/d37/lb9 219 1 2024-04-26T11:24:03.849 INFO:tasks.workunit.client.0.smithi073.stdout:0/808: write d2/d5f/f8c [974991,78742] 0 2024-04-26T11:24:03.849 INFO:tasks.workunit.client.0.smithi073.stdout:9/818: write d0/d13/d25/d2c/dbf/fea [119402,46451] 0 2024-04-26T11:24:03.850 INFO:tasks.workunit.client.0.smithi073.stdout:2/778: sync 2024-04-26T11:24:03.850 INFO:tasks.workunit.client.0.smithi073.stdout:6/713: sync 2024-04-26T11:24:03.850 INFO:tasks.workunit.client.0.smithi073.stdout:7/825: sync 2024-04-26T11:24:03.850 INFO:tasks.workunit.client.0.smithi073.stdout:4/855: sync 2024-04-26T11:24:03.850 INFO:tasks.workunit.client.0.smithi073.stdout:0/809: chown d2/d22/d51/d57/d78/f86 14919715 1 2024-04-26T11:24:03.850 INFO:tasks.workunit.client.0.smithi073.stdout:6/714: stat d0/dc/d55/d79 0 2024-04-26T11:24:03.851 INFO:tasks.workunit.client.0.smithi073.stdout:7/826: mkdir d1/d11/d24/d29/dd7/d80/df9/d11f 0 2024-04-26T11:24:03.851 INFO:tasks.workunit.client.0.smithi073.stdout:6/715: unlink d0/d1a/d26/d4b/d49/f9c 0 2024-04-26T11:24:03.851 INFO:tasks.workunit.client.0.smithi073.stdout:4/856: creat d8/d1a/d1b/dd2/d114/f128 x:0 0 0 2024-04-26T11:24:03.851 INFO:tasks.workunit.client.0.smithi073.stdout:0/810: creat d2/d22/d51/d57/f11f x:0 0 0 2024-04-26T11:24:03.852 INFO:tasks.workunit.client.0.smithi073.stdout:2/779: rename dd/de/d38/f93 to dd/de/d38/d53/d60/db2/dc7/ff0 0 2024-04-26T11:24:03.852 INFO:tasks.workunit.client.0.smithi073.stdout:6/716: mkdir d0/d15/dd7 0 2024-04-26T11:24:03.853 INFO:tasks.workunit.client.0.smithi073.stdout:4/857: chown d8/d1a/d1b/d24/lff 14287754 1 2024-04-26T11:24:03.853 INFO:tasks.workunit.client.0.smithi073.stdout:0/811: rename d2/d37/d3c/d6a/cb8 to d2/d1f/d9c/c120 0 2024-04-26T11:24:03.853 INFO:tasks.workunit.client.0.smithi073.stdout:7/827: read d1/d33/d1b/d66/d50/f6e [3640040,14044] 0 2024-04-26T11:24:03.854 INFO:tasks.workunit.client.0.smithi073.stdout:6/717: getdents d0/d1a/d7a 0 2024-04-26T11:24:03.854 INFO:tasks.workunit.client.0.smithi073.stdout:4/858: creat d8/d1a/d1b/f129 x:0 0 0 2024-04-26T11:24:03.855 INFO:tasks.workunit.client.0.smithi073.stdout:4/859: chown d8/d1a/d1b/f129 1637 1 2024-04-26T11:24:03.855 INFO:tasks.workunit.client.0.smithi073.stdout:0/812: rename d2/d1f/d9c/db1/f101 to d2/d1f/d9d/f121 0 2024-04-26T11:24:03.856 INFO:tasks.workunit.client.0.smithi073.stdout:9/819: truncate d0/d13/d5a/fa2 31968 0 2024-04-26T11:24:03.856 INFO:tasks.workunit.client.0.smithi073.stdout:0/813: write d2/ff [6117968,112947] 0 2024-04-26T11:24:03.859 INFO:tasks.workunit.client.0.smithi073.stdout:3/784: dread d0/d11/d19/d1d/f8d [0,4194304] 0 2024-04-26T11:24:03.859 INFO:tasks.workunit.client.0.smithi073.stdout:1/883: dread d1/d73/d53/f59 [0,4194304] 0 2024-04-26T11:24:03.859 INFO:tasks.workunit.client.0.smithi073.stdout:2/780: dwrite dd/d4c/d48/f2c [0,4194304] 0 2024-04-26T11:24:03.860 INFO:tasks.workunit.client.0.smithi073.stdout:6/718: getdents d0/dc/d8c 0 2024-04-26T11:24:03.861 INFO:tasks.workunit.client.0.smithi073.stdout:7/828: write d1/d11/d51/dfb/f10f [1290647,52470] 0 2024-04-26T11:24:03.861 INFO:tasks.workunit.client.0.smithi073.stdout:1/884: symlink d1/d73/d40/d44/d8e/l131 0 2024-04-26T11:24:03.863 INFO:tasks.workunit.client.0.smithi073.stdout:4/860: dread d8/d1a/d1b/fb5 [0,4194304] 0 2024-04-26T11:24:03.863 INFO:tasks.workunit.client.0.smithi073.stdout:1/885: symlink d1/d6/d7f/d8f/l132 0 2024-04-26T11:24:03.864 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:03.860+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:03.864 INFO:tasks.workunit.client.0.smithi073.stdout:7/829: creat d1/d11/d24/de0/f120 x:0 0 0 2024-04-26T11:24:03.865 INFO:tasks.workunit.client.0.smithi073.stdout:5/809: dread d4/de/d23/f36 [0,4194304] 0 2024-04-26T11:24:03.867 INFO:tasks.workunit.client.0.smithi073.stdout:7/830: dread - d1/d11/d10/f110 zero size 2024-04-26T11:24:03.870 INFO:tasks.workunit.client.0.smithi073.stdout:0/814: dwrite d2/d22/f112 [0,4194304] 0 2024-04-26T11:24:03.870 INFO:tasks.workunit.client.0.smithi073.stdout:9/820: dwrite d0/d13/d25/d2c/dbf/fea [0,4194304] 0 2024-04-26T11:24:03.870 INFO:tasks.workunit.client.0.smithi073.stdout:4/861: symlink d8/d1a/d86/l12a 0 2024-04-26T11:24:03.871 INFO:tasks.workunit.client.0.smithi073.stdout:1/886: rmdir d1/d16/d4f/d55/d5a 39 2024-04-26T11:24:03.871 INFO:tasks.workunit.client.0.smithi073.stdout:3/785: dwrite d0/d11/d19/d1d/f44 [4194304,4194304] 0 2024-04-26T11:24:03.871 INFO:tasks.workunit.client.0.smithi073.stdout:5/810: creat d4/de/d23/d4f/f126 x:0 0 0 2024-04-26T11:24:03.871 INFO:tasks.workunit.client.0.smithi073.stdout:7/831: stat d1/d11/d24/d29/l85 0 2024-04-26T11:24:03.872 INFO:tasks.workunit.client.0.smithi073.stdout:0/815: write d2/d1f/d40/ffb [848607,121175] 0 2024-04-26T11:24:03.872 INFO:tasks.workunit.client.0.smithi073.stdout:4/862: dread - d8/d1a/d1b/d24/dac/ffe zero size 2024-04-26T11:24:03.873 INFO:tasks.workunit.client.0.smithi073.stdout:7/832: dread - d1/d33/d1b/fb3 zero size 2024-04-26T11:24:03.874 INFO:tasks.workunit.client.0.smithi073.stdout:2/781: dwrite dd/de/d49/f67 [4194304,4194304] 0 2024-04-26T11:24:03.874 INFO:tasks.workunit.client.0.smithi073.stdout:4/863: truncate d8/d15/da1/fa9 760561 0 2024-04-26T11:24:03.874 INFO:tasks.workunit.client.0.smithi073.stdout:6/719: dwrite d0/d1a/d26/d4b/d2b/d2c/f3b [8388608,4194304] 0 2024-04-26T11:24:03.875 INFO:tasks.workunit.client.0.smithi073.stdout:5/811: write d4/d95/fc9 [1568588,92679] 0 2024-04-26T11:24:03.875 INFO:tasks.workunit.client.0.smithi073.stdout:5/812: readlink d4/d73/le8 0 2024-04-26T11:24:03.876 INFO:tasks.workunit.client.0.smithi073.stdout:9/821: mknod d0/d13/d5a/db2/de1/c11a 0 2024-04-26T11:24:03.876 INFO:tasks.workunit.client.0.smithi073.stdout:1/887: mknod d1/d16/d4f/d55/d5a/dc6/d11e/c133 0 2024-04-26T11:24:03.876 INFO:tasks.workunit.client.0.smithi073.stdout:0/816: fdatasync d2/d1f/fda 0 2024-04-26T11:24:03.876 INFO:tasks.workunit.client.0.smithi073.stdout:6/720: getdents d0/d1a/d7a 0 2024-04-26T11:24:03.876 INFO:tasks.workunit.client.0.smithi073.stdout:6/721: readlink d0/d19/l1f 0 2024-04-26T11:24:03.877 INFO:tasks.workunit.client.0.smithi073.stdout:2/782: link dd/de/d29/lba dd/de/d38/lf1 0 2024-04-26T11:24:03.877 INFO:tasks.workunit.client.0.smithi073.stdout:1/888: write d1/d73/d40/d54/f117 [104537,4137] 0 2024-04-26T11:24:03.877 INFO:tasks.workunit.client.0.smithi073.stdout:5/813: chown d4/d8/d9/d7d/da3/fba 3 1 2024-04-26T11:24:03.877 INFO:tasks.workunit.client.0.smithi073.stdout:2/783: chown dd/de/d38/d4e/f8d 496423 1 2024-04-26T11:24:03.877 INFO:tasks.workunit.client.0.smithi073.stdout:8/813: sync 2024-04-26T11:24:03.878 INFO:tasks.workunit.client.0.smithi073.stdout:3/786: sync 2024-04-26T11:24:03.878 INFO:tasks.workunit.client.0.smithi073.stdout:8/814: stat d1/d4/d15/dbc/dc3/dc6/ddb/dfe/f117 0 2024-04-26T11:24:03.878 INFO:tasks.workunit.client.0.smithi073.stdout:0/817: unlink d2/d22/d51/d57/l67 0 2024-04-26T11:24:03.879 INFO:tasks.workunit.client.0.smithi073.stdout:9/822: creat d0/d13/d25/f11b x:0 0 0 2024-04-26T11:24:03.880 INFO:tasks.workunit.client.0.smithi073.stdout:2/784: unlink dd/de/l8e 0 2024-04-26T11:24:03.880 INFO:tasks.workunit.client.0.smithi073.stdout:8/815: chown d1/d4/l49 249669887 1 2024-04-26T11:24:03.880 INFO:tasks.workunit.client.0.smithi073.stdout:6/722: rename d0/d15/d2d/d3f/dd6 to d0/d15/dd8 0 2024-04-26T11:24:03.880 INFO:tasks.workunit.client.0.smithi073.stdout:1/889: write d1/d73/d40/d54/f5f [1284084,33612] 0 2024-04-26T11:24:03.881 INFO:tasks.workunit.client.0.smithi073.stdout:0/818: chown d2/d1f/d40/feb 105462461 1 2024-04-26T11:24:03.881 INFO:tasks.workunit.client.0.smithi073.stdout:6/723: chown d0/d15/d2d/fb2 15323200 1 2024-04-26T11:24:03.881 INFO:tasks.workunit.client.0.smithi073.stdout:8/816: chown d1/d4/d7b/d8d/f110 13 1 2024-04-26T11:24:03.881 INFO:tasks.workunit.client.0.smithi073.stdout:1/890: write d1/d16/d4f/d55/fa3 [665656,109339] 0 2024-04-26T11:24:03.881 INFO:tasks.workunit.client.0.smithi073.stdout:8/817: fsync d1/d4/d7b/ff5 0 2024-04-26T11:24:03.882 INFO:tasks.workunit.client.0.smithi073.stdout:9/823: mkdir d0/d1a/d4e/d70/d59/de8/d11c 0 2024-04-26T11:24:03.883 INFO:tasks.workunit.client.0.smithi073.stdout:0/819: mkdir d2/d1f/d40/d48/d122 0 2024-04-26T11:24:03.883 INFO:tasks.workunit.client.0.smithi073.stdout:6/724: mkdir d0/dc/d80/d97/dd9 0 2024-04-26T11:24:03.885 INFO:tasks.workunit.client.0.smithi073.stdout:5/814: truncate d4/d95/fc9 2934672 0 2024-04-26T11:24:03.885 INFO:tasks.workunit.client.0.smithi073.stdout:0/820: chown d2/d37/d8b/faf 2177 1 2024-04-26T11:24:03.885 INFO:tasks.workunit.client.0.smithi073.stdout:5/815: sync 2024-04-26T11:24:03.885 INFO:tasks.workunit.client.0.smithi073.stdout:9/824: chown d0/d13/d25/d75/d8e/db9/fd1 2544422 1 2024-04-26T11:24:03.885 INFO:tasks.workunit.client.0.smithi073.stdout:3/787: link d0/d11/d19/db/d3e/d47/fc4 d0/d11/d19/db/d3e/d3f/d69/d96/f10e 0 2024-04-26T11:24:03.886 INFO:tasks.workunit.client.0.smithi073.stdout:6/725: stat d0/d19/f21 0 2024-04-26T11:24:03.886 INFO:tasks.workunit.client.0.smithi073.stdout:2/785: link dd/d4c/d48/d46/d91/d9f/f43 dd/d27/dcd/ff2 0 2024-04-26T11:24:03.886 INFO:tasks.workunit.client.0.smithi073.stdout:1/891: getdents d1/d8/d5d/d89/de6 0 2024-04-26T11:24:03.886 INFO:tasks.workunit.client.0.smithi073.stdout:0/821: rmdir d2/d37/d3c/d6a 39 2024-04-26T11:24:03.887 INFO:tasks.workunit.client.0.smithi073.stdout:3/788: mknod d0/d11/d19/d52/c10f 0 2024-04-26T11:24:03.887 INFO:tasks.workunit.client.0.smithi073.stdout:2/786: mkdir dd/de/d29/d98/df3 0 2024-04-26T11:24:03.887 INFO:tasks.workunit.client.0.smithi073.stdout:6/726: mkdir d0/d1a/d26/d27/dda 0 2024-04-26T11:24:03.888 INFO:tasks.workunit.client.0.smithi073.stdout:1/892: write d1/d16/d6a/f71 [534631,117905] 0 2024-04-26T11:24:03.888 INFO:tasks.workunit.client.0.smithi073.stdout:0/822: fdatasync d2/f17 0 2024-04-26T11:24:03.888 INFO:tasks.workunit.client.0.smithi073.stdout:5/816: getdents d4/d73/d8a/da0 0 2024-04-26T11:24:03.889 INFO:tasks.workunit.client.0.smithi073.stdout:3/789: symlink d0/d11/d19/d70/daa/l110 0 2024-04-26T11:24:03.889 INFO:tasks.workunit.client.0.smithi073.stdout:2/787: truncate dd/de/d49/fad 1407291 0 2024-04-26T11:24:03.890 INFO:tasks.workunit.client.0.smithi073.stdout:6/727: fsync d0/d1a/d26/d4b/d2b/f3d 0 2024-04-26T11:24:03.891 INFO:tasks.workunit.client.0.smithi073.stdout:1/893: readlink d1/d73/d40/d44/d8e/l131 0 2024-04-26T11:24:03.891 INFO:tasks.workunit.client.0.smithi073.stdout:8/818: dwrite d1/d4/d15/de4/dfc/d2c/ddd/d67/fa6 [0,4194304] 0 2024-04-26T11:24:03.891 INFO:tasks.workunit.client.0.smithi073.stdout:2/788: stat dd/d4c/d48/d77/lb4 0 2024-04-26T11:24:03.891 INFO:tasks.workunit.client.0.smithi073.stdout:6/728: readlink d0/d15/d2d/l53 0 2024-04-26T11:24:03.892 INFO:tasks.workunit.client.0.smithi073.stdout:8/819: read d1/d4/d15/f75 [435786,16114] 0 2024-04-26T11:24:03.892 INFO:tasks.workunit.client.0.smithi073.stdout:1/894: dread - d1/d16/d4f/d55/d5a/fcf zero size 2024-04-26T11:24:03.893 INFO:tasks.workunit.client.0.smithi073.stdout:0/823: fdatasync d2/d1f/d40/d48/da9/dd8/f105 0 2024-04-26T11:24:03.893 INFO:tasks.workunit.client.0.smithi073.stdout:6/729: creat d0/d1a/d26/d4b/d2b/fdb x:0 0 0 2024-04-26T11:24:03.894 INFO:tasks.workunit.client.0.smithi073.stdout:1/895: symlink d1/d8/d5d/l134 0 2024-04-26T11:24:03.894 INFO:tasks.workunit.client.0.smithi073.stdout:9/825: dwrite d0/d1a/d4e/d8f/fbe [0,4194304] 0 2024-04-26T11:24:03.895 INFO:tasks.workunit.client.0.smithi073.stdout:2/789: chown dd/d4c/d48/d77/cd9 2957 1 2024-04-26T11:24:03.895 INFO:tasks.workunit.client.0.smithi073.stdout:7/833: dread d1/d11/d24/d71/d90/f9f [0,4194304] 0 2024-04-26T11:24:03.895 INFO:tasks.workunit.client.0.smithi073.stdout:3/790: read d0/d34/f4e [443254,96600] 0 2024-04-26T11:24:03.895 INFO:tasks.workunit.client.0.smithi073.stdout:1/896: chown d1/d73/d40/d54/fc4 6 1 2024-04-26T11:24:03.896 INFO:tasks.workunit.client.0.smithi073.stdout:1/897: readlink d1/d73/d53/l58 0 2024-04-26T11:24:03.897 INFO:tasks.workunit.client.0.smithi073.stdout:5/817: rename d4/d95 to d4/d8/d9/d7d/d84/da7/db7/d127 0 2024-04-26T11:24:03.898 INFO:tasks.workunit.client.0.smithi073.stdout:0/824: rename d2/d1f/d40/d48/f4a to d2/d1f/d40/d48/f123 0 2024-04-26T11:24:03.898 INFO:tasks.workunit.client.0.smithi073.stdout:7/834: symlink d1/d33/d68/d78/daf/l121 0 2024-04-26T11:24:03.899 INFO:tasks.workunit.client.0.smithi073.stdout:3/791: fdatasync d0/d11/d19/f71 0 2024-04-26T11:24:03.900 INFO:tasks.workunit.client.0.smithi073.stdout:8/820: rename d1/d4/d37/dd3/de8/fd0 to d1/d4/d15/dbc/dc3/dc6/f118 0 2024-04-26T11:24:03.901 INFO:tasks.workunit.client.0.smithi073.stdout:7/835: symlink d1/d11/d24/d29/dd7/d4b/l122 0 2024-04-26T11:24:03.902 INFO:tasks.workunit.client.0.smithi073.stdout:4/864: dread d8/d1a/d1b/d24/dac/d49/d85/d8b/f66 [0,4194304] 0 2024-04-26T11:24:03.903 INFO:tasks.workunit.client.0.smithi073.stdout:5/818: truncate d4/d8/d9/d42/d68/f6e 775738 0 2024-04-26T11:24:03.903 INFO:tasks.workunit.client.0.smithi073.stdout:3/792: chown d0/d11/d19/db/ddc/l56 6449726 1 2024-04-26T11:24:03.904 INFO:tasks.workunit.client.0.smithi073.stdout:6/730: dwrite d0/f2 [0,4194304] 0 2024-04-26T11:24:03.905 INFO:tasks.workunit.client.0.smithi073.stdout:7/836: write d1/d11/d51/dbd/f102 [965810,68835] 0 2024-04-26T11:24:03.905 INFO:tasks.workunit.client.0.smithi073.stdout:2/790: dwrite dd/d4c/d48/d46/d91/d9f/d1d/f44 [0,4194304] 0 2024-04-26T11:24:03.906 INFO:tasks.workunit.client.0.smithi073.stdout:9/826: dwrite d0/d1a/d2f/fcd [0,4194304] 0 2024-04-26T11:24:03.907 INFO:tasks.workunit.client.0.smithi073.stdout:6/731: write d0/dc/d2e/d6e/f70 [545547,92630] 0 2024-04-26T11:24:03.908 INFO:tasks.workunit.client.0.smithi073.stdout:1/898: dwrite d1/d73/d40/d44/d8e/f9a [0,4194304] 0 2024-04-26T11:24:03.909 INFO:tasks.workunit.client.0.smithi073.stdout:2/791: write dd/de/fcf [688925,55522] 0 2024-04-26T11:24:03.909 INFO:tasks.workunit.client.0.smithi073.stdout:0/825: rename d2/d22/d51/d57/d78/de1 to d2/d124 0 2024-04-26T11:24:03.909 INFO:tasks.workunit.client.0.smithi073.stdout:7/837: unlink d1/d11/c6 0 2024-04-26T11:24:03.909 INFO:tasks.workunit.client.0.smithi073.stdout:4/865: dread - d8/d1a/d5e/dc5/f11b zero size 2024-04-26T11:24:03.909 INFO:tasks.workunit.client.0.smithi073.stdout:5/819: getdents d4/de/d23/d11e 0 2024-04-26T11:24:03.910 INFO:tasks.workunit.client.0.smithi073.stdout:5/820: sync 2024-04-26T11:24:03.910 INFO:tasks.workunit.client.0.smithi073.stdout:9/827: creat d0/d6c/dc7/f11d x:0 0 0 2024-04-26T11:24:03.911 INFO:tasks.workunit.client.0.smithi073.stdout:4/866: fsync d8/f10 0 2024-04-26T11:24:03.911 INFO:tasks.workunit.client.0.smithi073.stdout:0/826: readlink d2/d84/dd2/lf8 0 2024-04-26T11:24:03.926 INFO:tasks.workunit.client.0.smithi073.stdout:7/838: write d1/d11/d10/f110 [862506,64467] 0 2024-04-26T11:24:03.926 INFO:tasks.workunit.client.0.smithi073.stdout:2/792: stat dd/d4c/d48/d77/fa3 0 2024-04-26T11:24:03.927 INFO:tasks.workunit.client.0.smithi073.stdout:2/793: chown l4 78006619 1 2024-04-26T11:24:03.927 INFO:tasks.workunit.client.0.smithi073.stdout:7/839: fsync d1/d11/d51/dbd/f102 0 2024-04-26T11:24:03.927 INFO:tasks.workunit.client.0.smithi073.stdout:7/840: sync 2024-04-26T11:24:03.927 INFO:tasks.workunit.client.0.smithi073.stdout:8/821: dwrite d1/d4/d15/f60 [0,4194304] 0 2024-04-26T11:24:03.927 INFO:tasks.workunit.client.0.smithi073.stdout:3/793: dwrite d0/d11/d19/d70/daa/f101 [0,4194304] 0 2024-04-26T11:24:03.928 INFO:tasks.workunit.client.0.smithi073.stdout:9/828: fsync d0/d1a/d4e/d70/f111 0 2024-04-26T11:24:03.928 INFO:tasks.workunit.client.0.smithi073.stdout:4/867: symlink d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/l12b 0 2024-04-26T11:24:03.928 INFO:tasks.workunit.client.0.smithi073.stdout:7/841: rmdir d1/d11/d51/dca/df3 0 2024-04-26T11:24:03.928 INFO:tasks.workunit.client.0.smithi073.stdout:8/822: write d1/d4/d15/de4/dfc/d2a/f52 [600972,79475] 0 2024-04-26T11:24:03.928 INFO:tasks.workunit.client.0.smithi073.stdout:5/821: getdents d4/d8/d9/d7d/d84/da7/db7/dcd/dd4 0 2024-04-26T11:24:03.928 INFO:tasks.workunit.client.0.smithi073.stdout:2/794: getdents dd/d27/da0 0 2024-04-26T11:24:03.929 INFO:tasks.workunit.client.0.smithi073.stdout:4/868: write d8/d1a/d1b/d24/dac/f27 [1650479,31922] 0 2024-04-26T11:24:03.929 INFO:tasks.workunit.client.0.smithi073.stdout:9/829: truncate d0/d1a/d4e/d70/feb 1240858 0 2024-04-26T11:24:03.929 INFO:tasks.workunit.client.0.smithi073.stdout:5/822: mkdir d4/d73/d8a/dc8/d128 0 2024-04-26T11:24:03.929 INFO:tasks.workunit.client.0.smithi073.stdout:1/899: dwrite d1/d16/d4f/d55/d5a/dc6/fff [0,4194304] 0 2024-04-26T11:24:03.930 INFO:tasks.workunit.client.0.smithi073.stdout:4/869: chown d8/d1a/d1b/d24/dac/d49/d85 31210341 1 2024-04-26T11:24:03.930 INFO:tasks.workunit.client.0.smithi073.stdout:7/842: symlink d1/d11/d24/d29/dd7/d80/dc3/l123 0 2024-04-26T11:24:03.930 INFO:tasks.workunit.client.0.smithi073.stdout:1/900: creat d1/d51/f135 x:0 0 0 2024-04-26T11:24:03.930 INFO:tasks.workunit.client.0.smithi073.stdout:5/823: mknod d4/de/d15/c129 0 2024-04-26T11:24:03.930 INFO:tasks.workunit.client.0.smithi073.stdout:7/843: mkdir d1/d11/d24/d29/dd7/d80/df9/d11f/d124 0 2024-04-26T11:24:03.930 INFO:tasks.workunit.client.0.smithi073.stdout:8/823: getdents d1/d4/d15/de4/dfc/d2c/ddd/d67 0 2024-04-26T11:24:03.931 INFO:tasks.workunit.client.0.smithi073.stdout:9/830: dread d0/d13/d5a/db2/de1/fe6 [0,4194304] 0 2024-04-26T11:24:03.931 INFO:tasks.workunit.client.0.smithi073.stdout:1/901: chown d1/d73/d34/d98/daa/f121 4 1 2024-04-26T11:24:03.931 INFO:tasks.workunit.client.0.smithi073.stdout:5/824: write d4/d8/d9/f21 [1431940,48699] 0 2024-04-26T11:24:03.931 INFO:tasks.workunit.client.0.smithi073.stdout:7/844: dread - d1/d11/d24/d71/f109 zero size 2024-04-26T11:24:03.931 INFO:tasks.workunit.client.0.smithi073.stdout:1/902: mknod d1/d8/d2e/c136 0 2024-04-26T11:24:03.931 INFO:tasks.workunit.client.0.smithi073.stdout:9/831: symlink d0/d1a/d4e/d70/l11e 0 2024-04-26T11:24:03.932 INFO:tasks.workunit.client.0.smithi073.stdout:8/824: getdents d1/d4/d37/d5b 0 2024-04-26T11:24:03.932 INFO:tasks.workunit.client.0.smithi073.stdout:1/903: stat d1/d6/fb 0 2024-04-26T11:24:03.932 INFO:tasks.workunit.client.0.smithi073.stdout:5/825: mkdir d4/d8/d9/d7d/d84/da7/db7/dcd/df1/df3/d12a 0 2024-04-26T11:24:03.936 INFO:tasks.workunit.client.0.smithi073.stdout:3/794: write d0/d26/f58 [599496,18312] 0 2024-04-26T11:24:03.937 INFO:tasks.workunit.client.0.smithi073.stdout:9/832: mknod d0/d13/d25/c11f 0 2024-04-26T11:24:03.937 INFO:tasks.workunit.client.0.smithi073.stdout:0/827: dread d2/d37/f45 [0,4194304] 0 2024-04-26T11:24:03.937 INFO:tasks.workunit.client.0.smithi073.stdout:1/904: rename d1/d16/d61/dfe/f115 to d1/d8/d2e/d3c/f137 0 2024-04-26T11:24:03.937 INFO:tasks.workunit.client.0.smithi073.stdout:7/845: link d1/d11/d24/d29/l85 d1/d11/d24/d29/dd7/d4b/l125 0 2024-04-26T11:24:03.937 INFO:tasks.workunit.client.0.smithi073.stdout:9/833: chown d0/d13/d25/d9c 9023630 1 2024-04-26T11:24:03.938 INFO:tasks.workunit.client.0.smithi073.stdout:8/825: link d1/d4/d37/d5b/f69 d1/d4/d4c/f119 0 2024-04-26T11:24:03.938 INFO:tasks.workunit.client.0.smithi073.stdout:4/870: dwrite d8/d1a/d1b/d1d/f21 [8388608,4194304] 0 2024-04-26T11:24:03.938 INFO:tasks.workunit.client.0.smithi073.stdout:0/828: creat d2/d37/d8b/f125 x:0 0 0 2024-04-26T11:24:03.938 INFO:tasks.workunit.client.0.smithi073.stdout:3/795: chown d0/d11/d19/db/d3e/d3f/d69 3 1 2024-04-26T11:24:03.938 INFO:tasks.workunit.client.0.smithi073.stdout:2/795: dwrite dd/de/d38/f9e [0,4194304] 0 2024-04-26T11:24:03.938 INFO:tasks.workunit.client.0.smithi073.stdout:7/846: write d1/d11/d24/d29/f49 [2352581,89158] 0 2024-04-26T11:24:03.939 INFO:tasks.workunit.client.0.smithi073.stdout:8/826: mkdir d1/d4/d4c/d66/d11a 0 2024-04-26T11:24:03.939 INFO:tasks.workunit.client.0.smithi073.stdout:4/871: fdatasync d8/d1a/d9c/f106 0 2024-04-26T11:24:03.939 INFO:tasks.workunit.client.0.smithi073.stdout:3/796: rmdir d0/d11/d19/d52/d102/d8b/dc9 39 2024-04-26T11:24:03.939 INFO:tasks.workunit.client.0.smithi073.stdout:8/827: readlink d1/d4/da9/lf8 0 2024-04-26T11:24:03.939 INFO:tasks.workunit.client.0.smithi073.stdout:3/797: rmdir d0/d11/d23/d86 39 2024-04-26T11:24:03.939 INFO:tasks.workunit.client.0.smithi073.stdout:0/829: getdents d2/d1f/d9c 0 2024-04-26T11:24:03.939 INFO:tasks.workunit.client.0.smithi073.stdout:2/796: rename dd/de/f28 to dd/d4c/d48/d46/d91/d9f/d1d/d8c/ff4 0 2024-04-26T11:24:03.943 INFO:tasks.workunit.client.0.smithi073.stdout:9/834: dwrite d0/d6c/dc7/ff6 [0,4194304] 0 2024-04-26T11:24:03.943 INFO:tasks.workunit.client.0.smithi073.stdout:3/798: dread - d0/d11/d19/d1d/ff5 zero size 2024-04-26T11:24:03.944 INFO:tasks.workunit.client.0.smithi073.stdout:8/828: creat d1/d4/d37/d5b/f11b x:0 0 0 2024-04-26T11:24:03.944 INFO:tasks.workunit.client.0.smithi073.stdout:7/847: rename d1/d33/d1b/d95/fbb to d1/d11/d24/d29/dd7/d3d/d41/d64/f126 0 2024-04-26T11:24:03.944 INFO:tasks.workunit.client.0.smithi073.stdout:4/872: creat d8/d1a/d4d/ddc/d127/f12c x:0 0 0 2024-04-26T11:24:03.944 INFO:tasks.workunit.client.0.smithi073.stdout:2/797: mkdir dd/d4c/d48/d46/d91/da5/df5 0 2024-04-26T11:24:03.944 INFO:tasks.workunit.client.0.smithi073.stdout:3/799: symlink d0/d11/d19/db/d3e/d47/db5/l111 0 2024-04-26T11:24:03.944 INFO:tasks.workunit.client.0.smithi073.stdout:8/829: rename d1/d4/d37/d5b/d83 to d1/d4/d37/dd3/dee/d11c 0 2024-04-26T11:24:03.944 INFO:tasks.workunit.client.0.smithi073.stdout:4/873: stat d8/d1a/d1b/d24/dac/d72/d77/lc9 0 2024-04-26T11:24:03.945 INFO:tasks.workunit.client.0.smithi073.stdout:8/830: fdatasync d1/d4/d15/f75 0 2024-04-26T11:24:03.945 INFO:tasks.workunit.client.0.smithi073.stdout:2/798: dread - dd/de/d38/d53/d60/db2/dc7/fcc zero size 2024-04-26T11:24:03.945 INFO:tasks.workunit.client.0.smithi073.stdout:4/874: fsync d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/fbe 0 2024-04-26T11:24:03.945 INFO:tasks.workunit.client.0.smithi073.stdout:8/831: symlink d1/d4/d15/de4/dfc/d2c/ddd/d67/l11d 0 2024-04-26T11:24:03.945 INFO:tasks.workunit.client.0.smithi073.stdout:8/832: sync 2024-04-26T11:24:03.945 INFO:tasks.workunit.client.0.smithi073.stdout:1/905: dread d1/d8/d5d/f8a [0,4194304] 0 2024-04-26T11:24:03.946 INFO:tasks.workunit.client.0.smithi073.stdout:2/799: mkdir dd/d4c/d48/d46/d91/da5/df6 0 2024-04-26T11:24:03.946 INFO:tasks.workunit.client.0.smithi073.stdout:2/800: sync 2024-04-26T11:24:03.948 INFO:tasks.workunit.client.0.smithi073.stdout:9/835: dwrite d0/d83/f86 [0,4194304] 0 2024-04-26T11:24:03.949 INFO:tasks.workunit.client.0.smithi073.stdout:2/801: write dd/d4c/d48/d46/d91/d9f/d1d/f81 [287478,102911] 0 2024-04-26T11:24:03.949 INFO:tasks.workunit.client.0.smithi073.stdout:1/906: truncate d1/d73/d40/d54/d112/fa5 9818933 0 2024-04-26T11:24:03.949 INFO:tasks.workunit.client.0.smithi073.stdout:1/907: sync 2024-04-26T11:24:03.949 INFO:tasks.workunit.client.0.smithi073.stdout:9/836: rmdir d0/d1a/d4e/d8f 39 2024-04-26T11:24:03.949 INFO:tasks.workunit.client.0.smithi073.stdout:3/800: dwrite d0/d11/d19/db/d3e/d3f/d69/feb [0,4194304] 0 2024-04-26T11:24:03.949 INFO:tasks.workunit.client.0.smithi073.stdout:2/802: symlink dd/de/d38/d4e/lf7 0 2024-04-26T11:24:03.950 INFO:tasks.workunit.client.0.smithi073.stdout:1/908: write d1/d6/d7f/d47/f129 [152577,118068] 0 2024-04-26T11:24:03.950 INFO:tasks.workunit.client.0.smithi073.stdout:9/837: mkdir d0/d1a/d4e/d10b/d120 0 2024-04-26T11:24:03.952 INFO:tasks.workunit.client.0.smithi073.stdout:1/909: readlink d1/d73/d53/dd4/le3 0 2024-04-26T11:24:03.952 INFO:tasks.workunit.client.0.smithi073.stdout:4/875: truncate d8/d1a/d5e/dc5/fc6 2586449 0 2024-04-26T11:24:03.952 INFO:tasks.workunit.client.0.smithi073.stdout:8/833: dwrite d1/d4/d7b/ff5 [0,4194304] 0 2024-04-26T11:24:03.953 INFO:tasks.workunit.client.0.smithi073.stdout:9/838: unlink d0/d13/d5a/d65/fdb 0 2024-04-26T11:24:03.953 INFO:tasks.workunit.client.0.smithi073.stdout:2/803: link dd/d4c/l68 dd/de/lf8 0 2024-04-26T11:24:03.953 INFO:tasks.workunit.client.0.smithi073.stdout:8/834: link d1/d4/d4c/d66/fa0 d1/d4/d7b/d8d/f11e 0 2024-04-26T11:24:03.953 INFO:tasks.workunit.client.0.smithi073.stdout:1/910: fsync d1/d6/d7f/f76 0 2024-04-26T11:24:03.953 INFO:tasks.workunit.client.0.smithi073.stdout:3/801: link d0/d11/d19/c5a d0/d11/d19/db/d3e/d3f/da1/c112 0 2024-04-26T11:24:03.953 INFO:tasks.workunit.client.0.smithi073.stdout:4/876: rename d8/d1a/d1b/d46/d57/cbc to d8/d15/c12d 0 2024-04-26T11:24:03.955 INFO:tasks.workunit.client.0.smithi073.stdout:4/877: chown d8/d1a/d5e/dc5/dfb/dfd 38 1 2024-04-26T11:24:03.956 INFO:tasks.workunit.client.0.smithi073.stdout:1/911: unlink d1/d16/d6a/f72 0 2024-04-26T11:24:03.956 INFO:tasks.workunit.client.0.smithi073.stdout:2/804: symlink dd/de/lf9 0 2024-04-26T11:24:03.956 INFO:tasks.workunit.client.0.smithi073.stdout:3/802: mkdir d0/d2d/df4/d113 0 2024-04-26T11:24:03.956 INFO:tasks.workunit.client.0.smithi073.stdout:8/835: write d1/d4/d15/de4/dfc/d2a/f43 [2504420,56161] 0 2024-04-26T11:24:03.956 INFO:tasks.workunit.client.0.smithi073.stdout:1/912: write d1/d6/db3/fb9 [454355,79192] 0 2024-04-26T11:24:03.957 INFO:tasks.workunit.client.0.smithi073.stdout:3/803: creat d0/d11/d19/d70/daa/f114 x:0 0 0 2024-04-26T11:24:03.958 INFO:tasks.workunit.client.0.smithi073.stdout:3/804: mkdir d0/d11/d19/d52/d102/d60/d104/d115 0 2024-04-26T11:24:03.958 INFO:tasks.workunit.client.0.smithi073.stdout:9/839: dwrite d0/d13/d5a/d5e/fcf [0,4194304] 0 2024-04-26T11:24:03.964 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:03.964 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:24:03.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:24:03.964 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:03.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.964 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 1284087~3916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:03.965 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:03.965 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5481246190000002, 2024-04-26T11:24:03.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075641310000000003, 2024-04-26T11:24:03.965 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.965 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.965 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:03.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413130+0000", 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6770000000000001e-06 2024-04-26T11:24:03.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413138+0000", 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.277e-06 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413143+0000", 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5609999999999998e-06 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478754+0000", 2024-04-26T11:24:03.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065610702000000007 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478846+0000", 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1525000000000002e-05 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478916+0000", 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0630000000000006e-05 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:03.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481402+0000", 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00248577 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488675+0000", 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007273219 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488724+0000", 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8525e-05 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:03.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488764+0000", 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0095000000000002e-05 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 1288003~3903 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5480976860000002, 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075709753000000005, 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413158+0000", 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413175+0000", 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7008999999999999e-05 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413181+0000", 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479410+0000", 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066228713999999994 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479498+0000", 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7478000000000005e-05 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479629+0000", 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013174500000000001 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482049+0000", 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024196249999999999 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488812+0000", 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067625810000000001 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488842+0000", 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0281e-05 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488859+0000", 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7306e-05 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 1291906~6986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5480600129999997, 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079787192000000007, 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.975 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:03.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413195+0000", 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413204+0000", 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7839999999999992e-06 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413210+0000", 2024-04-26T11:24:03.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8440000000000003e-06 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480166+0000", 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066956565999999995 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480263+0000", 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6997999999999995e-05 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:03.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480359+0000", 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5858000000000003e-05 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482071+0000", 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001711918 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492877+0000", 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010805465 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:03.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492942+0000", 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5456999999999993e-05 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492974+0000", 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2162000000000001e-05 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 1298892~7865 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5480319549999999, 2024-04-26T11:24:03.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080075681999999995, 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413225+0000", 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0767e-05 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413233+0000", 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4540000000000001e-06 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413239+0000", 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0959999999999997e-06 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480790+0000", 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067551471000000002 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480867+0000", 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6334000000000005e-05 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480982+0000", 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115395 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484440+0000", 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003458259 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493045+0000", 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086047999999999993 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493113+0000", 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8040000000000006e-05 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493291+0000", 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017755900000000001 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 1306757~7740 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:03.985 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5451138799999997, 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.085136109000000001, 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416132+0000", 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416221+0000", 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8979000000000003e-05 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416233+0000", 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.202e-05 2024-04-26T11:24:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416242+0000", 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3299999999999999e-06 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481553+0000", 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065311285999999996 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481603+0000", 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0191000000000001e-05 2024-04-26T11:24:03.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481668+0000", 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4961000000000004e-05 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484444+0000", 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027755100000000001 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501161+0000", 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016716992999999999 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501229+0000", 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8664000000000005e-05 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501269+0000", 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9956999999999997e-05 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.990 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 1314497~14459 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5443322769999996, 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.084463892999999998, 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:03.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416914+0000", 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416932+0000", 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416943+0000", 2024-04-26T11:24:03.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0456e-05 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416950+0000", 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.345e-06 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482123+0000", 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065173399000000007 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482206+0000", 2024-04-26T11:24:03.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2589000000000005e-05 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482318+0000", 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011194200000000001 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484979+0000", 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026616019999999999 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501313+0000", 2024-04-26T11:24:03.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016333174999999998 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501343+0000", 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0056000000000002e-05 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501379+0000", 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5991999999999997e-05 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 1328956~3568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.542376, 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082605777000000005, 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:03.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418870+0000", 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418878+0000", 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8629999999999997e-06 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:03.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418895+0000", 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6886999999999999e-05 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418904+0000", 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5769999999999994e-06 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482753+0000", 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063849218999999999 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:03.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482799+0000", 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5346999999999998e-05 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482864+0000", 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5124999999999997e-05 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484984+0000", 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021205820000000002 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:03.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501422+0000", 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016438066000000001 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501457+0000", 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5154999999999998e-05 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501477+0000", 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9417999999999999e-05 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 1332524~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5423345030000002, 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082655731999999996, 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:04.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:04.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418912+0000", 2024-04-26T11:24:04.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418920+0000", 2024-04-26T11:24:04.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:04.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418927+0000", 2024-04-26T11:24:04.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6399999999999997e-06 2024-04-26T11:24:04.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418933+0000", 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9270000000000002e-06 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483248+0000", 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064314274000000005 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483345+0000", 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7065000000000007e-05 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483458+0000", 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113285 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484989+0000", 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001531012 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501510+0000", 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016520981000000001 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501535+0000", 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501568+0000", 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2808000000000002e-05 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 1333928~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.006 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5423084110000005, 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082729079999999997, 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:04.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418938+0000", 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418946+0000", 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9929999999999995e-06 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418966+0000", 2024-04-26T11:24:04.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0095e-05 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418973+0000", 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483863+0000", 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064890529000000002 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483929+0000", 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5665000000000002e-05 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484000+0000", 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0903999999999997e-05 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485480+0000", 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001480084 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501598+0000", 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016118789000000001 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501631+0000", 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3015000000000002e-05 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501668+0000", 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6239999999999999e-05 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.011 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 1336693~3915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5421587990000001, 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082682631000000006, 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:04.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419095+0000", 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7219999999999999e-06 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419120+0000", 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4854e-05 2024-04-26T11:24:04.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419127+0000", 2024-04-26T11:24:04.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4540000000000004e-06 2024-04-26T11:24:04.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484461+0000", 2024-04-26T11:24:04.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065334619999999996 2024-04-26T11:24:04.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484507+0000", 2024-04-26T11:24:04.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5906999999999999e-05 2024-04-26T11:24:04.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484612+0000", 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104813 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.486851+0000", 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022388479999999999 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501706+0000", 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014855419999999999 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501734+0000", 2024-04-26T11:24:04.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7617999999999999e-05 2024-04-26T11:24:04.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.021 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:03.962+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:04.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501771+0000", 2024-04-26T11:24:04.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T11:24:04.022 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 1340608~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5391513449999996, 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079811516999999998, 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:04.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422094+0000", 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422107+0000", 2024-04-26T11:24:04.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2762000000000001e-05 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422121+0000", 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3784999999999999e-05 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422134+0000", 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3304e-05 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485009+0000", 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.062874860000000005 2024-04-26T11:24:04.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485053+0000", 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3949000000000002e-05 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485172+0000", 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011921699999999999 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487692+0000", 2024-04-26T11:24:04.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025201939999999999 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501818+0000", 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014125499 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501864+0000", 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6403999999999998e-05 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501907+0000", 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3266000000000002e-05 2024-04-26T11:24:04.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:558 3.2 3:4272d415:::200.0000000b:head [write 1343057~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5391027480000004, 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079859576000000002, 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422153+0000", 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909999999999999e-06 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422161+0000", 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4319999999999999e-06 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422168+0000", 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485516+0000", 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063348074000000004 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485624+0000", 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485781+0000", 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015710100000000001 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487700+0000", 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001918746 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501949+0000", 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014249114 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501973+0000", 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4627e-05 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502004+0000", 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:559 3.2 3:4272d415:::200.0000000b:head [write 1345015~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5390736900000004, 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079931344000000001, 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:04.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422183+0000", 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8959999999999998e-06 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422190+0000", 2024-04-26T11:24:04.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7669999999999998e-06 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422195+0000", 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.011e-06 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487222+0000", 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065027153000000004 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487263+0000", 2024-04-26T11:24:04.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1201000000000001e-05 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487330+0000", 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6507999999999994e-05 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488866+0000", 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001536747 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502050+0000", 2024-04-26T11:24:04.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013183540000000001 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502085+0000", 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4952e-05 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502105+0000", 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9947999999999999e-05 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:560 3.2 3:4272d415:::200.0000000b:head [write 1349228~3445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5390468669999997, 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079997483999999994, 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422208+0000", 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0309999999999998e-06 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422214+0000", 2024-04-26T11:24:04.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6560000000000003e-06 2024-04-26T11:24:04.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422220+0000", 2024-04-26T11:24:04.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6489999999999996e-06 2024-04-26T11:24:04.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487739+0000", 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065519226 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487833+0000", 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4106999999999999e-05 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487972+0000", 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013830099999999999 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492072+0000", 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040998379999999997 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502140+0000", 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010068238 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502165+0000", 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5454999999999999e-05 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502198+0000", 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2478999999999999e-05 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:561 3.2 3:4272d415:::200.0000000b:head [write 1352673~4505 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5390199400000002, 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080048127999999996, 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.043 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:04.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422235+0000", 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422242+0000", 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7670000000000003e-06 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422248+0000", 2024-04-26T11:24:04.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:24:04.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488886+0000", 2024-04-26T11:24:04.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066638785000000006 2024-04-26T11:24:04.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488982+0000", 2024-04-26T11:24:04.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5387e-05 2024-04-26T11:24:04.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489141+0000", 2024-04-26T11:24:04.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015913400000000001 2024-04-26T11:24:04.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492079+0000", 2024-04-26T11:24:04.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029382509999999998 2024-04-26T11:24:04.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502233+0000", 2024-04-26T11:24:04.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010154379 2024-04-26T11:24:04.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502259+0000", 2024-04-26T11:24:04.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5029999999999999e-05 2024-04-26T11:24:04.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502275+0000", 2024-04-26T11:24:04.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6735000000000002e-05 2024-04-26T11:24:04.052 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.052 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.052 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.052 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:562 3.2 3:4272d415:::200.0000000b:head [write 1357178~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.052 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:04.052 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5389935609999998, 2024-04-26T11:24:04.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080110050000000002, 2024-04-26T11:24:04.052 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.053 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.053 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:04.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:04.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422253+0000", 2024-04-26T11:24:04.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422257+0000", 2024-04-26T11:24:04.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-04-26T11:24:04.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422263+0000", 2024-04-26T11:24:04.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0580000000000003e-06 2024-04-26T11:24:04.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422268+0000", 2024-04-26T11:24:04.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-04-26T11:24:04.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489892+0000", 2024-04-26T11:24:04.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067623600000000006 2024-04-26T11:24:04.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490047+0000", 2024-04-26T11:24:04.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154933 2024-04-26T11:24:04.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490335+0000", 2024-04-26T11:24:04.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028846200000000002 2024-04-26T11:24:04.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497761+0000", 2024-04-26T11:24:04.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074257460000000004 2024-04-26T11:24:04.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502307+0000", 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045457910000000004 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502331+0000", 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4601e-05 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502364+0000", 2024-04-26T11:24:04.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2224000000000002e-05 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:563 3.2 3:4272d415:::200.0000000b:head [write 1358582~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5389742139999996, 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080161018000000001, 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422272+0000", 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422280+0000", 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0250000000000002e-06 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422288+0000", 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422293+0000", 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3669999999999996e-06 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491197+0000", 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068903765000000006 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491329+0000", 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013223400000000001 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491443+0000", 2024-04-26T11:24:04.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114159 2024-04-26T11:24:04.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497769+0000", 2024-04-26T11:24:04.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063253190000000003 2024-04-26T11:24:04.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502392+0000", 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004622915 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502415+0000", 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3626e-05 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502434+0000", 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8703999999999999e-05 2024-04-26T11:24:04.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:564 3.2 3:4272d415:::200.0000000b:head [write 1360496~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5389469729999998, 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080221908999999994, 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422304+0000", 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9360000000000001e-06 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422311+0000", 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422317+0000", 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:24:04.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492152+0000", 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069834487000000001 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492258+0000", 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106351 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492423+0000", 2024-04-26T11:24:04.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016443600000000001 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497775+0000", 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053519650000000002 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502465+0000", 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046902660000000002 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502490+0000", 2024-04-26T11:24:04.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4777999999999999e-05 2024-04-26T11:24:04.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502522+0000", 2024-04-26T11:24:04.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2369999999999997e-05 2024-04-26T11:24:04.071 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.071 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.071 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:565 3.2 3:4272d415:::200.0000000b:head [write 1362424~12956 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5378599319999999, 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079271854000000003, 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423386+0000", 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423436+0000", 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0121999999999999e-05 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423449+0000", 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2863e-05 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423459+0000", 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493380+0000", 2024-04-26T11:24:04.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069921187999999995 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493456+0000", 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6416999999999997e-05 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493584+0000", 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000128009 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499173+0000", 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055883599999999997 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502578+0000", 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034056020000000002 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502625+0000", 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6285000000000002e-05 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502659+0000", 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:566 3.2 3:4272d415:::200.0000000b:head [write 1375380~4794 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.5354698850000004, 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.078877303999999995, 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:04.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:04.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425775+0000", 2024-04-26T11:24:04.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:04.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425794+0000", 2024-04-26T11:24:04.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425810+0000", 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.525e-05 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425821+0000", 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0981e-05 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494069+0000", 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068247996000000005 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494115+0000", 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310999999999998e-05 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494183+0000", 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7841000000000003e-05 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499177+0000", 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049940109999999996 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504563+0000", 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053863339999999996 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504614+0000", 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0334999999999998e-05 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:04.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504654+0000", 2024-04-26T11:24:04.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0976000000000002e-05 2024-04-26T11:24:04.083 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.083 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.083 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.083 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.083 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.083 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:04.084 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:04.092 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:04.086+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:04.100 INFO:tasks.workunit.client.0.smithi073.stdout:2/805: dwrite dd/d4c/d48/d46/d91/d9f/d1d/f44 [0,4194304] 0 2024-04-26T11:24:04.100 INFO:tasks.workunit.client.0.smithi073.stdout:8/836: dwrite d1/d4/d7b/d8d/d112/f9c [0,4194304] 0 2024-04-26T11:24:04.100 INFO:tasks.workunit.client.0.smithi073.stdout:2/806: sync 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:2/807: write dd/de/d49/dbb/fc0 [980416,70077] 0 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/840: dwrite d0/d1a/d4e/d70/dae/fdc [0,4194304] 0 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:2/808: chown dd/de/d49/fe8 3618547 1 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/841: dread - d0/d1a/d4e/ff8 zero size 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:8/837: rename d1/d4/d15/de4/dfc/d2c/c103 to d1/d4/d15/de4/dfc/d2c/ddd/c11f 0 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/842: mkdir d0/d83/d121 0 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/843: creat d0/d1a/d4e/d70/d59/d10a/f122 x:0 0 0 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/844: creat d0/d13/d25/d2c/f123 x:0 0 0 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:2/809: dread dd/de/d38/f9e [0,4194304] 0 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/845: mkdir d0/d13/d25/d75/d124 0 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:2/810: write dd/d4c/d48/d46/d91/d9f/d1d/fe4 [929385,79824] 0 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:9/846: chown d0/d1a/d4e/d70/d51/l91 1556208 1 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:8/838: dwrite d1/d4/d15/de4/dfc/d2a/f52 [0,4194304] 0 2024-04-26T11:24:04.101 INFO:tasks.workunit.client.0.smithi073.stdout:1/913: read d1/d6/d7f/ffa [2028118,82865] 0 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:2/811: unlink dd/d27/cd6 0 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:8/839: fdatasync d1/d4/da9/f82 0 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:8/840: creat d1/d4/d37/d5b/f120 x:0 0 0 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:1/914: truncate d1/d8/d2e/fe8 1138912 0 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:2/812: rename dd/d4c/d48/ca1 to dd/d4c/d48/d46/d91/d9f/d1d/d8c/cfa 0 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:2/813: stat dd/d4c/f42 0 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:8/841: write d1/d4/d15/de4/dfc/d2c/ddd/feb [691672,93029] 0 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:1/915: dread - d1/d16/d4f/d55/f10c zero size 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:8/842: write d1/d4/d37/dd3/dee/d11c/fa3 [49787,7353] 0 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:8/843: chown d1/d4/d4c/d66/cbd 35971 1 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:8/844: mkdir d1/d4/da9/d121 0 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:1/916: dwrite d1/d16/d4f/d55/fa3 [0,4194304] 0 2024-04-26T11:24:04.102 INFO:tasks.workunit.client.0.smithi073.stdout:2/814: dwrite dd/de/d49/dbb/fcb [4194304,4194304] 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:1/917: symlink d1/d8/d57/l138 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:8/845: creat d1/d4/d37/dd3/de8/f122 x:0 0 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:2/815: creat dd/de/d38/d4e/dec/ffb x:0 0 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:1/918: creat d1/d16/d61/d109/f139 x:0 0 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:8/846: creat d1/d4/d15/dbc/dc3/f123 x:0 0 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:2/816: rename dd/de/d38/d53/d60/db2/dc7 to dd/de/d49/dbb/dfc 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:8/847: chown d1/d4/cb 262 1 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:2/817: getdents dd/d27/da0/da7 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:2/818: readlink dd/de/d38/d4e/lf7 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:8/848: dwrite d1/d4/d15/dbc/dc3/dc6/ddb/f10b [4194304,4194304] 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:8/849: fdatasync d1/d4/d15/de4/dfc/d2c/ddd/f36 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:7/848: dread d1/d11/d24/d29/dd7/d4b/fbf [0,4194304] 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:2/819: dwrite dd/d4c/d48/d46/d91/d9f/d1d/f5c [0,4194304] 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:6/732: dread d0/d1a/d26/f54 [0,4194304] 0 2024-04-26T11:24:04.103 INFO:tasks.workunit.client.0.smithi073.stdout:8/850: dwrite d1/d4/d7b/d8d/d112/f84 [4194304,4194304] 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:8/851: rename d1/d4/d4c/d66/f78 to d1/d4/da9/f124 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:7/849: creat d1/d11/d24/d29/dd7/d3d/d41/d64/dae/f127 x:0 0 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:6/733: chown d0/d1a/d26/d27/cad 34523 1 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:2/820: unlink dd/d4c/d48/d46/d91/d9f/d1d/c1f 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:6/734: mknod d0/dc/d2e/d6e/cdc 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:2/821: unlink dd/d4c/d48/c8b 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:7/850: rename d1/d33/f97 to d1/d33/d1b/d66/f128 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:8/852: fdatasync d1/d4/d15/dbc/dc3/dc6/f118 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:2/822: stat dd/d27/l92 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:6/735: truncate d0/d1a/d26/d4b/d2b/fdb 234789 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:7/851: mkdir d1/d11/d24/d29/d129 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:6/736: write d0/d1a/d26/d4b/d2b/d2c/fa9 [742308,128806] 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:2/823: rename dd/de/d38/d4e/dec to dd/d4c/d48/d46/d91/da5/df6/dfd 0 2024-04-26T11:24:04.104 INFO:tasks.workunit.client.0.smithi073.stdout:6/737: fsync d0/d1a/d26/d4b/d49/fa3 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:7/852: link d1/d33/d1b/cb9 d1/d11/d24/d29/dd7/d4b/c12a 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:7/853: fdatasync d1/d11/d24/fe4 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:2/824: write dd/d4c/d48/d46/d91/da5/df6/dfd/ffb [1048262,105818] 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:6/738: mkdir d0/d1a/d26/d27/dda/ddd 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:7/854: getdents d1/d11/d24/d29/dd7/d3d 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:7/855: symlink d1/d11/d24/d71/l12b 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:3/805: dread d0/d11/d19/d52/d102/d7a/dce/dd3/f10a [0,4194304] 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:2/825: symlink dd/d4c/d48/d46/d91/da5/df5/lfe 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:7/856: readlink d1/d33/d1b/ldb 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:3/806: fsync d0/d11/d19/db/d3e/d3f/f59 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:5/826: dread d4/de/d15/f9e [0,4194304] 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:2/826: write dd/de/d49/f67 [2859504,17245] 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:3/807: rmdir d0/d11/d19/d5b 39 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:2/827: unlink dd/d4c/d48/f2c 0 2024-04-26T11:24:04.105 INFO:tasks.workunit.client.0.smithi073.stdout:2/828: readlink dd/l2e 0 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:3/808: readlink d0/d11/d19/db/lf3 0 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:2/829: fsync dd/de/d49/f79 0 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:6/739: dwrite d0/d1a/d26/f94 [0,4194304] 0 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:7/857: dwrite d1/d33/d68/d78/daf/d114/f11d [0,4194304] 0 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:7/858: chown d1/d11/d51/dbd/ca5 6028922 1 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:5/827: write d4/de/d15/d67/d103/d105/f10a [4069766,104360] 0 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:3/809: dwrite d0/d11/d19/d52/d102/d7a/dbc/fdd [0,4194304] 0 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:6/740: dwrite d0/d1a/d26/d4b/d63/da0/fd0 [0,4194304] 0 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:0/830: dread d2/d37/f83 [0,4194304] 0 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:3/810: chown d0/d11/d19/d1d/f4c 0 1 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:1/919: dread d1/fe5 [0,4194304] 0 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:4/878: dread d8/d15/f17 [0,4194304] 0 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:1/920: chown d1/d8/d5d/l134 45714 1 2024-04-26T11:24:04.106 INFO:tasks.workunit.client.0.smithi073.stdout:3/811: truncate d0/d11/d19/db/d3e/d3f/f59 4853821 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:7/859: dwrite d1/d11/d24/d29/fa4 [0,4194304] 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:2/830: creat dd/de/d29/d98/df3/fff x:0 0 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:5/828: readlink d4/l37 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:7/860: chown d1/d33/d1b/c21 368298 1 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:6/741: dwrite d0/d1a/d26/d4b/d2b/d43/f88 [0,4194304] 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:1/921: symlink d1/d8/l13a 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:7/861: symlink d1/d33/d1b/d66/l12c 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:6/742: chown d0/d1a/d26/d4b/d63/da0/d7c/fd4 219686992 1 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:6/743: mkdir d0/d1a/d26/d4b/d49/d84/dde 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:1/922: chown d1/d16/d4f/d55/d5a/f7a 101230338 1 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:1/923: fsync d1/d16/d61/f90 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:7/862: link d1/d11/d24/d29/fa4 d1/d33/d1b/d66/f12d 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:3/812: dwrite d0/d11/d19/db/d3e/d47/f79 [0,4194304] 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:6/744: rename d0/d15/dd7 to d0/d1a/d26/d27/dbc/ddf 0 2024-04-26T11:24:04.107 INFO:tasks.workunit.client.0.smithi073.stdout:5/829: dwrite d4/d73/fd6 [0,4194304] 0 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:0/831: dwrite d2/d1f/d40/d48/fc4 [0,4194304] 0 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:5/830: chown d4/de/d23/f36 243397864 1 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:7/863: readlink d1/d11/d24/d29/dd7/d3d/dba/lff 0 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:3/813: symlink d0/d11/d19/d52/d102/d8b/l116 0 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:0/832: write d2/d1f/fda [367774,38998] 0 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:4/879: sync 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:5/831: sync 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:5/832: dread - d4/d8/fb5 zero size 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:6/745: dwrite d0/d1a/d26/d4b/d2b/d2c/fa9 [4194304,4194304] 0 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:1/924: dread d1/d16/d4f/d55/d5a/dc6/fff [0,4194304] 0 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:7/864: dwrite d1/d11/d51/dbd/f102 [0,4194304] 0 2024-04-26T11:24:04.108 INFO:tasks.workunit.client.0.smithi073.stdout:7/865: read - d1/d11/d24/d29/dd7/d80/da0/f107 zero size 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:2/831: read dd/d4c/d48/d46/f69 [5565909,78202] 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:2/832: write dd/d4c/d48/d46/d91/d9f/d1d/fbd [267408,69828] 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:9/847: dread d0/d13/db/f23 [0,4194304] 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:4/880: dwrite d8/d1a/d1b/d24/dac/d49/d85/f79 [4194304,4194304] 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:4/881: getdents d8/d1a/d1b/d24/dac/d49/d85/d8b 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:1/925: link d1/d6/d7f/d8f/de9/f11c d1/d73/d40/f13b 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:4/882: unlink d8/d1a/d9c/f106 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:5/833: dwrite d4/de/d15/d33/ffc [4194304,4194304] 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:7/866: dwrite d1/d11/d24/d29/dd7/d3d/d41/d64/f126 [0,4194304] 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:7/867: rename d1/d11/d24/d29/dd7/d4b/c12a to d1/d11/d24/d29/dd7/d80/da0/c12e 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:7/868: sync 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:7/869: symlink d1/d11/d24/d29/dd7/d80/df9/d11f/l12f 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:0/833: truncate d2/fbd 3161309 0 2024-04-26T11:24:04.109 INFO:tasks.workunit.client.0.smithi073.stdout:7/870: stat d1/d11/d24/d29/dd7/f6f 0 2024-04-26T11:24:04.110 INFO:tasks.workunit.client.0.smithi073.stdout:4/883: dwrite d8/d1a/d5e/d7c/f82 [0,4194304] 0 2024-04-26T11:24:04.110 INFO:tasks.workunit.client.0.smithi073.stdout:9/848: write d0/d1a/d4e/d70/d46/f8a [2071092,93276] 0 2024-04-26T11:24:04.110 INFO:tasks.workunit.client.0.smithi073.stdout:7/871: mkdir d1/d11/d24/d29/dd7/d80/df9/d11f/d124/d130 0 2024-04-26T11:24:04.110 INFO:tasks.workunit.client.0.smithi073.stdout:1/926: write d1/d16/d4f/d55/d5a/dc6/fca [3305845,19394] 0 2024-04-26T11:24:04.110 INFO:tasks.workunit.client.0.smithi073.stdout:1/927: write d1/d73/d34/f7e [5258223,96439] 0 2024-04-26T11:24:04.110 INFO:tasks.workunit.client.0.smithi073.stdout:9/849: chown d0/d13/d25/d75/d8e/db9/lca 4542 1 2024-04-26T11:24:04.110 INFO:tasks.workunit.client.0.smithi073.stdout:4/884: getdents d8/d1a/d4d 0 2024-04-26T11:24:04.110 INFO:tasks.workunit.client.0.smithi073.stdout:4/885: stat d8/d1a/d1b/dd2/d114 0 2024-04-26T11:24:04.110 INFO:tasks.workunit.client.0.smithi073.stdout:7/872: creat d1/d11/d24/d29/d129/f131 x:0 0 0 2024-04-26T11:24:04.110 INFO:tasks.workunit.client.0.smithi073.stdout:4/886: read - d8/d1a/d1b/dd2/fed zero size 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:9/850: mkdir d0/d13/d25/d75/d8e/db9/d125 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:1/928: fdatasync d1/d8/d2e/fe8 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:2/833: read dd/de/d38/d53/f74 [1333400,108945] 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:0/834: dwrite d2/d37/d8b/f125 [0,4194304] 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:7/873: dwrite d1/d33/d1b/fe7 [0,4194304] 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:1/929: rmdir d1/d73/d40/d54 39 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:2/834: mknod dd/de/d49/dbb/dfc/c100 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:5/834: dread d4/d73/d8a/dc8/f112 [0,4194304] 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:2/835: chown dd/de/ca9 15 1 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:1/930: mkdir d1/d73/d34/d98/daa/dee/d13c 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:4/887: truncate d8/d15/da1/fa9 31064 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:9/851: getdents d0/d1a/d4e/d70/d59/de8 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:0/835: write d2/d1f/d40/d48/d62/f71 [1213123,82700] 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:7/874: creat d1/d33/d68/f132 x:0 0 0 2024-04-26T11:24:04.111 INFO:tasks.workunit.client.0.smithi073.stdout:4/888: readlink d8/d1a/d1b/d24/dac/d49/dad/lce 0 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:8/853: dread d1/d4/d15/de4/dfc/d2a/f43 [0,4194304] 0 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:4/889: chown d8/d15/da1/df2/c7d 382 1 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:7/875: rmdir d1/d11/d24/de0 39 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:4/890: fdatasync d8/d1a/d1b/d24/dac/d49/f101 0 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:0/836: rename d2/d1f/d40/d48/c70 to d2/d1f/d40/d48/da9/de6/c126 0 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:2/836: getdents dd/d4c/d48/d46/d91 0 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:1/931: creat d1/d73/f13d x:0 0 0 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:7/876: fsync d1/d33/d68/d78/f101 0 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:2/837: chown dd/d27/da0/ce7 142 1 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:1/932: write d1/d73/d40/d44/d8e/f12e [56475,70158] 0 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:2/838: write dd/de/d6b/f5f [4005330,98659] 0 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:1/933: chown d1/d16/d4f/d55/c66 0 1 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:1/934: rename d1/d8/dfb to d1/d73/d34/d98/dce/d13e 0 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:8/854: dwrite d1/d4/da9/fc0 [0,4194304] 0 2024-04-26T11:24:04.112 INFO:tasks.workunit.client.0.smithi073.stdout:1/935: creat d1/d6/d62/f13f x:0 0 0 2024-04-26T11:24:04.113 INFO:tasks.workunit.client.0.smithi073.stdout:7/877: dwrite d1/d11/d24/d29/dd7/d3d/d41/d64/dae/fd8 [0,4194304] 0 2024-04-26T11:24:04.113 INFO:tasks.workunit.client.0.smithi073.stdout:1/936: symlink d1/d73/d34/d98/daa/l140 0 2024-04-26T11:24:04.113 INFO:tasks.workunit.client.0.smithi073.stdout:1/937: write d1/d16/d6a/f71 [232188,74722] 0 2024-04-26T11:24:04.113 INFO:tasks.workunit.client.0.smithi073.stdout:1/938: chown d1/d73/d53/dd4/le3 1252106 1 2024-04-26T11:24:04.115 INFO:tasks.workunit.client.0.smithi073.stdout:8/855: dwrite d1/d4/d15/fe9 [0,4194304] 0 2024-04-26T11:24:04.115 INFO:tasks.workunit.client.0.smithi073.stdout:7/878: dread d1/d33/d1b/fe7 [0,4194304] 0 2024-04-26T11:24:04.115 INFO:tasks.workunit.client.0.smithi073.stdout:8/856: write d1/d4/d37/d5b/f7c [1802056,91570] 0 2024-04-26T11:24:04.115 INFO:tasks.workunit.client.0.smithi073.stdout:7/879: mkdir d1/d11/d24/d29/dd7/d3d/d133 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:8/857: mkdir d1/d4/d15/dbc/d125 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:8/858: symlink d1/d4/d15/dbc/dc3/dc6/l126 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:7/880: stat d1/d33/d1b/l2b 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:2/839: truncate dd/de/d49/dbb/fcb 7256739 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:8/859: write d1/f18 [2099996,24800] 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:7/881: symlink d1/d33/d1b/l134 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:2/840: symlink dd/de/d49/dbb/l101 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:8/860: chown d1/d4/d7b/d8d/d112/l9f 267793065 1 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:2/841: mkdir dd/de/d38/d53/d60/db2/d102 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:7/882: rename d1/d33/c13 to d1/d11/d24/d29/c135 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:2/842: getdents dd/de/d49 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:9/852: dread d0/d13/d5a/d5e/f6d [0,4194304] 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:6/746: dread d0/dc/d2e/d6e/f70 [0,4194304] 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:9/853: write d0/d1a/d4e/d70/d59/f112 [597155,115360] 0 2024-04-26T11:24:04.116 INFO:tasks.workunit.client.0.smithi073.stdout:7/883: chown d1/d11/d24/d29/dd7/d3d/d41/d64/l9b 437617913 1 2024-04-26T11:24:04.117 INFO:tasks.workunit.client.0.smithi073.stdout:6/747: mknod d0/d1a/d26/d4b/d49/d84/dde/ce0 0 2024-04-26T11:24:04.117 INFO:tasks.workunit.client.0.smithi073.stdout:7/884: symlink d1/d11/d24/d29/dd7/d80/da0/dd2/l136 0 2024-04-26T11:24:04.117 INFO:tasks.workunit.client.0.smithi073.stdout:8/861: dwrite d1/d4/d37/d5b/f104 [0,4194304] 0 2024-04-26T11:24:04.117 INFO:tasks.workunit.client.0.smithi073.stdout:9/854: unlink d0/d1a/d4e/d70/d46/df2/f114 0 2024-04-26T11:24:04.117 INFO:tasks.workunit.client.0.smithi073.stdout:7/885: creat d1/d33/d1b/d66/d50/f137 x:0 0 0 2024-04-26T11:24:04.117 INFO:tasks.workunit.client.0.smithi073.stdout:9/855: sync 2024-04-26T11:24:04.118 INFO:tasks.workunit.client.0.smithi073.stdout:7/886: chown d1/d11/d51/dca/cd6 63371389 1 2024-04-26T11:24:04.119 INFO:tasks.workunit.client.0.smithi073.stdout:9/856: chown d0/d1a/d4e/d70/d59/f112 1 1 2024-04-26T11:24:04.119 INFO:tasks.workunit.client.0.smithi073.stdout:2/843: dwrite dd/de/d38/d4e/f51 [0,4194304] 0 2024-04-26T11:24:04.120 INFO:tasks.workunit.client.0.smithi073.stdout:7/887: creat d1/d33/d68/f138 x:0 0 0 2024-04-26T11:24:04.120 INFO:tasks.workunit.client.0.smithi073.stdout:9/857: creat d0/d13/d25/d75/d8e/db9/f126 x:0 0 0 2024-04-26T11:24:04.121 INFO:tasks.workunit.client.0.smithi073.stdout:8/862: truncate d1/d4/d37/d5b/f7c 458788 0 2024-04-26T11:24:04.121 INFO:tasks.workunit.client.0.smithi073.stdout:2/844: truncate dd/de/d38/d53/dc3/dd3/fe3 108345 0 2024-04-26T11:24:04.121 INFO:tasks.workunit.client.0.smithi073.stdout:9/858: write d0/d13/d25/d2c/f53 [5988832,9057] 0 2024-04-26T11:24:04.122 INFO:tasks.workunit.client.0.smithi073.stdout:9/859: readlink d0/d13/d25/d9c/lc8 0 2024-04-26T11:24:04.123 INFO:tasks.workunit.client.0.smithi073.stdout:2/845: creat dd/de/d38/d53/d9d/f103 x:0 0 0 2024-04-26T11:24:04.124 INFO:tasks.workunit.client.0.smithi073.stdout:9/860: creat d0/d1a/d4e/d70/d51/f127 x:0 0 0 2024-04-26T11:24:04.124 INFO:tasks.workunit.client.0.smithi073.stdout:1/939: dread d1/d73/d40/d44/f4e [0,4194304] 0 2024-04-26T11:24:04.125 INFO:tasks.workunit.client.0.smithi073.stdout:3/814: dread d0/f45 [0,4194304] 0 2024-04-26T11:24:04.126 INFO:tasks.workunit.client.0.smithi073.stdout:9/861: mknod d0/d1a/c128 0 2024-04-26T11:24:04.126 INFO:tasks.workunit.client.0.smithi073.stdout:2/846: chown dd/d27/da0/ce7 2011 1 2024-04-26T11:24:04.128 INFO:tasks.workunit.client.0.smithi073.stdout:3/815: mkdir d0/d11/d19/d52/d102/d117 0 2024-04-26T11:24:04.129 INFO:tasks.workunit.client.0.smithi073.stdout:2/847: fsync dd/de/d6b/f61 0 2024-04-26T11:24:04.129 INFO:tasks.workunit.client.0.smithi073.stdout:9/862: mkdir d0/d13/d5a/d116/d129 0 2024-04-26T11:24:04.130 INFO:tasks.workunit.client.0.smithi073.stdout:7/888: dwrite d1/d11/d24/fe4 [0,4194304] 0 2024-04-26T11:24:04.130 INFO:tasks.workunit.client.0.smithi073.stdout:6/748: dread d0/d19/f21 [0,4194304] 0 2024-04-26T11:24:04.131 INFO:tasks.workunit.client.0.smithi073.stdout:5/835: dread d4/d8/d9/d7d/d84/da7/db7/dcd/df1/df3/f102 [0,4194304] 0 2024-04-26T11:24:04.133 INFO:tasks.workunit.client.0.smithi073.stdout:8/863: dwrite d1/d4/d15/de4/dfc/d2c/ddd/d67/f98 [0,4194304] 0 2024-04-26T11:24:04.133 INFO:tasks.workunit.client.0.smithi073.stdout:7/889: rmdir d1/d11/d24/d29/dd7/d80/da0/dd2 39 2024-04-26T11:24:04.133 INFO:tasks.workunit.client.0.smithi073.stdout:2/848: creat dd/de/d29/d98/df3/f104 x:0 0 0 2024-04-26T11:24:04.134 INFO:tasks.workunit.client.0.smithi073.stdout:3/816: rename d0/d11/l7b to d0/d11/d19/d52/d102/d8b/d8c/da3/l118 0 2024-04-26T11:24:04.134 INFO:tasks.workunit.client.0.smithi073.stdout:2/849: write f6 [5263454,87913] 0 2024-04-26T11:24:04.135 INFO:tasks.workunit.client.0.smithi073.stdout:2/850: fdatasync dd/de/d38/d4e/f51 0 2024-04-26T11:24:04.136 INFO:tasks.workunit.client.0.smithi073.stdout:9/863: dwrite d0/d1a/d4e/d70/d51/ff4 [0,4194304] 0 2024-04-26T11:24:04.138 INFO:tasks.workunit.client.0.smithi073.stdout:5/836: rename d4/d8/cf to d4/d73/d8a/da0/c12b 0 2024-04-26T11:24:04.139 INFO:tasks.workunit.client.0.smithi073.stdout:2/851: creat dd/de/d49/f105 x:0 0 0 2024-04-26T11:24:04.139 INFO:tasks.workunit.client.0.smithi073.stdout:5/837: write d4/f7a [1076314,54830] 0 2024-04-26T11:24:04.141 INFO:tasks.workunit.client.0.smithi073.stdout:5/838: write f2 [8798022,27896] 0 2024-04-26T11:24:04.141 INFO:tasks.workunit.client.0.smithi073.stdout:0/837: dread d2/d1f/d40/d48/ff3 [0,4194304] 0 2024-04-26T11:24:04.143 INFO:tasks.workunit.client.0.smithi073.stdout:6/749: write d0/d1a/d26/d4b/d2b/d43/f88 [4569692,102689] 0 2024-04-26T11:24:04.143 INFO:tasks.workunit.client.0.smithi073.stdout:3/817: write d0/fac [72758,125793] 0 2024-04-26T11:24:04.143 INFO:tasks.workunit.client.0.smithi073.stdout:6/750: sync 2024-04-26T11:24:04.144 INFO:tasks.workunit.client.0.smithi073.stdout:9/864: truncate d0/d13/f1f 3213846 0 2024-04-26T11:24:04.144 INFO:tasks.workunit.client.0.smithi073.stdout:2/852: symlink dd/d4c/d48/d46/d91/da5/df6/dfd/l106 0 2024-04-26T11:24:04.144 INFO:tasks.workunit.client.0.smithi073.stdout:7/890: dwrite d1/d11/d10/f110 [0,4194304] 0 2024-04-26T11:24:04.144 INFO:tasks.workunit.client.0.smithi073.stdout:0/838: rename d2/d22/d51/d57/d78/c9e to d2/d1f/d40/d48/c127 0 2024-04-26T11:24:04.145 INFO:tasks.workunit.client.0.smithi073.stdout:4/891: dread d8/d1a/d1b/d24/dac/d49/d85/f71 [0,4194304] 0 2024-04-26T11:24:04.145 INFO:tasks.workunit.client.0.smithi073.stdout:2/853: symlink dd/de/d49/l107 0 2024-04-26T11:24:04.145 INFO:tasks.workunit.client.0.smithi073.stdout:3/818: chown d0/d34/f68 76 1 2024-04-26T11:24:04.146 INFO:tasks.workunit.client.0.smithi073.stdout:0/839: unlink d2/d1f/d40/d48/l59 0 2024-04-26T11:24:04.146 INFO:tasks.workunit.client.0.smithi073.stdout:2/854: mknod dd/d27/da0/dd5/c108 0 2024-04-26T11:24:04.147 INFO:tasks.workunit.client.0.smithi073.stdout:9/865: rename d0/fdf to d0/d1a/d4e/d10b/f12a 0 2024-04-26T11:24:04.147 INFO:tasks.workunit.client.0.smithi073.stdout:6/751: mknod d0/d1a/d4e/d67/ce1 0 2024-04-26T11:24:04.148 INFO:tasks.workunit.client.0.smithi073.stdout:4/892: write d8/d1a/d1b/dd2/fda [863037,62452] 0 2024-04-26T11:24:04.150 INFO:tasks.workunit.client.0.smithi073.stdout:3/819: dread - d0/d11/d19/db/d3e/d3f/d69/fbf zero size 2024-04-26T11:24:04.151 INFO:tasks.workunit.client.0.smithi073.stdout:9/866: fsync d0/d13/f20 0 2024-04-26T11:24:04.151 INFO:tasks.workunit.client.0.smithi073.stdout:3/820: sync 2024-04-26T11:24:04.151 INFO:tasks.workunit.client.0.smithi073.stdout:5/839: dread d4/d8/f81 [0,4194304] 0 2024-04-26T11:24:04.151 INFO:tasks.workunit.client.0.smithi073.stdout:7/891: truncate d1/d11/d51/dca/f105 370645 0 2024-04-26T11:24:04.151 INFO:tasks.workunit.client.0.smithi073.stdout:1/940: dread d1/d73/d34/fc9 [0,4194304] 0 2024-04-26T11:24:04.151 INFO:tasks.workunit.client.0.smithi073.stdout:0/840: mknod d2/d1f/d40/d48/d122/c128 0 2024-04-26T11:24:04.151 INFO:tasks.workunit.client.0.smithi073.stdout:2/855: unlink dd/d4c/d48/d46/d91/d9f/d1d/d8c/f99 0 2024-04-26T11:24:04.152 INFO:tasks.workunit.client.0.smithi073.stdout:5/840: chown d4/d8/d8e/cce 245799 1 2024-04-26T11:24:04.152 INFO:tasks.workunit.client.0.smithi073.stdout:6/752: creat d0/d1a/d26/d4b/d2b/d2c/fe2 x:0 0 0 2024-04-26T11:24:04.152 INFO:tasks.workunit.client.0.smithi073.stdout:8/864: dwrite d1/d4/d37/d5b/f69 [0,4194304] 0 2024-04-26T11:24:04.152 INFO:tasks.workunit.client.0.smithi073.stdout:4/893: write d8/d1a/d5e/d7c/f7f [1297700,34783] 0 2024-04-26T11:24:04.153 INFO:tasks.workunit.client.0.smithi073.stdout:5/841: creat d4/d8/d8e/f12c x:0 0 0 2024-04-26T11:24:04.153 INFO:tasks.workunit.client.0.smithi073.stdout:8/865: read d1/d4/d15/dbc/dc3/dc6/fe1 [1446197,78109] 0 2024-04-26T11:24:04.153 INFO:tasks.workunit.client.0.smithi073.stdout:9/867: rename d0/d1a/d4e/lf7 to d0/d13/d25/d75/d98/l12b 0 2024-04-26T11:24:04.153 INFO:tasks.workunit.client.0.smithi073.stdout:9/868: sync 2024-04-26T11:24:04.153 INFO:tasks.workunit.client.0.smithi073.stdout:6/753: creat d0/d15/d2d/fe3 x:0 0 0 2024-04-26T11:24:04.158 INFO:tasks.workunit.client.0.smithi073.stdout:1/941: mkdir d1/d73/d34/d98/daa/dee/d13c/d141 0 2024-04-26T11:24:04.158 INFO:tasks.workunit.client.0.smithi073.stdout:6/754: creat d0/d1a/d26/d4b/d63/fe4 x:0 0 0 2024-04-26T11:24:04.159 INFO:tasks.workunit.client.0.smithi073.stdout:5/842: symlink d4/d8/l12d 0 2024-04-26T11:24:04.159 INFO:tasks.workunit.client.0.smithi073.stdout:3/821: link d0/d11/d23/fa7 d0/d11/d19/d52/d102/d8b/d8c/da3/f119 0 2024-04-26T11:24:04.159 INFO:tasks.workunit.client.0.smithi073.stdout:1/942: creat d1/d6/db3/d9f/f142 x:0 0 0 2024-04-26T11:24:04.159 INFO:tasks.workunit.client.0.smithi073.stdout:5/843: unlink d4/de/d15/d33/l90 0 2024-04-26T11:24:04.159 INFO:tasks.workunit.client.0.smithi073.stdout:6/755: creat d0/d1a/d26/d27/dda/ddd/fe5 x:0 0 0 2024-04-26T11:24:04.159 INFO:tasks.workunit.client.0.smithi073.stdout:1/943: mkdir d1/d8/d2e/d3c/d143 0 2024-04-26T11:24:04.159 INFO:tasks.workunit.client.0.smithi073.stdout:5/844: mkdir d4/d8/d9/d12e 0 2024-04-26T11:24:04.159 INFO:tasks.workunit.client.0.smithi073.stdout:6/756: unlink d0/d15/d9a/fcd 0 2024-04-26T11:24:04.161 INFO:tasks.workunit.client.0.smithi073.stdout:1/944: symlink d1/d8/d2e/d3c/d143/l144 0 2024-04-26T11:24:04.161 INFO:tasks.workunit.client.0.smithi073.stdout:9/869: dwrite d0/d13/db/f4b [0,4194304] 0 2024-04-26T11:24:04.161 INFO:tasks.workunit.client.0.smithi073.stdout:8/866: dwrite d1/d4/d4c/f6c [4194304,4194304] 0 2024-04-26T11:24:04.163 INFO:tasks.workunit.client.0.smithi073.stdout:3/822: dwrite d0/d11/d19/d52/d102/d7a/dbc/fd0 [0,4194304] 0 2024-04-26T11:24:04.165 INFO:tasks.workunit.client.0.smithi073.stdout:5/845: mkdir d4/de/d15/d12f 0 2024-04-26T11:24:04.165 INFO:tasks.workunit.client.0.smithi073.stdout:6/757: symlink d0/d1a/d26/d4b/d49/d84/le6 0 2024-04-26T11:24:04.165 INFO:tasks.workunit.client.0.smithi073.stdout:8/867: mknod d1/d4/d4c/c127 0 2024-04-26T11:24:04.166 INFO:tasks.workunit.client.0.smithi073.stdout:5/846: write d4/de/d15/ff9 [920632,45284] 0 2024-04-26T11:24:04.167 INFO:tasks.workunit.client.0.smithi073.stdout:8/868: rmdir d1/d4/d7b 39 2024-04-26T11:24:04.168 INFO:tasks.workunit.client.0.smithi073.stdout:3/823: getdents d0/d11/d19/db/d3e/d3f/d69/d96 0 2024-04-26T11:24:04.168 INFO:tasks.workunit.client.0.smithi073.stdout:9/870: dwrite d0/d1a/d4e/d70/d51/f127 [0,4194304] 0 2024-04-26T11:24:04.169 INFO:tasks.workunit.client.0.smithi073.stdout:5/847: symlink d4/d8/d9/d7d/d84/da7/db7/dcd/l130 0 2024-04-26T11:24:04.170 INFO:tasks.workunit.client.0.smithi073.stdout:5/848: write d4/f1f [2098972,125927] 0 2024-04-26T11:24:04.171 INFO:tasks.workunit.client.0.smithi073.stdout:8/869: getdents d1/d4/d37/dd3/dee 0 2024-04-26T11:24:04.171 INFO:tasks.workunit.client.0.smithi073.stdout:8/870: stat d1/cc2 0 2024-04-26T11:24:04.171 INFO:tasks.workunit.client.0.smithi073.stdout:5/849: mkdir d4/de/d15/d67/d103/d105/d131 0 2024-04-26T11:24:04.172 INFO:tasks.workunit.client.0.smithi073.stdout:8/871: unlink d1/d4/d4c/d66/f8f 0 2024-04-26T11:24:04.172 INFO:tasks.workunit.client.0.smithi073.stdout:5/850: rename d4/d8/d9/d7d/l80 to d4/d8/dc3/l132 0 2024-04-26T11:24:04.173 INFO:tasks.workunit.client.0.smithi073.stdout:5/851: fdatasync d4/d73/fd6 0 2024-04-26T11:24:04.174 INFO:tasks.workunit.client.0.smithi073.stdout:1/945: dread d1/d16/d4f/d55/da2/dcd/ffd [0,4194304] 0 2024-04-26T11:24:04.175 INFO:tasks.workunit.client.0.smithi073.stdout:3/824: dwrite d0/d11/d19/d1d/ff5 [0,4194304] 0 2024-04-26T11:24:04.176 INFO:tasks.workunit.client.0.smithi073.stdout:1/946: fdatasync d1/d16/d4f/d55/f10c 0 2024-04-26T11:24:04.178 INFO:tasks.workunit.client.0.smithi073.stdout:3/825: write d0/d11/d19/d1d/f44 [1418672,107789] 0 2024-04-26T11:24:04.178 INFO:tasks.workunit.client.0.smithi073.stdout:1/947: creat d1/d8/d5d/ddf/d11f/f145 x:0 0 0 2024-04-26T11:24:04.180 INFO:tasks.workunit.client.0.smithi073.stdout:8/872: dwrite d1/d4/d15/db7/df7/ffb [0,4194304] 0 2024-04-26T11:24:04.180 INFO:tasks.workunit.client.0.smithi073.stdout:1/948: unlink d1/d73/f35 0 2024-04-26T11:24:04.181 INFO:tasks.workunit.client.0.smithi073.stdout:5/852: dwrite d4/f1f [4194304,4194304] 0 2024-04-26T11:24:04.182 INFO:tasks.workunit.client.0.smithi073.stdout:9/871: dwrite d0/fa7 [0,4194304] 0 2024-04-26T11:24:04.182 INFO:tasks.workunit.client.0.smithi073.stdout:1/949: truncate d1/d16/d4f/dd5/f93 997384 0 2024-04-26T11:24:04.183 INFO:tasks.workunit.client.0.smithi073.stdout:2/856: dread - dd/fee zero size 2024-04-26T11:24:04.183 INFO:tasks.workunit.client.0.smithi073.stdout:1/950: dread - d1/d16/d61/d109/f139 zero size 2024-04-26T11:24:04.187 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:04.184+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:04.187 INFO:tasks.workunit.client.0.smithi073.stdout:7/892: creat d1/d11/d24/d29/dd7/d80/dc3/f139 x:0 0 0 2024-04-26T11:24:04.187 INFO:tasks.workunit.client.0.smithi073.stdout:5/853: write d4/d8/dff/f11d [841073,46422] 0 2024-04-26T11:24:04.187 INFO:tasks.workunit.client.0.smithi073.stdout:2/857: rmdir dd/d27/da0/dd5 39 2024-04-26T11:24:04.188 INFO:tasks.workunit.client.0.smithi073.stdout:8/873: dwrite d1/d4/d15/dbc/dc3/dc6/ddb/dfe/f117 [0,4194304] 0 2024-04-26T11:24:04.188 INFO:tasks.workunit.client.0.smithi073.stdout:3/826: dwrite d0/d34/f4e [0,4194304] 0 2024-04-26T11:24:04.189 INFO:tasks.workunit.client.0.smithi073.stdout:9/872: symlink d0/d1a/d4e/d10b/d120/l12c 0 2024-04-26T11:24:04.189 INFO:tasks.workunit.client.0.smithi073.stdout:7/893: fdatasync d1/d11/d10/f9c 0 2024-04-26T11:24:04.190 INFO:tasks.workunit.client.0.smithi073.stdout:5/854: mknod d4/de/d15/d67/d103/c133 0 2024-04-26T11:24:04.191 INFO:tasks.workunit.client.0.smithi073.stdout:9/873: unlink d0/d13/d25/d75/ld0 0 2024-04-26T11:24:04.191 INFO:tasks.workunit.client.0.smithi073.stdout:2/858: write dd/d4c/d48/d46/d91/d9f/f5e [52755,119383] 0 2024-04-26T11:24:04.191 INFO:tasks.workunit.client.0.smithi073.stdout:5/855: write d4/de/f10 [783343,101470] 0 2024-04-26T11:24:04.192 INFO:tasks.workunit.client.0.smithi073.stdout:3/827: write d0/d11/d19/db/d3e/d47/f73 [3032768,34330] 0 2024-04-26T11:24:04.193 INFO:tasks.workunit.client.0.smithi073.stdout:3/828: sync 2024-04-26T11:24:04.194 INFO:tasks.workunit.client.0.smithi073.stdout:1/951: dwrite d1/d73/d34/d98/ff9 [0,4194304] 0 2024-04-26T11:24:04.194 INFO:tasks.workunit.client.0.smithi073.stdout:9/874: write d0/d1a/d4e/ff8 [740541,10864] 0 2024-04-26T11:24:04.194 INFO:tasks.workunit.client.0.smithi073.stdout:3/829: rmdir d0 39 2024-04-26T11:24:04.194 INFO:tasks.workunit.client.0.smithi073.stdout:2/859: write dd/d4c/d48/d46/f69 [3534348,32372] 0 2024-04-26T11:24:04.194 INFO:tasks.workunit.client.0.smithi073.stdout:9/875: fdatasync d0/d1a/d4e/d70/feb 0 2024-04-26T11:24:04.194 INFO:tasks.workunit.client.0.smithi073.stdout:7/894: rename d1/d11/d24/de0 to d1/d11/d24/d29/dd7/d80/da0/d13a 0 2024-04-26T11:24:04.195 INFO:tasks.workunit.client.0.smithi073.stdout:1/952: symlink d1/d73/d34/d98/daa/l146 0 2024-04-26T11:24:04.195 INFO:tasks.workunit.client.0.smithi073.stdout:5/856: link d4/d8/d8e/cce d4/de/dc6/c134 0 2024-04-26T11:24:04.195 INFO:tasks.workunit.client.0.smithi073.stdout:9/876: unlink d0/l68 0 2024-04-26T11:24:04.196 INFO:tasks.workunit.client.0.smithi073.stdout:2/860: rename dd/d4c/d48/d46/d91/d9f/d1d/f35 to dd/de/f109 0 2024-04-26T11:24:04.196 INFO:tasks.workunit.client.0.smithi073.stdout:5/857: creat d4/de/f135 x:0 0 0 2024-04-26T11:24:04.196 INFO:tasks.workunit.client.0.smithi073.stdout:9/877: fsync d0/d1a/d4e/d70/d46/f8a 0 2024-04-26T11:24:04.197 INFO:tasks.workunit.client.0.smithi073.stdout:0/841: truncate d2/d1f/d9d/f121 46002 0 2024-04-26T11:24:04.197 INFO:tasks.workunit.client.0.smithi073.stdout:3/830: rename d0/d11/d19/d5b/f7e to d0/d11/d23/d86/d10c/f11a 0 2024-04-26T11:24:04.197 INFO:tasks.workunit.client.0.smithi073.stdout:5/858: rmdir d4/de/d15/d67/d103/d105 39 2024-04-26T11:24:04.197 INFO:tasks.workunit.client.0.smithi073.stdout:9/878: mkdir d0/d13/d25/d75/d124/d12d 0 2024-04-26T11:24:04.198 INFO:tasks.workunit.client.0.smithi073.stdout:2/861: chown dd/de/d38/d53/d60/db2/cc5 291 1 2024-04-26T11:24:04.198 INFO:tasks.workunit.client.0.smithi073.stdout:3/831: chown d0/fdf 7566 1 2024-04-26T11:24:04.198 INFO:tasks.workunit.client.0.smithi073.stdout:9/879: chown d0/d83/lab 70331872 1 2024-04-26T11:24:04.200 INFO:tasks.workunit.client.0.smithi073.stdout:2/862: creat dd/f10a x:0 0 0 2024-04-26T11:24:04.200 INFO:tasks.workunit.client.0.smithi073.stdout:5/859: mknod d4/d8/d9/d7d/d84/da7/db7/dcd/df1/df3/c136 0 2024-04-26T11:24:04.200 INFO:tasks.workunit.client.0.smithi073.stdout:9/880: read d0/d1a/d4e/d70/d51/f127 [3649258,112794] 0 2024-04-26T11:24:04.200 INFO:tasks.workunit.client.0.smithi073.stdout:2/863: readlink dd/d4c/d48/d77/lb4 0 2024-04-26T11:24:04.200 INFO:tasks.workunit.client.0.smithi073.stdout:5/860: chown d4/de/l8c 0 1 2024-04-26T11:24:04.200 INFO:tasks.workunit.client.0.smithi073.stdout:3/832: truncate d0/d11/d19/d52/d102/d7a/dbc/f10d 558094 0 2024-04-26T11:24:04.200 INFO:tasks.workunit.client.0.smithi073.stdout:2/864: mkdir dd/d10b 0 2024-04-26T11:24:04.201 INFO:tasks.workunit.client.0.smithi073.stdout:9/881: link d0/d1a/d4e/d70/feb d0/d3c/dcc/f12e 0 2024-04-26T11:24:04.201 INFO:tasks.workunit.client.0.smithi073.stdout:3/833: symlink d0/d11/d19/d52/d102/l11b 0 2024-04-26T11:24:04.201 INFO:tasks.workunit.client.0.smithi073.stdout:2/865: fdatasync dd/d4c/d48/d46/d91/da5/df6/dfd/ffb 0 2024-04-26T11:24:04.202 INFO:tasks.workunit.client.0.smithi073.stdout:9/882: creat d0/d1a/d4e/d70/dd6/f12f x:0 0 0 2024-04-26T11:24:04.204 INFO:tasks.workunit.client.0.smithi073.stdout:3/834: symlink d0/d11/d19/d52/d102/d8b/d8c/d90/db4/l11c 0 2024-04-26T11:24:04.204 INFO:tasks.workunit.client.0.smithi073.stdout:9/883: read - d0/d1a/d4e/d70/dd6/f12f zero size 2024-04-26T11:24:04.204 INFO:tasks.workunit.client.0.smithi073.stdout:8/874: truncate d1/d4/d15/de4/dfc/d2c/ddd/d67/fba 1405023 0 2024-04-26T11:24:04.204 INFO:tasks.workunit.client.0.smithi073.stdout:7/895: truncate d1/d33/d68/fad 3256908 0 2024-04-26T11:24:04.205 INFO:tasks.workunit.client.0.smithi073.stdout:0/842: dwrite d2/d22/d51/d57/d78/f117 [0,4194304] 0 2024-04-26T11:24:04.205 INFO:tasks.workunit.client.0.smithi073.stdout:9/884: stat d0/d13/d25/l27 0 2024-04-26T11:24:04.206 INFO:tasks.workunit.client.0.smithi073.stdout:3/835: symlink d0/d11/d19/d52/d102/d60/d104/d115/l11d 0 2024-04-26T11:24:04.207 INFO:tasks.workunit.client.0.smithi073.stdout:8/875: chown d1/d4/d15/db7/f114 1022045346 1 2024-04-26T11:24:04.207 INFO:tasks.workunit.client.0.smithi073.stdout:7/896: chown d1/d11/d24/d29/dd7/d3d/f93 14 1 2024-04-26T11:24:04.208 INFO:tasks.workunit.client.0.smithi073.stdout:0/843: write d2/d1f/d9c/db1/f10f [4208672,127599] 0 2024-04-26T11:24:04.209 INFO:tasks.workunit.client.0.smithi073.stdout:4/894: dread d8/d14/d60/f6f [0,4194304] 0 2024-04-26T11:24:04.209 INFO:tasks.workunit.client.0.smithi073.stdout:7/897: creat d1/d33/f13b x:0 0 0 2024-04-26T11:24:04.209 INFO:tasks.workunit.client.0.smithi073.stdout:0/844: fdatasync d2/d1f/d40/f82 0 2024-04-26T11:24:04.210 INFO:tasks.workunit.client.0.smithi073.stdout:5/861: truncate d4/d8/dff/f108 3129014 0 2024-04-26T11:24:04.210 INFO:tasks.workunit.client.0.smithi073.stdout:4/895: rmdir d8/d1a/d4d/ddc 39 2024-04-26T11:24:04.212 INFO:tasks.workunit.client.0.smithi073.stdout:5/862: creat d4/d8/d8e/f137 x:0 0 0 2024-04-26T11:24:04.213 INFO:tasks.workunit.client.0.smithi073.stdout:4/896: write d8/d1f/f5f [3797123,84430] 0 2024-04-26T11:24:04.213 INFO:tasks.workunit.client.0.smithi073.stdout:2/866: dwrite dd/de/d38/f9e [0,4194304] 0 2024-04-26T11:24:04.214 INFO:tasks.workunit.client.0.smithi073.stdout:2/867: dread - dd/d4c/d48/d46/fdc zero size 2024-04-26T11:24:04.216 INFO:tasks.workunit.client.0.smithi073.stdout:0/845: link d2/d1f/d9c/f100 d2/d1f/d40/d48/d62/de5/f129 0 2024-04-26T11:24:04.216 INFO:tasks.workunit.client.0.smithi073.stdout:9/885: dwrite d0/d1a/d4e/d70/d51/ff4 [0,4194304] 0 2024-04-26T11:24:04.216 INFO:tasks.workunit.client.0.smithi073.stdout:8/876: write d1/fdc [1127550,107339] 0 2024-04-26T11:24:04.217 INFO:tasks.workunit.client.0.smithi073.stdout:5/863: mknod d4/de/d15/d67/c138 0 2024-04-26T11:24:04.217 INFO:tasks.workunit.client.0.smithi073.stdout:0/846: fsync d2/d22/d51/fd1 0 2024-04-26T11:24:04.217 INFO:tasks.workunit.client.0.smithi073.stdout:5/864: readlink d4/df8/l115 0 2024-04-26T11:24:04.217 INFO:tasks.workunit.client.0.smithi073.stdout:9/886: write d0/d1a/d4e/d70/d46/f8a [478654,81990] 0 2024-04-26T11:24:04.218 INFO:tasks.workunit.client.0.smithi073.stdout:6/758: dread d0/d1a/d26/d4b/d2b/f3e [0,4194304] 0 2024-04-26T11:24:04.222 INFO:tasks.workunit.client.0.smithi073.stdout:9/887: write d0/d13/db/f85 [85118,66826] 0 2024-04-26T11:24:04.223 INFO:tasks.workunit.client.0.smithi073.stdout:3/836: truncate d0/d11/d23/f88 1363993 0 2024-04-26T11:24:04.224 INFO:tasks.workunit.client.0.smithi073.stdout:6/759: write d0/d19/f60 [3463406,95580] 0 2024-04-26T11:24:04.225 INFO:tasks.workunit.client.0.smithi073.stdout:1/953: dread d1/d73/d40/d54/d112/fa5 [4194304,4194304] 0 2024-04-26T11:24:04.232 INFO:tasks.workunit.client.0.smithi073.stdout:5/865: dwrite d4/d73/fd6 [0,4194304] 0 2024-04-26T11:24:04.232 INFO:tasks.workunit.client.0.smithi073.stdout:8/877: dwrite d1/d4/d4c/fbe [0,4194304] 0 2024-04-26T11:24:04.232 INFO:tasks.workunit.client.0.smithi073.stdout:6/760: write d0/d1a/d26/d4b/d2b/d2c/f76 [1151002,75799] 0 2024-04-26T11:24:04.232 INFO:tasks.workunit.client.0.smithi073.stdout:9/888: dwrite d0/d13/f20 [0,4194304] 0 2024-04-26T11:24:04.232 INFO:tasks.workunit.client.0.smithi073.stdout:3/837: symlink d0/d11/d19/db/d51/l11e 0 2024-04-26T11:24:04.233 INFO:tasks.workunit.client.0.smithi073.stdout:6/761: fdatasync d0/d1a/d7a/f85 0 2024-04-26T11:24:04.233 INFO:tasks.workunit.client.0.smithi073.stdout:5/866: creat d4/d8/dff/f139 x:0 0 0 2024-04-26T11:24:04.233 INFO:tasks.workunit.client.0.smithi073.stdout:1/954: creat d1/d73/d40/f147 x:0 0 0 2024-04-26T11:24:04.233 INFO:tasks.workunit.client.0.smithi073.stdout:8/878: fdatasync d1/d4/d15/de4/dfc/d2a/fb0 0 2024-04-26T11:24:04.233 INFO:tasks.workunit.client.0.smithi073.stdout:8/879: stat d1/d4/d4c/d66/c9d 0 2024-04-26T11:24:04.233 INFO:tasks.workunit.client.0.smithi073.stdout:6/762: write d0/d1a/d26/d4b/d63/fe4 [916613,103568] 0 2024-04-26T11:24:04.234 INFO:tasks.workunit.client.0.smithi073.stdout:1/955: creat d1/d8/d2e/d3c/d143/f148 x:0 0 0 2024-04-26T11:24:04.234 INFO:tasks.workunit.client.0.smithi073.stdout:0/847: dwrite d2/d22/d51/d57/d78/f94 [0,4194304] 0 2024-04-26T11:24:04.235 INFO:tasks.workunit.client.0.smithi073.stdout:3/838: mknod d0/d11/d19/d52/d102/d8b/d8c/d106/c11f 0 2024-04-26T11:24:04.235 INFO:tasks.workunit.client.0.smithi073.stdout:8/880: dread - d1/d4/d15/de4/dfc/d2c/ddd/fc9 zero size 2024-04-26T11:24:04.235 INFO:tasks.workunit.client.0.smithi073.stdout:1/956: write d1/d6/db3/d9f/f119 [32307,59204] 0 2024-04-26T11:24:04.235 INFO:tasks.workunit.client.0.smithi073.stdout:3/839: chown d0/d11/d19/d52/c10f 35495 1 2024-04-26T11:24:04.236 INFO:tasks.workunit.client.0.smithi073.stdout:0/848: creat d2/d37/f12a x:0 0 0 2024-04-26T11:24:04.237 INFO:tasks.workunit.client.0.smithi073.stdout:1/957: creat d1/d16/d4f/d55/d5a/f149 x:0 0 0 2024-04-26T11:24:04.237 INFO:tasks.workunit.client.0.smithi073.stdout:9/889: truncate d0/d13/d25/d2c/f123 60273 0 2024-04-26T11:24:04.237 INFO:tasks.workunit.client.0.smithi073.stdout:8/881: chown d1/d4/d7b/d8d/d112/fad 3996 1 2024-04-26T11:24:04.238 INFO:tasks.workunit.client.0.smithi073.stdout:1/958: mkdir d1/d6/d7f/d8f/d14a 0 2024-04-26T11:24:04.238 INFO:tasks.workunit.client.0.smithi073.stdout:5/867: write d4/d8/d8e/fab [300862,86887] 0 2024-04-26T11:24:04.239 INFO:tasks.workunit.client.0.smithi073.stdout:9/890: chown d0/d1a/d4e/d70/d46/fff 27281777 1 2024-04-26T11:24:04.239 INFO:tasks.workunit.client.0.smithi073.stdout:0/849: chown d2/d1f/d40/d48/da9/de6/c126 0 1 2024-04-26T11:24:04.239 INFO:tasks.workunit.client.0.smithi073.stdout:3/840: rename d0/d11/d19/db/lf3 to d0/d11/d19/db/d51/l120 0 2024-04-26T11:24:04.241 INFO:tasks.workunit.client.0.smithi073.stdout:1/959: mknod d1/d8/d5d/ddf/d11f/c14b 0 2024-04-26T11:24:04.241 INFO:tasks.workunit.client.0.smithi073.stdout:4/897: dread d8/d1a/d1b/d24/dac/d49/f91 [0,4194304] 0 2024-04-26T11:24:04.241 INFO:tasks.workunit.client.0.smithi073.stdout:6/763: dwrite d0/dc/d80/d97/da2/fae [0,4194304] 0 2024-04-26T11:24:04.241 INFO:tasks.workunit.client.0.smithi073.stdout:6/764: stat d0/d1a/d26/d4b 0 2024-04-26T11:24:04.243 INFO:tasks.workunit.client.0.smithi073.stdout:9/891: mknod d0/d13/d25/d2c/c130 0 2024-04-26T11:24:04.243 INFO:tasks.workunit.client.0.smithi073.stdout:0/850: creat d2/d1f/d40/d48/da9/de6/f12b x:0 0 0 2024-04-26T11:24:04.243 INFO:tasks.workunit.client.0.smithi073.stdout:4/898: fdatasync d8/f13 0 2024-04-26T11:24:04.243 INFO:tasks.workunit.client.0.smithi073.stdout:1/960: unlink d1/d73/f23 0 2024-04-26T11:24:04.243 INFO:tasks.workunit.client.0.smithi073.stdout:6/765: creat d0/d1a/d26/d27/dda/fe7 x:0 0 0 2024-04-26T11:24:04.243 INFO:tasks.workunit.client.0.smithi073.stdout:5/868: link d4/de/l5e d4/d73/d8a/dc8/l13a 0 2024-04-26T11:24:04.243 INFO:tasks.workunit.client.0.smithi073.stdout:0/851: symlink d2/d84/l12c 0 2024-04-26T11:24:04.245 INFO:tasks.workunit.client.0.smithi073.stdout:9/892: mkdir d0/d13/d5a/d116/d131 0 2024-04-26T11:24:04.245 INFO:tasks.workunit.client.0.smithi073.stdout:6/766: mknod d0/d15/d2d/d3f/ce8 0 2024-04-26T11:24:04.245 INFO:tasks.workunit.client.0.smithi073.stdout:4/899: read - d8/d1a/d4d/ddc/d127/f12c zero size 2024-04-26T11:24:04.245 INFO:tasks.workunit.client.0.smithi073.stdout:9/893: sync 2024-04-26T11:24:04.245 INFO:tasks.workunit.client.0.smithi073.stdout:0/852: write d2/d1f/f28 [5665805,96643] 0 2024-04-26T11:24:04.245 INFO:tasks.workunit.client.0.smithi073.stdout:5/869: symlink d4/d8/d9/d7d/d84/da7/db7/d127/da5/l13b 0 2024-04-26T11:24:04.246 INFO:tasks.workunit.client.0.smithi073.stdout:0/853: mknod d2/d37/c12d 0 2024-04-26T11:24:04.247 INFO:tasks.workunit.client.0.smithi073.stdout:6/767: link d0/d19/d20/f65 d0/d1a/d26/d4b/d2b/fe9 0 2024-04-26T11:24:04.247 INFO:tasks.workunit.client.0.smithi073.stdout:0/854: fsync d2/d37/d3c/d73/f7c 0 2024-04-26T11:24:04.248 INFO:tasks.workunit.client.0.smithi073.stdout:6/768: creat d0/d1a/d26/d27/fea x:0 0 0 2024-04-26T11:24:04.249 INFO:tasks.workunit.client.0.smithi073.stdout:0/855: mknod d2/d37/d8b/c12e 0 2024-04-26T11:24:04.249 INFO:tasks.workunit.client.0.smithi073.stdout:0/856: sync 2024-04-26T11:24:04.249 INFO:tasks.workunit.client.0.smithi073.stdout:0/857: chown d2/d1f/d40/d48/da9/dd8 110187791 1 2024-04-26T11:24:04.249 INFO:tasks.workunit.client.0.smithi073.stdout:0/858: sync 2024-04-26T11:24:04.249 INFO:tasks.workunit.client.0.smithi073.stdout:0/859: sync 2024-04-26T11:24:04.250 INFO:tasks.workunit.client.0.smithi073.stdout:0/860: write d2/d37/d8b/fba [287629,24002] 0 2024-04-26T11:24:04.250 INFO:tasks.workunit.client.0.smithi073.stdout:8/882: dread d1/d4/f55 [0,4194304] 0 2024-04-26T11:24:04.251 INFO:tasks.workunit.client.0.smithi073.stdout:3/841: dread - d0/d11/d19/db/d3e/d3f/da1/fc0 zero size 2024-04-26T11:24:04.252 INFO:tasks.workunit.client.0.smithi073.stdout:4/900: dwrite d8/d14/fd7 [0,4194304] 0 2024-04-26T11:24:04.252 INFO:tasks.workunit.client.0.smithi073.stdout:0/861: truncate d2/d37/f12a 462093 0 2024-04-26T11:24:04.252 INFO:tasks.workunit.client.0.smithi073.stdout:1/961: truncate d1/d6/d7f/d47/fc2 1725709 0 2024-04-26T11:24:04.253 INFO:tasks.workunit.client.0.smithi073.stdout:8/883: mkdir d1/d4/d4c/d101/d128 0 2024-04-26T11:24:04.253 INFO:tasks.workunit.client.0.smithi073.stdout:3/842: stat d0/d11/d19/db/ddc/d3c/l5f 0 2024-04-26T11:24:04.253 INFO:tasks.workunit.client.0.smithi073.stdout:1/962: dread - d1/d8/d5d/ddf/d11f/f145 zero size 2024-04-26T11:24:04.253 INFO:tasks.workunit.client.0.smithi073.stdout:9/894: truncate d0/d6c/dc7/fce 513227 0 2024-04-26T11:24:04.254 INFO:tasks.workunit.client.0.smithi073.stdout:4/901: truncate d8/d1a/d1b/dd2/d114/f128 335020 0 2024-04-26T11:24:04.254 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:04.255 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:24:04.255 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:04.257 INFO:tasks.workunit.client.0.smithi073.stdout:8/884: creat d1/d4/d15/dbc/d125/f129 x:0 0 0 2024-04-26T11:24:04.257 INFO:tasks.workunit.client.0.smithi073.stdout:5/870: read d4/d8/d9/d42/f9c [3257601,88043] 0 2024-04-26T11:24:04.257 INFO:tasks.workunit.client.0.smithi073.stdout:1/963: write d1/d8/d2e/d3c/f3e [4788236,111720] 0 2024-04-26T11:24:04.257 INFO:tasks.workunit.client.0.smithi073.stdout:4/902: symlink d8/d1a/d9c/d9d/l12e 0 2024-04-26T11:24:04.257 INFO:tasks.workunit.client.0.smithi073.stdout:4/903: stat d8/d1a/d5e/d7c/f90 0 2024-04-26T11:24:04.257 INFO:tasks.workunit.client.0.smithi073.stdout:5/871: write d4/d8/d8e/f10c [866992,13622] 0 2024-04-26T11:24:04.258 INFO:tasks.workunit.client.0.smithi073.stdout:3/843: link d0/d11/d19/d70/cc6 d0/d11/d19/c121 0 2024-04-26T11:24:04.258 INFO:tasks.workunit.client.0.smithi073.stdout:2/868: dread dd/de/d49/dbb/dfc/ff0 [0,4194304] 0 2024-04-26T11:24:04.258 INFO:tasks.workunit.client.0.smithi073.stdout:0/862: dread d2/d1f/d9d/f121 [0,4194304] 0 2024-04-26T11:24:04.260 INFO:tasks.workunit.client.0.smithi073.stdout:6/769: dread d0/d15/d2d/d3f/f98 [0,4194304] 0 2024-04-26T11:24:04.261 INFO:tasks.workunit.client.0.smithi073.stdout:4/904: creat d8/d1a/d1b/d24/dac/d72/da3/f12f x:0 0 0 2024-04-26T11:24:04.261 INFO:tasks.workunit.client.0.smithi073.stdout:1/964: link d1/cea d1/d16/d4f/dae/c14c 0 2024-04-26T11:24:04.261 INFO:tasks.workunit.client.0.smithi073.stdout:9/895: read d0/d13/d5a/db2/de1/fe6 [2255739,110548] 0 2024-04-26T11:24:04.261 INFO:tasks.workunit.client.0.smithi073.stdout:3/844: write d0/d11/d19/db/d3e/d47/f79 [678259,120284] 0 2024-04-26T11:24:04.261 INFO:tasks.workunit.client.0.smithi073.stdout:0/863: fdatasync d2/d1f/d40/d48/dc1/fc6 0 2024-04-26T11:24:04.261 INFO:tasks.workunit.client.0.smithi073.stdout:1/965: read d1/d73/d34/fc9 [37241,20756] 0 2024-04-26T11:24:04.262 INFO:tasks.workunit.client.0.smithi073.stdout:4/905: chown d8/d1a/d1b/d24/dac/f50 144 1 2024-04-26T11:24:04.262 INFO:tasks.workunit.client.0.smithi073.stdout:7/898: dread d1/d11/d24/d29/dd7/d3d/d41/d64/f4c [0,4194304] 0 2024-04-26T11:24:04.262 INFO:tasks.workunit.client.0.smithi073.stdout:2/869: creat dd/d4c/d48/d46/d91/da5/df6/f10c x:0 0 0 2024-04-26T11:24:04.262 INFO:tasks.workunit.client.0.smithi073.stdout:6/770: rename d0/d1a/d26/d4b/d2b/d2c to d0/d15/d2d/d3f/d59/deb 0 2024-04-26T11:24:04.264 INFO:tasks.workunit.client.0.smithi073.stdout:6/771: chown d0/c36 450 1 2024-04-26T11:24:04.264 INFO:tasks.workunit.client.0.smithi073.stdout:3/845: symlink d0/d11/d19/d52/d102/d7a/dbc/l122 0 2024-04-26T11:24:04.264 INFO:tasks.workunit.client.0.smithi073.stdout:2/870: read dd/de/d49/dbb/dfc/ff0 [2288825,104121] 0 2024-04-26T11:24:04.264 INFO:tasks.workunit.client.0.smithi073.stdout:6/772: readlink d0/dc/d55/lb9 0 2024-04-26T11:24:04.264 INFO:tasks.workunit.client.0.smithi073.stdout:4/906: mkdir d8/d1a/d1b/d24/dac/d49/d84/d130 0 2024-04-26T11:24:04.264 INFO:tasks.workunit.client.0.smithi073.stdout:1/966: getdents d1/d73/d34 0 2024-04-26T11:24:04.265 INFO:tasks.workunit.client.0.smithi073.stdout:8/885: dwrite d1/d4/d15/de4/dfc/d2c/ddd/d67/fa6 [0,4194304] 0 2024-04-26T11:24:04.265 INFO:tasks.workunit.client.0.smithi073.stdout:4/907: write d8/d1a/d5e/f69 [1766669,19897] 0 2024-04-26T11:24:04.267 INFO:tasks.workunit.client.0.smithi073.stdout:7/899: truncate d1/d11/fb4 123804 0 2024-04-26T11:24:04.267 INFO:tasks.workunit.client.0.smithi073.stdout:2/871: rename dd/de/d38/d53/d60/db2/fdb to dd/d27/f10d 0 2024-04-26T11:24:04.268 INFO:tasks.workunit.client.0.smithi073.stdout:1/967: truncate d1/d8/d5d/d89/de6/f118 250359 0 2024-04-26T11:24:04.268 INFO:tasks.workunit.client.0.smithi073.stdout:4/908: chown d8/d1a/d1b/d24/dac/d72/d77/f7a 6126696 1 2024-04-26T11:24:04.269 INFO:tasks.workunit.client.0.smithi073.stdout:7/900: write d1/d11/d5e/d8f/f91 [4836690,72368] 0 2024-04-26T11:24:04.269 INFO:tasks.workunit.client.0.smithi073.stdout:9/896: dwrite d0/d1a/d4e/d70/dd6/ff9 [0,4194304] 0 2024-04-26T11:24:04.270 INFO:tasks.workunit.client.0.smithi073.stdout:1/968: creat d1/d73/d40/d54/f14d x:0 0 0 2024-04-26T11:24:04.271 INFO:tasks.workunit.client.0.smithi073.stdout:4/909: dread - d8/d1a/d4d/ddc/dde/f124 zero size 2024-04-26T11:24:04.271 INFO:tasks.workunit.client.0.smithi073.stdout:3/846: dwrite d0/d2d/f89 [0,4194304] 0 2024-04-26T11:24:04.272 INFO:tasks.workunit.client.0.smithi073.stdout:9/897: chown d0/d13/db/le 21672 1 2024-04-26T11:24:04.272 INFO:tasks.workunit.client.0.smithi073.stdout:4/910: dread - d8/d1a/d1b/f129 zero size 2024-04-26T11:24:04.276 INFO:tasks.workunit.client.0.smithi073.stdout:9/898: stat d0/d13/lb5 0 2024-04-26T11:24:04.276 INFO:tasks.workunit.client.0.smithi073.stdout:1/969: truncate d1/d6/db3/d9f/f119 758902 0 2024-04-26T11:24:04.276 INFO:tasks.workunit.client.0.smithi073.stdout:5/872: dread d4/d8/dff/f11d [0,4194304] 0 2024-04-26T11:24:04.276 INFO:tasks.workunit.client.0.smithi073.stdout:7/901: rename d1/d33/d68/d78/daf/l11c to d1/d11/d24/d29/d129/l13c 0 2024-04-26T11:24:04.277 INFO:tasks.workunit.client.0.smithi073.stdout:9/899: unlink d0/d13/d5a/d5e/cd2 0 2024-04-26T11:24:04.277 INFO:tasks.workunit.client.0.smithi073.stdout:1/970: chown d1/d73/d40/f2f 239 1 2024-04-26T11:24:04.277 INFO:tasks.workunit.client.0.smithi073.stdout:5/873: dread - d4/d8/d8e/f12c zero size 2024-04-26T11:24:04.277 INFO:tasks.workunit.client.0.smithi073.stdout:7/902: mkdir d1/d33/d1b/d95/d13d 0 2024-04-26T11:24:04.278 INFO:tasks.workunit.client.0.smithi073.stdout:4/911: read - d8/d1a/d1b/d46/d57/f121 zero size 2024-04-26T11:24:04.279 INFO:tasks.workunit.client.0.smithi073.stdout:2/872: dwrite dd/de/d49/f79 [0,4194304] 0 2024-04-26T11:24:04.280 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:04.281 INFO:tasks.workunit.client.0.smithi073.stdout:1/971: truncate d1/d8/d5d/ddf/d11f/f145 826604 0 2024-04-26T11:24:04.281 INFO:tasks.workunit.client.0.smithi073.stdout:8/886: dwrite d1/d4/d15/de4/dfc/d2a/fb0 [0,4194304] 0 2024-04-26T11:24:04.282 INFO:tasks.workunit.client.0.smithi073.stdout:4/912: chown d8/d15/da1/ff1 4104909 1 2024-04-26T11:24:04.282 INFO:tasks.workunit.client.0.smithi073.stdout:0/864: dread d2/d22/f33 [0,4194304] 0 2024-04-26T11:24:04.284 INFO:tasks.workunit.client.0.smithi073.stdout:4/913: stat d8/d1a/d1b/d46/d57/f121 0 2024-04-26T11:24:04.284 INFO:tasks.workunit.client.0.smithi073.stdout:7/903: link d1/d11/d5e/d8f/l103 d1/d11/d24/d29/d129/l13e 0 2024-04-26T11:24:04.284 INFO:tasks.workunit.client.0.smithi073.stdout:0/865: write d2/f13 [3904484,70131] 0 2024-04-26T11:24:04.284 INFO:tasks.workunit.client.0.smithi073.stdout:3/847: dwrite d0/d11/d19/d1d/ff5 [0,4194304] 0 2024-04-26T11:24:04.284 INFO:tasks.workunit.client.0.smithi073.stdout:1/972: dread d1/d16/d4f/d55/da2/dcd/ffd [0,4194304] 0 2024-04-26T11:24:04.290 INFO:tasks.workunit.client.0.smithi073.stdout:8/887: link d1/d4/d7b/d8d/d112/f84 d1/d4/d37/dd3/d105/f12a 0 2024-04-26T11:24:04.290 INFO:tasks.workunit.client.0.smithi073.stdout:0/866: unlink d2/d1f/d40/d48/da9/dd8/f105 0 2024-04-26T11:24:04.290 INFO:tasks.workunit.client.0.smithi073.stdout:7/904: symlink d1/d11/d5e/d8f/ddf/l13f 0 2024-04-26T11:24:04.290 INFO:tasks.workunit.client.0.smithi073.stdout:1/973: mknod d1/d6/d7f/d8f/c14e 0 2024-04-26T11:24:04.291 INFO:tasks.workunit.client.0.smithi073.stdout:3/848: write d0/d11/d19/d1d/f44 [5149856,94476] 0 2024-04-26T11:24:04.291 INFO:tasks.workunit.client.0.smithi073.stdout:1/974: chown d1/d8/d5d/d89/de6 389 1 2024-04-26T11:24:04.291 INFO:tasks.workunit.client.0.smithi073.stdout:7/905: mkdir d1/d11/d10/d140 0 2024-04-26T11:24:04.291 INFO:tasks.workunit.client.0.smithi073.stdout:3/849: dread - d0/d11/d23/fa7 zero size 2024-04-26T11:24:04.291 INFO:tasks.workunit.client.0.smithi073.stdout:2/873: truncate dd/de/d38/f9e 1405145 0 2024-04-26T11:24:04.291 INFO:tasks.workunit.client.0.smithi073.stdout:5/874: truncate d4/d8/d9/d7d/da3/fba 3850135 0 2024-04-26T11:24:04.292 INFO:tasks.workunit.client.0.smithi073.stdout:8/888: truncate d1/d4/d15/de4/dfc/d2c/ddd/ff0 4460695 0 2024-04-26T11:24:04.292 INFO:tasks.workunit.client.0.smithi073.stdout:0/867: truncate d2/d1f/d40/d48/f52 602450 0 2024-04-26T11:24:04.292 INFO:tasks.workunit.client.0.smithi073.stdout:7/906: fdatasync d1/ddc/f10c 0 2024-04-26T11:24:04.292 INFO:tasks.workunit.client.0.smithi073.stdout:1/975: unlink d1/d16/d4f/dd5/f99 0 2024-04-26T11:24:04.292 INFO:tasks.workunit.client.0.smithi073.stdout:9/900: dwrite d0/d13/d5a/d5e/fcf [0,4194304] 0 2024-04-26T11:24:04.292 INFO:tasks.workunit.client.0.smithi073.stdout:2/874: chown dd/de/d49/dbb/fbf 529054158 1 2024-04-26T11:24:04.292 INFO:tasks.workunit.client.0.smithi073.stdout:8/889: chown d1/d4/d7b/d8d 1018 1 2024-04-26T11:24:04.293 INFO:tasks.workunit.client.0.smithi073.stdout:0/868: write d2/d22/f68 [8860598,36503] 0 2024-04-26T11:24:04.293 INFO:tasks.workunit.client.0.smithi073.stdout:2/875: chown dd/c13 36 1 2024-04-26T11:24:04.299 INFO:tasks.workunit.client.0.smithi073.stdout:0/869: write d2/d22/d51/fc8 [206138,88342] 0 2024-04-26T11:24:04.299 INFO:tasks.workunit.client.0.smithi073.stdout:7/907: creat d1/d33/d68/d78/daf/f141 x:0 0 0 2024-04-26T11:24:04.299 INFO:tasks.workunit.client.0.smithi073.stdout:3/850: rmdir d0/d11/d19/d52/d102/d8b/d8c/d106 39 2024-04-26T11:24:04.300 INFO:tasks.workunit.client.0.smithi073.stdout:1/976: mknod d1/d73/d40/d54/d112/c14f 0 2024-04-26T11:24:04.300 INFO:tasks.workunit.client.0.smithi073.stdout:9/901: dread d0/d13/d25/d2c/f123 [0,4194304] 0 2024-04-26T11:24:04.300 INFO:tasks.workunit.client.0.smithi073.stdout:2/876: write dd/d4c/d48/d46/d91/d9f/d1d/f5c [3355558,16970] 0 2024-04-26T11:24:04.300 INFO:tasks.workunit.client.0.smithi073.stdout:8/890: rename d1/d4/d37/dd3/de8/f94 to d1/d4/d4c/d101/f12b 0 2024-04-26T11:24:04.300 INFO:tasks.workunit.client.0.smithi073.stdout:2/877: fsync dd/de/f11 0 2024-04-26T11:24:04.301 INFO:tasks.workunit.client.0.smithi073.stdout:3/851: dread - d0/d11/d19/db/ddc/fed zero size 2024-04-26T11:24:04.301 INFO:tasks.workunit.client.0.smithi073.stdout:7/908: unlink d1/d33/d1b/lf0 0 2024-04-26T11:24:04.301 INFO:tasks.workunit.client.0.smithi073.stdout:3/852: creat d0/d11/d19/d52/d102/d60/d104/d115/f123 x:0 0 0 2024-04-26T11:24:04.301 INFO:tasks.workunit.client.0.smithi073.stdout:0/870: creat d2/d37/d3c/d116/f12f x:0 0 0 2024-04-26T11:24:04.301 INFO:tasks.workunit.client.0.smithi073.stdout:9/902: creat d0/d3c/dcc/f132 x:0 0 0 2024-04-26T11:24:04.301 INFO:tasks.workunit.client.0.smithi073.stdout:0/871: sync 2024-04-26T11:24:04.302 INFO:tasks.workunit.client.0.smithi073.stdout:8/891: symlink d1/d4/d37/dd3/de8/d10a/l12c 0 2024-04-26T11:24:04.302 INFO:tasks.workunit.client.0.smithi073.stdout:1/977: getdents d1/d16/d4f/d55/da2/dcd 0 2024-04-26T11:24:04.302 INFO:tasks.workunit.client.0.smithi073.stdout:1/978: sync 2024-04-26T11:24:04.302 INFO:tasks.workunit.client.0.smithi073.stdout:5/875: dwrite d4/d8/dff/f111 [0,4194304] 0 2024-04-26T11:24:04.302 INFO:tasks.workunit.client.0.smithi073.stdout:3/853: truncate d0/d26/f8f 5009002 0 2024-04-26T11:24:04.302 INFO:tasks.workunit.client.0.smithi073.stdout:1/979: fdatasync d1/d8/f122 0 2024-04-26T11:24:04.303 INFO:tasks.workunit.client.0.smithi073.stdout:7/909: getdents d1/d33 0 2024-04-26T11:24:04.303 INFO:tasks.workunit.client.0.smithi073.stdout:0/872: truncate d2/d110/f114 381930 0 2024-04-26T11:24:04.303 INFO:tasks.workunit.client.0.smithi073.stdout:5/876: stat d4/d8/dc3/ff6 0 2024-04-26T11:24:04.303 INFO:tasks.workunit.client.0.smithi073.stdout:9/903: write d0/d3c/dcc/f132 [256891,74400] 0 2024-04-26T11:24:04.304 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:04.292+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:04.307 INFO:tasks.workunit.client.0.smithi073.stdout:3/854: symlink d0/d11/d19/db/d3e/d3f/d69/d96/l124 0 2024-04-26T11:24:04.308 INFO:tasks.workunit.client.0.smithi073.stdout:1/980: unlink d1/d16/d6a/lb0 0 2024-04-26T11:24:04.308 INFO:tasks.workunit.client.0.smithi073.stdout:9/904: rmdir d0/d13/d5a/db2/de1/df5 39 2024-04-26T11:24:04.308 INFO:tasks.workunit.client.0.smithi073.stdout:7/910: dread - d1/d11/d24/d29/dd7/d3d/dba/fc4 zero size 2024-04-26T11:24:04.308 INFO:tasks.workunit.client.0.smithi073.stdout:5/877: rmdir d4/d8/d9/d7d/d84/da7/db7/dcd/df1/df3/d12a 0 2024-04-26T11:24:04.308 INFO:tasks.workunit.client.0.smithi073.stdout:3/855: readlink d0/d11/d19/d1d/lbe 0 2024-04-26T11:24:04.308 INFO:tasks.workunit.client.0.smithi073.stdout:8/892: write d1/d4/d15/dbc/dc3/dc6/fe1 [760204,30508] 0 2024-04-26T11:24:04.309 INFO:tasks.workunit.client.0.smithi073.stdout:7/911: creat d1/d11/f142 x:0 0 0 2024-04-26T11:24:04.309 INFO:tasks.workunit.client.0.smithi073.stdout:2/878: dwrite dd/d4c/d48/d46/d91/d9f/d1d/f81 [4194304,4194304] 0 2024-04-26T11:24:04.309 INFO:tasks.workunit.client.0.smithi073.stdout:8/893: write d1/d4/d37/f40 [2768893,75892] 0 2024-04-26T11:24:04.309 INFO:tasks.workunit.client.0.smithi073.stdout:1/981: write d1/d73/d34/fc9 [1402057,66196] 0 2024-04-26T11:24:04.309 INFO:tasks.workunit.client.0.smithi073.stdout:3/856: mkdir d0/d11/d23/d86/d125 0 2024-04-26T11:24:04.309 INFO:tasks.workunit.client.0.smithi073.stdout:5/878: mknod d4/d8/d9/d7d/d84/da7/db7/d127/c13c 0 2024-04-26T11:24:04.310 INFO:tasks.workunit.client.0.smithi073.stdout:5/879: fsync d4/de/d15/d67/fad 0 2024-04-26T11:24:04.310 INFO:tasks.workunit.client.0.smithi073.stdout:3/857: unlink d0/d11/d19/d70/c7d 0 2024-04-26T11:24:04.312 INFO:tasks.workunit.client.0.smithi073.stdout:8/894: dread d1/d4/d7b/d8d/d112/fad [0,4194304] 0 2024-04-26T11:24:04.313 INFO:tasks.workunit.client.0.smithi073.stdout:2/879: link dd/d27/fb8 dd/d4c/d48/d77/f10e 0 2024-04-26T11:24:04.313 INFO:tasks.workunit.client.0.smithi073.stdout:9/905: dwrite d0/d1a/d4e/d70/dd6/ff9 [0,4194304] 0 2024-04-26T11:24:04.313 INFO:tasks.workunit.client.0.smithi073.stdout:6/773: dread d0/d1a/d26/d4b/d2b/fe9 [0,4194304] 0 2024-04-26T11:24:04.313 INFO:tasks.workunit.client.0.smithi073.stdout:3/858: fsync d0/d11/d19/db/d3e/d3f/fe1 0 2024-04-26T11:24:04.313 INFO:tasks.workunit.client.0.smithi073.stdout:2/880: mknod dd/d4c/d48/d46/c10f 0 2024-04-26T11:24:04.313 INFO:tasks.workunit.client.0.smithi073.stdout:5/880: dread d4/d8/d9/d7d/d84/fde [0,4194304] 0 2024-04-26T11:24:04.314 INFO:tasks.workunit.client.0.smithi073.stdout:9/906: readlink d0/d1a/d4e/d10b/d120/l12c 0 2024-04-26T11:24:04.314 INFO:tasks.workunit.client.0.smithi073.stdout:8/895: chown d1/d4/d15/dbc/dc3/dc6/fe1 1996 1 2024-04-26T11:24:04.316 INFO:tasks.workunit.client.0.smithi073.stdout:8/896: fdatasync d1/f6 0 2024-04-26T11:24:04.316 INFO:tasks.workunit.client.0.smithi073.stdout:7/912: dwrite d1/d11/d24/d29/dd7/d3d/d41/d64/fa6 [0,4194304] 0 2024-04-26T11:24:04.316 INFO:tasks.workunit.client.0.smithi073.stdout:3/859: write d0/d11/d19/d1d/f44 [3156904,71690] 0 2024-04-26T11:24:04.316 INFO:tasks.workunit.client.0.smithi073.stdout:9/907: chown d0/d13/f1c 222 1 2024-04-26T11:24:04.316 INFO:tasks.workunit.client.0.smithi073.stdout:8/897: chown d1/d4/d15/de4/dfc/d2c/ddd/c6d 29 1 2024-04-26T11:24:04.316 INFO:tasks.workunit.client.0.smithi073.stdout:1/982: dwrite d1/d16/d6a/fc8 [0,4194304] 0 2024-04-26T11:24:04.318 INFO:tasks.workunit.client.0.smithi073.stdout:8/898: dread - d1/d4/d15/de4/dfc/d2a/f102 zero size 2024-04-26T11:24:04.318 INFO:tasks.workunit.client.0.smithi073.stdout:2/881: creat dd/de/d38/d4e/f110 x:0 0 0 2024-04-26T11:24:04.318 INFO:tasks.workunit.client.0.smithi073.stdout:7/913: fsync d1/d33/d1b/d66/d50/f7d 0 2024-04-26T11:24:04.318 INFO:tasks.workunit.client.0.smithi073.stdout:9/908: symlink d0/d13/d25/d2c/dbf/l133 0 2024-04-26T11:24:04.319 INFO:tasks.workunit.client.0.smithi073.stdout:8/899: rmdir d1/d4/d4c 39 2024-04-26T11:24:04.319 INFO:tasks.workunit.client.0.smithi073.stdout:3/860: link d0/d11/d19/db/fa8 d0/d34/f126 0 2024-04-26T11:24:04.322 INFO:tasks.workunit.client.0.smithi073.stdout:6/774: truncate d0/d1a/d26/d4b/d2b/d43/f88 2223315 0 2024-04-26T11:24:04.322 INFO:tasks.workunit.client.0.smithi073.stdout:7/914: write d1/d11/d24/d29/dd7/d4b/f70 [2599662,113055] 0 2024-04-26T11:24:04.322 INFO:tasks.workunit.client.0.smithi073.stdout:1/983: creat d1/d73/d53/dd4/f150 x:0 0 0 2024-04-26T11:24:04.322 INFO:tasks.workunit.client.0.smithi073.stdout:3/861: fsync d0/d34/f9e 0 2024-04-26T11:24:04.322 INFO:tasks.workunit.client.0.smithi073.stdout:9/909: mknod d0/d1a/d4e/d70/c134 0 2024-04-26T11:24:04.323 INFO:tasks.workunit.client.0.smithi073.stdout:2/882: link dd/de/d38/d53/d9d/f103 dd/de/d29/d98/f111 0 2024-04-26T11:24:04.323 INFO:tasks.workunit.client.0.smithi073.stdout:6/775: rmdir d0/d1a/d26/d4b/d63/da0/d7c 39 2024-04-26T11:24:04.323 INFO:tasks.workunit.client.0.smithi073.stdout:7/915: dread - d1/d11/d24/d29/dd7/d3d/d41/d64/dae/f127 zero size 2024-04-26T11:24:04.323 INFO:tasks.workunit.client.0.smithi073.stdout:9/910: dread - d0/d3c/fa3 zero size 2024-04-26T11:24:04.326 INFO:tasks.workunit.client.0.smithi073.stdout:7/916: unlink f0 0 2024-04-26T11:24:04.326 INFO:tasks.workunit.client.0.smithi073.stdout:1/984: truncate d1/d16/d4f/d55/d5a/fcf 98151 0 2024-04-26T11:24:04.326 INFO:tasks.workunit.client.0.smithi073.stdout:2/883: write dd/d4c/d48/d46/d91/d9f/d1d/f73 [267563,126388] 0 2024-04-26T11:24:04.326 INFO:tasks.workunit.client.0.smithi073.stdout:1/985: creat d1/d73/d34/d98/daa/f151 x:0 0 0 2024-04-26T11:24:04.327 INFO:tasks.workunit.client.0.smithi073.stdout:7/917: chown d1/d11/d24/d71/d90/fb6 16578412 1 2024-04-26T11:24:04.327 INFO:tasks.workunit.client.0.smithi073.stdout:8/900: truncate d1/d4/d15/de4/dfc/d2c/ddd/fed 637170 0 2024-04-26T11:24:04.327 INFO:tasks.workunit.client.0.smithi073.stdout:2/884: mkdir dd/d4c/d48/d77/d80/d112 0 2024-04-26T11:24:04.327 INFO:tasks.workunit.client.0.smithi073.stdout:7/918: chown d1/c5b 216 1 2024-04-26T11:24:04.327 INFO:tasks.workunit.client.0.smithi073.stdout:8/901: readlink d1/d4/l5f 0 2024-04-26T11:24:04.327 INFO:tasks.workunit.client.0.smithi073.stdout:1/986: mknod d1/d6/d7f/d47/db7/c152 0 2024-04-26T11:24:04.329 INFO:tasks.workunit.client.0.smithi073.stdout:1/987: readlink d1/d6/l1f 0 2024-04-26T11:24:04.329 INFO:tasks.workunit.client.0.smithi073.stdout:2/885: mknod dd/d27/da0/da7/ddd/c113 0 2024-04-26T11:24:04.329 INFO:tasks.workunit.client.0.smithi073.stdout:8/902: mkdir d1/d4/d115/d12d 0 2024-04-26T11:24:04.329 INFO:tasks.workunit.client.0.smithi073.stdout:6/776: dread d0/d15/f14 [0,4194304] 0 2024-04-26T11:24:04.330 INFO:tasks.workunit.client.0.smithi073.stdout:1/988: getdents d1/d73/d34/d98 0 2024-04-26T11:24:04.331 INFO:tasks.workunit.client.0.smithi073.stdout:2/886: dread - dd/d4c/d48/d46/d91/da5/df6/f10c zero size 2024-04-26T11:24:04.331 INFO:tasks.workunit.client.0.smithi073.stdout:8/903: symlink d1/d4/d15/dbc/dc3/dc6/ddb/l12e 0 2024-04-26T11:24:04.331 INFO:tasks.workunit.client.0.smithi073.stdout:9/911: dwrite d0/d13/d25/d75/d8e/db9/fd1 [0,4194304] 0 2024-04-26T11:24:04.331 INFO:tasks.workunit.client.0.smithi073.stdout:1/989: fsync d1/d16/d6a/f100 0 2024-04-26T11:24:04.331 INFO:tasks.workunit.client.0.smithi073.stdout:5/881: dread d4/f7a [0,4194304] 0 2024-04-26T11:24:04.332 INFO:tasks.workunit.client.0.smithi073.stdout:1/990: chown d1/d8/d2e/d3c/d10a 6949 1 2024-04-26T11:24:04.333 INFO:tasks.workunit.client.0.smithi073.stdout:1/991: dread - d1/d16/d4f/d55/d5a/f149 zero size 2024-04-26T11:24:04.333 INFO:tasks.workunit.client.0.smithi073.stdout:0/873: dread d2/d1f/d9c/ff1 [0,4194304] 0 2024-04-26T11:24:04.333 INFO:tasks.workunit.client.0.smithi073.stdout:0/874: dread - d2/d22/d51/d57/d78/f10e zero size 2024-04-26T11:24:04.334 INFO:tasks.workunit.client.0.smithi073.stdout:0/875: fsync d2/d1f/d9c/fa0 0 2024-04-26T11:24:04.335 INFO:tasks.workunit.client.0.smithi073.stdout:0/876: readlink d2/d1f/d40/d48/lc9 0 2024-04-26T11:24:04.335 INFO:tasks.workunit.client.0.smithi073.stdout:2/887: rename dd/d4c/d48/d46/fdc to dd/d27/dcd/f114 0 2024-04-26T11:24:04.336 INFO:tasks.workunit.client.0.smithi073.stdout:8/904: creat d1/d4/d15/dbc/dc3/dc6/ddb/dfe/f12f x:0 0 0 2024-04-26T11:24:04.336 INFO:tasks.workunit.client.0.smithi073.stdout:5/882: creat d4/d73/d8a/da0/f13d x:0 0 0 2024-04-26T11:24:04.337 INFO:tasks.workunit.client.0.smithi073.stdout:6/777: getdents d0/d1a/d26/d4b/d63/da0/dd2 0 2024-04-26T11:24:04.337 INFO:tasks.workunit.client.0.smithi073.stdout:7/919: fdatasync d1/d33/f13b 0 2024-04-26T11:24:04.337 INFO:tasks.workunit.client.0.smithi073.stdout:1/992: creat d1/d16/d4f/d55/f153 x:0 0 0 2024-04-26T11:24:04.338 INFO:tasks.workunit.client.0.smithi073.stdout:6/778: fsync d0/d19/f60 0 2024-04-26T11:24:04.338 INFO:tasks.workunit.client.0.smithi073.stdout:2/888: truncate dd/f10a 840122 0 2024-04-26T11:24:04.339 INFO:tasks.workunit.client.0.smithi073.stdout:9/912: dwrite d0/d1a/d4e/d70/d59/de8/fed [0,4194304] 0 2024-04-26T11:24:04.339 INFO:tasks.workunit.client.0.smithi073.stdout:0/877: rename d2/d22/d51/d57/f5e to d2/d1f/d40/d48/d62/f130 0 2024-04-26T11:24:04.339 INFO:tasks.workunit.client.0.smithi073.stdout:5/883: creat d4/de/d23/d11e/f13e x:0 0 0 2024-04-26T11:24:04.339 INFO:tasks.workunit.client.0.smithi073.stdout:4/914: dread d8/d1f/fc0 [0,4194304] 0 2024-04-26T11:24:04.340 INFO:tasks.workunit.client.0.smithi073.stdout:0/878: fdatasync d2/d1f/f28 0 2024-04-26T11:24:04.340 INFO:tasks.workunit.client.0.smithi073.stdout:3/862: dread d0/d11/d19/db/d3e/d47/f4f [0,4194304] 0 2024-04-26T11:24:04.340 INFO:tasks.workunit.client.0.smithi073.stdout:9/913: fdatasync d0/d6c/ffd 0 2024-04-26T11:24:04.340 INFO:tasks.workunit.client.0.smithi073.stdout:0/879: sync 2024-04-26T11:24:04.341 INFO:tasks.workunit.client.0.smithi073.stdout:6/779: chown d0/d1a/d26/d4b/d63 502505 1 2024-04-26T11:24:04.342 INFO:tasks.workunit.client.0.smithi073.stdout:5/884: mkdir d4/de/d23/d4f/d13f 0 2024-04-26T11:24:04.342 INFO:tasks.workunit.client.0.smithi073.stdout:9/914: symlink d0/d3c/d104/l135 0 2024-04-26T11:24:04.342 INFO:tasks.workunit.client.0.smithi073.stdout:2/889: link dd/de/fcf dd/d27/f115 0 2024-04-26T11:24:04.343 INFO:tasks.workunit.client.0.smithi073.stdout:3/863: stat d0/d11/d19/db/d3e/d3f/da1/fec 0 2024-04-26T11:24:04.343 INFO:tasks.workunit.client.0.smithi073.stdout:8/905: dread d1/d4/d15/de4/dfc/d2c/f8c [0,4194304] 0 2024-04-26T11:24:04.343 INFO:tasks.workunit.client.0.smithi073.stdout:6/780: mkdir d0/d19/dec 0 2024-04-26T11:24:04.344 INFO:tasks.workunit.client.0.smithi073.stdout:3/864: readlink d0/d11/d19/db/ddc/l56 0 2024-04-26T11:24:04.344 INFO:tasks.workunit.client.0.smithi073.stdout:4/915: rename d8/d1a/d1b/d46/d57 to d8/d1a/d1b/d24/dac/d72/d77/d131 0 2024-04-26T11:24:04.344 INFO:tasks.workunit.client.0.smithi073.stdout:9/915: creat d0/d13/d5a/db2/de1/df5/f136 x:0 0 0 2024-04-26T11:24:04.344 INFO:tasks.workunit.client.0.smithi073.stdout:2/890: rename dd/de/d6b to dd/d27/dcd/d116 0 2024-04-26T11:24:04.346 INFO:tasks.workunit.client.0.smithi073.stdout:8/906: chown d1/d4/d15/de4/dfc/d2a/f2b 3426 1 2024-04-26T11:24:04.346 INFO:tasks.workunit.client.0.smithi073.stdout:4/916: write d8/d1a/f2b [209675,130814] 0 2024-04-26T11:24:04.346 INFO:tasks.workunit.client.0.smithi073.stdout:5/885: rename d4/d8/d9/l5a to d4/de/d15/d33/l140 0 2024-04-26T11:24:04.347 INFO:tasks.workunit.client.0.smithi073.stdout:1/993: dwrite d1/d16/fbd [0,4194304] 0 2024-04-26T11:24:04.348 INFO:tasks.workunit.client.0.smithi073.stdout:8/907: chown d1/d4/d7b/d8d/d112/da5/ff4 498909382 1 2024-04-26T11:24:04.348 INFO:tasks.workunit.client.0.smithi073.stdout:1/994: fsync d1/d16/fb4 0 2024-04-26T11:24:04.349 INFO:tasks.workunit.client.0.smithi073.stdout:3/865: rename d0/d11/d19/cfc to d0/d2d/df4/c127 0 2024-04-26T11:24:04.349 INFO:tasks.workunit.client.0.smithi073.stdout:5/886: creat d4/d8/d8e/f141 x:0 0 0 2024-04-26T11:24:04.350 INFO:tasks.workunit.client.0.smithi073.stdout:0/880: dwrite d2/d84/fbc [0,4194304] 0 2024-04-26T11:24:04.350 INFO:tasks.workunit.client.0.smithi073.stdout:3/866: fsync d0/d11/d19/db/d3e/d3f/da1/fc0 0 2024-04-26T11:24:04.352 INFO:tasks.workunit.client.0.smithi073.stdout:8/908: symlink d1/d4/d37/dd3/de8/d10a/l130 0 2024-04-26T11:24:04.352 INFO:tasks.workunit.client.0.smithi073.stdout:4/917: rename d8/d14/f93 to d8/d1a/d9c/d100/f132 0 2024-04-26T11:24:04.352 INFO:tasks.workunit.client.0.smithi073.stdout:1/995: write d1/d6/fb [6382150,129556] 0 2024-04-26T11:24:04.352 INFO:tasks.workunit.client.0.smithi073.stdout:3/867: dread - d0/d11/d19/d52/d102/d8b/dc9/ffa zero size 2024-04-26T11:24:04.352 INFO:tasks.workunit.client.0.smithi073.stdout:0/881: rename d2/d37/d8b/fba to d2/d1f/d40/d48/f131 0 2024-04-26T11:24:04.353 INFO:tasks.workunit.client.0.smithi073.stdout:8/909: creat d1/d4/d7b/d8d/f131 x:0 0 0 2024-04-26T11:24:04.353 INFO:tasks.workunit.client.0.smithi073.stdout:3/868: read - d0/d11/d19/d70/f84 zero size 2024-04-26T11:24:04.353 INFO:tasks.workunit.client.0.smithi073.stdout:0/882: write d2/d110/f11a [870375,15485] 0 2024-04-26T11:24:04.353 INFO:tasks.workunit.client.0.smithi073.stdout:8/910: creat d1/d4/d7b/f132 x:0 0 0 2024-04-26T11:24:04.354 INFO:tasks.workunit.client.0.smithi073.stdout:1/996: truncate d1/d16/d4f/d55/d5a/f7a 1851742 0 2024-04-26T11:24:04.355 INFO:tasks.workunit.client.0.smithi073.stdout:9/916: truncate d0/d1a/d4e/d70/d51/f127 2539096 0 2024-04-26T11:24:04.355 INFO:tasks.workunit.client.0.smithi073.stdout:3/869: creat d0/d11/d19/d52/f128 x:0 0 0 2024-04-26T11:24:04.355 INFO:tasks.workunit.client.0.smithi073.stdout:7/920: dread d1/d11/d24/d29/dd7/d3d/d41/f47 [0,4194304] 0 2024-04-26T11:24:04.356 INFO:tasks.workunit.client.0.smithi073.stdout:0/883: truncate d2/d22/d51/d57/f5c 597814 0 2024-04-26T11:24:04.356 INFO:tasks.workunit.client.0.smithi073.stdout:0/884: fdatasync d2/d37/f6e 0 2024-04-26T11:24:04.356 INFO:tasks.workunit.client.0.smithi073.stdout:7/921: mknod d1/d11/d24/d29/dd7/d3d/d133/c143 0 2024-04-26T11:24:04.357 INFO:tasks.workunit.client.0.smithi073.stdout:8/911: creat d1/d4/d7b/d8d/d112/da5/f133 x:0 0 0 2024-04-26T11:24:04.357 INFO:tasks.workunit.client.0.smithi073.stdout:9/917: truncate d0/d13/d25/d75/d98/fb4 213940 0 2024-04-26T11:24:04.357 INFO:tasks.workunit.client.0.smithi073.stdout:0/885: mknod d2/d1f/d40/d48/d62/de5/c132 0 2024-04-26T11:24:04.359 INFO:tasks.workunit.client.0.smithi073.stdout:9/918: write d0/d1a/d4e/d70/d51/f88 [5136222,97221] 0 2024-04-26T11:24:04.359 INFO:tasks.workunit.client.0.smithi073.stdout:0/886: creat d2/d110/d11b/f133 x:0 0 0 2024-04-26T11:24:04.359 INFO:tasks.workunit.client.0.smithi073.stdout:1/997: dread d1/d73/d40/d54/fc4 [0,4194304] 0 2024-04-26T11:24:04.359 INFO:tasks.workunit.client.0.smithi073.stdout:0/887: chown d2/d1f/f2c 6 1 2024-04-26T11:24:04.360 INFO:tasks.workunit.client.0.smithi073.stdout:1/998: fdatasync d1/d6/d7f/d47/f129 0 2024-04-26T11:24:04.360 INFO:tasks.workunit.client.0.smithi073.stdout:9/919: creat d0/d1a/d4e/d70/f137 x:0 0 0 2024-04-26T11:24:04.361 INFO:tasks.workunit.client.0.smithi073.stdout:1/999: truncate d1/d8/f11b 903961 0 2024-04-26T11:24:04.364 INFO:tasks.workunit.client.0.smithi073.stdout:8/912: dwrite d1/d4/d15/de4/dfc/d2c/ddd/f42 [0,4194304] 0 2024-04-26T11:24:04.368 INFO:tasks.workunit.client.0.smithi073.stdout:0/888: truncate d2/f31 125553 0 2024-04-26T11:24:04.368 INFO:tasks.workunit.client.0.smithi073.stdout:8/913: creat d1/d4/d15/de4/dfc/d2c/f134 x:0 0 0 2024-04-26T11:24:04.368 INFO:tasks.workunit.client.0.smithi073.stdout:0/889: mknod d2/d37/d3c/d6a/c134 0 2024-04-26T11:24:04.369 INFO:tasks.workunit.client.0.smithi073.stdout:8/914: getdents d1/d4/d15/de4/dfc/d2c/ddd 0 2024-04-26T11:24:04.370 INFO:tasks.workunit.client.0.smithi073.stdout:8/915: unlink d1/d4/d15/de4/dfc/d2c/ddd/ce0 0 2024-04-26T11:24:04.370 INFO:tasks.workunit.client.0.smithi073.stdout:8/916: truncate d1/d4/d15/f1f 7971047 0 2024-04-26T11:24:04.378 INFO:tasks.workunit.client.0.smithi073.stdout:6/781: dread d0/d1a/d26/d4b/d63/da0/f56 [0,4194304] 0 2024-04-26T11:24:04.382 INFO:tasks.workunit.client.0.smithi073.stdout:7/922: dread d1/d11/d24/d29/dd7/d4b/ff8 [4194304,4194304] 0 2024-04-26T11:24:04.382 INFO:tasks.workunit.client.0.smithi073.stdout:4/918: sync 2024-04-26T11:24:04.384 INFO:tasks.workunit.client.0.smithi073.stdout:2/891: dread dd/d4c/d48/d46/d91/d9f/d1d/f36 [0,4194304] 0 2024-04-26T11:24:04.384 INFO:tasks.workunit.client.0.smithi073.stdout:4/919: chown d8/d1a/d1b/d24/f122 17860 1 2024-04-26T11:24:04.384 INFO:tasks.workunit.client.0.smithi073.stdout:6/782: dwrite d0/d1a/d4e/fb8 [0,4194304] 0 2024-04-26T11:24:04.384 INFO:tasks.workunit.client.0.smithi073.stdout:4/920: chown d8/d1a/d86 0 1 2024-04-26T11:24:04.386 INFO:tasks.workunit.client.0.smithi073.stdout:4/921: rmdir d8/d1a/d9c/d9d 39 2024-04-26T11:24:04.387 INFO:tasks.workunit.client.0.smithi073.stdout:5/887: dread d4/d8/d9/d7d/d84/da7/db7/d127/fd0 [0,4194304] 0 2024-04-26T11:24:04.387 INFO:tasks.workunit.client.0.smithi073.stdout:6/783: mknod d0/d1a/ced 0 2024-04-26T11:24:04.388 INFO:tasks.workunit.client.0.smithi073.stdout:4/922: readlink d8/d1a/d9c/d9d/l12e 0 2024-04-26T11:24:04.389 INFO:tasks.workunit.client.0.smithi073.stdout:5/888: unlink d4/d8/d9/d7d/d84/l77 0 2024-04-26T11:24:04.390 INFO:tasks.workunit.client.0.smithi073.stdout:3/870: dread d0/d11/d19/d70/daa/f101 [0,4194304] 0 2024-04-26T11:24:04.390 INFO:tasks.workunit.client.0.smithi073.stdout:6/784: creat d0/d1a/d26/d4b/fee x:0 0 0 2024-04-26T11:24:04.391 INFO:tasks.workunit.client.0.smithi073.stdout:5/889: mkdir d4/de/d142 0 2024-04-26T11:24:04.392 INFO:tasks.workunit.client.0.smithi073.stdout:7/923: dwrite d1/d11/d51/dca/f105 [0,4194304] 0 2024-04-26T11:24:04.393 INFO:tasks.workunit.client.0.smithi073.stdout:2/892: dwrite dd/d4c/d48/d46/d91/d9f/d1d/f44 [0,4194304] 0 2024-04-26T11:24:04.393 INFO:tasks.workunit.client.0.smithi073.stdout:3/871: symlink d0/d11/d19/d70/l129 0 2024-04-26T11:24:04.394 INFO:tasks.workunit.client.0.smithi073.stdout:2/893: write f6 [5429356,98444] 0 2024-04-26T11:24:04.395 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:04.390+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:04.399 INFO:tasks.workunit.client.0.smithi073.stdout:5/890: symlink d4/d8/d9/d12e/l143 0 2024-04-26T11:24:04.399 INFO:tasks.workunit.client.0.smithi073.stdout:7/924: creat d1/d11/d24/d29/d129/f144 x:0 0 0 2024-04-26T11:24:04.399 INFO:tasks.workunit.client.0.smithi073.stdout:4/923: dwrite d8/d1a/d5e/d7c/f90 [4194304,4194304] 0 2024-04-26T11:24:04.399 INFO:tasks.workunit.client.0.smithi073.stdout:5/891: stat d4/d8/d9/d7d/d84/fde 0 2024-04-26T11:24:04.399 INFO:tasks.workunit.client.0.smithi073.stdout:5/892: chown d4/de/f2c 16124506 1 2024-04-26T11:24:04.399 INFO:tasks.workunit.client.0.smithi073.stdout:8/917: dread d1/d4/d15/de4/dfc/d2c/ddd/ff0 [0,4194304] 0 2024-04-26T11:24:04.402 INFO:tasks.workunit.client.0.smithi073.stdout:6/785: dwrite d0/d1a/d4e/fb8 [0,4194304] 0 2024-04-26T11:24:04.404 INFO:tasks.workunit.client.0.smithi073.stdout:4/924: rename d8/d1a/d86/l95 to d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/dc2/l133 0 2024-04-26T11:24:04.404 INFO:tasks.workunit.client.0.smithi073.stdout:7/925: mknod d1/d33/d1b/d95/d13d/c145 0 2024-04-26T11:24:04.406 INFO:tasks.workunit.client.0.smithi073.stdout:6/786: write d0/d15/d2d/fb2 [156817,129912] 0 2024-04-26T11:24:04.406 INFO:tasks.workunit.client.0.smithi073.stdout:7/926: fsync d1/d33/d1b/d95/fd1 0 2024-04-26T11:24:04.406 INFO:tasks.workunit.client.0.smithi073.stdout:4/925: fsync d8/d1a/fe6 0 2024-04-26T11:24:04.406 INFO:tasks.workunit.client.0.smithi073.stdout:4/926: fsync d8/d1a/d1b/f83 0 2024-04-26T11:24:04.406 INFO:tasks.workunit.client.0.smithi073.stdout:6/787: fdatasync d0/d1a/d26/f54 0 2024-04-26T11:24:04.407 INFO:tasks.workunit.client.0.smithi073.stdout:4/927: write d8/d1a/d5e/dc5/f11b [85470,33722] 0 2024-04-26T11:24:04.407 INFO:tasks.workunit.client.0.smithi073.stdout:6/788: rmdir d0/d1a/d26/d4b/d63/da0/d7c 39 2024-04-26T11:24:04.407 INFO:tasks.workunit.client.0.smithi073.stdout:6/789: write d0/d15/d2d/d3f/d59/deb/fe2 [333297,15094] 0 2024-04-26T11:24:04.411 INFO:tasks.workunit.client.0.smithi073.stdout:7/927: dwrite d1/d11/d24/d71/d90/f9f [0,4194304] 0 2024-04-26T11:24:04.411 INFO:tasks.workunit.client.0.smithi073.stdout:7/928: read - d1/d33/d1b/d66/d50/f137 zero size 2024-04-26T11:24:04.412 INFO:tasks.workunit.client.0.smithi073.stdout:7/929: write d1/d11/f1c [2997789,85692] 0 2024-04-26T11:24:04.413 INFO:tasks.workunit.client.0.smithi073.stdout:7/930: chown d1/d11/d24/d29/lb7 716 1 2024-04-26T11:24:04.416 INFO:tasks.workunit.client.0.smithi073.stdout:7/931: link d1/d33/d1b/fd3 d1/d33/d68/d78/daf/f146 0 2024-04-26T11:24:04.416 INFO:tasks.workunit.client.0.smithi073.stdout:9/920: sync 2024-04-26T11:24:04.416 INFO:tasks.workunit.client.0.smithi073.stdout:0/890: sync 2024-04-26T11:24:04.416 INFO:tasks.workunit.client.0.smithi073.stdout:5/893: sync 2024-04-26T11:24:04.416 INFO:tasks.workunit.client.0.smithi073.stdout:3/872: dread d0/f45 [0,4194304] 0 2024-04-26T11:24:04.419 INFO:tasks.workunit.client.0.smithi073.stdout:9/921: write d0/d1a/d4e/d70/f38 [897504,130300] 0 2024-04-26T11:24:04.419 INFO:tasks.workunit.client.0.smithi073.stdout:3/873: mknod d0/d11/d19/db/ddc/c12a 0 2024-04-26T11:24:04.419 INFO:tasks.workunit.client.0.smithi073.stdout:5/894: symlink d4/d8/d9/d7d/d84/da7/db7/dcd/dd4/l144 0 2024-04-26T11:24:04.419 INFO:tasks.workunit.client.0.smithi073.stdout:7/932: link d1/d33/c62 d1/d11/d5e/d8f/c147 0 2024-04-26T11:24:04.419 INFO:tasks.workunit.client.0.smithi073.stdout:3/874: stat d0/d11/d23/fa7 0 2024-04-26T11:24:04.419 INFO:tasks.workunit.client.0.smithi073.stdout:5/895: creat d4/d73/d8a/f145 x:0 0 0 2024-04-26T11:24:04.419 INFO:tasks.workunit.client.0.smithi073.stdout:5/896: stat d4/d8/dff 0 2024-04-26T11:24:04.420 INFO:tasks.workunit.client.0.smithi073.stdout:3/875: chown d0/d11/d19/d52/c10f 148 1 2024-04-26T11:24:04.420 INFO:tasks.workunit.client.0.smithi073.stdout:9/922: rename d0/d3c/dcc to d0/d13/d5a/db2/de1/df5/d109/d138 0 2024-04-26T11:24:04.421 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:04.421 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:04.421 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:24:04.421 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:24:04.421 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:04.421 INFO:tasks.workunit.client.0.smithi073.stdout:7/933: getdents d1/d11/d24/d29/dd7/d3d 0 2024-04-26T11:24:04.422 INFO:tasks.workunit.client.0.smithi073.stdout:9/923: creat d0/d13/d5a/d116/f139 x:0 0 0 2024-04-26T11:24:04.422 INFO:tasks.workunit.client.0.smithi073.stdout:7/934: chown d1/d11/d24/d29/dd7/d3d/d7b 396248 1 2024-04-26T11:24:04.422 INFO:tasks.workunit.client.0.smithi073.stdout:5/897: rename d4/d8/d9/d7d/d84/f5d to d4/d73/d8a/da0/f146 0 2024-04-26T11:24:04.422 INFO:tasks.workunit.client.0.smithi073.stdout:7/935: fdatasync d1/d11/d24/d29/dd7/d4b/f56 0 2024-04-26T11:24:04.422 INFO:tasks.workunit.client.0.smithi073.stdout:9/924: creat d0/d13/d5a/d116/d129/f13a x:0 0 0 2024-04-26T11:24:04.426 INFO:tasks.workunit.client.0.smithi073.stdout:0/891: dwrite d2/d37/d3c/f4c [0,4194304] 0 2024-04-26T11:24:04.426 INFO:tasks.workunit.client.0.smithi073.stdout:9/925: chown d0/d13/d5a/d116 110809 1 2024-04-26T11:24:04.427 INFO:tasks.workunit.client.0.smithi073.stdout:2/894: dread f6 [0,4194304] 0 2024-04-26T11:24:04.427 INFO:tasks.workunit.client.0.smithi073.stdout:9/926: write d0/d13/db/f4b [989375,24116] 0 2024-04-26T11:24:04.429 INFO:tasks.workunit.client.0.smithi073.stdout:2/895: unlink dd/d27/cd4 0 2024-04-26T11:24:04.429 INFO:tasks.workunit.client.0.smithi073.stdout:7/936: chown d1/d11/d24/d29/dd7/d80/da0/dd2/c10e 12 1 2024-04-26T11:24:04.430 INFO:tasks.workunit.client.0.smithi073.stdout:9/927: getdents d0/d1a/d4e/d70/d59/de8/d11c 0 2024-04-26T11:24:04.430 INFO:tasks.workunit.client.0.smithi073.stdout:2/896: write dd/de/d38/d53/dc3/fc4 [3653266,6768] 0 2024-04-26T11:24:04.430 INFO:tasks.workunit.client.0.smithi073.stdout:7/937: dread - d1/d11/d24/d71/d90/f119 zero size 2024-04-26T11:24:04.430 INFO:tasks.workunit.client.0.smithi073.stdout:2/897: stat dd/d27/feb 0 2024-04-26T11:24:04.430 INFO:tasks.workunit.client.0.smithi073.stdout:7/938: chown d1/d11/d24/d71/d90/cd4 911 1 2024-04-26T11:24:04.430 INFO:tasks.workunit.client.0.smithi073.stdout:2/898: chown dd/de/d29 0 1 2024-04-26T11:24:04.430 INFO:tasks.workunit.client.0.smithi073.stdout:9/928: symlink d0/d1a/d4e/d70/l13b 0 2024-04-26T11:24:04.430 INFO:tasks.workunit.client.0.smithi073.stdout:9/929: mknod d0/d1a/d4e/d70/d46/df2/c13c 0 2024-04-26T11:24:04.430 INFO:tasks.workunit.client.0.smithi073.stdout:7/939: truncate d1/d11/d24/d29/dd7/d4b/f56 1555006 0 2024-04-26T11:24:04.431 INFO:tasks.workunit.client.0.smithi073.stdout:9/930: write d0/d1a/d4e/d70/d59/d10a/f122 [443272,90222] 0 2024-04-26T11:24:04.431 INFO:tasks.workunit.client.0.smithi073.stdout:7/940: write d1/d11/d24/d29/fee [613484,115840] 0 2024-04-26T11:24:04.431 INFO:tasks.workunit.client.0.smithi073.stdout:9/931: mkdir d0/d83/d121/d13d 0 2024-04-26T11:24:04.431 INFO:tasks.workunit.client.0.smithi073.stdout:7/941: rmdir d1/d11/d51/dfb 39 2024-04-26T11:24:04.431 INFO:tasks.workunit.client.0.smithi073.stdout:9/932: chown d0/d13/db 597688 1 2024-04-26T11:24:04.432 INFO:tasks.workunit.client.0.smithi073.stdout:9/933: write d0/d1a/d4e/d70/dae/fdc [4289541,28521] 0 2024-04-26T11:24:04.432 INFO:tasks.workunit.client.0.smithi073.stdout:7/942: creat d1/d11/d24/d29/dd7/d80/f148 x:0 0 0 2024-04-26T11:24:04.433 INFO:tasks.workunit.client.0.smithi073.stdout:7/943: symlink d1/d11/d5e/d8f/l149 0 2024-04-26T11:24:04.433 INFO:tasks.workunit.client.0.smithi073.stdout:9/934: chown d0/d13/d5a/db2/de1/df5/d109/d138/f12e 217 1 2024-04-26T11:24:04.433 INFO:tasks.workunit.client.0.smithi073.stdout:9/935: chown d0/f3f 0 1 2024-04-26T11:24:04.434 INFO:tasks.workunit.client.0.smithi073.stdout:7/944: truncate d1/d11/d24/d29/dd7/d3d/d41/ffa 1763914 0 2024-04-26T11:24:04.435 INFO:tasks.workunit.client.0.smithi073.stdout:9/936: link d0/d1a/d4e/d70/c63 d0/d1a/d4e/d10b/c13e 0 2024-04-26T11:24:04.435 INFO:tasks.workunit.client.0.smithi073.stdout:7/945: rmdir d1/d11/d24/d71/d90/da3 0 2024-04-26T11:24:04.436 INFO:tasks.workunit.client.0.smithi073.stdout:7/946: chown d1 84932 1 2024-04-26T11:24:04.436 INFO:tasks.workunit.client.0.smithi073.stdout:7/947: symlink d1/d11/d24/d29/dd7/d3d/l14a 0 2024-04-26T11:24:04.437 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:04.438 INFO:tasks.workunit.client.0.smithi073.stdout:7/948: link d1/d33/d68/d78/daf/f23 d1/d33/d1b/d95/f14b 0 2024-04-26T11:24:04.438 INFO:tasks.workunit.client.0.smithi073.stdout:7/949: chown d1/d33/f13b 153761144 1 2024-04-26T11:24:04.438 INFO:tasks.workunit.client.0.smithi073.stdout:7/950: fdatasync d1/d11/d24/d29/fee 0 2024-04-26T11:24:04.441 INFO:tasks.workunit.client.0.smithi073.stdout:5/898: dread d4/de/d15/d67/fad [0,4194304] 0 2024-04-26T11:24:04.442 INFO:tasks.workunit.client.0.smithi073.stdout:5/899: readlink d4/de/d23/d4f/lae 0 2024-04-26T11:24:04.446 INFO:tasks.workunit.client.0.smithi073.stdout:3/876: dread d0/d11/d19/d52/d102/d7a/dbc/fdd [0,4194304] 0 2024-04-26T11:24:04.446 INFO:tasks.workunit.client.0.smithi073.stdout:3/877: mkdir d0/d11/d19/d1d/d12b 0 2024-04-26T11:24:04.454 INFO:tasks.workunit.client.0.smithi073.stdout:5/900: dread d4/d8/d9/d42/d68/f71 [0,4194304] 0 2024-04-26T11:24:04.454 INFO:tasks.workunit.client.0.smithi073.stdout:5/901: readlink d4/d8/d9/d7d/da3/lb2 0 2024-04-26T11:24:04.456 INFO:tasks.workunit.client.0.smithi073.stdout:5/902: read d4/de/d23/fc4 [362749,70228] 0 2024-04-26T11:24:04.457 INFO:tasks.workunit.client.0.smithi073.stdout:3/878: dread d0/d11/d19/db/d3e/d3f/fe1 [0,4194304] 0 2024-04-26T11:24:04.457 INFO:tasks.workunit.client.0.smithi073.stdout:5/903: unlink d4/d73/l107 0 2024-04-26T11:24:04.458 INFO:tasks.workunit.client.0.smithi073.stdout:5/904: chown d4/d8/dff/f108 2131724 1 2024-04-26T11:24:04.458 INFO:tasks.workunit.client.0.smithi073.stdout:3/879: creat d0/d11/d19/db/d51/f12c x:0 0 0 2024-04-26T11:24:04.458 INFO:tasks.workunit.client.0.smithi073.stdout:5/905: chown d4/d73/d8a/da0/fb1 3597788 1 2024-04-26T11:24:04.459 INFO:tasks.workunit.client.0.smithi073.stdout:5/906: fsync d4/de/d15/d67/fc5 0 2024-04-26T11:24:04.460 INFO:tasks.workunit.client.0.smithi073.stdout:5/907: read - d4/de/d23/d4f/f126 zero size 2024-04-26T11:24:04.460 INFO:tasks.workunit.client.0.smithi073.stdout:5/908: mkdir d4/d8/d8e/d147 0 2024-04-26T11:24:04.469 INFO:tasks.workunit.client.0.smithi073.stdout:2/899: rename dd/de/d38/d4e/cbe to dd/d4c/d48/d46/d91/d9f/d1d/c117 0 2024-04-26T11:24:04.469 INFO:tasks.workunit.client.0.smithi073.stdout:2/900: symlink dd/d4c/d48/d46/d91/d9f/d1d/l118 0 2024-04-26T11:24:04.471 INFO:tasks.workunit.client.0.smithi073.stdout:2/901: link dd/d27/dcd/d116/f61 dd/d27/da0/da7/ddd/f119 0 2024-04-26T11:24:04.474 INFO:tasks.workunit.client.0.smithi073.stdout:2/902: link dd/d4c/d48/d46/d91/da5/df5/lfe dd/d27/da0/da7/ddd/l11a 0 2024-04-26T11:24:04.474 INFO:tasks.workunit.client.0.smithi073.stdout:3/880: dread d0/d34/f126 [0,4194304] 0 2024-04-26T11:24:04.474 INFO:tasks.workunit.client.0.smithi073.stdout:2/903: chown dd/de/d38/fa2 1713602 1 2024-04-26T11:24:04.477 INFO:tasks.workunit.client.0.smithi073.stdout:8/918: dwrite d1/d4/f55 [0,4194304] 0 2024-04-26T11:24:04.479 INFO:tasks.workunit.client.0.smithi073.stdout:8/919: mknod d1/d4/d4c/dc4/c135 0 2024-04-26T11:24:04.479 INFO:tasks.workunit.client.0.smithi073.stdout:8/920: mknod d1/d4/d37/dd3/d105/d113/c136 0 2024-04-26T11:24:04.480 INFO:tasks.workunit.client.0.smithi073.stdout:8/921: fsync d1/d4/d4c/d101/f12b 0 2024-04-26T11:24:04.481 INFO:tasks.workunit.client.0.smithi073.stdout:6/790: truncate d0/dc/f64 901478 0 2024-04-26T11:24:04.481 INFO:tasks.workunit.client.0.smithi073.stdout:6/791: symlink d0/dc/d55/d79/lef 0 2024-04-26T11:24:04.483 INFO:tasks.workunit.client.0.smithi073.stdout:6/792: readlink d0/l18 0 2024-04-26T11:24:04.486 INFO:tasks.workunit.client.0.smithi073.stdout:8/922: dwrite d1/d4/d15/de4/dfc/d2c/ddd/d67/f98 [0,4194304] 0 2024-04-26T11:24:04.487 INFO:tasks.workunit.client.0.smithi073.stdout:8/923: mknod d1/d4/d15/dbc/dc3/dc6/c137 0 2024-04-26T11:24:04.488 INFO:tasks.workunit.client.0.smithi073.stdout:8/924: truncate d1/d4/d7b/d8d/fc8 450039 0 2024-04-26T11:24:04.489 INFO:tasks.workunit.client.0.smithi073.stdout:8/925: creat d1/d4/d115/d12d/f138 x:0 0 0 2024-04-26T11:24:04.496 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:04.492+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:04.498 INFO:tasks.workunit.client.0.smithi073.stdout:0/892: dwrite d2/d5f/f6c [0,4194304] 0 2024-04-26T11:24:04.500 INFO:tasks.workunit.client.0.smithi073.stdout:0/893: write d2/d1f/d40/d48/d62/f130 [28514,91921] 0 2024-04-26T11:24:04.500 INFO:tasks.workunit.client.0.smithi073.stdout:0/894: chown d2/d1f/d9c/ccf 1471 1 2024-04-26T11:24:04.503 INFO:tasks.workunit.client.0.smithi073.stdout:9/937: write d0/d1a/d4e/d70/feb [1966584,35250] 0 2024-04-26T11:24:04.506 INFO:tasks.workunit.client.0.smithi073.stdout:8/926: dread d1/d4/d37/f40 [0,4194304] 0 2024-04-26T11:24:04.507 INFO:tasks.workunit.client.0.smithi073.stdout:8/927: readlink d1/d4/d37/d5b/lff 0 2024-04-26T11:24:04.508 INFO:tasks.workunit.client.0.smithi073.stdout:8/928: creat d1/d4/d115/d12d/f139 x:0 0 0 2024-04-26T11:24:04.508 INFO:tasks.workunit.client.0.smithi073.stdout:9/938: dwrite d0/d1a/d4e/d70/d3b/fbc [4194304,4194304] 0 2024-04-26T11:24:04.509 INFO:tasks.workunit.client.0.smithi073.stdout:8/929: fdatasync d1/d4/d15/f4d 0 2024-04-26T11:24:04.509 INFO:tasks.workunit.client.0.smithi073.stdout:9/939: write d0/d13/d25/d2c/dbf/fea [4356256,59546] 0 2024-04-26T11:24:04.511 INFO:tasks.workunit.client.0.smithi073.stdout:9/940: getdents d0/d13/d5a/db2 0 2024-04-26T11:24:04.512 INFO:tasks.workunit.client.0.smithi073.stdout:9/941: dread - d0/d13/d5a/d65/f8d zero size 2024-04-26T11:24:04.512 INFO:tasks.workunit.client.0.smithi073.stdout:8/930: link d1/d4/d15/c6a d1/d4/d15/de4/dfc/d2c/c13a 0 2024-04-26T11:24:04.512 INFO:tasks.workunit.client.0.smithi073.stdout:8/931: chown d1/c44 424 1 2024-04-26T11:24:04.512 INFO:tasks.workunit.client.0.smithi073.stdout:9/942: rename d0/d83/dd4/c117 to d0/d1a/d4e/d10b/d120/c13f 0 2024-04-26T11:24:04.513 INFO:tasks.workunit.client.0.smithi073.stdout:9/943: mknod d0/d6c/c140 0 2024-04-26T11:24:04.514 INFO:tasks.workunit.client.0.smithi073.stdout:9/944: creat d0/d13/d25/d75/d8e/db9/d125/f141 x:0 0 0 2024-04-26T11:24:04.515 INFO:tasks.workunit.client.0.smithi073.stdout:5/909: rmdir d4 39 2024-04-26T11:24:04.517 INFO:tasks.workunit.client.0.smithi073.stdout:8/932: dwrite d1/d4/d15/dbc/dc3/dc6/ddb/dfe/f108 [0,4194304] 0 2024-04-26T11:24:04.519 INFO:tasks.workunit.client.0.smithi073.stdout:8/933: getdents d1/d4/d15/dbc/d125 0 2024-04-26T11:24:04.520 INFO:tasks.workunit.client.0.smithi073.stdout:8/934: fdatasync d1/d4/d37/f10e 0 2024-04-26T11:24:04.520 INFO:tasks.workunit.client.0.smithi073.stdout:8/935: creat d1/d4/d15/de4/dfc/d2a/f13b x:0 0 0 2024-04-26T11:24:04.522 INFO:tasks.workunit.client.0.smithi073.stdout:3/881: write d0/d11/d19/fe3 [576274,107034] 0 2024-04-26T11:24:04.522 INFO:tasks.workunit.client.0.smithi073.stdout:8/936: readlink d1/d4/d15/de4/dfc/l109 0 2024-04-26T11:24:04.522 INFO:tasks.workunit.client.0.smithi073.stdout:2/904: write fb [4188985,14918] 0 2024-04-26T11:24:04.522 INFO:tasks.workunit.client.0.smithi073.stdout:3/882: creat d0/d11/d19/db/d3e/d3f/da1/f12d x:0 0 0 2024-04-26T11:24:04.523 INFO:tasks.workunit.client.0.smithi073.stdout:2/905: creat dd/de/d38/d4e/f11b x:0 0 0 2024-04-26T11:24:04.523 INFO:tasks.workunit.client.0.smithi073.stdout:8/937: rename d1/d4/d7b/d8d/d112/da5/ff4 to d1/f13c 0 2024-04-26T11:24:04.523 INFO:tasks.workunit.client.0.smithi073.stdout:3/883: mknod d0/d26/da2/c12e 0 2024-04-26T11:24:04.523 INFO:tasks.workunit.client.0.smithi073.stdout:2/906: write dd/de/d49/f105 [159631,101125] 0 2024-04-26T11:24:04.524 INFO:tasks.workunit.client.0.smithi073.stdout:8/938: rmdir d1/d4/d115 39 2024-04-26T11:24:04.524 INFO:tasks.workunit.client.0.smithi073.stdout:8/939: fdatasync d1/d4/d37/f4f 0 2024-04-26T11:24:04.524 INFO:tasks.workunit.client.0.smithi073.stdout:3/884: dread - d0/d11/d19/db/d3e/d3f/da1/fec zero size 2024-04-26T11:24:04.524 INFO:tasks.workunit.client.0.smithi073.stdout:2/907: rename dd/d27/da0/da7/ld0 to dd/de/d38/d53/l11c 0 2024-04-26T11:24:04.525 INFO:tasks.workunit.client.0.smithi073.stdout:2/908: chown dd/de/d38/d53/c5d 3 1 2024-04-26T11:24:04.527 INFO:tasks.workunit.client.0.smithi073.stdout:2/909: rename dd/de/d29/c34 to dd/de/d38/c11d 0 2024-04-26T11:24:04.527 INFO:tasks.workunit.client.0.smithi073.stdout:2/910: chown dd/de/d38/c50 860932 1 2024-04-26T11:24:04.530 INFO:tasks.workunit.client.0.smithi073.stdout:8/940: dwrite d1/d4/d37/dd3/de8/fa4 [0,4194304] 0 2024-04-26T11:24:04.530 INFO:tasks.workunit.client.0.smithi073.stdout:3/885: dwrite d0/d11/d19/db/d3e/d47/f73 [0,4194304] 0 2024-04-26T11:24:04.531 INFO:tasks.workunit.client.0.smithi073.stdout:8/941: stat d1/d4/d15/dbc/dc3/dc6 0 2024-04-26T11:24:04.532 INFO:tasks.workunit.client.0.smithi073.stdout:3/886: creat d0/d11/d19/d70/f12f x:0 0 0 2024-04-26T11:24:04.532 INFO:tasks.workunit.client.0.smithi073.stdout:3/887: mkdir d0/d26/d130 0 2024-04-26T11:24:04.533 INFO:tasks.workunit.client.0.smithi073.stdout:3/888: mkdir d0/d11/d19/d52/d102/d117/d131 0 2024-04-26T11:24:04.535 INFO:tasks.workunit.client.0.smithi073.stdout:7/951: truncate d1/d11/d24/d29/dd7/d3d/d41/d64/fa6 3934271 0 2024-04-26T11:24:04.536 INFO:tasks.workunit.client.0.smithi073.stdout:3/889: mkdir d0/d11/d19/d70/daa/d132 0 2024-04-26T11:24:04.537 INFO:tasks.workunit.client.0.smithi073.stdout:3/890: stat d0/d11/d19/db/d3e/d3f 0 2024-04-26T11:24:04.538 INFO:tasks.workunit.client.0.smithi073.stdout:7/952: chown d1/d11/d5e/d8f/l103 421 1 2024-04-26T11:24:04.538 INFO:tasks.workunit.client.0.smithi073.stdout:0/895: dwrite d2/d1f/d40/d48/f52 [0,4194304] 0 2024-04-26T11:24:04.541 INFO:tasks.workunit.client.0.smithi073.stdout:5/910: sync 2024-04-26T11:24:04.541 INFO:tasks.workunit.client.0.smithi073.stdout:8/942: sync 2024-04-26T11:24:04.541 INFO:tasks.workunit.client.0.smithi073.stdout:0/896: link d2/d37/d3c/c41 d2/d22/d51/d57/d78/d10d/c135 0 2024-04-26T11:24:04.542 INFO:tasks.workunit.client.0.smithi073.stdout:0/897: symlink d2/d1f/d40/d48/l136 0 2024-04-26T11:24:04.542 INFO:tasks.workunit.client.0.smithi073.stdout:7/953: dwrite d1/d11/d10/f2f [0,4194304] 0 2024-04-26T11:24:04.543 INFO:tasks.workunit.client.0.smithi073.stdout:5/911: write d4/d8/d9/d7d/d84/da7/db7/dcd/df1/f100 [939663,89087] 0 2024-04-26T11:24:04.543 INFO:tasks.workunit.client.0.smithi073.stdout:5/912: stat f2 0 2024-04-26T11:24:04.543 INFO:tasks.workunit.client.0.smithi073.stdout:0/898: mkdir d2/d37/d8b/d137 0 2024-04-26T11:24:04.543 INFO:tasks.workunit.client.0.smithi073.stdout:8/943: read d1/d4/d15/de4/dfc/d2c/ddd/f2e [513962,70885] 0 2024-04-26T11:24:04.544 INFO:tasks.workunit.client.0.smithi073.stdout:7/954: write d1/d11/d24/d29/dd7/d80/da0/f107 [255514,33570] 0 2024-04-26T11:24:04.544 INFO:tasks.workunit.client.0.smithi073.stdout:8/944: chown d1/d4/d15/c6a 208 1 2024-04-26T11:24:04.545 INFO:tasks.workunit.client.0.smithi073.stdout:0/899: unlink d2/d1f/d40/c46 0 2024-04-26T11:24:04.546 INFO:tasks.workunit.client.0.smithi073.stdout:0/900: readlink d2/l10 0 2024-04-26T11:24:04.546 INFO:tasks.workunit.client.0.smithi073.stdout:7/955: rename d1/d33/d68/c7a to d1/d11/d24/d29/dd7/d3d/d41/d64/c14c 0 2024-04-26T11:24:04.546 INFO:tasks.workunit.client.0.smithi073.stdout:7/956: write d1/d33/d1b/d66/d50/f137 [869439,51218] 0 2024-04-26T11:24:04.547 INFO:tasks.workunit.client.0.smithi073.stdout:0/901: mkdir d2/d37/d8b/d137/d138 0 2024-04-26T11:24:04.548 INFO:tasks.workunit.client.0.smithi073.stdout:7/957: rmdir d1/d11/d24/d29/dd7/d80/da0/dd2 39 2024-04-26T11:24:04.548 INFO:tasks.workunit.client.0.smithi073.stdout:5/913: sync 2024-04-26T11:24:04.548 INFO:tasks.workunit.client.0.smithi073.stdout:0/902: truncate d2/d1f/d40/feb 1976413 0 2024-04-26T11:24:04.548 INFO:tasks.workunit.client.0.smithi073.stdout:7/958: creat d1/d33/f14d x:0 0 0 2024-04-26T11:24:04.549 INFO:tasks.workunit.client.0.smithi073.stdout:5/914: stat d4/d8/dc3/l132 0 2024-04-26T11:24:04.550 INFO:tasks.workunit.client.0.smithi073.stdout:5/915: rmdir d4/de/d23/d4f 39 2024-04-26T11:24:04.551 INFO:tasks.workunit.client.0.smithi073.stdout:8/945: dread d1/d4/d15/de4/dfc/d2c/ddd/f36 [0,4194304] 0 2024-04-26T11:24:04.551 INFO:tasks.workunit.client.0.smithi073.stdout:5/916: mkdir d4/d73/d8a/da0/d148 0 2024-04-26T11:24:04.552 INFO:tasks.workunit.client.0.smithi073.stdout:8/946: mknod d1/c13d 0 2024-04-26T11:24:04.553 INFO:tasks.workunit.client.0.smithi073.stdout:7/959: write d1/d33/d68/d78/daf/f23 [759221,91639] 0 2024-04-26T11:24:04.553 INFO:tasks.workunit.client.0.smithi073.stdout:7/960: sync 2024-04-26T11:24:04.553 INFO:tasks.workunit.client.0.smithi073.stdout:5/917: readlink d4/d8/d9/d7d/d84/da7/db7/d127/da5/l13b 0 2024-04-26T11:24:04.553 INFO:tasks.workunit.client.0.smithi073.stdout:8/947: creat d1/d4/d37/f13e x:0 0 0 2024-04-26T11:24:04.554 INFO:tasks.workunit.client.0.smithi073.stdout:5/918: mkdir d4/d73/d8a/da0/d149 0 2024-04-26T11:24:04.554 INFO:tasks.workunit.client.0.smithi073.stdout:8/948: stat d1/d4/d15/de4/dfc/d2a/l31 0 2024-04-26T11:24:04.554 INFO:tasks.workunit.client.0.smithi073.stdout:7/961: write d1/d11/d24/d29/dd7/d3d/d41/d64/dae/f118 [152115,46693] 0 2024-04-26T11:24:04.555 INFO:tasks.workunit.client.0.smithi073.stdout:4/928: dread d8/d1a/d1b/d24/dac/d49/d85/d8b/f66 [0,4194304] 0 2024-04-26T11:24:04.556 INFO:tasks.workunit.client.0.smithi073.stdout:8/949: link d1/d4/d37/dd3/d105/c9b d1/d4/d7b/d8d/c13f 0 2024-04-26T11:24:04.557 INFO:tasks.workunit.client.0.smithi073.stdout:7/962: truncate d1/d33/d1b/fd3 2515992 0 2024-04-26T11:24:04.557 INFO:tasks.workunit.client.0.smithi073.stdout:4/929: rmdir d8/d1a/d1b/d24/dac/da7 39 2024-04-26T11:24:04.557 INFO:tasks.workunit.client.0.smithi073.stdout:7/963: mkdir d1/d33/d68/d78/d14e 0 2024-04-26T11:24:04.558 INFO:tasks.workunit.client.0.smithi073.stdout:4/930: chown d8/d1a/d1b/d24/dac/d49/d85/f71 481322 1 2024-04-26T11:24:04.559 INFO:tasks.workunit.client.0.smithi073.stdout:4/931: symlink d8/d1a/d9c/d9d/l134 0 2024-04-26T11:24:04.560 INFO:tasks.workunit.client.0.smithi073.stdout:5/919: dwrite d4/de/d15/d67/fe1 [0,4194304] 0 2024-04-26T11:24:04.561 INFO:tasks.workunit.client.0.smithi073.stdout:5/920: unlink d4/d8/fb5 0 2024-04-26T11:24:04.564 INFO:tasks.workunit.client.0.smithi073.stdout:3/891: dread d0/d11/d19/d52/d102/d7a/dce/dd3/f10a [0,4194304] 0 2024-04-26T11:24:04.564 INFO:tasks.workunit.client.0.smithi073.stdout:0/903: dread d2/d37/f12a [0,4194304] 0 2024-04-26T11:24:04.565 INFO:tasks.workunit.client.0.smithi073.stdout:8/950: dwrite d1/d4/d15/de4/dfc/d2c/f134 [0,4194304] 0 2024-04-26T11:24:04.566 INFO:tasks.workunit.client.0.smithi073.stdout:6/793: dread d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:04.566 INFO:tasks.workunit.client.0.smithi073.stdout:9/945: dread d0/d3c/f7a [0,4194304] 0 2024-04-26T11:24:04.566 INFO:tasks.workunit.client.0.smithi073.stdout:8/951: write d1/d4/d4c/d66/f72 [1612349,11154] 0 2024-04-26T11:24:04.566 INFO:tasks.workunit.client.0.smithi073.stdout:9/946: stat d0/d83/dd4 0 2024-04-26T11:24:04.567 INFO:tasks.workunit.client.0.smithi073.stdout:8/952: write d1/d4/f12 [177126,38497] 0 2024-04-26T11:24:04.567 INFO:tasks.workunit.client.0.smithi073.stdout:5/921: dread d4/de/d15/f45 [0,4194304] 0 2024-04-26T11:24:04.568 INFO:tasks.workunit.client.0.smithi073.stdout:6/794: truncate d0/d15/f14 127960 0 2024-04-26T11:24:04.568 INFO:tasks.workunit.client.0.smithi073.stdout:0/904: symlink d2/d22/d51/d57/l139 0 2024-04-26T11:24:04.568 INFO:tasks.workunit.client.0.smithi073.stdout:9/947: mkdir d0/d83/d121/d142 0 2024-04-26T11:24:04.568 INFO:tasks.workunit.client.0.smithi073.stdout:3/892: rmdir d0/d11/d19/d52/d102/d60/dcd/d105 0 2024-04-26T11:24:04.570 INFO:tasks.workunit.client.0.smithi073.stdout:0/905: truncate d2/d1f/d9c/ff1 4372340 0 2024-04-26T11:24:04.570 INFO:tasks.workunit.client.0.smithi073.stdout:5/922: rmdir d4/d8/d9/d7d/da3 39 2024-04-26T11:24:04.571 INFO:tasks.workunit.client.0.smithi073.stdout:9/948: rename d0/d13/d5a/db2/de1/df5/d109/d138/f132 to d0/d13/d25/d75/f143 0 2024-04-26T11:24:04.573 INFO:tasks.workunit.client.0.smithi073.stdout:9/949: creat d0/d13/d5a/d116/d129/f144 x:0 0 0 2024-04-26T11:24:04.573 INFO:tasks.workunit.client.0.smithi073.stdout:8/953: dread d1/d4/d15/de4/dfc/d2c/f134 [0,4194304] 0 2024-04-26T11:24:04.574 INFO:tasks.workunit.client.0.smithi073.stdout:9/950: chown d0/d13/d25/d75/d8e/db9/f126 112 1 2024-04-26T11:24:04.574 INFO:tasks.workunit.client.0.smithi073.stdout:8/954: write d1/fdc [473783,12944] 0 2024-04-26T11:24:04.574 INFO:tasks.workunit.client.0.smithi073.stdout:3/893: truncate d0/d11/d19/db/d3e/d3f/fad 229477 0 2024-04-26T11:24:04.575 INFO:tasks.workunit.client.0.smithi073.stdout:8/955: mknod d1/d4/da9/c140 0 2024-04-26T11:24:04.576 INFO:tasks.workunit.client.0.smithi073.stdout:8/956: unlink d1/d4/d15/de4/dfc/d2c/ddd/d67/fb8 0 2024-04-26T11:24:04.582 INFO:tasks.workunit.client.0.smithi073.stdout:3/894: dwrite d0/faf [0,4194304] 0 2024-04-26T11:24:04.582 INFO:tasks.workunit.client.0.smithi073.stdout:9/951: dwrite d0/d1a/d4e/ffa [0,4194304] 0 2024-04-26T11:24:04.582 INFO:tasks.workunit.client.0.smithi073.stdout:9/952: chown d0/d13/db 11842 1 2024-04-26T11:24:04.583 INFO:tasks.workunit.client.0.smithi073.stdout:4/932: sync 2024-04-26T11:24:04.583 INFO:tasks.workunit.client.0.smithi073.stdout:2/911: dread dd/d4c/d48/f90 [0,4194304] 0 2024-04-26T11:24:04.583 INFO:tasks.workunit.client.0.smithi073.stdout:3/895: truncate d0/d11/d19/d70/f12f 849675 0 2024-04-26T11:24:04.584 INFO:tasks.workunit.client.0.smithi073.stdout:3/896: chown d0/d11/d19/db/d51/fc8 2 1 2024-04-26T11:24:04.585 INFO:tasks.workunit.client.0.smithi073.stdout:3/897: readlink d0/d11/d19/d1d/l4a 0 2024-04-26T11:24:04.585 INFO:tasks.workunit.client.0.smithi073.stdout:0/906: dread d2/fbd [0,4194304] 0 2024-04-26T11:24:04.586 INFO:tasks.workunit.client.0.smithi073.stdout:8/957: truncate d1/f18 3446033 0 2024-04-26T11:24:04.588 INFO:tasks.workunit.client.0.smithi073.stdout:4/933: creat d8/d1a/d1b/d24/dac/d72/d77/d131/f135 x:0 0 0 2024-04-26T11:24:04.588 INFO:tasks.workunit.client.0.smithi073.stdout:0/907: truncate d2/d22/d51/fc7 216284 0 2024-04-26T11:24:04.588 INFO:tasks.workunit.client.0.smithi073.stdout:8/958: mknod d1/d4/d37/dfa/c141 0 2024-04-26T11:24:04.588 INFO:tasks.workunit.client.0.smithi073.stdout:7/964: dread d1/d33/d1b/d66/f128 [0,4194304] 0 2024-04-26T11:24:04.590 INFO:tasks.workunit.client.0.smithi073.stdout:0/908: readlink d2/d1f/d40/l81 0 2024-04-26T11:24:04.590 INFO:tasks.workunit.client.0.smithi073.stdout:7/965: unlink d1/d11/d51/fd5 0 2024-04-26T11:24:04.590 INFO:tasks.workunit.client.0.smithi073.stdout:2/912: dwrite dd/de/d49/dbb/fc0 [0,4194304] 0 2024-04-26T11:24:04.590 INFO:tasks.workunit.client.0.smithi073.stdout:7/966: write d1/d11/d10/f110 [2206357,62756] 0 2024-04-26T11:24:04.592 INFO:tasks.workunit.client.0.smithi073.stdout:2/913: readlink dd/d4c/d48/d46/d91/da5/df6/dfd/l106 0 2024-04-26T11:24:04.593 INFO:tasks.workunit.client.0.smithi073.stdout:7/967: creat d1/d33/d68/f14f x:0 0 0 2024-04-26T11:24:04.593 INFO:tasks.workunit.client.0.smithi073.stdout:2/914: symlink dd/de/d49/dbb/l11e 0 2024-04-26T11:24:04.594 INFO:tasks.workunit.client.0.smithi073.stdout:7/968: rmdir d1/d11/d24 39 2024-04-26T11:24:04.595 INFO:tasks.workunit.client.0.smithi073.stdout:4/934: dwrite d8/d1a/fe6 [0,4194304] 0 2024-04-26T11:24:04.595 INFO:tasks.workunit.client.0.smithi073.stdout:4/935: chown d8/d1a/d1b/d1d/f56 0 1 2024-04-26T11:24:04.597 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:04.590+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:04.597 INFO:tasks.workunit.client.0.smithi073.stdout:7/969: write d1/d11/d24/d29/dd7/d4b/ff8 [1409952,117869] 0 2024-04-26T11:24:04.598 INFO:tasks.workunit.client.0.smithi073.stdout:9/953: dread d0/d1a/d2f/f3e [0,4194304] 0 2024-04-26T11:24:04.598 INFO:tasks.workunit.client.0.smithi073.stdout:4/936: write d8/f2e [8797604,88403] 0 2024-04-26T11:24:04.598 INFO:tasks.workunit.client.0.smithi073.stdout:8/959: truncate d1/d4/d15/dbc/dc3/dc6/fe1 2409621 0 2024-04-26T11:24:04.599 INFO:tasks.workunit.client.0.smithi073.stdout:8/960: chown d1/d4/d15/lca 2323380 1 2024-04-26T11:24:04.599 INFO:tasks.workunit.client.0.smithi073.stdout:2/915: write dd/d4c/d48/d46/d91/d9f/f43 [1714645,32407] 0 2024-04-26T11:24:04.599 INFO:tasks.workunit.client.0.smithi073.stdout:7/970: mknod d1/d33/d68/d78/daf/dc5/c150 0 2024-04-26T11:24:04.601 INFO:tasks.workunit.client.0.smithi073.stdout:2/916: rename dd/de/d38/d53/f74 to dd/d4c/d48/d77/d80/f11f 0 2024-04-26T11:24:04.603 INFO:tasks.workunit.client.0.smithi073.stdout:9/954: truncate d0/d13/d5a/d5e/f6d 3616544 0 2024-04-26T11:24:04.604 INFO:tasks.workunit.client.0.smithi073.stdout:2/917: truncate dd/d27/da0/da7/ddd/f119 458645 0 2024-04-26T11:24:04.604 INFO:tasks.workunit.client.0.smithi073.stdout:9/955: rmdir d0/d13 39 2024-04-26T11:24:04.604 INFO:tasks.workunit.client.0.smithi073.stdout:2/918: stat dd/d27/da0/da7 0 2024-04-26T11:24:04.604 INFO:tasks.workunit.client.0.smithi073.stdout:4/937: dwrite d8/d1a/d5e/d7c/f90 [8388608,4194304] 0 2024-04-26T11:24:04.607 INFO:tasks.workunit.client.0.smithi073.stdout:2/919: rmdir dd/d4c/d48/d46/d91/da5 39 2024-04-26T11:24:04.607 INFO:tasks.workunit.client.0.smithi073.stdout:4/938: mkdir d8/d1a/d4d/ddc/dde/d136 0 2024-04-26T11:24:04.607 INFO:tasks.workunit.client.0.smithi073.stdout:3/898: dread d0/d11/d19/f25 [0,4194304] 0 2024-04-26T11:24:04.607 INFO:tasks.workunit.client.0.smithi073.stdout:3/899: chown d0/d11/d23 20973070 1 2024-04-26T11:24:04.607 INFO:tasks.workunit.client.0.smithi073.stdout:2/920: write dd/de/d38/d4e/f110 [189939,3367] 0 2024-04-26T11:24:04.608 INFO:tasks.workunit.client.0.smithi073.stdout:3/900: write d0/d11/d19/d1d/ff5 [342911,65834] 0 2024-04-26T11:24:04.608 INFO:tasks.workunit.client.0.smithi073.stdout:2/921: rmdir dd/d4c/d48/d46/d91/d9f/d1d 39 2024-04-26T11:24:04.608 INFO:tasks.workunit.client.0.smithi073.stdout:2/922: chown dd/de/d2a/dbc/de1 186 1 2024-04-26T11:24:04.609 INFO:tasks.workunit.client.0.smithi073.stdout:9/956: dwrite d0/d13/f5b [0,4194304] 0 2024-04-26T11:24:04.613 INFO:tasks.workunit.client.0.smithi073.stdout:2/923: truncate dd/d4c/d48/d46/d91/d9f/d1d/f81 7293389 0 2024-04-26T11:24:04.614 INFO:tasks.workunit.client.0.smithi073.stdout:3/901: dwrite d0/d11/d19/d1d/f50 [0,4194304] 0 2024-04-26T11:24:04.614 INFO:tasks.workunit.client.0.smithi073.stdout:3/902: dread - d0/fdf zero size 2024-04-26T11:24:04.615 INFO:tasks.workunit.client.0.smithi073.stdout:3/903: unlink d0/d11/d19/c121 0 2024-04-26T11:24:04.618 INFO:tasks.workunit.client.0.smithi073.stdout:3/904: symlink d0/d11/d19/db/df0/l133 0 2024-04-26T11:24:04.619 INFO:tasks.workunit.client.0.smithi073.stdout:3/905: chown d0/d11/d19/d70/f84 9675 1 2024-04-26T11:24:04.619 INFO:tasks.workunit.client.0.smithi073.stdout:5/923: dread d4/d8/dff/f108 [0,4194304] 0 2024-04-26T11:24:04.621 INFO:tasks.workunit.client.0.smithi073.stdout:5/924: unlink d4/de/d23/c85 0 2024-04-26T11:24:04.622 INFO:tasks.workunit.client.0.smithi073.stdout:2/924: dwrite dd/d4c/d48/d46/d91/d9f/d1d/f36 [0,4194304] 0 2024-04-26T11:24:04.622 INFO:tasks.workunit.client.0.smithi073.stdout:2/925: chown dd/d4c/d48/d46/ca8 3137 1 2024-04-26T11:24:04.623 INFO:tasks.workunit.client.0.smithi073.stdout:5/925: symlink d4/de/d15/d67/d103/d105/l14a 0 2024-04-26T11:24:04.624 INFO:tasks.workunit.client.0.smithi073.stdout:2/926: mknod dd/d27/da0/da7/ddd/c120 0 2024-04-26T11:24:04.624 INFO:tasks.workunit.client.0.smithi073.stdout:2/927: fsync dd/d4c/f42 0 2024-04-26T11:24:04.624 INFO:tasks.workunit.client.0.smithi073.stdout:9/957: dread d0/d13/d5a/d5e/f6d [0,4194304] 0 2024-04-26T11:24:04.624 INFO:tasks.workunit.client.0.smithi073.stdout:5/926: write d4/d8/d9/d7d/fd1 [493913,99149] 0 2024-04-26T11:24:04.625 INFO:tasks.workunit.client.0.smithi073.stdout:5/927: creat d4/d8/d9/d12e/f14b x:0 0 0 2024-04-26T11:24:04.626 INFO:tasks.workunit.client.0.smithi073.stdout:2/928: readlink dd/d4c/d48/d46/d91/da5/df5/lfe 0 2024-04-26T11:24:04.630 INFO:tasks.workunit.client.0.smithi073.stdout:3/906: dread d0/d11/d19/fe3 [0,4194304] 0 2024-04-26T11:24:04.630 INFO:tasks.workunit.client.0.smithi073.stdout:6/795: dread d0/d15/d2d/d3f/d59/f6b [0,4194304] 0 2024-04-26T11:24:04.632 INFO:tasks.workunit.client.0.smithi073.stdout:3/907: write d0/d11/d19/d52/d102/d7a/ff1 [2640598,84419] 0 2024-04-26T11:24:04.632 INFO:tasks.workunit.client.0.smithi073.stdout:5/928: dwrite d4/de/d15/d33/f8f [0,4194304] 0 2024-04-26T11:24:04.632 INFO:tasks.workunit.client.0.smithi073.stdout:6/796: getdents d0/d19/d20 0 2024-04-26T11:24:04.632 INFO:tasks.workunit.client.0.smithi073.stdout:5/929: chown d4/de/d15/d33/l64 1 1 2024-04-26T11:24:04.633 INFO:tasks.workunit.client.0.smithi073.stdout:5/930: chown d4/de/d15/d67/d103/d105/d10f 98522611 1 2024-04-26T11:24:04.634 INFO:tasks.workunit.client.0.smithi073.stdout:9/958: write d0/d13/d25/d2c/f123 [1082372,88440] 0 2024-04-26T11:24:04.634 INFO:tasks.workunit.client.0.smithi073.stdout:7/971: sync 2024-04-26T11:24:04.635 INFO:tasks.workunit.client.0.smithi073.stdout:2/929: truncate dd/d4c/d48/d46/d91/d9f/f6f 204077 0 2024-04-26T11:24:04.635 INFO:tasks.workunit.client.0.smithi073.stdout:9/959: chown d0/d1a/d4e/d70/dd6/f12f 931269 1 2024-04-26T11:24:04.636 INFO:tasks.workunit.client.0.smithi073.stdout:5/931: link d4/de/l5e d4/d8/d9/d7d/l14c 0 2024-04-26T11:24:04.637 INFO:tasks.workunit.client.0.smithi073.stdout:7/972: link d1/d11/d24/d71/d90/f119 d1/d11/d24/d29/dd7/f151 0 2024-04-26T11:24:04.637 INFO:tasks.workunit.client.0.smithi073.stdout:9/960: fdatasync d0/d1a/d4e/d70/d59/de8/fed 0 2024-04-26T11:24:04.637 INFO:tasks.workunit.client.0.smithi073.stdout:2/930: rename dd/d4c/cc8 to dd/d4c/d48/d46/d91/da5/df6/dfd/c121 0 2024-04-26T11:24:04.637 INFO:tasks.workunit.client.0.smithi073.stdout:5/932: mknod d4/d73/d8a/da0/c14d 0 2024-04-26T11:24:04.638 INFO:tasks.workunit.client.0.smithi073.stdout:5/933: chown d4/de/d15 9566700 1 2024-04-26T11:24:04.638 INFO:tasks.workunit.client.0.smithi073.stdout:9/961: readlink d0/d13/d5a/d5e/l10d 0 2024-04-26T11:24:04.638 INFO:tasks.workunit.client.0.smithi073.stdout:7/973: chown d1/d11/d24/d29/dd7/d80/da0/f107 493 1 2024-04-26T11:24:04.638 INFO:tasks.workunit.client.0.smithi073.stdout:6/797: dwrite d0/d1a/d26/f94 [0,4194304] 0 2024-04-26T11:24:04.639 INFO:tasks.workunit.client.0.smithi073.stdout:6/798: readlink d0/dc/d2e/d6e/l9d 0 2024-04-26T11:24:04.640 INFO:tasks.workunit.client.0.smithi073.stdout:2/931: symlink dd/d4c/d48/d46/d91/da5/df6/l122 0 2024-04-26T11:24:04.641 INFO:tasks.workunit.client.0.smithi073.stdout:5/934: mkdir d4/d73/d14e 0 2024-04-26T11:24:04.641 INFO:tasks.workunit.client.0.smithi073.stdout:7/974: write d1/d11/d24/d29/fa4 [522465,8942] 0 2024-04-26T11:24:04.641 INFO:tasks.workunit.client.0.smithi073.stdout:2/932: symlink dd/d27/dcd/d116/l123 0 2024-04-26T11:24:04.641 INFO:tasks.workunit.client.0.smithi073.stdout:5/935: mkdir d4/de/d14f 0 2024-04-26T11:24:04.642 INFO:tasks.workunit.client.0.smithi073.stdout:7/975: mkdir d1/d11/d24/d29/dd7/d3d/d133/d152 0 2024-04-26T11:24:04.642 INFO:tasks.workunit.client.0.smithi073.stdout:5/936: dread - d4/de/d15/d67/fe4 zero size 2024-04-26T11:24:04.643 INFO:tasks.workunit.client.0.smithi073.stdout:7/976: dread - d1/d11/d5e/d8f/fa2 zero size 2024-04-26T11:24:04.644 INFO:tasks.workunit.client.0.smithi073.stdout:5/937: chown d4/d8/d9/d7d/d84/da7/db7/dcd/df1/df3/c136 112165 1 2024-04-26T11:24:04.644 INFO:tasks.workunit.client.0.smithi073.stdout:7/977: creat d1/d11/d24/d29/dd7/d80/da0/f153 x:0 0 0 2024-04-26T11:24:04.645 INFO:tasks.workunit.client.0.smithi073.stdout:2/933: write dd/d4c/d48/d77/f10e [831720,119765] 0 2024-04-26T11:24:04.645 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:04.646 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:24:04.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:24:04.646 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:04.646 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.646 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2615 3.d 3:b02ffd62:::200.00000010:head [write 2546869~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.646 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:04.646 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.23683221199999999, 2024-04-26T11:24:04.646 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070123572999999995, 2024-04-26T11:24:04.646 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.647 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.647 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.648 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:04.648 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.648 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.648 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.648 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406472+0000", 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406483+0000", 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1219999999999999e-05 2024-04-26T11:24:04.649 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406499+0000", 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5452999999999999e-05 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406511+0000", 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1769e-05 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.650 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472319+0000", 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065808723 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472411+0000", 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1896000000000002e-05 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476347+0000", 2024-04-26T11:24:04.651 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039353060000000004 2024-04-26T11:24:04.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476433+0000", 2024-04-26T11:24:04.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6487000000000001e-05 2024-04-26T11:24:04.652 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.652 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.652 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.652 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476597+0000", 2024-04-26T11:24:04.652 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163461 2024-04-26T11:24:04.653 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.653 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.653 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.653 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.653 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.653 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2616 3.d 3:b02ffd62:::200.00000010:head [write 2548776~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.653 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:04.653 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.23678550400000001, 2024-04-26T11:24:04.653 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070199544000000003, 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.654 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406519+0000", 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406531+0000", 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.172e-05 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.655 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406546+0000", 2024-04-26T11:24:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5685999999999999e-05 2024-04-26T11:24:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406556+0000", 2024-04-26T11:24:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0071000000000001e-05 2024-04-26T11:24:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.656 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473252+0000", 2024-04-26T11:24:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066695915999999994 2024-04-26T11:24:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473332+0000", 2024-04-26T11:24:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:24:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.657 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476611+0000", 2024-04-26T11:24:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032787630000000001 2024-04-26T11:24:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476656+0000", 2024-04-26T11:24:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5096999999999999e-05 2024-04-26T11:24:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.658 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476719+0000", 2024-04-26T11:24:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3332999999999998e-05 2024-04-26T11:24:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2617 3.d 3:b02ffd62:::200.00000010:head [write 2552653~1113 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.659 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.23673989400000001, 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073674075000000006, 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.660 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406564+0000", 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406570+0000", 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6520000000000003e-06 2024-04-26T11:24:04.661 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406583+0000", 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2679e-05 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406594+0000", 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1032999999999999e-05 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474020+0000", 2024-04-26T11:24:04.662 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.067425944000000002 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474102+0000", 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2806999999999995e-05 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480120+0000", 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060174729999999997 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.663 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480169+0000", 2024-04-26T11:24:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9570999999999997e-05 2024-04-26T11:24:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480239+0000", 2024-04-26T11:24:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0026999999999999e-05 2024-04-26T11:24:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.664 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2618 3.d 3:b02ffd62:::200.00000010:head [write 2553766~1050 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.23396022899999999, 2024-04-26T11:24:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071002984000000005, 2024-04-26T11:24:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.665 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409344+0000", 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:04.666 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409353+0000", 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9150000000000002e-06 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409371+0000", 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8904000000000001e-05 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409384+0000", 2024-04-26T11:24:04.667 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2566e-05 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065596495000000005 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475126+0000", 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145329 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480249+0000", 2024-04-26T11:24:04.668 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005123102 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480288+0000", 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9285000000000001e-05 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480348+0000", 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9728999999999997e-05 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.669 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:14995 4.5 4:a0840aa3:::10000003880.00000000:head [write 85470~33722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.23390097100000001, 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071045135999999995, 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14995 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.670 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.671 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409431+0000", 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7233000000000002e-05 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409440+0000", 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5859999999999994e-06 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409446+0000", 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9429999999999997e-06 2024-04-26T11:24:04.672 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065534244000000005 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475214+0000", 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023348600000000001 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480357+0000", 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051425710000000003 2024-04-26T11:24:04.673 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480394+0000", 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7289000000000002e-05 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480449+0000", 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5507000000000002e-05 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.674 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2619 3.d 3:b02ffd62:::200.00000010:head [write 2554816~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.23327488099999999, 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071786804999999995, 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.675 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410029+0000", 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410037+0000", 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2760000000000003e-06 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.676 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410047+0000", 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0555e-05 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410054+0000", 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9399999999999996e-06 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476866+0000", 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066812270000000007 2024-04-26T11:24:04.677 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.477059+0000", 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019292199999999999 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481712+0000", 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046527210000000003 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481754+0000", 2024-04-26T11:24:04.678 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2017000000000001e-05 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481817+0000", 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3054999999999999e-05 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2620 3.d 3:b02ffd62:::200.00000010:head [write 2557602~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.230283142, 2024-04-26T11:24:04.679 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073204069999999996, 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.680 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413021+0000", 2024-04-26T11:24:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413038+0000", 2024-04-26T11:24:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6787999999999999e-05 2024-04-26T11:24:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.681 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413052+0000", 2024-04-26T11:24:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4606999999999999e-05 2024-04-26T11:24:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413062+0000", 2024-04-26T11:24:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9669999999999996e-06 2024-04-26T11:24:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.682 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478002+0000", 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064940093000000004 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478080+0000", 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7985999999999995e-05 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486106+0000", 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080256040000000004 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.683 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486157+0000", 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1063000000000002e-05 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486226+0000", 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9078000000000005e-05 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2621 3.d 3:b02ffd62:::200.00000010:head [write 2559526~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:04.684 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.22745691900000001, 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070487039000000001, 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:04.685 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415847+0000", 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415855+0000", 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6929999999999996e-06 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.686 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415888+0000", 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2954999999999999e-05 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415902+0000", 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3706000000000001e-05 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478597+0000", 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062695089999999995 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.687 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478709+0000", 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111777 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486236+0000", 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075266700000000001 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486276+0000", 2024-04-26T11:24:04.688 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9966999999999999e-05 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486335+0000", 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9713000000000002e-05 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2622 3.d 3:b02ffd62:::200.00000010:head [write 2561446~5986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.22733957900000001, 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.072007783000000006, 2024-04-26T11:24:04.689 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.690 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415965+0000", 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415979+0000", 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4697e-05 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415993+0000", 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3947e-05 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.691 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416003+0000", 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479418+0000", 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063414807000000004 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479500+0000", 2024-04-26T11:24:04.692 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1631999999999994e-05 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487756+0000", 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082565529999999998 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487831+0000", 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4449999999999994e-05 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487973+0000", 2024-04-26T11:24:04.693 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014249999999999999 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2623 3.d 3:b02ffd62:::200.00000010:head [write 2567432~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.22696819500000001, 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071791032000000005, 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.694 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.695 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416336+0000", 2024-04-26T11:24:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416343+0000", 2024-04-26T11:24:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.827e-06 2024-04-26T11:24:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416354+0000", 2024-04-26T11:24:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1168e-05 2024-04-26T11:24:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416364+0000", 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7520000000000008e-06 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480382+0000", 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064018284999999994 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480487+0000", 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010463099999999999 2024-04-26T11:24:04.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487984+0000", 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074974000000000004 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488035+0000", 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0702999999999999e-05 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488128+0000", 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3246999999999997e-05 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2624 3.d 3:b02ffd62:::200.00000010:head [write 2569339~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.22692758099999999, 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071901926000000005, 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416377+0000", 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416380+0000", 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.287e-06 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416386+0000", 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4559999999999999e-06 2024-04-26T11:24:04.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416390+0000", 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0659999999999997e-06 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481222+0000", 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064831753000000006 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481290+0000", 2024-04-26T11:24:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8425999999999998e-05 2024-04-26T11:24:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488139+0000", 2024-04-26T11:24:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068488289999999999 2024-04-26T11:24:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488191+0000", 2024-04-26T11:24:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1629000000000003e-05 2024-04-26T11:24:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488280+0000", 2024-04-26T11:24:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9009000000000001e-05 2024-04-26T11:24:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:15009 4.1d 4:b80503fc:::10000003240.00000000:head [write 897504~130300] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.22524179799999999, 2024-04-26T11:24:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069065685000000002, 2024-04-26T11:24:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:04.706 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 15009 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418062+0000", 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418222+0000", 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016041800000000001 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418233+0000", 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0604999999999999e-05 2024-04-26T11:24:04.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418240+0000", 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481210+0000", 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062970672000000005 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481312+0000", 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101834 2024-04-26T11:24:04.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487023+0000", 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057108910000000001 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487065+0000", 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1553e-05 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487129+0000", 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4394999999999996e-05 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2625 3.d 3:b02ffd62:::200.00000010:head [write 2571246~11889 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.22492557699999999, 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069981421000000002, 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418379+0000", 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418393+0000", 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4819e-05 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418405+0000", 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1756999999999999e-05 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418413+0000", 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6839999999999996e-06 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481846+0000", 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063433324999999999 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481927+0000", 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0531000000000005e-05 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488289+0000", 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063617559999999997 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488322+0000", 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3130999999999998e-05 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488361+0000", 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9385000000000003e-05 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2626 3.d 3:b02ffd62:::200.00000010:head [write 2583135~1955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.715 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.223942268, 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071468652999999993, 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419362+0000", 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419368+0000", 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2260000000000002e-06 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419379+0000", 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0920999999999999e-05 2024-04-26T11:24:04.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419388+0000", 2024-04-26T11:24:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1740000000000006e-06 2024-04-26T11:24:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482729+0000", 2024-04-26T11:24:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063340152999999996 2024-04-26T11:24:04.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482840+0000", 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011119400000000001 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490744+0000", 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079037740000000006 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490781+0000", 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.735e-05 2024-04-26T11:24:04.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490832+0000", 2024-04-26T11:24:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0729000000000002e-05 2024-04-26T11:24:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.720 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2627 3.d 3:b02ffd62:::200.00000010:head [write 2585090~9888 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.22246044700000001, 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070072738999999995, 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420844+0000", 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420857+0000", 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2974e-05 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420868+0000", 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1063999999999999e-05 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420876+0000", 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2060000000000007e-06 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483561+0000", 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062684472000000005 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483646+0000", 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5006000000000006e-05 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490839+0000", 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071929979999999999 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490872+0000", 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3550999999999998e-05 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490917+0000", 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5426000000000002e-05 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2628 3.d 3:b02ffd62:::200.00000010:head [write 2594978~23633 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.22102775999999999, 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068718354999999995, 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.725 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422276+0000", 2024-04-26T11:24:04.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422309+0000", 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422319+0000", 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0254e-05 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422326+0000", 2024-04-26T11:24:04.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4509999999999997e-06 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484314+0000", 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.061988468999999997 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484428+0000", 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011424799999999999 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490923+0000", 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064948699999999998 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490950+0000", 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7163000000000001e-05 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490996+0000", 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5423000000000002e-05 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2629 3.d 3:b02ffd62:::200.00000010:head [write 2618611~3263 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.22097112399999999, 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068771545000000003, 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422337+0000", 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5659999999999998e-06 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422342+0000", 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000002e-06 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422346+0000", 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8419999999999998e-06 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485397+0000", 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063051691000000007 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485487+0000", 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9986000000000002e-05 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491001+0000", 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055139899999999999 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491030+0000", 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8314999999999999e-05 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491106+0000", 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5845000000000003e-05 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2634 3.d 3:b02ffd62:::200.00000010:head [write 2639450~2419 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:04.734 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.217058588, 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070097349000000003, 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:04.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426246+0000", 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426250+0000", 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4750000000000004e-06 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426257+0000", 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4320000000000004e-06 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426261+0000", 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.732e-06 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491320+0000", 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065059326000000001 2024-04-26T11:24:04.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491435+0000", 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011479 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496253+0000", 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004818676 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496292+0000", 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8640999999999998e-05 2024-04-26T11:24:04.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496344+0000", 2024-04-26T11:24:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1870000000000003e-05 2024-04-26T11:24:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.739 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2635 3.d 3:b02ffd62:::200.00000010:head [write 2641869~3599 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.21700232699999999, 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071646847999999999, 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:04.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426302+0000", 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426306+0000", 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6169999999999998e-06 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426314+0000", 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1079999999999993e-06 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426318+0000", 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3769999999999998e-06 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492040+0000", 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065721110999999999 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492102+0000", 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2378999999999993e-05 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497865+0000", 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057628710000000001 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497901+0000", 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5963000000000001e-05 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497950+0000", 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8968000000000003e-05 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2636 3.d 3:b02ffd62:::200.00000010:head [write 2645468~4496 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.215069598, 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069794832000000001, 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.744 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428235+0000", 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428244+0000", 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8580000000000006e-06 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428253+0000", 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5289999999999997e-06 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428261+0000", 2024-04-26T11:24:04.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3189999999999997e-06 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492846+0000", 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064585646999999996 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492940+0000", 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3393000000000005e-05 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497957+0000", 2024-04-26T11:24:04.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050173370000000002 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497986+0000", 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8946e-05 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.498030+0000", 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4561000000000002e-05 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.748 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:04.749 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:04.749 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:04.751 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:04.751 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:04.746+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:04.767 INFO:tasks.workunit.client.0.smithi073.stdout:7/978: write d1/d11/d24/d29/dd7/d80/f148 [48835,90279] 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:0/909: dread d2/d22/f5a [0,4194304] 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:2/934: truncate dd/de/f71 1435724 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:2/935: fsync dd/de/d49/f79 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:0/910: mknod d2/d22/d51/d57/d78/c13a 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:7/979: link d1/d11/d24/d29/dd7/d4b/f56 d1/d33/d1b/d95/f154 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:2/936: link dd/de/d38/d4e/lf7 dd/d4c/d48/d77/d80/l124 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:6/799: read d0/d1a/d26/f54 [87034,64650] 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:6/800: write d0/d1a/d26/fc6 [5501012,103533] 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:7/980: read d1/d11/d24/d29/dd7/d4b/f56 [1011796,18197] 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:6/801: creat d0/d1a/d26/d4b/d63/da0/d7c/ff0 x:0 0 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:6/802: unlink d0/d1a/d4e/d67/f8f 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:4/939: dread d8/d15/f17 [0,4194304] 0 2024-04-26T11:24:04.768 INFO:tasks.workunit.client.0.smithi073.stdout:0/911: dwrite d2/d22/f33 [0,4194304] 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:9/962: dread d0/d1a/d4e/d70/dd6/ff9 [0,4194304] 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:2/937: read dd/de/d38/d4e/f110 [159516,111831] 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:5/938: dread d4/d8/dff/f11d [4194304,4194304] 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:8/961: dread d1/d4/d15/f4d [0,4194304] 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:0/912: rename d2/f15 to d2/d37/d8b/d137/f13b 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:4/940: unlink d8/d1a/d1b/d24/dac/c10a 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:5/939: chown d4/d8/d9/d7d/da3/ddc/f89 5989 1 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:0/913: write d2/d22/fd7 [103485,5865] 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:8/962: mknod d1/d4/c142 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:5/940: mknod d4/de/d142/c150 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:0/914: write d2/d37/d3c/d116/f12f [707784,67821] 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:8/963: rmdir d1/d4/d4c 39 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:4/941: getdents d8/d14 0 2024-04-26T11:24:04.769 INFO:tasks.workunit.client.0.smithi073.stdout:3/908: dread d0/f7 [0,4194304] 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:5/941: dread - d4/de/d23/d4f/f126 zero size 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:6/803: dread d0/d15/d2d/d3f/d59/deb/fe2 [0,4194304] 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:4/942: write d8/d1a/d1b/d24/fcd [90725,26852] 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:6/804: stat d0/dc/d80/d97/ccf 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:4/943: getdents d8/d1a/d1b/d24/dac/da7 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:2/938: dwrite dd/d4c/d48/f90 [0,4194304] 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:5/942: fsync d4/de/d15/f65 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:2/939: stat dd/de/f12 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:2/940: mknod dd/d4c/d48/d77/d80/d112/c125 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:8/964: dwrite d1/d4/d15/db7/df7/ffb [0,4194304] 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:5/943: chown d4/d8/d9/d7d/da3/fba 26077 1 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:8/965: write d1/d4/d15/fe9 [1561315,101163] 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:3/909: truncate d0/d2d/f89 1095405 0 2024-04-26T11:24:04.770 INFO:tasks.workunit.client.0.smithi073.stdout:0/915: dwrite d2/d1f/d40/d48/f123 [0,4194304] 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:4/944: write d8/d1a/d86/fa8 [1115555,38593] 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:6/805: dwrite d0/d15/d2d/f33 [0,4194304] 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:0/916: creat d2/d1f/d9c/db1/f13c x:0 0 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:4/945: mkdir d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/dc2/dc3/d137 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:6/806: creat d0/dc/d55/d79/dd5/ff1 x:0 0 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:6/807: creat d0/dc/d55/d79/dce/ff2 x:0 0 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:4/946: mknod d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/dc2/c138 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:6/808: truncate d0/dc/d55/d79/dd5/ff1 923 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:4/947: symlink d8/d1a/d1b/d24/dac/d72/l139 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:6/809: mkdir d0/d1a/d26/d4b/d38/df3 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:5/944: dwrite d4/de/d15/d67/d103/d105/d10f/f118 [0,4194304] 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:6/810: unlink d0/d19/f6f 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:6/811: write d0/f61 [4629345,117418] 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:4/948: link d8/d1a/d86/ca0 d8/d1a/d1b/d1d/c13a 0 2024-04-26T11:24:04.771 INFO:tasks.workunit.client.0.smithi073.stdout:5/945: link d4/de/d15/d33/cb9 d4/d8/d9/d7d/da3/ddc/d117/c151 0 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:4/949: fdatasync d8/d1a/d1b/d24/dac/d72/d77/d131/f135 0 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:6/812: write d0/d1a/d26/d4b/d2b/f3e [3148278,118439] 0 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:5/946: mkdir d4/de/d15/d121/d152 0 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:4/950: dread - d8/d1a/d1b/d24/dac/fdd zero size 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:6/813: chown d0/d1a/d26/d4b/d49/d84 991 1 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:7/981: sync 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:9/963: sync 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:5/947: symlink d4/d8/dc3/l153 0 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:9/964: stat d0/d1a/d4e/d70/f137 0 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:6/814: link d0/d1a/d4e/f51 d0/d1a/d26/d4b/d49/ff4 0 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:4/951: rename d8/d1a/d1b/d24/dac/da7/fba to d8/d1a/d9c/d100/f13b 0 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:4/952: creat d8/d15/f13c x:0 0 0 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:6/815: truncate d0/d19/f60 660136 0 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:4/953: mkdir d8/d15/da1/d13d 0 2024-04-26T11:24:04.772 INFO:tasks.workunit.client.0.smithi073.stdout:5/948: dwrite d4/de/d15/d67/fe1 [0,4194304] 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:5/949: write d4/d8/d8e/f137 [578213,20345] 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:5/950: creat d4/de/d15/d67/f154 x:0 0 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:5/951: unlink d4/de/d15/d67/fe4 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:5/952: chown d4/d73/lfa 147546 1 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:4/954: dwrite d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/fbe [4194304,4194304] 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:4/955: symlink d8/d1a/d4d/l13e 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:4/956: fdatasync d8/d1a/d9c/fb8 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:9/965: write d0/d13/f1f [2091055,15087] 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:2/941: dread dd/de/d38/d53/dc3/fc4 [0,4194304] 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:4/957: dread - d8/d1a/d5e/dc5/dfb/f11f zero size 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:9/966: fsync d0/d13/d5a/d65/f8d 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:0/917: dread d2/d1f/d40/d48/fa5 [0,4194304] 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:2/942: mknod dd/d27/dcd/c126 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:9/967: creat d0/d1a/d4e/d70/d59/de8/f145 x:0 0 0 2024-04-26T11:24:04.773 INFO:tasks.workunit.client.0.smithi073.stdout:0/918: mknod d2/d1f/d40/d48/d122/c13d 0 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:2/943: chown dd/de/d38/d4e/cae 13 1 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:9/968: write d0/d1a/d4e/ff8 [99756,32549] 0 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:2/944: write dd/de/f109 [912761,112596] 0 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:4/958: dwrite d8/d1a/d1b/f129 [0,4194304] 0 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:6/816: dread d0/d1a/d26/d27/f29 [0,4194304] 0 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:9/969: dwrite d0/d1a/d4e/d70/d51/ff4 [4194304,4194304] 0 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:2/945: dwrite dd/de/f11 [0,4194304] 0 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:6/817: rename d0/d1a/d26/d4b/d63/da0/dd2 to d0/d1a/d4e/d67/df5 0 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:9/970: mkdir d0/d13/d5a/d65/d146 0 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:2/946: symlink dd/d4c/d48/d77/d80/l127 0 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:0/919: dwrite d2/d1f/d9c/fa0 [0,4194304] 0 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:9/971: chown d0/d13/l17 11806 1 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:6/818: dread - d0/d1a/d7a/fb3 zero size 2024-04-26T11:24:04.774 INFO:tasks.workunit.client.0.smithi073.stdout:2/947: unlink dd/de/d29/d98/f111 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:0/920: creat d2/d5f/f13e x:0 0 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:4/959: read d8/d1a/d1b/d24/dac/f50 [748350,46996] 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:0/921: read - d2/d1f/d40/d48/f99 zero size 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:6/819: rmdir d0/d19/dec 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:3/910: dread d0/d11/d19/d1d/f108 [0,4194304] 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:2/948: rename dd/de/d49/c8f to dd/d4c/d48/d46/d91/d9f/d1d/d8c/c128 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:6/820: creat d0/dc/d55/d79/dd5/ff6 x:0 0 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:0/922: mknod d2/d1f/d40/c13f 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:4/960: fdatasync d8/d15/da1/fa9 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:3/911: creat d0/d11/d23/d86/d125/f134 x:0 0 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:0/923: mkdir d2/d37/d140 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:3/912: mkdir d0/d11/d19/d1d/d135 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:4/961: write d8/d1a/d1b/d24/dac/d72/d77/d96/fea [996411,114027] 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:2/949: dread dd/d27/dcd/d116/f61 [0,4194304] 0 2024-04-26T11:24:04.775 INFO:tasks.workunit.client.0.smithi073.stdout:0/924: mknod d2/d1f/d40/d48/dc1/dd6/c141 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:0/925: chown d2/d37/f12a 1 1 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:0/926: mknod d2/d1f/d40/d48/da9/de6/c142 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:5/953: dread d4/de/d23/d4f/f59 [0,4194304] 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:9/972: write d0/d1a/d4e/d70/f111 [3265155,29591] 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:9/973: chown d0/d1a/d4e/d10b 10175741 1 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:6/821: write d0/d19/d20/f65 [5909,82963] 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:4/962: dwrite d8/d1a/d5e/dc5/dfb/f11f [0,4194304] 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:3/913: dwrite d0/d11/d19/f27 [0,4194304] 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:6/822: rename d0/dc/d80/d97 to d0/d19/df7 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:2/950: dwrite dd/d27/da0/da7/ddd/f119 [0,4194304] 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:9/974: symlink d0/d13/d5a/db2/de1/df5/d109/l147 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:3/914: fdatasync d0/d11/d19/d52/d102/d7a/dce/f100 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:5/954: symlink d4/d8/d9/d42/d68/df2/d125/l155 0 2024-04-26T11:24:04.776 INFO:tasks.workunit.client.0.smithi073.stdout:6/823: mknod d0/d19/df7/cf8 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:2/951: write dd/d27/feb [55358,21296] 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:4/963: creat d8/d1a/d9c/f13f x:0 0 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:6/824: mknod d0/d15/d2d/d3f/cf9 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:2/952: symlink dd/de/d38/d53/d60/l129 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:8/966: sync 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:8/967: mknod d1/d4/d15/dbc/dc3/dc6/ddb/c143 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:2/953: truncate dd/de/d49/fad 1359781 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:5/955: write d4/d8/d9/d7d/d84/f78 [3671465,46613] 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:8/968: mkdir d1/d4/d15/db7/d144 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:5/956: mkdir d4/d8/dff/d156 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:8/969: creat d1/d4/d115/f145 x:0 0 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:2/954: creat dd/d27/da0/f12a x:0 0 0 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:5/957: dread - d4/d8/d9/d7d/d84/da7/db7/dcd/dd4/fec zero size 2024-04-26T11:24:04.777 INFO:tasks.workunit.client.0.smithi073.stdout:8/970: mkdir d1/d4/d15/dbc/d125/d146 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:5/958: read d4/d8/d9/d42/f9c [2202559,12885] 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:0/927: read d2/d1f/d40/d48/f131 [485354,86642] 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:8/971: truncate d1/d4/d37/d5b/fa2 1109329 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:5/959: stat d4/d8/l12d 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:4/964: dread d8/d1a/d1b/d24/dac/d72/d77/d131/f8a [0,4194304] 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:8/972: chown d1/d4/d4c/laa 11 1 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:5/960: creat d4/d73/d8a/dc8/f157 x:0 0 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:0/928: truncate d2/d1f/d40/f44 1551065 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:8/973: mknod d1/d4/da9/d121/c147 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:4/965: rename d8/d1a/d1b/f83 to d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/f140 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:5/961: mkdir d4/d8/d9/d7d/d84/da7/db7/dcd/dd4/d158 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:5/962: mkdir d4/d8/d159 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:2/955: dwrite dd/d4c/d48/d46/d91/d9f/d1d/d8c/f95 [0,4194304] 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:8/974: truncate d1/d4/d7b/d8d/f11e 1392694 0 2024-04-26T11:24:04.778 INFO:tasks.workunit.client.0.smithi073.stdout:4/966: unlink d8/d1a/d1b/d24/dac/d72/d77/d131/d37/lc7 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:5/963: stat d4/d8/d9/d7d/d84/da7/db7/d127/ff7 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:4/967: creat d8/f141 x:0 0 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:4/968: write d8/d1a/d1b/fb5 [397267,112644] 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:4/969: chown d8/d1a/d1b/d1d/f6a 1662 1 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:6/825: dread d0/d1a/d26/d4b/d2b/f3e [0,4194304] 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:8/975: dwrite d1/d4/d4c/d101/f12b [0,4194304] 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:4/970: mknod d8/d1a/c142 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:6/826: stat d0/d1a/d26/d27/f8a 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:5/964: dwrite d4/d8/d9/d12e/f14b [0,4194304] 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:8/976: write d1/d4/d15/de4/dfc/d2c/ddd/f42 [176524,3425] 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:4/971: dread d8/d1a/d1b/d24/dac/d72/d77/d131/f8a [0,4194304] 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:4/972: chown d8/d1a/d1b/d24/dac/d72/da3/cd0 5 1 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:8/977: truncate d1/d4/d15/de4/dfc/d2a/f39 1019274 0 2024-04-26T11:24:04.779 INFO:tasks.workunit.client.0.smithi073.stdout:8/978: creat d1/d4/d15/dbc/d125/f148 x:0 0 0 2024-04-26T11:24:04.780 INFO:tasks.workunit.client.0.smithi073.stdout:8/979: dread - d1/fcf zero size 2024-04-26T11:24:04.780 INFO:tasks.workunit.client.0.smithi073.stdout:8/980: write d1/d4/d4c/fbe [3309504,128142] 0 2024-04-26T11:24:04.780 INFO:tasks.workunit.client.0.smithi073.stdout:8/981: getdents d1/d4/d4c/d66 0 2024-04-26T11:24:04.780 INFO:tasks.workunit.client.0.smithi073.stdout:5/965: dwrite d4/d8/dff/f139 [0,4194304] 0 2024-04-26T11:24:04.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:24:04.782 INFO:tasks.workunit.client.0.smithi073.stdout:5/966: rmdir d4/de/dc6 39 2024-04-26T11:24:04.782 INFO:tasks.workunit.client.0.smithi073.stdout:8/982: chown d1/d4/d15/de4/dfc/d2c/ddd/d67/l99 806870 1 2024-04-26T11:24:04.782 INFO:tasks.workunit.client.0.smithi073.stdout:4/973: dwrite d8/d1a/d1b/d24/dac/ffe [0,4194304] 0 2024-04-26T11:24:04.782 INFO:tasks.workunit.client.0.smithi073.stdout:5/967: dread - d4/d8/d9/d7d/f106 zero size 2024-04-26T11:24:04.782 INFO:tasks.workunit.client.0.smithi073.stdout:8/983: rmdir d1/d4/d37/dfa 39 2024-04-26T11:24:04.782 INFO:tasks.workunit.client.0.smithi073.stdout:5/968: mkdir d4/de/d15/d121/d15a 0 2024-04-26T11:24:04.782 INFO:tasks.workunit.client.0.smithi073.stdout:6/827: dwrite d0/d19/f60 [0,4194304] 0 2024-04-26T11:24:04.782 INFO:tasks.workunit.client.0.smithi073.stdout:5/969: creat d4/d8/d9/d42/f15b x:0 0 0 2024-04-26T11:24:04.783 INFO:tasks.workunit.client.0.smithi073.stdout:8/984: rename d1/d4/d7b/d8d/f11e to d1/d4/d15/db7/f149 0 2024-04-26T11:24:04.783 INFO:tasks.workunit.client.0.smithi073.stdout:7/982: sync 2024-04-26T11:24:04.783 INFO:tasks.workunit.client.0.smithi073.stdout:7/983: symlink d1/d11/d24/d29/dd7/d3d/d41/d64/l155 0 2024-04-26T11:24:04.783 INFO:tasks.workunit.client.0.smithi073.stdout:7/984: stat d1/d11/d24/d29/dd7/d3d/l61 0 2024-04-26T11:24:04.783 INFO:tasks.workunit.client.0.smithi073.stdout:6/828: dwrite d0/d1a/d26/d27/dbc/fac [0,4194304] 0 2024-04-26T11:24:04.783 INFO:tasks.workunit.client.0.smithi073.stdout:5/970: dwrite d4/de/d15/d33/f48 [0,4194304] 0 2024-04-26T11:24:04.784 INFO:tasks.workunit.client.0.smithi073.stdout:8/985: dwrite d1/d4/d15/de4/dfc/d2c/ddd/fe7 [0,4194304] 0 2024-04-26T11:24:04.784 INFO:tasks.workunit.client.0.smithi073.stdout:7/985: mkdir d1/d11/d5e/d8f/ddf/d156 0 2024-04-26T11:24:04.784 INFO:tasks.workunit.client.0.smithi073.stdout:8/986: stat d1/d4/d15/de4/dfc/d2c/ddd/f2e 0 2024-04-26T11:24:04.785 INFO:tasks.workunit.client.0.smithi073.stdout:5/971: mknod d4/d8/d9/d7d/da3/ddc/c15c 0 2024-04-26T11:24:04.785 INFO:tasks.workunit.client.0.smithi073.stdout:6/829: truncate d0/d1a/d7a/f85 3519446 0 2024-04-26T11:24:04.785 INFO:tasks.workunit.client.0.smithi073.stdout:7/986: read d1/d33/d68/d78/daf/d114/f11d [3791955,42572] 0 2024-04-26T11:24:04.786 INFO:tasks.workunit.client.0.smithi073.stdout:8/987: getdents d1/d4/d115/d12d 0 2024-04-26T11:24:04.786 INFO:tasks.workunit.client.0.smithi073.stdout:8/988: readlink d1/d4/l5f 0 2024-04-26T11:24:04.787 INFO:tasks.workunit.client.0.smithi073.stdout:8/989: stat d1/d4/d15/dbc/d125/d146 0 2024-04-26T11:24:04.787 INFO:tasks.workunit.client.0.smithi073.stdout:8/990: write d1/d4/f5a [1718484,42948] 0 2024-04-26T11:24:04.789 INFO:tasks.workunit.client.0.smithi073.stdout:8/991: symlink d1/d4/l14a 0 2024-04-26T11:24:04.791 INFO:tasks.workunit.client.0.smithi073.stdout:8/992: rmdir d1/d4/d37/dd3 39 2024-04-26T11:24:04.793 INFO:tasks.workunit.client.0.smithi073.stdout:5/972: dwrite d4/f7a [0,4194304] 0 2024-04-26T11:24:04.793 INFO:tasks.workunit.client.0.smithi073.stdout:6/830: dwrite d0/d1a/d7a/fb3 [0,4194304] 0 2024-04-26T11:24:04.794 INFO:tasks.workunit.client.0.smithi073.stdout:5/973: symlink d4/d8/d9/d7d/da3/l15d 0 2024-04-26T11:24:04.794 INFO:tasks.workunit.client.0.smithi073.stdout:8/993: creat d1/d4/d37/dd3/d105/f14b x:0 0 0 2024-04-26T11:24:04.794 INFO:tasks.workunit.client.0.smithi073.stdout:6/831: rmdir d0/d15 39 2024-04-26T11:24:04.795 INFO:tasks.workunit.client.0.smithi073.stdout:8/994: write d1/d4/d4c/d101/f12b [2026833,99889] 0 2024-04-26T11:24:04.795 INFO:tasks.workunit.client.0.smithi073.stdout:5/974: chown d4/d8/d9/d7d/da3/ddc/dee/f116 3797 1 2024-04-26T11:24:04.796 INFO:tasks.workunit.client.0.smithi073.stdout:6/832: truncate d0/d1a/d26/d4b/d49/fa3 472613 0 2024-04-26T11:24:04.797 INFO:tasks.workunit.client.0.smithi073.stdout:8/995: mkdir d1/d4/d15/de4/dfc/d2a/d14c 0 2024-04-26T11:24:04.797 INFO:tasks.workunit.client.0.smithi073.stdout:5/975: read - d4/d8/d9/d7d/f106 zero size 2024-04-26T11:24:04.799 INFO:tasks.workunit.client.0.smithi073.stdout:5/976: creat d4/de/d15/d67/d103/d105/d131/f15e x:0 0 0 2024-04-26T11:24:04.801 INFO:tasks.workunit.client.0.smithi073.stdout:5/977: chown d4/d8/d9/d7d/d84/da7/db7/dcd/l120 426 1 2024-04-26T11:24:04.803 INFO:tasks.workunit.client.0.smithi073.stdout:5/978: unlink d4/de/d23/d4f/ce7 0 2024-04-26T11:24:04.803 INFO:tasks.workunit.client.0.smithi073.stdout:6/833: dwrite d0/d1a/d26/d4b/d49/fa3 [0,4194304] 0 2024-04-26T11:24:04.803 INFO:tasks.workunit.client.0.smithi073.stdout:6/834: chown d0/d1a/d26/d4b/d38/fc1 6 1 2024-04-26T11:24:04.804 INFO:tasks.workunit.client.0.smithi073.stdout:5/979: symlink d4/d73/d8a/dc8/d128/l15f 0 2024-04-26T11:24:04.804 INFO:tasks.workunit.client.0.smithi073.stdout:5/980: creat d4/d8/dff/f160 x:0 0 0 2024-04-26T11:24:04.805 INFO:tasks.workunit.client.0.smithi073.stdout:6/835: rename d0/d1a/d7a/cc8 to d0/d1a/d4e/d67/cfa 0 2024-04-26T11:24:04.805 INFO:tasks.workunit.client.0.smithi073.stdout:8/996: truncate d1/d4/d4c/f119 4129220 0 2024-04-26T11:24:04.805 INFO:tasks.workunit.client.0.smithi073.stdout:7/987: dread d1/d33/d1b/fd3 [0,4194304] 0 2024-04-26T11:24:04.805 INFO:tasks.workunit.client.0.smithi073.stdout:5/981: fdatasync d4/de/d15/d33/fda 0 2024-04-26T11:24:04.806 INFO:tasks.workunit.client.0.smithi073.stdout:7/988: chown d1/d11/d24/d71/f109 13414 1 2024-04-26T11:24:04.807 INFO:tasks.workunit.client.0.smithi073.stdout:7/989: dread - d1/d11/d24/d29/dd7/d3d/d41/d64/dae/f127 zero size 2024-04-26T11:24:04.811 INFO:tasks.workunit.client.0.smithi073.stdout:6/836: truncate d0/d15/d2d/d3f/d59/deb/fa9 4086631 0 2024-04-26T11:24:04.812 INFO:tasks.workunit.client.0.smithi073.stdout:6/837: truncate d0/d1a/d26/d4b/d49/d84/fa5 101858 0 2024-04-26T11:24:04.813 INFO:tasks.workunit.client.0.smithi073.stdout:6/838: rmdir d0/dc/d2e/d6e 39 2024-04-26T11:24:04.814 INFO:tasks.workunit.client.0.smithi073.stdout:6/839: creat d0/d19/df7/ffb x:0 0 0 2024-04-26T11:24:04.814 INFO:tasks.workunit.client.0.smithi073.stdout:8/997: dwrite d1/d4/f89 [0,4194304] 0 2024-04-26T11:24:04.814 INFO:tasks.workunit.client.0.smithi073.stdout:6/840: fsync d0/d15/d2d/fe3 0 2024-04-26T11:24:04.817 INFO:tasks.workunit.client.0.smithi073.stdout:6/841: symlink d0/dc/d55/d79/dd5/lfc 0 2024-04-26T11:24:04.818 INFO:tasks.workunit.client.0.smithi073.stdout:6/842: stat d0/d1a/d26/d27/dbc 0 2024-04-26T11:24:04.819 INFO:tasks.workunit.client.0.smithi073.stdout:8/998: getdents d1/d4/d15/de4/dfc/d2a 0 2024-04-26T11:24:04.820 INFO:tasks.workunit.client.0.smithi073.stdout:6/843: write d0/d15/d2d/f33 [899064,125168] 0 2024-04-26T11:24:04.821 INFO:tasks.workunit.client.0.smithi073.stdout:6/844: write d0/dc/d2e/d6e/f70 [1417879,64099] 0 2024-04-26T11:24:04.822 INFO:tasks.workunit.client.0.smithi073.stdout:6/845: mknod d0/d1a/d4e/cfd 0 2024-04-26T11:24:04.823 INFO:tasks.workunit.client.0.smithi073.stdout:6/846: symlink d0/d1a/d4e/d67/lfe 0 2024-04-26T11:24:04.824 INFO:tasks.workunit.client.0.smithi073.stdout:8/999: truncate d1/d4/d15/de4/dfc/d2c/ddd/d67/fa6 1875331 0 2024-04-26T11:24:04.824 INFO:tasks.workunit.client.0.smithi073.stdout:3/915: sync 2024-04-26T11:24:04.824 INFO:tasks.workunit.client.0.smithi073.stdout:9/975: sync 2024-04-26T11:24:04.824 INFO:tasks.workunit.client.0.smithi073.stdout:0/929: sync 2024-04-26T11:24:04.824 INFO:tasks.workunit.client.0.smithi073.stdout:6/847: mknod d0/d1a/d26/d4b/d63/da0/d7c/cff 0 2024-04-26T11:24:04.825 INFO:tasks.workunit.client.0.smithi073.stdout:2/956: sync 2024-04-26T11:24:04.825 INFO:tasks.workunit.client.0.smithi073.stdout:0/930: fsync d2/d37/f6e 0 2024-04-26T11:24:04.825 INFO:tasks.workunit.client.0.smithi073.stdout:6/848: chown d0/d1a/d26/d27/l75 7098 1 2024-04-26T11:24:04.826 INFO:tasks.workunit.client.0.smithi073.stdout:9/976: creat d0/d13/d5a/f148 x:0 0 0 2024-04-26T11:24:04.826 INFO:tasks.workunit.client.0.smithi073.stdout:0/931: fdatasync d2/d1f/f2c 0 2024-04-26T11:24:04.826 INFO:tasks.workunit.client.0.smithi073.stdout:2/957: fdatasync dd/d4c/d48/d46/d91/d9f/f5e 0 2024-04-26T11:24:04.826 INFO:tasks.workunit.client.0.smithi073.stdout:2/958: readlink dd/l2e 0 2024-04-26T11:24:04.827 INFO:tasks.workunit.client.0.smithi073.stdout:0/932: stat d2/d37/d8b/faf 0 2024-04-26T11:24:04.828 INFO:tasks.workunit.client.0.smithi073.stdout:9/977: mkdir d0/d1a/d2f/d149 0 2024-04-26T11:24:04.828 INFO:tasks.workunit.client.0.smithi073.stdout:2/959: symlink dd/de/d38/d53/dc3/dd3/l12b 0 2024-04-26T11:24:04.829 INFO:tasks.workunit.client.0.smithi073.stdout:0/933: rename d2/d37/d8b/d137 to d2/d1f/d40/d48/dc1/d143 0 2024-04-26T11:24:04.830 INFO:tasks.workunit.client.0.smithi073.stdout:4/974: dread d8/d1a/d1b/d24/f43 [4194304,4194304] 0 2024-04-26T11:24:04.836 INFO:tasks.workunit.client.0.smithi073.stdout:6/849: dread d0/d1a/d26/d4b/d63/fe4 [0,4194304] 0 2024-04-26T11:24:04.836 INFO:tasks.workunit.client.0.smithi073.stdout:9/978: rename d0/d13/d5a/db2/cb8 to d0/d1a/d4e/d70/dae/c14a 0 2024-04-26T11:24:04.836 INFO:tasks.workunit.client.0.smithi073.stdout:0/934: creat d2/d22/d51/f144 x:0 0 0 2024-04-26T11:24:04.836 INFO:tasks.workunit.client.0.smithi073.stdout:4/975: unlink d8/d1a/d5e/dc5/fc6 0 2024-04-26T11:24:04.836 INFO:tasks.workunit.client.0.smithi073.stdout:6/850: write d0/d1a/d26/d4b/f5b [4751653,72254] 0 2024-04-26T11:24:04.836 INFO:tasks.workunit.client.0.smithi073.stdout:4/976: stat d8/f10 0 2024-04-26T11:24:04.836 INFO:tasks.workunit.client.0.smithi073.stdout:0/935: write d2/d110/f11a [1635451,16060] 0 2024-04-26T11:24:04.837 INFO:tasks.workunit.client.0.smithi073.stdout:9/979: creat d0/d13/d25/d75/d124/f14b x:0 0 0 2024-04-26T11:24:04.837 INFO:tasks.workunit.client.0.smithi073.stdout:5/982: dread d4/d8/d9/d42/f99 [0,4194304] 0 2024-04-26T11:24:04.837 INFO:tasks.workunit.client.0.smithi073.stdout:0/936: write d2/d5f/f6c [3016553,120125] 0 2024-04-26T11:24:04.837 INFO:tasks.workunit.client.0.smithi073.stdout:4/977: rmdir d8/d1a/d1b/dd2/d114 39 2024-04-26T11:24:04.837 INFO:tasks.workunit.client.0.smithi073.stdout:9/980: creat d0/d13/d5a/db2/f14c x:0 0 0 2024-04-26T11:24:04.838 INFO:tasks.workunit.client.0.smithi073.stdout:6/851: getdents d0/d1a/d26/d4b/d38/df3 0 2024-04-26T11:24:04.838 INFO:tasks.workunit.client.0.smithi073.stdout:2/960: dwrite dd/de/f11 [4194304,4194304] 0 2024-04-26T11:24:04.838 INFO:tasks.workunit.client.0.smithi073.stdout:9/981: dread - d0/d13/d5a/d116/d129/f13a zero size 2024-04-26T11:24:04.838 INFO:tasks.workunit.client.0.smithi073.stdout:7/990: dread d1/d33/d68/d78/daf/f23 [4194304,4194304] 0 2024-04-26T11:24:04.839 INFO:tasks.workunit.client.0.smithi073.stdout:5/983: mknod d4/c161 0 2024-04-26T11:24:04.840 INFO:tasks.workunit.client.0.smithi073.stdout:7/991: mkdir d1/d11/d24/d29/dd7/d80/df9/d11f/d124/d157 0 2024-04-26T11:24:04.840 INFO:tasks.workunit.client.0.smithi073.stdout:9/982: symlink d0/d13/d5a/l14d 0 2024-04-26T11:24:04.842 INFO:tasks.workunit.client.0.smithi073.stdout:0/937: rename d2/d1f/cc5 to d2/d1f/d40/d48/d122/c145 0 2024-04-26T11:24:04.843 INFO:tasks.workunit.client.0.smithi073.stdout:9/983: creat d0/d1a/d4e/d70/d59/d10a/f14e x:0 0 0 2024-04-26T11:24:04.843 INFO:tasks.workunit.client.0.smithi073.stdout:5/984: dread - d4/de/dc6/f110 zero size 2024-04-26T11:24:04.843 INFO:tasks.workunit.client.0.smithi073.stdout:0/938: chown d2/d1f/d40/d48/da9/cc0 10760 1 2024-04-26T11:24:04.844 INFO:tasks.workunit.client.0.smithi073.stdout:4/978: dwrite d8/d15/da1/ff1 [0,4194304] 0 2024-04-26T11:24:04.845 INFO:tasks.workunit.client.0.smithi073.stdout:2/961: dread dd/d4c/d48/d46/f88 [0,4194304] 0 2024-04-26T11:24:04.845 INFO:tasks.workunit.client.0.smithi073.stdout:4/979: chown d8/d1a/d1b/d24/dac/c59 9 1 2024-04-26T11:24:04.846 INFO:tasks.workunit.client.0.smithi073.stdout:5/985: rename d4/de/d15/d67/l11c to d4/d73/d8a/l162 0 2024-04-26T11:24:04.847 INFO:tasks.workunit.client.0.smithi073.stdout:2/962: mknod dd/de/d2a/dbc/c12c 0 2024-04-26T11:24:04.847 INFO:tasks.workunit.client.0.smithi073.stdout:0/939: getdents d2 0 2024-04-26T11:24:04.847 INFO:tasks.workunit.client.0.smithi073.stdout:4/980: getdents d8/d1a/d5e 0 2024-04-26T11:24:04.848 INFO:tasks.workunit.client.0.smithi073.stdout:2/963: write dd/d27/da0/f12a [837503,92312] 0 2024-04-26T11:24:04.850 INFO:tasks.workunit.client.0.smithi073.stdout:5/986: creat d4/df8/f163 x:0 0 0 2024-04-26T11:24:04.850 INFO:tasks.workunit.client.0.smithi073.stdout:0/940: symlink d2/d37/l146 0 2024-04-26T11:24:04.850 INFO:tasks.workunit.client.0.smithi073.stdout:2/964: write dd/de/d49/f79 [2774984,10221] 0 2024-04-26T11:24:04.850 INFO:tasks.workunit.client.0.smithi073.stdout:5/987: dread - d4/de/d15/d67/f154 zero size 2024-04-26T11:24:04.850 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:04.846+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:04.851 INFO:tasks.workunit.client.0.smithi073.stdout:4/981: creat d8/d1a/d1b/d24/dac/d49/d84/d130/f143 x:0 0 0 2024-04-26T11:24:04.852 INFO:tasks.workunit.client.0.smithi073.stdout:5/988: mkdir d4/d8/d9/d7d/d84/da7/db7/d127/da5/d164 0 2024-04-26T11:24:04.853 INFO:tasks.workunit.client.0.smithi073.stdout:4/982: link d8/d1a/d1b/d24/dac/d72/l139 d8/d1a/d1b/d24/dac/d49/d84/d130/l144 0 2024-04-26T11:24:04.855 INFO:tasks.workunit.client.0.smithi073.stdout:5/989: getdents d4/d8/d8e 0 2024-04-26T11:24:04.855 INFO:tasks.workunit.client.0.smithi073.stdout:0/941: dread d2/d37/f6e [0,4194304] 0 2024-04-26T11:24:04.857 INFO:tasks.workunit.client.0.smithi073.stdout:0/942: truncate d2/d22/d51/d57/f85 4133065 0 2024-04-26T11:24:04.857 INFO:tasks.workunit.client.0.smithi073.stdout:0/943: read d2/d1f/fda [2086158,112064] 0 2024-04-26T11:24:04.858 INFO:tasks.workunit.client.0.smithi073.stdout:0/944: dread - d2/d22/d51/d57/d78/f87 zero size 2024-04-26T11:24:04.859 INFO:tasks.workunit.client.0.smithi073.stdout:4/983: dwrite d8/d1a/d5e/d7c/ff9 [0,4194304] 0 2024-04-26T11:24:04.860 INFO:tasks.workunit.client.0.smithi073.stdout:5/990: truncate d4/d73/d8a/da0/fcf 3585074 0 2024-04-26T11:24:04.861 INFO:tasks.workunit.client.0.smithi073.stdout:4/984: write d8/d15/f76 [216021,56148] 0 2024-04-26T11:24:04.861 INFO:tasks.workunit.client.0.smithi073.stdout:5/991: mkdir d4/d8/d9/d7d/d84/da7/d165 0 2024-04-26T11:24:04.861 INFO:tasks.workunit.client.0.smithi073.stdout:4/985: chown d8/d1a/d1b/d24/lff 216 1 2024-04-26T11:24:04.863 INFO:tasks.workunit.client.0.smithi073.stdout:6/852: dread d0/d1a/d7a/f85 [0,4194304] 0 2024-04-26T11:24:04.863 INFO:tasks.workunit.client.0.smithi073.stdout:0/945: link d2/d1f/d40/d48/f55 d2/d1f/d40/d48/f147 0 2024-04-26T11:24:04.864 INFO:tasks.workunit.client.0.smithi073.stdout:7/992: dread d1/d11/d51/dbd/f102 [0,4194304] 0 2024-04-26T11:24:04.864 INFO:tasks.workunit.client.0.smithi073.stdout:6/853: mkdir d0/d1a/d26/d4b/d2b/d43/d100 0 2024-04-26T11:24:04.864 INFO:tasks.workunit.client.0.smithi073.stdout:4/986: creat d8/d15/da1/f145 x:0 0 0 2024-04-26T11:24:04.865 INFO:tasks.workunit.client.0.smithi073.stdout:0/946: truncate d2/d37/f6e 668553 0 2024-04-26T11:24:04.865 INFO:tasks.workunit.client.0.smithi073.stdout:7/993: stat d1/d11/d24/d29/dd7/d3d/d41/d64/dae 0 2024-04-26T11:24:04.865 INFO:tasks.workunit.client.0.smithi073.stdout:2/965: dread dd/d27/da0/f12a [0,4194304] 0 2024-04-26T11:24:04.866 INFO:tasks.workunit.client.0.smithi073.stdout:4/987: mknod d8/d1a/d5e/dc5/dfb/dfd/c146 0 2024-04-26T11:24:04.867 INFO:tasks.workunit.client.0.smithi073.stdout:5/992: truncate d4/d8/dff/f111 746130 0 2024-04-26T11:24:04.867 INFO:tasks.workunit.client.0.smithi073.stdout:2/966: write f0 [6251362,63431] 0 2024-04-26T11:24:04.867 INFO:tasks.workunit.client.0.smithi073.stdout:4/988: mkdir d8/d14/d147 0 2024-04-26T11:24:04.868 INFO:tasks.workunit.client.0.smithi073.stdout:7/994: rename d1/d11/d24/d29/dd7/d3d/cd0 to d1/d33/d68/d78/daf/c158 0 2024-04-26T11:24:04.870 INFO:tasks.workunit.client.0.smithi073.stdout:9/984: dread d0/d1a/d4e/d8f/fbe [0,4194304] 0 2024-04-26T11:24:04.871 INFO:tasks.workunit.client.0.smithi073.stdout:6/854: dread d0/d1a/d26/d4b/d2b/fe9 [0,4194304] 0 2024-04-26T11:24:04.873 INFO:tasks.workunit.client.0.smithi073.stdout:6/855: creat d0/d1a/d26/d4b/d2b/d43/d100/f101 x:0 0 0 2024-04-26T11:24:04.874 INFO:tasks.workunit.client.0.smithi073.stdout:4/989: link d8/d14/ccf d8/d1a/d1b/d24/dac/d49/c148 0 2024-04-26T11:24:04.875 INFO:tasks.workunit.client.0.smithi073.stdout:6/856: creat d0/d1a/d26/d27/dbc/f102 x:0 0 0 2024-04-26T11:24:04.876 INFO:tasks.workunit.client.0.smithi073.stdout:5/993: dwrite d4/de/d23/d4f/f126 [0,4194304] 0 2024-04-26T11:24:04.877 INFO:tasks.workunit.client.0.smithi073.stdout:5/994: readlink d4/de/dc6/l79 0 2024-04-26T11:24:04.877 INFO:tasks.workunit.client.0.smithi073.stdout:9/985: dwrite d0/d13/d5a/d65/fe0 [0,4194304] 0 2024-04-26T11:24:04.879 INFO:tasks.workunit.client.0.smithi073.stdout:4/990: symlink d8/d1a/d1b/d24/dac/d49/d85/d8b/d6d/dc2/l149 0 2024-04-26T11:24:04.880 INFO:tasks.workunit.client.0.smithi073.stdout:5/995: mkdir d4/de/d14f/d166 0 2024-04-26T11:24:04.880 INFO:tasks.workunit.client.0.smithi073.stdout:9/986: getdents d0/d13/d25/d75/d124/d12d 0 2024-04-26T11:24:04.881 INFO:tasks.workunit.client.0.smithi073.stdout:4/991: unlink d8/d1a/d5e/dc5/dfb/dfd/c112 0 2024-04-26T11:24:04.881 INFO:tasks.workunit.client.0.smithi073.stdout:5/996: mknod d4/d8/d159/c167 0 2024-04-26T11:24:04.883 INFO:tasks.workunit.client.0.smithi073.stdout:6/857: truncate d0/dc/d80/f83 512743 0 2024-04-26T11:24:04.884 INFO:tasks.workunit.client.0.smithi073.stdout:6/858: write d0/d19/f21 [25936,106517] 0 2024-04-26T11:24:04.884 INFO:tasks.workunit.client.0.smithi073.stdout:2/967: dread dd/d27/dcd/d116/f5f [0,4194304] 0 2024-04-26T11:24:04.885 INFO:tasks.workunit.client.0.smithi073.stdout:6/859: stat d0/d19/d20/cca 0 2024-04-26T11:24:04.885 INFO:tasks.workunit.client.0.smithi073.stdout:0/947: dread d2/d1f/d40/d48/fc4 [0,4194304] 0 2024-04-26T11:24:04.886 INFO:tasks.workunit.client.0.smithi073.stdout:9/987: truncate d0/d1a/d4e/ffa 3851141 0 2024-04-26T11:24:04.886 INFO:tasks.workunit.client.0.smithi073.stdout:2/968: rename dd/d4c/d48/d46/d91/d9f/d1d/d8c/ff4 to dd/de/d38/d53/dc3/f12d 0 2024-04-26T11:24:04.886 INFO:tasks.workunit.client.0.smithi073.stdout:6/860: unlink d0/d19/df7/da2/fae 0 2024-04-26T11:24:04.886 INFO:tasks.workunit.client.0.smithi073.stdout:0/948: write d2/d1f/d40/d48/d62/f71 [118770,12859] 0 2024-04-26T11:24:04.887 INFO:tasks.workunit.client.0.smithi073.stdout:2/969: chown dd/d4c/d48 0 1 2024-04-26T11:24:04.887 INFO:tasks.workunit.client.0.smithi073.stdout:6/861: stat d0/dc/fb5 0 2024-04-26T11:24:04.887 INFO:tasks.workunit.client.0.smithi073.stdout:9/988: write d0/d1a/d4e/d70/faa [402467,109754] 0 2024-04-26T11:24:04.890 INFO:tasks.workunit.client.0.smithi073.stdout:4/992: dwrite d8/d1a/d1b/d24/dac/d72/fca [0,4194304] 0 2024-04-26T11:24:04.893 INFO:tasks.workunit.client.0.smithi073.stdout:6/862: write d0/d1a/d26/d4b/d49/ff4 [1712366,24224] 0 2024-04-26T11:24:04.893 INFO:tasks.workunit.client.0.smithi073.stdout:6/863: readlink d0/lc0 0 2024-04-26T11:24:04.894 INFO:tasks.workunit.client.0.smithi073.stdout:2/970: dwrite dd/d4c/d48/d46/d91/d9f/d1d/f44 [4194304,4194304] 0 2024-04-26T11:24:04.894 INFO:tasks.workunit.client.0.smithi073.stdout:6/864: dread - d0/d1a/d4e/fa4 zero size 2024-04-26T11:24:04.896 INFO:tasks.workunit.client.0.smithi073.stdout:9/989: dwrite d0/f3f [0,4194304] 0 2024-04-26T11:24:04.897 INFO:tasks.workunit.client.0.smithi073.stdout:2/971: rename dd/d27/da0/da7/ddd/l11a to dd/d4c/d48/d77/d80/d112/l12e 0 2024-04-26T11:24:04.898 INFO:tasks.workunit.client.0.smithi073.stdout:6/865: dread d0/d1a/d26/d4b/d63/fe4 [0,4194304] 0 2024-04-26T11:24:04.899 INFO:tasks.workunit.client.0.smithi073.stdout:6/866: read - d0/d1a/d26/d4b/d63/da0/d7c/ff0 zero size 2024-04-26T11:24:04.899 INFO:tasks.workunit.client.0.smithi073.stdout:2/972: rename dd/d4c/d48/d46/d91/d9f/d1d/f15 to dd/de/d38/d53/d60/db2/f12f 0 2024-04-26T11:24:04.900 INFO:tasks.workunit.client.0.smithi073.stdout:3/916: sync 2024-04-26T11:24:04.900 INFO:tasks.workunit.client.0.smithi073.stdout:7/995: sync 2024-04-26T11:24:04.900 INFO:tasks.workunit.client.0.smithi073.stdout:6/867: write d0/d15/d2d/d3f/d59/deb/fb0 [102943,48364] 0 2024-04-26T11:24:04.901 INFO:tasks.workunit.client.0.smithi073.stdout:6/868: dread - d0/d15/f9e zero size 2024-04-26T11:24:04.901 INFO:tasks.workunit.client.0.smithi073.stdout:2/973: mkdir dd/de/d49/dbb/dfc/d130 0 2024-04-26T11:24:04.901 INFO:tasks.workunit.client.0.smithi073.stdout:2/974: chown dd/d27/da0 2069058 1 2024-04-26T11:24:04.902 INFO:tasks.workunit.client.0.smithi073.stdout:6/869: mknod d0/dc/d80/c103 0 2024-04-26T11:24:04.902 INFO:tasks.workunit.client.0.smithi073.stdout:7/996: rename d1/d33/d68/d78/daf/dc5/c150 to d1/d33/d1b/c159 0 2024-04-26T11:24:04.903 INFO:tasks.workunit.client.0.smithi073.stdout:6/870: creat d0/dc/d55/d79/f104 x:0 0 0 2024-04-26T11:24:04.903 INFO:tasks.workunit.client.0.smithi073.stdout:2/975: mknod dd/d27/da0/c131 0 2024-04-26T11:24:04.903 INFO:tasks.workunit.client.0.smithi073.stdout:7/997: write d1/d33/d1b/d95/fd1 [615382,50480] 0 2024-04-26T11:24:04.904 INFO:tasks.workunit.client.0.smithi073.stdout:2/976: getdents dd/d4c/d48/d46 0 2024-04-26T11:24:04.904 INFO:tasks.workunit.client.0.smithi073.stdout:7/998: write d1/ddc/f10c [908768,54764] 0 2024-04-26T11:24:04.905 INFO:tasks.workunit.client.0.smithi073.stdout:2/977: rename dd/d27/dcd/d116/f61 to dd/de/d49/f132 0 2024-04-26T11:24:04.906 INFO:tasks.workunit.client.0.smithi073.stdout:3/917: dread d0/d11/f91 [0,4194304] 0 2024-04-26T11:24:04.909 INFO:tasks.workunit.client.0.smithi073.stdout:3/918: rename d0/d11/d23/d86/d10c to d0/d11/d19/db/d3e/d3f/d69/d96/d136 0 2024-04-26T11:24:04.910 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:15441 4.19 4:9a926cb7:::10000003665.00000000:head [write 102943~48364 in=48364b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:04.906025+0000", 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0044716369999999997, 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045001060000000002, 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 15441 2024-04-26T11:24:04.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906025+0000", 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906025+0000", 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906025+0000", 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906060+0000", 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5803000000000003e-05 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906069+0000", 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.242e-06 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906074+0000", 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6439999999999997e-06 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906109+0000", 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5076000000000001e-05 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906245+0000", 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013589200000000001 2024-04-26T11:24:04.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906359+0000", 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011353699999999999 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:15443 4.0 4:00ac869c:::100000036a1.00000000:head [write 615382~50480 in=50480b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:04.906123+0000", 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.0043743499999999999, 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044978249999999996, 2024-04-26T11:24:04.915 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 15443 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906123+0000", 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906123+0000", 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906122+0000", 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906158+0000", 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5601e-05 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906165+0000", 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7710000000000006e-06 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906172+0000", 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1330000000000001e-06 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906212+0000", 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9385999999999999e-05 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906317+0000", 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0001053 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.910538+0000", 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042210579999999998 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.910583+0000", 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5243e-05 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.919 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:15451 4.f 4.b902a28f (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:04.909864+0000", 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.00063245200000000004, 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083935200000000002, 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "queued for pg", 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 15451 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.909864+0000", 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.909864+0000", 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.909864+0000", 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.921 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.909868+0000", 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7950000000000001e-06 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.909877+0000", 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9719999999999998e-06 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.909881+0000", 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6249999999999998e-06 2024-04-26T11:24:04.922 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4728.0:15435 4.21 4:86cc9d86:::10000003359.00000001:head [write 0~4194304 in=4194304b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:04.899585+0000", 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.010912224, 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011156628, 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "waiting for sub ops", 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4728", 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 15435 2024-04-26T11:24:04.923 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.899585+0000", 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.899585+0000", 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.899584+0000", 2024-04-26T11:24:04.924 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.905909+0000", 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006325448 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.905921+0000", 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1745e-05 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.905926+0000", 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2120000000000002e-06 2024-04-26T11:24:04.925 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.905970+0000", 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3234e-05 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906083+0000", 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113103 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:04.906213+0000", 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013049599999999999 2024-04-26T11:24:04.926 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-26T11:24:04.927 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 4 2024-04-26T11:24:04.927 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:04.929 INFO:tasks.workunit.client.0.smithi073.stdout:3/919: unlink d0/d11/d19/db/ddc/c3d 0 2024-04-26T11:24:04.929 INFO:tasks.workunit.client.0.smithi073.stdout:7/999: dwrite d1/ffd [0,4194304] 0 2024-04-26T11:24:04.929 INFO:tasks.workunit.client.0.smithi073.stdout:9/990: dread d0/d1a/d4e/d70/f38 [0,4194304] 0 2024-04-26T11:24:04.929 INFO:tasks.workunit.client.0.smithi073.stdout:6/871: dwrite d0/d1a/d26/d4b/d2b/d43/f88 [0,4194304] 0 2024-04-26T11:24:04.929 INFO:tasks.workunit.client.0.smithi073.stdout:2/978: dwrite dd/d27/f115 [0,4194304] 0 2024-04-26T11:24:04.929 INFO:tasks.workunit.client.0.smithi073.stdout:3/920: sync 2024-04-26T11:24:04.929 INFO:tasks.workunit.client.0.smithi073.stdout:6/872: chown d0/dc/d80/c96 46167 1 2024-04-26T11:24:04.929 INFO:tasks.workunit.client.0.smithi073.stdout:9/991: rename d0/d13/db/lec to d0/d13/d5a/d65/d146/l14f 0 2024-04-26T11:24:04.929 INFO:tasks.workunit.client.0.smithi073.stdout:3/921: mkdir d0/d11/d19/d70/d137 0 2024-04-26T11:24:04.929 INFO:tasks.workunit.client.0.smithi073.stdout:0/949: dread d2/d1f/d9c/ff1 [0,4194304] 0 2024-04-26T11:24:04.930 INFO:tasks.workunit.client.0.smithi073.stdout:6/873: rename d0/d19 to d0/d1a/d26/d105 0 2024-04-26T11:24:04.930 INFO:tasks.workunit.client.0.smithi073.stdout:9/992: mkdir d0/d13/d5a/d116/d150 0 2024-04-26T11:24:04.930 INFO:tasks.workunit.client.0.smithi073.stdout:2/979: link dd/f10a dd/d4c/d48/d46/d91/f133 0 2024-04-26T11:24:04.930 INFO:tasks.workunit.client.0.smithi073.stdout:9/993: fdatasync d0/fa7 0 2024-04-26T11:24:04.930 INFO:tasks.workunit.client.0.smithi073.stdout:0/950: write d2/f3d [693817,25816] 0 2024-04-26T11:24:04.930 INFO:tasks.workunit.client.0.smithi073.stdout:4/993: dread d8/d1a/d9c/d100/f13b [0,4194304] 0 2024-04-26T11:24:04.930 INFO:tasks.workunit.client.0.smithi073.stdout:6/874: symlink d0/d15/dd8/l106 0 2024-04-26T11:24:04.930 INFO:tasks.workunit.client.0.smithi073.stdout:0/951: truncate d2/d1f/d40/d48/d62/de5/f129 368106 0 2024-04-26T11:24:04.930 INFO:tasks.workunit.client.0.smithi073.stdout:9/994: rename d0/d1a/d4e/d70/dd6/l105 to d0/d13/d5a/d116/d129/l151 0 2024-04-26T11:24:04.931 INFO:tasks.workunit.client.0.smithi073.stdout:4/994: unlink d8/d1a/d1b/d24/dac/d72/d77/d131/d37/f70 0 2024-04-26T11:24:04.931 INFO:tasks.workunit.client.0.smithi073.stdout:0/952: write d2/d1f/d9c/fa0 [2111406,67055] 0 2024-04-26T11:24:04.931 INFO:tasks.workunit.client.0.smithi073.stdout:3/922: write d0/d11/d19/db/d3e/d3f/f55 [3183233,111656] 0 2024-04-26T11:24:04.931 INFO:tasks.workunit.client.0.smithi073.stdout:9/995: creat d0/d13/d25/d75/d124/f152 x:0 0 0 2024-04-26T11:24:04.931 INFO:tasks.workunit.client.0.smithi073.stdout:5/997: dread d4/f1d [0,4194304] 0 2024-04-26T11:24:04.931 INFO:tasks.workunit.client.0.smithi073.stdout:4/995: fsync d8/d1a/d1b/d24/dac/ffe 0 2024-04-26T11:24:04.932 INFO:tasks.workunit.client.0.smithi073.stdout:0/953: fdatasync d2/d1f/d40/d48/d62/fff 0 2024-04-26T11:24:04.932 INFO:tasks.workunit.client.0.smithi073.stdout:3/923: write d0/d11/d19/f25 [1255114,79228] 0 2024-04-26T11:24:04.932 INFO:tasks.workunit.client.0.smithi073.stdout:9/996: mknod d0/d1a/d4e/d70/d59/d10a/c153 0 2024-04-26T11:24:04.932 INFO:tasks.workunit.client.0.smithi073.stdout:5/998: creat d4/de/d15/d121/f168 x:0 0 0 2024-04-26T11:24:04.933 INFO:tasks.workunit.client.0.smithi073.stdout:4/996: unlink d8/d1a/d1b/d1d/faa 0 2024-04-26T11:24:04.933 INFO:tasks.workunit.client.0.smithi073.stdout:0/954: mknod d2/d1f/d40/d48/d62/c148 0 2024-04-26T11:24:04.934 INFO:tasks.workunit.client.0.smithi073.stdout:9/997: symlink d0/d13/d5a/d116/d131/l154 0 2024-04-26T11:24:04.934 INFO:tasks.workunit.client.0.smithi073.stdout:3/924: getdents d0 0 2024-04-26T11:24:04.935 INFO:tasks.workunit.client.0.smithi073.stdout:5/999: write d4/d73/d8a/dc8/f112 [373388,90925] 0 2024-04-26T11:24:04.935 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:04.936 INFO:tasks.workunit.client.0.smithi073.stdout:0/955: mknod d2/d1f/c149 0 2024-04-26T11:24:04.936 INFO:tasks.workunit.client.0.smithi073.stdout:2/980: dwrite dd/de/d38/d53/d60/db2/f12f [4194304,4194304] 0 2024-04-26T11:24:04.937 INFO:tasks.workunit.client.0.smithi073.stdout:9/998: write d0/d1a/d4e/d70/d59/de8/fed [4514501,80239] 0 2024-04-26T11:24:04.941 INFO:tasks.workunit.client.0.smithi073.stdout:9/999: mknod d0/d3c/d104/c155 0 2024-04-26T11:24:04.941 INFO:tasks.workunit.client.0.smithi073.stdout:3/925: getdents d0/d11/d19/db/d3e/d3f 0 2024-04-26T11:24:04.942 INFO:tasks.workunit.client.0.smithi073.stdout:4/997: dwrite d8/d1a/d1b/d24/dac/d72/d77/d131/d37/ffa [0,4194304] 0 2024-04-26T11:24:04.944 INFO:tasks.workunit.client.0.smithi073.stdout:0/956: dwrite d2/d1f/d40/d48/dc1/dd6/f106 [0,4194304] 0 2024-04-26T11:24:04.945 INFO:tasks.workunit.client.0.smithi073.stdout:3/926: creat d0/d11/d19/db/d3e/d3f/d69/d96/d136/f138 x:0 0 0 2024-04-26T11:24:04.947 INFO:tasks.workunit.client.0.smithi073.stdout:4/998: symlink d8/d1a/d4d/ddc/d127/l14a 0 2024-04-26T11:24:04.952 INFO:tasks.workunit.client.0.smithi073.stdout:3/927: write d0/d11/d23/fb2 [808418,128687] 0 2024-04-26T11:24:04.953 INFO:tasks.workunit.client.0.smithi073.stdout:3/928: mkdir d0/d11/d19/d1d/d139 0 2024-04-26T11:24:04.954 INFO:tasks.workunit.client.0.smithi073.stdout:3/929: truncate d0/d11/d19/d70/daa/f101 4570167 0 2024-04-26T11:24:04.954 INFO:tasks.workunit.client.0.smithi073.stdout:0/957: dread d2/d110/f114 [0,4194304] 0 2024-04-26T11:24:04.956 INFO:tasks.workunit.client.0.smithi073.stdout:2/981: dread dd/de/d49/f67 [0,4194304] 0 2024-04-26T11:24:04.956 INFO:tasks.workunit.client.0.smithi073.stdout:3/930: getdents d0/d11/d19/d52/d102/d8b/d8c/d90 0 2024-04-26T11:24:04.956 INFO:tasks.workunit.client.0.smithi073.stdout:2/982: symlink dd/d27/l134 0 2024-04-26T11:24:04.956 INFO:tasks.workunit.client.0.smithi073.stdout:3/931: write d0/d34/f66 [7996064,94948] 0 2024-04-26T11:24:04.957 INFO:tasks.workunit.client.0.smithi073.stdout:2/983: write dd/d27/dcd/ff2 [1132338,35554] 0 2024-04-26T11:24:04.958 INFO:tasks.workunit.client.0.smithi073.stdout:2/984: mkdir dd/de/d135 0 2024-04-26T11:24:04.958 INFO:tasks.workunit.client.0.smithi073.stdout:3/932: getdents d0/d2d/df6 0 2024-04-26T11:24:04.959 INFO:tasks.workunit.client.0.smithi073.stdout:2/985: rmdir dd/d4c/d48 39 2024-04-26T11:24:04.959 INFO:tasks.workunit.client.0.smithi073.stdout:3/933: creat d0/d11/d19/d52/d102/d7a/dce/f13a x:0 0 0 2024-04-26T11:24:04.960 INFO:tasks.workunit.client.0.smithi073.stdout:0/958: dwrite d2/d22/d51/d57/d78/fa3 [0,4194304] 0 2024-04-26T11:24:04.962 INFO:tasks.workunit.client.0.smithi073.stdout:6/875: dread d0/d1a/d26/d105/f44 [0,4194304] 0 2024-04-26T11:24:04.963 INFO:tasks.workunit.client.0.smithi073.stdout:3/934: stat d0/d11/d19/db/d51/f12c 0 2024-04-26T11:24:04.964 INFO:tasks.workunit.client.0.smithi073.stdout:6/876: mkdir d0/d1a/d26/d4b/d2b/d43/d100/d107 0 2024-04-26T11:24:04.965 INFO:tasks.workunit.client.0.smithi073.stdout:0/959: dread d2/f31 [0,4194304] 0 2024-04-26T11:24:04.965 INFO:tasks.workunit.client.0.smithi073.stdout:6/877: symlink d0/dc/d2e/d6e/l108 0 2024-04-26T11:24:04.965 INFO:tasks.workunit.client.0.smithi073.stdout:3/935: rename d0/d11/d19/db/d3e/d47/f9a to d0/d11/d19/db/d3e/d3f/d69/d96/d136/f13b 0 2024-04-26T11:24:04.966 INFO:tasks.workunit.client.0.smithi073.stdout:2/986: dwrite fb [0,4194304] 0 2024-04-26T11:24:04.966 INFO:tasks.workunit.client.0.smithi073.stdout:0/960: dread - d2/d1f/d40/d48/dc1/fc6 zero size 2024-04-26T11:24:04.967 INFO:tasks.workunit.client.0.smithi073.stdout:2/987: write dd/de/d49/f105 [147327,109958] 0 2024-04-26T11:24:04.968 INFO:tasks.workunit.client.0.smithi073.stdout:6/878: rename d0/c10 to d0/d1a/d26/d105/df7/da2/c109 0 2024-04-26T11:24:04.969 INFO:tasks.workunit.client.0.smithi073.stdout:2/988: write dd/de/d38/d53/d60/db2/fb5 [285590,101382] 0 2024-04-26T11:24:04.969 INFO:tasks.workunit.client.0.smithi073.stdout:0/961: fsync d2/d1f/d40/d48/fc4 0 2024-04-26T11:24:04.969 INFO:tasks.workunit.client.0.smithi073.stdout:0/962: rmdir d2/d1f/d40/d48/dc1/dd6 39 2024-04-26T11:24:04.969 INFO:tasks.workunit.client.0.smithi073.stdout:6/879: fdatasync d0/d1a/d26/d4b/d49/fc9 0 2024-04-26T11:24:04.970 INFO:tasks.workunit.client.0.smithi073.stdout:2/989: rename dd/d27/fe9 to dd/d4c/d48/d77/d80/f136 0 2024-04-26T11:24:04.970 INFO:tasks.workunit.client.0.smithi073.stdout:0/963: mkdir d2/d84/dd2/d14a 0 2024-04-26T11:24:04.970 INFO:tasks.workunit.client.0.smithi073.stdout:2/990: dread - dd/d4c/d48/d77/d80/f136 zero size 2024-04-26T11:24:04.971 INFO:tasks.workunit.client.0.smithi073.stdout:0/964: mknod d2/d37/df7/c14b 0 2024-04-26T11:24:04.971 INFO:tasks.workunit.client.0.smithi073.stdout:0/965: unlink d2/d1f/c60 0 2024-04-26T11:24:04.972 INFO:tasks.workunit.client.0.smithi073.stdout:2/991: symlink dd/de/d49/dbb/dfc/d130/l137 0 2024-04-26T11:24:04.972 INFO:tasks.workunit.client.0.smithi073.stdout:2/992: dread - dd/de/d38/fa2 zero size 2024-04-26T11:24:04.972 INFO:tasks.workunit.client.0.smithi073.stdout:0/966: chown d2/d22/d51/d57/d78/c13a 21 1 2024-04-26T11:24:04.972 INFO:tasks.workunit.client.0.smithi073.stdout:0/967: stat d2/d84/ldb 0 2024-04-26T11:24:04.973 INFO:tasks.workunit.client.0.smithi073.stdout:2/993: symlink dd/d27/da0/l138 0 2024-04-26T11:24:04.979 INFO:tasks.workunit.client.0.smithi073.stdout:0/968: dwrite d2/d1f/faa [0,4194304] 0 2024-04-26T11:24:04.982 INFO:tasks.workunit.client.0.smithi073.stdout:0/969: link d2/d1f/d40/feb d2/d1f/d40/d48/dc1/dd6/f14c 0 2024-04-26T11:24:04.982 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:04.980+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:04.983 INFO:tasks.workunit.client.0.smithi073.stdout:4/999: dread d8/d1a/d5e/d7c/f7f [0,4194304] 0 2024-04-26T11:24:04.983 INFO:tasks.workunit.client.0.smithi073.stdout:0/970: rename d2/d1f/d40/d48/c7f to d2/d37/d140/c14d 0 2024-04-26T11:24:04.985 INFO:tasks.workunit.client.0.smithi073.stdout:2/994: dwrite dd/de/d38/f9e [0,4194304] 0 2024-04-26T11:24:04.988 INFO:tasks.workunit.client.0.smithi073.stdout:2/995: rename l4 to dd/de/d38/d53/d60/db2/d102/l139 0 2024-04-26T11:24:04.989 INFO:tasks.workunit.client.0.smithi073.stdout:2/996: read - dd/de/d49/dbb/dfc/fcc zero size 2024-04-26T11:24:04.989 INFO:tasks.workunit.client.0.smithi073.stdout:6/880: dread d0/d1a/d26/d4b/d63/da0/fd0 [0,4194304] 0 2024-04-26T11:24:04.990 INFO:tasks.workunit.client.0.smithi073.stdout:2/997: chown dd/de/d38/d4e/f11b 521314 1 2024-04-26T11:24:04.990 INFO:tasks.workunit.client.0.smithi073.stdout:6/881: creat d0/d1a/d26/d27/dda/ddd/f10a x:0 0 0 2024-04-26T11:24:04.991 INFO:tasks.workunit.client.0.smithi073.stdout:2/998: link dd/de/d38/c54 dd/de/d49/dbb/dfc/c13a 0 2024-04-26T11:24:04.992 INFO:tasks.workunit.client.0.smithi073.stdout:2/999: chown dd/de/ca9 1932699 1 2024-04-26T11:24:04.996 INFO:tasks.workunit.client.0.smithi073.stdout:6/882: dwrite d0/d15/d2d/d3f/d59/deb/f3b [4194304,4194304] 0 2024-04-26T11:24:04.996 INFO:tasks.workunit.client.0.smithi073.stdout:6/883: readlink d0/dc/d80/l81 0 2024-04-26T11:24:04.997 INFO:tasks.workunit.client.0.smithi073.stdout:6/884: mkdir d0/d1a/d4e/d10b 0 2024-04-26T11:24:04.998 INFO:tasks.workunit.client.0.smithi073.stdout:6/885: symlink d0/d1a/d26/d105/df7/l10c 0 2024-04-26T11:24:05.001 INFO:tasks.workunit.client.0.smithi073.stdout:0/971: dread d2/d1f/d40/f82 [0,4194304] 0 2024-04-26T11:24:05.002 INFO:tasks.workunit.client.0.smithi073.stdout:3/936: sync 2024-04-26T11:24:05.003 INFO:tasks.workunit.client.0.smithi073.stdout:3/937: read d0/d11/d19/db/d3e/d3f/f55 [1374815,788] 0 2024-04-26T11:24:05.004 INFO:tasks.workunit.client.0.smithi073.stdout:3/938: fdatasync d0/d11/d19/d52/d102/d60/dcd/fea 0 2024-04-26T11:24:05.005 INFO:tasks.workunit.client.0.smithi073.stdout:3/939: chown d0/d11/d19/db/d3e/d47/f4f 40140 1 2024-04-26T11:24:05.006 INFO:tasks.workunit.client.0.smithi073.stdout:6/886: dread d0/d1a/d4e/f51 [0,4194304] 0 2024-04-26T11:24:05.007 INFO:tasks.workunit.client.0.smithi073.stdout:3/940: mkdir d0/d11/d19/d52/d102/d60/d104/d115/d13c 0 2024-04-26T11:24:05.008 INFO:tasks.workunit.client.0.smithi073.stdout:3/941: creat d0/d26/f13d x:0 0 0 2024-04-26T11:24:05.008 INFO:tasks.workunit.client.0.smithi073.stdout:3/942: chown d0/d11/d19/db/d3e/d3f/fad 116 1 2024-04-26T11:24:05.009 INFO:tasks.workunit.client.0.smithi073.stdout:3/943: rename d0/d11/d19/db/d3e/d3f/d69/d96/l124 to d0/d11/d23/d86/l13e 0 2024-04-26T11:24:05.014 INFO:tasks.workunit.client.0.smithi073.stdout:0/972: dread d2/d1f/f28 [0,4194304] 0 2024-04-26T11:24:05.014 INFO:tasks.workunit.client.0.smithi073.stdout:0/973: mkdir d2/d37/d3c/d116/d14e 0 2024-04-26T11:24:05.021 INFO:tasks.workunit.client.0.smithi073.stdout:0/974: truncate d2/d1f/d40/d48/d62/f130 426599 0 2024-04-26T11:24:05.022 INFO:tasks.workunit.client.0.smithi073.stdout:0/975: creat d2/d37/d3c/f14f x:0 0 0 2024-04-26T11:24:05.022 INFO:tasks.workunit.client.0.smithi073.stdout:0/976: chown d2/d37/d3c/d73/f7c 307964434 1 2024-04-26T11:24:05.023 INFO:tasks.workunit.client.0.smithi073.stdout:0/977: fdatasync d2/d37/d3c/f88 0 2024-04-26T11:24:05.027 INFO:tasks.workunit.client.0.smithi073.stdout:0/978: dwrite d2/f3f [0,4194304] 0 2024-04-26T11:24:05.029 INFO:tasks.workunit.client.0.smithi073.stdout:0/979: mknod d2/d1f/d40/d48/d122/c150 0 2024-04-26T11:24:05.034 INFO:tasks.workunit.client.0.smithi073.stdout:0/980: dread d2/d22/f103 [0,4194304] 0 2024-04-26T11:24:05.035 INFO:tasks.workunit.client.0.smithi073.stdout:0/981: symlink d2/d1f/d40/d48/dc1/l151 0 2024-04-26T11:24:05.036 INFO:tasks.workunit.client.0.smithi073.stdout:0/982: mkdir d2/d1f/d9c/db1/d152 0 2024-04-26T11:24:05.037 INFO:tasks.workunit.client.0.smithi073.stdout:0/983: write d2/d1f/d40/d48/dc1/fc6 [355158,73624] 0 2024-04-26T11:24:05.037 INFO:tasks.workunit.client.0.smithi073.stdout:0/984: rmdir d2/d1f/d9d 39 2024-04-26T11:24:05.038 INFO:tasks.workunit.client.0.smithi073.stdout:0/985: creat d2/d1f/d40/d48/d62/f153 x:0 0 0 2024-04-26T11:24:05.038 INFO:tasks.workunit.client.0.smithi073.stdout:0/986: fsync d2/d37/f6e 0 2024-04-26T11:24:05.039 INFO:tasks.workunit.client.0.smithi073.stdout:0/987: write d2/d22/f50 [847515,85710] 0 2024-04-26T11:24:05.039 INFO:tasks.workunit.client.0.smithi073.stdout:0/988: dread - d2/d22/d51/d57/fee zero size 2024-04-26T11:24:05.044 INFO:tasks.workunit.client.0.smithi073.stdout:6/887: sync 2024-04-26T11:24:05.044 INFO:tasks.workunit.client.0.smithi073.stdout:3/944: sync 2024-04-26T11:24:05.045 INFO:tasks.workunit.client.0.smithi073.stdout:6/888: read - d0/d1a/d26/d4b/d63/da0/d7c/fd4 zero size 2024-04-26T11:24:05.045 INFO:tasks.workunit.client.0.smithi073.stdout:0/989: dwrite d2/f8a [0,4194304] 0 2024-04-26T11:24:05.046 INFO:tasks.workunit.client.0.smithi073.stdout:3/945: mknod d0/d11/d19/d52/d102/d60/d104/c13f 0 2024-04-26T11:24:05.047 INFO:tasks.workunit.client.0.smithi073.stdout:6/889: creat d0/d1a/d26/d4b/d2b/d43/d100/f10d x:0 0 0 2024-04-26T11:24:05.047 INFO:tasks.workunit.client.0.smithi073.stdout:3/946: dread - d0/d11/d19/d52/f128 zero size 2024-04-26T11:24:05.047 INFO:tasks.workunit.client.0.smithi073.stdout:0/990: link d2/l6f d2/d1f/d40/l154 0 2024-04-26T11:24:05.047 INFO:tasks.workunit.client.0.smithi073.stdout:6/890: chown d0/d1a/d7a/f85 0 1 2024-04-26T11:24:05.051 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:05.048+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:05.054 INFO:tasks.workunit.client.0.smithi073.stdout:3/947: dwrite d0/d11/d19/db/d3e/d47/f79 [4194304,4194304] 0 2024-04-26T11:24:05.054 INFO:tasks.workunit.client.0.smithi073.stdout:6/891: dwrite d0/d1a/d26/d4b/d63/f73 [0,4194304] 0 2024-04-26T11:24:05.057 INFO:tasks.workunit.client.0.smithi073.stdout:6/892: getdents d0/d1a/d26/d4b 0 2024-04-26T11:24:05.058 INFO:tasks.workunit.client.0.smithi073.stdout:6/893: truncate d0/d15/d2d/d3f/d59/f6b 927926 0 2024-04-26T11:24:05.058 INFO:tasks.workunit.client.0.smithi073.stdout:6/894: stat d0/d1a/d26/d27/l75 0 2024-04-26T11:24:05.059 INFO:tasks.workunit.client.0.smithi073.stdout:6/895: unlink d0/d1a/d26/d105/l1f 0 2024-04-26T11:24:05.059 INFO:tasks.workunit.client.0.smithi073.stdout:6/896: sync 2024-04-26T11:24:05.062 INFO:tasks.workunit.client.0.smithi073.stdout:6/897: truncate d0/d1a/d26/d4b/d63/da0/d7c/ff0 245630 0 2024-04-26T11:24:05.062 INFO:tasks.workunit.client.0.smithi073.stdout:3/948: dread d0/d11/d19/db/fb3 [0,4194304] 0 2024-04-26T11:24:05.063 INFO:tasks.workunit.client.0.smithi073.stdout:3/949: chown d0/d26/da2 2974 1 2024-04-26T11:24:05.064 INFO:tasks.workunit.client.0.smithi073.stdout:3/950: truncate d0/d11/d19/d52/d102/d7a/dbc/ff2 551083 0 2024-04-26T11:24:05.065 INFO:tasks.workunit.client.0.smithi073.stdout:3/951: creat d0/d11/d19/d52/d102/d8b/d8c/d106/f140 x:0 0 0 2024-04-26T11:24:05.074 INFO:tasks.workunit.client.0.smithi073.stdout:0/991: dread d2/d37/d3c/d73/fb4 [0,4194304] 0 2024-04-26T11:24:05.075 INFO:tasks.workunit.client.0.smithi073.stdout:0/992: creat d2/d1f/d40/d48/d62/f155 x:0 0 0 2024-04-26T11:24:05.079 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:05.079 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:05.079 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:24:05.079 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:24:05.080 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:05.080 INFO:tasks.workunit.client.0.smithi073.stdout:0/993: dwrite d2/d1f/d9d/fae [4194304,4194304] 0 2024-04-26T11:24:05.083 INFO:tasks.workunit.client.0.smithi073.stdout:0/994: fsync d2/fbd 0 2024-04-26T11:24:05.084 INFO:tasks.workunit.client.0.smithi073.stdout:0/995: write d2/d1f/d40/d48/d62/f153 [430453,120155] 0 2024-04-26T11:24:05.085 INFO:tasks.workunit.client.0.smithi073.stdout:3/952: dread d0/d11/d19/db/d3e/d47/f79 [0,4194304] 0 2024-04-26T11:24:05.085 INFO:tasks.workunit.client.0.smithi073.stdout:0/996: mkdir d2/d37/d140/d156 0 2024-04-26T11:24:05.085 INFO:tasks.workunit.client.0.smithi073.stdout:3/953: mkdir d0/d2d/df4/d141 0 2024-04-26T11:24:05.086 INFO:tasks.workunit.client.0.smithi073.stdout:6/898: dread d0/d1a/d26/d105/f60 [0,4194304] 0 2024-04-26T11:24:05.086 INFO:tasks.workunit.client.0.smithi073.stdout:0/997: creat d2/d1f/d40/d48/d62/f157 x:0 0 0 2024-04-26T11:24:05.087 INFO:tasks.workunit.client.0.smithi073.stdout:3/954: read - d0/d11/d19/db/d3e/d3f/d69/d96/d136/f11a zero size 2024-04-26T11:24:05.087 INFO:tasks.workunit.client.0.smithi073.stdout:6/899: symlink d0/dc/l10e 0 2024-04-26T11:24:05.087 INFO:tasks.workunit.client.0.smithi073.stdout:0/998: rename d2/d1f/d9c to d2/d1f/d40/d48/d62/de5/d158 0 2024-04-26T11:24:05.087 INFO:tasks.workunit.client.0.smithi073.stdout:3/955: rmdir d0/d11/d19/d70/daa 39 2024-04-26T11:24:05.088 INFO:tasks.workunit.client.0.smithi073.stdout:0/999: write d2/d5f/f13e [70826,54419] 0 2024-04-26T11:24:05.088 INFO:tasks.workunit.client.0.smithi073.stdout:3/956: creat d0/d11/f142 x:0 0 0 2024-04-26T11:24:05.088 INFO:tasks.workunit.client.0.smithi073.stdout:6/900: truncate d0/d1a/d26/d4b/d63/da0/d7c/fd4 101078 0 2024-04-26T11:24:05.089 INFO:tasks.workunit.client.0.smithi073.stdout:3/957: creat d0/d11/d19/d70/d137/f143 x:0 0 0 2024-04-26T11:24:05.089 INFO:tasks.workunit.client.0.smithi073.stdout:6/901: write d0/d1a/d26/d4b/d2b/fe9 [407778,129887] 0 2024-04-26T11:24:05.090 INFO:tasks.workunit.client.0.smithi073.stdout:6/902: rename d0/d1a/d26/d4b/d38/c5f to d0/d1a/d26/d4b/d49/d84/dde/c10f 0 2024-04-26T11:24:05.091 INFO:tasks.workunit.client.0.smithi073.stdout:6/903: symlink d0/d1a/d4e/d67/l110 0 2024-04-26T11:24:05.091 INFO:tasks.workunit.client.0.smithi073.stdout:3/958: read d0/d11/d23/fb2 [1072053,106589] 0 2024-04-26T11:24:05.092 INFO:tasks.workunit.client.0.smithi073.stdout:3/959: creat d0/d11/d19/db/d3e/d3f/f144 x:0 0 0 2024-04-26T11:24:05.094 INFO:tasks.workunit.client.0.smithi073.stdout:3/960: rename d0/d11/d19/d52/d102/d8b/d8c/d90/db4/lf8 to d0/d11/d19/db/ddc/d109/l145 0 2024-04-26T11:24:05.095 INFO:tasks.workunit.client.0.smithi073.stdout:3/961: mkdir d0/d11/d23/d86/d146 0 2024-04-26T11:24:05.097 INFO:tasks.workunit.client.0.smithi073.stdout:6/904: dwrite d0/d1a/d26/d4b/d2b/f3d [0,4194304] 0 2024-04-26T11:24:05.098 INFO:tasks.workunit.client.0.smithi073.stdout:6/905: mkdir d0/d1a/d7a/d111 0 2024-04-26T11:24:05.099 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:05.100 INFO:tasks.workunit.client.0.smithi073.stdout:6/906: mkdir d0/d1a/d4e/d10b/d112 0 2024-04-26T11:24:05.108 INFO:tasks.workunit.client.0.smithi073.stdout:3/962: dwrite d0/d11/d19/d52/f54 [0,4194304] 0 2024-04-26T11:24:05.108 INFO:tasks.workunit.client.0.smithi073.stdout:6/907: dwrite d0/d1a/d4e/fa4 [0,4194304] 0 2024-04-26T11:24:05.109 INFO:tasks.workunit.client.0.smithi073.stdout:3/963: write d0/d11/d19/d1d/ff5 [4120404,55998] 0 2024-04-26T11:24:05.110 INFO:tasks.workunit.client.0.smithi073.stdout:6/908: link d0/dc/d2e/d6e/cdc d0/dc/d55/d79/c113 0 2024-04-26T11:24:05.111 INFO:tasks.workunit.client.0.smithi073.stdout:6/909: readlink d0/dc/d2e/d6e/l9d 0 2024-04-26T11:24:05.111 INFO:tasks.workunit.client.0.smithi073.stdout:6/910: readlink d0/d15/d2d/l53 0 2024-04-26T11:24:05.114 INFO:tasks.workunit.client.0.smithi073.stdout:6/911: chown d0/d1a/d26/d105/df7/da2/c109 9073225 1 2024-04-26T11:24:05.114 INFO:tasks.workunit.client.0.smithi073.stdout:6/912: chown d0/d15/d2d/d3f/d59/deb/f3b 1854 1 2024-04-26T11:24:05.115 INFO:tasks.workunit.client.0.smithi073.stdout:6/913: stat d0/d1a/d4e/c78 0 2024-04-26T11:24:05.115 INFO:tasks.workunit.client.0.smithi073.stdout:6/914: unlink d0/dc/fb5 0 2024-04-26T11:24:05.116 INFO:tasks.workunit.client.0.smithi073.stdout:3/964: dread d0/d11/d19/d52/d102/d7a/dbc/f10d [0,4194304] 0 2024-04-26T11:24:05.117 INFO:tasks.workunit.client.0.smithi073.stdout:3/965: write d0/d26/f8f [3612851,16476] 0 2024-04-26T11:24:05.118 INFO:tasks.workunit.client.0.smithi073.stdout:3/966: creat d0/d11/d19/d70/d137/f147 x:0 0 0 2024-04-26T11:24:05.119 INFO:tasks.workunit.client.0.smithi073.stdout:3/967: rename d0/d11/d19/f71 to d0/d11/d19/d1d/f148 0 2024-04-26T11:24:05.120 INFO:tasks.workunit.client.0.smithi073.stdout:3/968: rmdir d0/d11/d19/d52/d102/d60 39 2024-04-26T11:24:05.120 INFO:tasks.workunit.client.0.smithi073.stdout:6/915: dwrite d0/d1a/d4e/fa4 [0,4194304] 0 2024-04-26T11:24:05.122 INFO:tasks.workunit.client.0.smithi073.stdout:6/916: unlink d0/dc/f64 0 2024-04-26T11:24:05.123 INFO:tasks.workunit.client.0.smithi073.stdout:3/969: creat d0/d11/d19/d52/d102/d7a/f149 x:0 0 0 2024-04-26T11:24:05.123 INFO:tasks.workunit.client.0.smithi073.stdout:6/917: mkdir d0/dc/d114 0 2024-04-26T11:24:05.124 INFO:tasks.workunit.client.0.smithi073.stdout:6/918: fsync d0/d1a/d26/d4b/d2b/f3e 0 2024-04-26T11:24:05.124 INFO:tasks.workunit.client.0.smithi073.stdout:6/919: write d0/f61 [2065042,21251] 0 2024-04-26T11:24:05.125 INFO:tasks.workunit.client.0.smithi073.stdout:6/920: write d0/dc/d55/d79/f104 [625264,84972] 0 2024-04-26T11:24:05.126 INFO:tasks.workunit.client.0.smithi073.stdout:6/921: creat d0/d15/d9a/f115 x:0 0 0 2024-04-26T11:24:05.131 INFO:tasks.workunit.client.0.smithi073.stdout:3/970: dwrite d0/d11/f91 [0,4194304] 0 2024-04-26T11:24:05.132 INFO:tasks.workunit.client.0.smithi073.stdout:6/922: dwrite d0/d1a/d26/d4b/d49/ff4 [0,4194304] 0 2024-04-26T11:24:05.134 INFO:tasks.workunit.client.0.smithi073.stdout:3/971: unlink d0/d11/d19/db/ddc/f46 0 2024-04-26T11:24:05.135 INFO:tasks.workunit.client.0.smithi073.stdout:6/923: truncate d0/d1a/d26/fc6 701010 0 2024-04-26T11:24:05.136 INFO:tasks.workunit.client.0.smithi073.stdout:3/972: rename d0/d11/d23/d86/d125 to d0/d11/d19/d52/d102/d60/dcd/d14a 0 2024-04-26T11:24:05.137 INFO:tasks.workunit.client.0.smithi073.stdout:6/924: dread d0/d1a/d26/d105/d20/f65 [0,4194304] 0 2024-04-26T11:24:05.144 INFO:tasks.workunit.client.0.smithi073.stdout:3/973: read d0/d11/d19/f39 [412630,7629] 0 2024-04-26T11:24:05.145 INFO:tasks.workunit.client.0.smithi073.stdout:3/974: rmdir d0/d11/d23 39 2024-04-26T11:24:05.145 INFO:tasks.workunit.client.0.smithi073.stdout:3/975: symlink d0/d11/d19/d1d/d135/l14b 0 2024-04-26T11:24:05.147 INFO:tasks.workunit.client.0.smithi073.stdout:3/976: dread d0/d11/d19/d70/f12f [0,4194304] 0 2024-04-26T11:24:05.148 INFO:tasks.workunit.client.0.smithi073.stdout:3/977: mkdir d0/d11/d19/d52/d14c 0 2024-04-26T11:24:05.148 INFO:tasks.workunit.client.0.smithi073.stdout:3/978: creat d0/d11/d19/d52/d14c/f14d x:0 0 0 2024-04-26T11:24:05.149 INFO:tasks.workunit.client.0.smithi073.stdout:3/979: readlink d0/d11/d19/l1b 0 2024-04-26T11:24:05.149 INFO:tasks.workunit.client.0.smithi073.stdout:3/980: creat d0/d11/d19/d52/d102/d8b/f14e x:0 0 0 2024-04-26T11:24:05.150 INFO:tasks.workunit.client.0.smithi073.stdout:3/981: mkdir d0/d2d/df4/d113/d14f 0 2024-04-26T11:24:05.151 INFO:tasks.workunit.client.0.smithi073.stdout:3/982: chown d0/d11/d19/db/ddc/d3c/c40 544021 1 2024-04-26T11:24:05.153 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:05.150+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:05.159 INFO:tasks.workunit.client.0.smithi073.stdout:6/925: sync 2024-04-26T11:24:05.159 INFO:tasks.workunit.client.0.smithi073.stdout:3/983: sync 2024-04-26T11:24:05.160 INFO:tasks.workunit.client.0.smithi073.stdout:6/926: read d0/d1a/d26/d27/f29 [1711915,83727] 0 2024-04-26T11:24:05.161 INFO:tasks.workunit.client.0.smithi073.stdout:6/927: unlink d0/d1a/d26/d105/l35 0 2024-04-26T11:24:05.162 INFO:tasks.workunit.client.0.smithi073.stdout:6/928: creat d0/dc/d55/d79/f116 x:0 0 0 2024-04-26T11:24:05.162 INFO:tasks.workunit.client.0.smithi073.stdout:6/929: readlink d0/d1a/d4e/d67/l110 0 2024-04-26T11:24:05.163 INFO:tasks.workunit.client.0.smithi073.stdout:6/930: symlink d0/d1a/d26/d105/l117 0 2024-04-26T11:24:05.164 INFO:tasks.workunit.client.0.smithi073.stdout:3/984: dwrite d0/d11/d19/f28 [0,4194304] 0 2024-04-26T11:24:05.165 INFO:tasks.workunit.client.0.smithi073.stdout:6/931: getdents d0/d15/d2d 0 2024-04-26T11:24:05.165 INFO:tasks.workunit.client.0.smithi073.stdout:6/932: chown d0/d1a/d26/d4b/d49/fc9 275116872 1 2024-04-26T11:24:05.166 INFO:tasks.workunit.client.0.smithi073.stdout:3/985: getdents d0/d26/d130 0 2024-04-26T11:24:05.166 INFO:tasks.workunit.client.0.smithi073.stdout:3/986: truncate d0/d11/d19/d70/daa/f114 415827 0 2024-04-26T11:24:05.172 INFO:tasks.workunit.client.0.smithi073.stdout:3/987: dwrite d0/d11/d19/d70/daa/f114 [0,4194304] 0 2024-04-26T11:24:05.172 INFO:tasks.workunit.client.0.smithi073.stdout:6/933: dwrite d0/d1a/d26/d4b/d2b/d43/f88 [0,4194304] 0 2024-04-26T11:24:05.173 INFO:tasks.workunit.client.0.smithi073.stdout:6/934: mkdir d0/dc/d55/d79/d118 0 2024-04-26T11:24:05.173 INFO:tasks.workunit.client.0.smithi073.stdout:3/988: getdents d0/d11/d19/d1d/d139 0 2024-04-26T11:24:05.174 INFO:tasks.workunit.client.0.smithi073.stdout:3/989: symlink d0/d11/d19/d1d/d12b/l150 0 2024-04-26T11:24:05.177 INFO:tasks.workunit.client.0.smithi073.stdout:6/935: truncate d0/d1a/d26/d27/fc5 873342 0 2024-04-26T11:24:05.182 INFO:tasks.workunit.client.0.smithi073.stdout:6/936: dwrite d0/d1a/d26/d4b/f7d [0,4194304] 0 2024-04-26T11:24:05.185 INFO:tasks.workunit.client.0.smithi073.stdout:6/937: dread d0/d1a/d26/d27/dbc/fab [0,4194304] 0 2024-04-26T11:24:05.186 INFO:tasks.workunit.client.0.smithi073.stdout:6/938: chown d0/d15/d2d/d3f/d59/f92 22818687 1 2024-04-26T11:24:05.186 INFO:tasks.workunit.client.0.smithi073.stdout:3/990: read d0/d26/f58 [615767,126203] 0 2024-04-26T11:24:05.186 INFO:tasks.workunit.client.0.smithi073.stdout:6/939: fdatasync d0/d1a/d4e/fb8 0 2024-04-26T11:24:05.187 INFO:tasks.workunit.client.0.smithi073.stdout:3/991: unlink d0/d11/d19/d52/d14c/f14d 0 2024-04-26T11:24:05.187 INFO:tasks.workunit.client.0.smithi073.stdout:3/992: truncate d0/f7 5074591 0 2024-04-26T11:24:05.188 INFO:tasks.workunit.client.0.smithi073.stdout:3/993: write d0/fa [2777480,42424] 0 2024-04-26T11:24:05.188 INFO:tasks.workunit.client.0.smithi073.stdout:6/940: dread d0/d1a/d26/d4b/d63/da0/d7c/fd4 [0,4194304] 0 2024-04-26T11:24:05.188 INFO:tasks.workunit.client.0.smithi073.stdout:3/994: mkdir d0/d34/d151 0 2024-04-26T11:24:05.188 INFO:tasks.workunit.client.0.smithi073.stdout:3/995: creat d0/d2d/df6/f152 x:0 0 0 2024-04-26T11:24:05.189 INFO:tasks.workunit.client.0.smithi073.stdout:6/941: rename d0/d1a/d26/d105/f44 to d0/d1a/d26/d27/f119 0 2024-04-26T11:24:05.189 INFO:tasks.workunit.client.0.smithi073.stdout:3/996: creat d0/d11/d19/d1d/f153 x:0 0 0 2024-04-26T11:24:05.190 INFO:tasks.workunit.client.0.smithi073.stdout:6/942: truncate d0/dc/d55/d79/dd5/ff6 296092 0 2024-04-26T11:24:05.190 INFO:tasks.workunit.client.0.smithi073.stdout:3/997: readlink d0/d11/d19/d52/d102/d8b/d8c/da3/l118 0 2024-04-26T11:24:05.191 INFO:tasks.workunit.client.0.smithi073.stdout:6/943: creat d0/d1a/d26/d4b/d2b/d43/d100/d107/f11a x:0 0 0 2024-04-26T11:24:05.191 INFO:tasks.workunit.client.0.smithi073.stdout:3/998: write d0/d11/d19/db/d3e/d3f/d69/d96/d136/f138 [287658,115866] 0 2024-04-26T11:24:05.192 INFO:tasks.workunit.client.0.smithi073.stdout:3/999: write d0/f45 [3745340,118045] 0 2024-04-26T11:24:05.192 INFO:tasks.workunit.client.0.smithi073.stdout:6/944: truncate d0/d1a/d26/d105/d20/fb4 693277 0 2024-04-26T11:24:05.196 INFO:tasks.workunit.client.0.smithi073.stdout:6/945: dwrite d0/dc/d2e/f91 [0,4194304] 0 2024-04-26T11:24:05.197 INFO:tasks.workunit.client.0.smithi073.stdout:6/946: write d0/d1a/d26/d4b/d2b/f3e [2529701,47933] 0 2024-04-26T11:24:05.203 INFO:tasks.workunit.client.0.smithi073.stdout:6/947: dwrite d0/d1a/d26/d105/d20/fb4 [0,4194304] 0 2024-04-26T11:24:05.207 INFO:tasks.workunit.client.0.smithi073.stdout:6/948: dwrite d0/d15/d2d/d3f/d59/deb/f3b [8388608,4194304] 0 2024-04-26T11:24:05.209 INFO:tasks.workunit.client.0.smithi073.stdout:6/949: fdatasync d0/d15/f14 0 2024-04-26T11:24:05.210 INFO:tasks.workunit.client.0.smithi073.stdout:6/950: stat d0/d1a/d26/d4b/d49/d84/fa5 0 2024-04-26T11:24:05.210 INFO:tasks.workunit.client.0.smithi073.stdout:6/951: chown d0/d1a/d26/d4b/d2b/fe9 404 1 2024-04-26T11:24:05.211 INFO:tasks.workunit.client.0.smithi073.stdout:6/952: rename d0/dc/d2e/d6e/l108 to d0/d1a/d26/d105/df7/l11b 0 2024-04-26T11:24:05.212 INFO:tasks.workunit.client.0.smithi073.stdout:6/953: chown d0/d1a/d26/d105/d20 2965 1 2024-04-26T11:24:05.212 INFO:tasks.workunit.client.0.smithi073.stdout:6/954: stat d0/d15/f14 0 2024-04-26T11:24:05.212 INFO:tasks.workunit.client.0.smithi073.stdout:6/955: creat d0/d1a/d26/d4b/d2b/d43/d100/d107/f11c x:0 0 0 2024-04-26T11:24:05.213 INFO:tasks.workunit.client.0.smithi073.stdout:6/956: mknod d0/d1a/d26/d4b/d63/c11d 0 2024-04-26T11:24:05.213 INFO:tasks.workunit.client.0.smithi073.stdout:6/957: unlink d0/d15/d2d/l53 0 2024-04-26T11:24:05.214 INFO:tasks.workunit.client.0.smithi073.stdout:6/958: creat d0/d1a/d26/d4b/d2b/d43/d100/f11e x:0 0 0 2024-04-26T11:24:05.214 INFO:tasks.workunit.client.0.smithi073.stdout:6/959: chown d0/d1a/d26/d27/c8d 997859 1 2024-04-26T11:24:05.218 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-26T11:24:05.223 INFO:tasks.workunit.client.0.smithi073.stdout:6/960: dwrite d0/d1a/d26/d4b/d63/da0/d7c/fd4 [0,4194304] 0 2024-04-26T11:24:05.224 INFO:tasks.workunit.client.0.smithi073.stdout:6/961: chown d0/d1a/d26/d27/l90 0 1 2024-04-26T11:24:05.225 INFO:tasks.workunit.client.0.smithi073.stdout:6/962: write d0/d15/d2d/fb2 [235165,73524] 0 2024-04-26T11:24:05.226 INFO:tasks.workunit.client.0.smithi073.stdout:6/963: creat d0/dc/d8c/f11f x:0 0 0 2024-04-26T11:24:05.227 INFO:tasks.workunit.client.0.smithi073.stdout:6/964: rename d0/d1a/d7a/f85 to d0/d1a/d26/d105/d20/f120 0 2024-04-26T11:24:05.227 INFO:tasks.workunit.client.0.smithi073.stdout:6/965: stat d0/dc/d55/d79/f104 0 2024-04-26T11:24:05.228 INFO:tasks.workunit.client.0.smithi073.stdout:6/966: fdatasync d0/d1a/d26/d4b/d2b/d43/d100/d107/f11a 0 2024-04-26T11:24:05.233 INFO:tasks.workunit.client.0.smithi073.stdout:6/967: dwrite d0/d1a/d26/d4b/d2b/fdb [0,4194304] 0 2024-04-26T11:24:05.234 INFO:tasks.workunit.client.0.smithi073.stdout:6/968: fsync d0/d1a/d26/d4b/d38/fc1 0 2024-04-26T11:24:05.235 INFO:tasks.workunit.client.0.smithi073.stdout:6/969: chown d0/d1a/d26/d4b/d49/ff4 27742148 1 2024-04-26T11:24:05.235 INFO:tasks.workunit.client.0.smithi073.stdout:6/970: chown d0/d15/f9e 707463 1 2024-04-26T11:24:05.242 INFO:tasks.workunit.client.0.smithi073.stdout:6/971: dwrite d0/d1a/d26/d4b/d63/da0/f56 [4194304,4194304] 0 2024-04-26T11:24:05.243 INFO:tasks.workunit.client.0.smithi073.stdout:6/972: mkdir d0/d15/d121 0 2024-04-26T11:24:05.244 INFO:tasks.workunit.client.0.smithi073.stdout:6/973: creat d0/d1a/d26/f122 x:0 0 0 2024-04-26T11:24:05.244 INFO:tasks.workunit.client.0.smithi073.stdout:6/974: chown d0/d1a/d26/d4b/cd1 79 1 2024-04-26T11:24:05.245 INFO:tasks.workunit.client.0.smithi073.stdout:6/975: creat d0/d1a/d26/d27/dbc/f123 x:0 0 0 2024-04-26T11:24:05.246 INFO:tasks.workunit.client.0.smithi073.stdout:6/976: creat d0/d1a/d26/d27/dda/ddd/f124 x:0 0 0 2024-04-26T11:24:05.247 INFO:tasks.workunit.client.0.smithi073.stdout:6/977: unlink d0/d1a/d26/d4b/d63/da0/d7c/fd4 0 2024-04-26T11:24:05.247 INFO:tasks.workunit.client.0.smithi073.stdout:6/978: dread - d0/d15/f9e zero size 2024-04-26T11:24:05.248 INFO:tasks.workunit.client.0.smithi073.stdout:6/979: creat d0/d1a/d4e/d67/df5/f125 x:0 0 0 2024-04-26T11:24:05.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:24:05.254 INFO:tasks.workunit.client.0.smithi073.stdout:6/980: dwrite d0/d1a/d26/d105/d20/f65 [0,4194304] 0 2024-04-26T11:24:05.254 INFO:tasks.workunit.client.0.smithi073.stdout:6/981: write d0/d1a/d26/d27/dda/fe7 [775603,53244] 0 2024-04-26T11:24:05.254 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:05.248+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:05.260 INFO:tasks.workunit.client.0.smithi073.stdout:6/982: truncate d0/dc/d55/d79/f104 293606 0 2024-04-26T11:24:05.261 INFO:tasks.workunit.client.0.smithi073.stdout:6/983: mknod d0/d1a/d26/d27/dda/ddd/c126 0 2024-04-26T11:24:05.262 INFO:tasks.workunit.client.0.smithi073.stdout:6/984: chown d0/d1a/d26/d4b/d2b/f3d 264313 1 2024-04-26T11:24:05.262 INFO:tasks.workunit.client.0.smithi073.stdout:6/985: symlink d0/d1a/d4e/d67/df5/l127 0 2024-04-26T11:24:05.263 INFO:tasks.workunit.client.0.smithi073.stdout:6/986: rename d0/d15/f14 to d0/d1a/d26/d27/dbc/f128 0 2024-04-26T11:24:05.264 INFO:tasks.workunit.client.0.smithi073.stdout:6/987: rename d0/d1a/d26/d27/dbc/f102 to d0/d15/d2d/f129 0 2024-04-26T11:24:05.264 INFO:tasks.workunit.client.0.smithi073.stdout:6/988: truncate d0/d1a/d26/d4b/fee 967668 0 2024-04-26T11:24:05.269 INFO:tasks.workunit.client.0.smithi073.stdout:6/989: dwrite d0/d1a/d7a/fb3 [0,4194304] 0 2024-04-26T11:24:05.276 INFO:tasks.workunit.client.0.smithi073.stdout:6/990: dwrite d0/d1a/d26/d4b/d38/fc1 [0,4194304] 0 2024-04-26T11:24:05.280 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:05.280 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:24:05.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:24:05.281 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:05.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.281 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 1284087~3916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.281 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:05.281 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.864569103, 2024-04-26T11:24:05.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075641310000000003, 2024-04-26T11:24:05.281 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.281 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.281 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413130+0000", 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6770000000000001e-06 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413138+0000", 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.277e-06 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413143+0000", 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5609999999999998e-06 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478754+0000", 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065610702000000007 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478846+0000", 2024-04-26T11:24:05.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1525000000000002e-05 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478916+0000", 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0630000000000006e-05 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481402+0000", 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00248577 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488675+0000", 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007273219 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488724+0000", 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8525e-05 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488764+0000", 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0095000000000002e-05 2024-04-26T11:24:05.286 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 1288003~3903 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.86454217, 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075709753000000005, 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413158+0000", 2024-04-26T11:24:05.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-04-26T11:24:05.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413175+0000", 2024-04-26T11:24:05.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7008999999999999e-05 2024-04-26T11:24:05.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413181+0000", 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479410+0000", 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066228713999999994 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479498+0000", 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7478000000000005e-05 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479629+0000", 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013174500000000001 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482049+0000", 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024196249999999999 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488812+0000", 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067625810000000001 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488842+0000", 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0281e-05 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488859+0000", 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7306e-05 2024-04-26T11:24:05.292 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 1291906~6986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8645044970000004, 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079787192000000007, 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:05.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:05.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.294 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.294 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.294 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:05.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.295 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413195+0000", 2024-04-26T11:24:05.295 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:24:05.295 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.295 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.295 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413204+0000", 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7839999999999992e-06 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413210+0000", 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8440000000000003e-06 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480166+0000", 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066956565999999995 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.296 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480263+0000", 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6997999999999995e-05 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480359+0000", 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5858000000000003e-05 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482071+0000", 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001711918 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.297 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492877+0000", 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010805465 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492942+0000", 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5456999999999993e-05 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492974+0000", 2024-04-26T11:24:05.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2162000000000001e-05 2024-04-26T11:24:05.299 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.299 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.299 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.299 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 1298892~7865 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.299 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8644764389999997, 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080075681999999995, 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413225+0000", 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0767e-05 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413233+0000", 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4540000000000001e-06 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413239+0000", 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0959999999999997e-06 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480790+0000", 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067551471000000002 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480867+0000", 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6334000000000005e-05 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480982+0000", 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115395 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484440+0000", 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003458259 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493045+0000", 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086047999999999993 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493113+0000", 2024-04-26T11:24:05.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8040000000000006e-05 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493291+0000", 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017755900000000001 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 1306757~7740 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:05.305 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8615583640000004, 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.085136109000000001, 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:05.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416132+0000", 2024-04-26T11:24:05.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:05.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416221+0000", 2024-04-26T11:24:05.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8979000000000003e-05 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416233+0000", 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.202e-05 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416242+0000", 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3299999999999999e-06 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481553+0000", 2024-04-26T11:24:05.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065311285999999996 2024-04-26T11:24:05.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481603+0000", 2024-04-26T11:24:05.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0191000000000001e-05 2024-04-26T11:24:05.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481668+0000", 2024-04-26T11:24:05.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4961000000000004e-05 2024-04-26T11:24:05.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.310 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.310 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484444+0000", 2024-04-26T11:24:05.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027755100000000001 2024-04-26T11:24:05.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501161+0000", 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016716992999999999 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501229+0000", 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8664000000000005e-05 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501269+0000", 2024-04-26T11:24:05.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9956999999999997e-05 2024-04-26T11:24:05.312 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.312 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.312 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.312 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 1314497~14459 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.312 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:05.312 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8607767610000003, 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.084463892999999998, 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:05.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416914+0000", 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416932+0000", 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416943+0000", 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0456e-05 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416950+0000", 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.345e-06 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482123+0000", 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065173399000000007 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482206+0000", 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2589000000000005e-05 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482318+0000", 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011194200000000001 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484979+0000", 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026616019999999999 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501313+0000", 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016333174999999998 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501343+0000", 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0056000000000002e-05 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501379+0000", 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5991999999999997e-05 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 1328956~3568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8588204839999998, 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082605777000000005, 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:05.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418870+0000", 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418878+0000", 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8629999999999997e-06 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418895+0000", 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6886999999999999e-05 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418904+0000", 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5769999999999994e-06 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482753+0000", 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063849218999999999 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482799+0000", 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5346999999999998e-05 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482864+0000", 2024-04-26T11:24:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5124999999999997e-05 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484984+0000", 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021205820000000002 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501422+0000", 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016438066000000001 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501457+0000", 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5154999999999998e-05 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501477+0000", 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9417999999999999e-05 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.323 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 1332524~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.858778987, 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082655731999999996, 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:05.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418912+0000", 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418920+0000", 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418927+0000", 2024-04-26T11:24:05.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6399999999999997e-06 2024-04-26T11:24:05.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418933+0000", 2024-04-26T11:24:05.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9270000000000002e-06 2024-04-26T11:24:05.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483248+0000", 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064314274000000005 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483345+0000", 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7065000000000007e-05 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483458+0000", 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113285 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484989+0000", 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001531012 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501510+0000", 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016520981000000001 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501535+0000", 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501568+0000", 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2808000000000002e-05 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 1333928~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8587528950000003, 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082729079999999997, 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418938+0000", 2024-04-26T11:24:05.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418946+0000", 2024-04-26T11:24:05.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9929999999999995e-06 2024-04-26T11:24:05.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418966+0000", 2024-04-26T11:24:05.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0095e-05 2024-04-26T11:24:05.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418973+0000", 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483863+0000", 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064890529000000002 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483929+0000", 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5665000000000002e-05 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484000+0000", 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0903999999999997e-05 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485480+0000", 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001480084 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501598+0000", 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016118789000000001 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501631+0000", 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3015000000000002e-05 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501668+0000", 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6239999999999999e-05 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 1336693~3915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8586032829999999, 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082682631000000006, 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.335 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:05.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:05.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419095+0000", 2024-04-26T11:24:05.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7219999999999999e-06 2024-04-26T11:24:05.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419120+0000", 2024-04-26T11:24:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4854e-05 2024-04-26T11:24:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419127+0000", 2024-04-26T11:24:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4540000000000004e-06 2024-04-26T11:24:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484461+0000", 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065334619999999996 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484507+0000", 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5906999999999999e-05 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484612+0000", 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104813 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.486851+0000", 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022388479999999999 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501706+0000", 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014855419999999999 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501734+0000", 2024-04-26T11:24:05.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7617999999999999e-05 2024-04-26T11:24:05.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501771+0000", 2024-04-26T11:24:05.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T11:24:05.341 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.341 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.341 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.342 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 1340608~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.342 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:05.342 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8555958290000003, 2024-04-26T11:24:05.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079811516999999998, 2024-04-26T11:24:05.342 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422094+0000", 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422107+0000", 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2762000000000001e-05 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422121+0000", 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3784999999999999e-05 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422134+0000", 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3304e-05 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485009+0000", 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.062874860000000005 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485053+0000", 2024-04-26T11:24:05.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3949000000000002e-05 2024-04-26T11:24:05.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485172+0000", 2024-04-26T11:24:05.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011921699999999999 2024-04-26T11:24:05.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487692+0000", 2024-04-26T11:24:05.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025201939999999999 2024-04-26T11:24:05.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501818+0000", 2024-04-26T11:24:05.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014125499 2024-04-26T11:24:05.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501864+0000", 2024-04-26T11:24:05.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6403999999999998e-05 2024-04-26T11:24:05.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501907+0000", 2024-04-26T11:24:05.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3266000000000002e-05 2024-04-26T11:24:05.350 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.350 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.350 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.351 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:558 3.2 3:4272d415:::200.0000000b:head [write 1343057~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.351 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:05.351 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8555472320000002, 2024-04-26T11:24:05.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079859576000000002, 2024-04-26T11:24:05.352 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.352 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.352 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:05.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:05.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:05.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422153+0000", 2024-04-26T11:24:05.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909999999999999e-06 2024-04-26T11:24:05.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422161+0000", 2024-04-26T11:24:05.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4319999999999999e-06 2024-04-26T11:24:05.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422168+0000", 2024-04-26T11:24:05.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:24:05.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485516+0000", 2024-04-26T11:24:05.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063348074000000004 2024-04-26T11:24:05.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485624+0000", 2024-04-26T11:24:05.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805 2024-04-26T11:24:05.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485781+0000", 2024-04-26T11:24:05.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015710100000000001 2024-04-26T11:24:05.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487700+0000", 2024-04-26T11:24:05.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001918746 2024-04-26T11:24:05.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501949+0000", 2024-04-26T11:24:05.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014249114 2024-04-26T11:24:05.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501973+0000", 2024-04-26T11:24:05.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4627e-05 2024-04-26T11:24:05.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502004+0000", 2024-04-26T11:24:05.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:24:05.363 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.364 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.364 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.364 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:559 3.2 3:4272d415:::200.0000000b:head [write 1345015~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.364 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:05.365 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8555181740000002, 2024-04-26T11:24:05.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079931344000000001, 2024-04-26T11:24:05.365 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.365 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.365 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:05.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:05.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:05.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422183+0000", 2024-04-26T11:24:05.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8959999999999998e-06 2024-04-26T11:24:05.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422190+0000", 2024-04-26T11:24:05.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7669999999999998e-06 2024-04-26T11:24:05.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422195+0000", 2024-04-26T11:24:05.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.011e-06 2024-04-26T11:24:05.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487222+0000", 2024-04-26T11:24:05.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065027153000000004 2024-04-26T11:24:05.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487263+0000", 2024-04-26T11:24:05.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1201000000000001e-05 2024-04-26T11:24:05.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487330+0000", 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6507999999999994e-05 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488866+0000", 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001536747 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502050+0000", 2024-04-26T11:24:05.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013183540000000001 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502085+0000", 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4952e-05 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502105+0000", 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9947999999999999e-05 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.374 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:560 3.2 3:4272d415:::200.0000000b:head [write 1349228~3445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8554913509999995, 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079997483999999994, 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422208+0000", 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0309999999999998e-06 2024-04-26T11:24:05.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422214+0000", 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6560000000000003e-06 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422220+0000", 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6489999999999996e-06 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487739+0000", 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065519226 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487833+0000", 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4106999999999999e-05 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487972+0000", 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013830099999999999 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492072+0000", 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040998379999999997 2024-04-26T11:24:05.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502140+0000", 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010068238 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502165+0000", 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5454999999999999e-05 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502198+0000", 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2478999999999999e-05 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:561 3.2 3:4272d415:::200.0000000b:head [write 1352673~4505 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.855464424, 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080048127999999996, 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422235+0000", 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422242+0000", 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7670000000000003e-06 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422248+0000", 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488886+0000", 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066638785000000006 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488982+0000", 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5387e-05 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489141+0000", 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015913400000000001 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492079+0000", 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029382509999999998 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502233+0000", 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010154379 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502259+0000", 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5029999999999999e-05 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502275+0000", 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6735000000000002e-05 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:562 3.2 3:4272d415:::200.0000000b:head [write 1357178~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8554380449999996, 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080110050000000002, 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.385 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422253+0000", 2024-04-26T11:24:05.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422257+0000", 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422263+0000", 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0580000000000003e-06 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422268+0000", 2024-04-26T11:24:05.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489892+0000", 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067623600000000006 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490047+0000", 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154933 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490335+0000", 2024-04-26T11:24:05.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028846200000000002 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497761+0000", 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074257460000000004 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502307+0000", 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045457910000000004 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502331+0000", 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4601e-05 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502364+0000", 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2224000000000002e-05 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:563 3.2 3:4272d415:::200.0000000b:head [write 1358582~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:05.390 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8554186980000003, 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080161018000000001, 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422272+0000", 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422280+0000", 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0250000000000002e-06 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422288+0000", 2024-04-26T11:24:05.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422293+0000", 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3669999999999996e-06 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491197+0000", 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068903765000000006 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491329+0000", 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013223400000000001 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491443+0000", 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114159 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497769+0000", 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063253190000000003 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502392+0000", 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004622915 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502415+0000", 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3626e-05 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502434+0000", 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8703999999999999e-05 2024-04-26T11:24:05.395 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:564 3.2 3:4272d415:::200.0000000b:head [write 1360496~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8553914569999996, 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080221908999999994, 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422304+0000", 2024-04-26T11:24:05.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9360000000000001e-06 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422311+0000", 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422317+0000", 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492152+0000", 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069834487000000001 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492258+0000", 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106351 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492423+0000", 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016443600000000001 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497775+0000", 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053519650000000002 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502465+0000", 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046902660000000002 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502490+0000", 2024-04-26T11:24:05.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4777999999999999e-05 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502522+0000", 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2369999999999997e-05 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:565 3.2 3:4272d415:::200.0000000b:head [write 1362424~12956 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8543044159999997, 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079271854000000003, 2024-04-26T11:24:05.401 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423386+0000", 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423436+0000", 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0121999999999999e-05 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423449+0000", 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2863e-05 2024-04-26T11:24:05.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423459+0000", 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493380+0000", 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069921187999999995 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493456+0000", 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6416999999999997e-05 2024-04-26T11:24:05.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493584+0000", 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000128009 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499173+0000", 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055883599999999997 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502578+0000", 2024-04-26T11:24:05.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034056020000000002 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502625+0000", 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6285000000000002e-05 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502659+0000", 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:566 3.2 3:4272d415:::200.0000000b:head [write 1375380~4794 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.8519143690000002, 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.078877303999999995, 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425775+0000", 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425794+0000", 2024-04-26T11:24:05.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425810+0000", 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.525e-05 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425821+0000", 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0981e-05 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:05.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494069+0000", 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068247996000000005 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494115+0000", 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310999999999998e-05 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494183+0000", 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7841000000000003e-05 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499177+0000", 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049940109999999996 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504563+0000", 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053863339999999996 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504614+0000", 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0334999999999998e-05 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:05.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:05.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:05.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504654+0000", 2024-04-26T11:24:05.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0976000000000002e-05 2024-04-26T11:24:05.412 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.412 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.412 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.412 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:05.412 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:05.412 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:05.414 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:05.415 INFO:tasks.workunit.client.0.smithi073.stdout:6/991: dwrite d0/d15/d2d/d3f/d59/f92 [0,4194304] 0 2024-04-26T11:24:05.415 INFO:tasks.workunit.client.0.smithi073.stdout:6/992: mkdir d0/d1a/d26/d4b/d2b/d43/d100/d12a 0 2024-04-26T11:24:05.415 INFO:tasks.workunit.client.0.smithi073.stdout:6/993: symlink d0/d1a/d26/d105/df7/dd9/l12b 0 2024-04-26T11:24:05.415 INFO:tasks.workunit.client.0.smithi073.stdout:6/994: readlink d0/d1a/d26/d4b/d2b/l4a 0 2024-04-26T11:24:05.415 INFO:tasks.workunit.client.0.smithi073.stdout:6/995: dwrite d0/d15/d2d/d3f/d59/deb/fe2 [0,4194304] 0 2024-04-26T11:24:05.415 INFO:tasks.workunit.client.0.smithi073.stdout:6/996: mknod d0/d1a/d26/d27/dda/c12c 0 2024-04-26T11:24:05.415 INFO:tasks.workunit.client.0.smithi073.stdout:6/997: mknod d0/d15/d2d/d3f/d59/deb/c12d 0 2024-04-26T11:24:05.416 INFO:tasks.workunit.client.0.smithi073.stdout:6/998: creat d0/d1a/d26/d4b/d2b/d43/f12e x:0 0 0 2024-04-26T11:24:05.416 INFO:tasks.workunit.client.0.smithi073.stdout:6/999: dwrite d0/dc/d2e/d6e/f70 [0,4194304] 0 2024-04-26T11:24:05.416 INFO:tasks.workunit.client.0.smithi073.stderr:+ rm -rf -- ./tmp.nUDyr3VotE 2024-04-26T11:24:05.416 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:24:05.416 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:24:05.417 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:24:05.417 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:24:05.417 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:24:05.418 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:05.410+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:05.418 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:24:05.419 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:24:05.514 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:05.512+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:05.549 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:05.549 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:05.564 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:05.615 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:05.612+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:05.689 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:05.690 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:05.705 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:05.717 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:05.712+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:05.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:05.814+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:05.831 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:05.831 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:05.846 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:05.918 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:05.914+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:05.988 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:05.989 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:06.004 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:06.019 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:06.014+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:06.120 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:06.116+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:06.128 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:06.128 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:06.144 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:06.221 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:06.218+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:06.306 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:06.307 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:06.321 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:06.322 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:06.318+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:06.423 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:06.418+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:06.455 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:06.455 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:06.469 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:06.525 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:06.520+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:06.625 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:06.620+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:06.637 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:06.637 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:06.652 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:06.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-04-26T11:24:06.726 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:06.722+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:06.779 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:06.779 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:06.795 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:06.838 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:06.836+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:06.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:06.926+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:06.930 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:06.930 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:06.945 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:07.034 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:07.032+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:07.120 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:07.120 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:07.130 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:07.126+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:07.135 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:07.231 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:07.226+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:07.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:24:07.315 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:07.315 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:07.331 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:07.332 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:07.330+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:07.419 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:24:07.433 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:07.430+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:07.463 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:07.463 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:07.477 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:07.534 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:07.532+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:07.539 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:24:07.558 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:24:07.558 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:24:07.579 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:24:07.580 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:24:07.582 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:24:07.583 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:24:07.636 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:07.632+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:07.647 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:07.647 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:07.647 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:24:07.647 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:24:07.647 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:07.661 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:07.736 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:07.732+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:07.801 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:07.802 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:24:07.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:24:07.802 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:07.802 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.802 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2615 3.d 3:b02ffd62:::200.00000010:head [write 2546869~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.802 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:07.802 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3927714930000001, 2024-04-26T11:24:07.802 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070123572999999995, 2024-04-26T11:24:07.802 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.802 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.802 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406472+0000", 2024-04-26T11:24:07.803 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406483+0000", 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1219999999999999e-05 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406499+0000", 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5452999999999999e-05 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406511+0000", 2024-04-26T11:24:07.804 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1769e-05 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472319+0000", 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065808723 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472411+0000", 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1896000000000002e-05 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476347+0000", 2024-04-26T11:24:07.805 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039353060000000004 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476433+0000", 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6487000000000001e-05 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476597+0000", 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163461 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.806 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2616 3.d 3:b02ffd62:::200.00000010:head [write 2548776~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.392724785, 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070199544000000003, 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.807 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.808 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:07.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.809 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.809 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406519+0000", 2024-04-26T11:24:07.809 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.809 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.809 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406531+0000", 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.172e-05 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406546+0000", 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5685999999999999e-05 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406556+0000", 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0071000000000001e-05 2024-04-26T11:24:07.810 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473252+0000", 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066695915999999994 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473332+0000", 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476611+0000", 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032787630000000001 2024-04-26T11:24:07.811 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476656+0000", 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5096999999999999e-05 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476719+0000", 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3332999999999998e-05 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.812 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2617 3.d 3:b02ffd62:::200.00000010:head [write 2552653~1113 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.813 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:07.813 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.392679175, 2024-04-26T11:24:07.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073674075000000006, 2024-04-26T11:24:07.813 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.813 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.813 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.813 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.813 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.813 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:07.813 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.813 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406564+0000", 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406570+0000", 2024-04-26T11:24:07.814 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6520000000000003e-06 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406583+0000", 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2679e-05 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406594+0000", 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1032999999999999e-05 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.815 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474020+0000", 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.067425944000000002 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474102+0000", 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2806999999999995e-05 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480120+0000", 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060174729999999997 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.816 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480169+0000", 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9570999999999997e-05 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480239+0000", 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0026999999999999e-05 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.817 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2618 3.d 3:b02ffd62:::200.00000010:head [write 2553766~1050 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3898995100000002, 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071002984000000005, 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:07.818 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409344+0000", 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409353+0000", 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9150000000000002e-06 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409371+0000", 2024-04-26T11:24:07.819 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8904000000000001e-05 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409384+0000", 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2566e-05 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065596495000000005 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.820 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475126+0000", 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145329 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480249+0000", 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005123102 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480288+0000", 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9285000000000001e-05 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.821 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480348+0000", 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9728999999999997e-05 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:14995 4.5 4:a0840aa3:::10000003880.00000000:head [write 85470~33722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3898402519999999, 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071045135999999995, 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:07.822 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14995 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.823 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409431+0000", 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7233000000000002e-05 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409440+0000", 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5859999999999994e-06 2024-04-26T11:24:07.824 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409446+0000", 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9429999999999997e-06 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065534244000000005 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475214+0000", 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023348600000000001 2024-04-26T11:24:07.825 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480357+0000", 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051425710000000003 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480394+0000", 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7289000000000002e-05 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480449+0000", 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5507000000000002e-05 2024-04-26T11:24:07.826 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.827 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.827 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.827 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.827 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.827 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2619 3.d 3:b02ffd62:::200.00000010:head [write 2554816~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.827 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:07.827 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.389214162, 2024-04-26T11:24:07.827 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071786804999999995, 2024-04-26T11:24:07.827 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.827 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410029+0000", 2024-04-26T11:24:07.828 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410037+0000", 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2760000000000003e-06 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410047+0000", 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0555e-05 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410054+0000", 2024-04-26T11:24:07.829 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9399999999999996e-06 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476866+0000", 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066812270000000007 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.477059+0000", 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019292199999999999 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.830 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481712+0000", 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046527210000000003 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481754+0000", 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2017000000000001e-05 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481817+0000", 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3054999999999999e-05 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.831 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2620 3.d 3:b02ffd62:::200.00000010:head [write 2557602~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.386222423, 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073204069999999996, 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.832 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413021+0000", 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413038+0000", 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6787999999999999e-05 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.833 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413052+0000", 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4606999999999999e-05 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413062+0000", 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9669999999999996e-06 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478002+0000", 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064940093000000004 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.834 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478080+0000", 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7985999999999995e-05 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486106+0000", 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080256040000000004 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486157+0000", 2024-04-26T11:24:07.835 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1063000000000002e-05 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486226+0000", 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9078000000000005e-05 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2621 3.d 3:b02ffd62:::200.00000010:head [write 2559526~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3833962, 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070487039000000001, 2024-04-26T11:24:07.836 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.837 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415847+0000", 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415855+0000", 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6929999999999996e-06 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415888+0000", 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2954999999999999e-05 2024-04-26T11:24:07.838 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415902+0000", 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3706000000000001e-05 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478597+0000", 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062695089999999995 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478709+0000", 2024-04-26T11:24:07.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111777 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486236+0000", 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075266700000000001 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486276+0000", 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9966999999999999e-05 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486335+0000", 2024-04-26T11:24:07.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9713000000000002e-05 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2622 3.d 3:b02ffd62:::200.00000010:head [write 2561446~5986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3832788599999999, 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.072007783000000006, 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415965+0000", 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415979+0000", 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4697e-05 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415993+0000", 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3947e-05 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416003+0000", 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.843 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479418+0000", 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063414807000000004 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479500+0000", 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1631999999999994e-05 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487756+0000", 2024-04-26T11:24:07.844 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082565529999999998 2024-04-26T11:24:07.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.845 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487831+0000", 2024-04-26T11:24:07.845 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4449999999999994e-05 2024-04-26T11:24:07.845 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.845 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.845 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487973+0000", 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014249999999999999 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2623 3.d 3:b02ffd62:::200.00000010:head [write 2567432~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3829074760000002, 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071791032000000005, 2024-04-26T11:24:07.846 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.847 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416336+0000", 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416343+0000", 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.827e-06 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416354+0000", 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1168e-05 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.848 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416364+0000", 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7520000000000008e-06 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480382+0000", 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064018284999999994 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480487+0000", 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010463099999999999 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.849 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487984+0000", 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074974000000000004 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488035+0000", 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0702999999999999e-05 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488128+0000", 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3246999999999997e-05 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.850 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2624 3.d 3:b02ffd62:::200.00000010:head [write 2569339~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3828668620000002, 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071901926000000005, 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.851 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416377+0000", 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416380+0000", 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.287e-06 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.852 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416386+0000", 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4559999999999999e-06 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416390+0000", 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0659999999999997e-06 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481222+0000", 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064831753000000006 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.853 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481290+0000", 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8425999999999998e-05 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488139+0000", 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068488289999999999 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488191+0000", 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1629000000000003e-05 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.854 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488280+0000", 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9009000000000001e-05 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:15009 4.1d 4:b80503fc:::10000003240.00000000:head [write 897504~130300] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3811810790000001, 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069065685000000002, 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:07.855 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 15009 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.856 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418062+0000", 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418222+0000", 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016041800000000001 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418233+0000", 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0604999999999999e-05 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.857 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418240+0000", 2024-04-26T11:24:07.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:24:07.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.858 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481210+0000", 2024-04-26T11:24:07.858 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062970672000000005 2024-04-26T11:24:07.858 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.858 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.858 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481312+0000", 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101834 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487023+0000", 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057108910000000001 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487065+0000", 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1553e-05 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.859 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487129+0000", 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4394999999999996e-05 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2625 3.d 3:b02ffd62:::200.00000010:head [write 2571246~11889 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3808648579999998, 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069981421000000002, 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.860 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418379+0000", 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418393+0000", 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4819e-05 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418405+0000", 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1756999999999999e-05 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418413+0000", 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6839999999999996e-06 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481846+0000", 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063433324999999999 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481927+0000", 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0531000000000005e-05 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488289+0000", 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063617559999999997 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488322+0000", 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3130999999999998e-05 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488361+0000", 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9385000000000003e-05 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.864 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2626 3.d 3:b02ffd62:::200.00000010:head [write 2583135~1955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3798815489999998, 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071468652999999993, 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419362+0000", 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419368+0000", 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2260000000000002e-06 2024-04-26T11:24:07.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419379+0000", 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0920999999999999e-05 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419388+0000", 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1740000000000006e-06 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482729+0000", 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063340152999999996 2024-04-26T11:24:07.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482840+0000", 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011119400000000001 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490744+0000", 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079037740000000006 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490781+0000", 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.735e-05 2024-04-26T11:24:07.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490832+0000", 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0729000000000002e-05 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2627 3.d 3:b02ffd62:::200.00000010:head [write 2585090~9888 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3783997279999998, 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070072738999999995, 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.869 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420844+0000", 2024-04-26T11:24:07.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420857+0000", 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2974e-05 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420868+0000", 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1063999999999999e-05 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420876+0000", 2024-04-26T11:24:07.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2060000000000007e-06 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483561+0000", 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062684472000000005 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483646+0000", 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5006000000000006e-05 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490839+0000", 2024-04-26T11:24:07.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071929979999999999 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490872+0000", 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3550999999999998e-05 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490917+0000", 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5426000000000002e-05 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2628 3.d 3:b02ffd62:::200.00000010:head [write 2594978~23633 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3769670409999999, 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068718354999999995, 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422276+0000", 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422309+0000", 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422319+0000", 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0254e-05 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422326+0000", 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4509999999999997e-06 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484314+0000", 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.061988468999999997 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484428+0000", 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011424799999999999 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490923+0000", 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064948699999999998 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490950+0000", 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7163000000000001e-05 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490996+0000", 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5423000000000002e-05 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2629 3.d 3:b02ffd62:::200.00000010:head [write 2618611~3263 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3769104049999998, 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068771545000000003, 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422337+0000", 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5659999999999998e-06 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422342+0000", 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000002e-06 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422346+0000", 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8419999999999998e-06 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485397+0000", 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063051691000000007 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485487+0000", 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9986000000000002e-05 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491001+0000", 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055139899999999999 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491030+0000", 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8314999999999999e-05 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491106+0000", 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5845000000000003e-05 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2634 3.d 3:b02ffd62:::200.00000010:head [write 2639450~2419 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3729978689999998, 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070097349000000003, 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426246+0000", 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426250+0000", 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4750000000000004e-06 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426257+0000", 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4320000000000004e-06 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426261+0000", 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.732e-06 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491320+0000", 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065059326000000001 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491435+0000", 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011479 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496253+0000", 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004818676 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496292+0000", 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8640999999999998e-05 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496344+0000", 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1870000000000003e-05 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2635 3.d 3:b02ffd62:::200.00000010:head [write 2641869~3599 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3729416080000001, 2024-04-26T11:24:07.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071646847999999999, 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426302+0000", 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426306+0000", 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6169999999999998e-06 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426314+0000", 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1079999999999993e-06 2024-04-26T11:24:07.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426318+0000", 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3769999999999998e-06 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492040+0000", 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065721110999999999 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492102+0000", 2024-04-26T11:24:07.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2378999999999993e-05 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497865+0000", 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057628710000000001 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497901+0000", 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5963000000000001e-05 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497950+0000", 2024-04-26T11:24:07.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8968000000000003e-05 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2636 3.d 3:b02ffd62:::200.00000010:head [write 2645468~4496 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 3.3710088790000001, 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069794832000000001, 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:07.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428235+0000", 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428244+0000", 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8580000000000006e-06 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428253+0000", 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5289999999999997e-06 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428261+0000", 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3189999999999997e-06 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:07.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492846+0000", 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064585646999999996 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492940+0000", 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3393000000000005e-05 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497957+0000", 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050173370000000002 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497986+0000", 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8946e-05 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.498030+0000", 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4561000000000002e-05 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:07.896 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:07.898 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:07.898 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:07.892+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:07.999 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:07.996+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:08.013 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:08.014 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:08.014 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:24:08.014 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:08.027 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:08.100 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:08.094+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:08.190 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:08.190 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:08.190 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:24:08.191 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:24:08.191 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:08.201 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:08.198+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:08.204 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:08.302 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:08.298+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:08.323 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:08.323 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:24:08.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:24:08.323 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:08.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.323 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 1284087~3916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.323 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:08.323 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.9062902529999999, 2024-04-26T11:24:08.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075641310000000003, 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413130+0000", 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6770000000000001e-06 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413138+0000", 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.277e-06 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413143+0000", 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5609999999999998e-06 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478754+0000", 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065610702000000007 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478846+0000", 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1525000000000002e-05 2024-04-26T11:24:08.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478916+0000", 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0630000000000006e-05 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481402+0000", 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00248577 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488675+0000", 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007273219 2024-04-26T11:24:08.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488724+0000", 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8525e-05 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488764+0000", 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0095000000000002e-05 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.328 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 1288003~3903 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.9062633200000008, 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075709753000000005, 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:08.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413158+0000", 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413175+0000", 2024-04-26T11:24:08.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7008999999999999e-05 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413181+0000", 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479410+0000", 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066228713999999994 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479498+0000", 2024-04-26T11:24:08.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7478000000000005e-05 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479629+0000", 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013174500000000001 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482049+0000", 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024196249999999999 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488812+0000", 2024-04-26T11:24:08.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067625810000000001 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488842+0000", 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0281e-05 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488859+0000", 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7306e-05 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 1291906~6986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.9062256469999994, 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079787192000000007, 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413195+0000", 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413204+0000", 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7839999999999992e-06 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413210+0000", 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8440000000000003e-06 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480166+0000", 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066956565999999995 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480263+0000", 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6997999999999995e-05 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480359+0000", 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5858000000000003e-05 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482071+0000", 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001711918 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492877+0000", 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010805465 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492942+0000", 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5456999999999993e-05 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492974+0000", 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2162000000000001e-05 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.338 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 1298892~7865 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.9061975889999996, 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080075681999999995, 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:08.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413225+0000", 2024-04-26T11:24:08.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0767e-05 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413233+0000", 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4540000000000001e-06 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413239+0000", 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0959999999999997e-06 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480790+0000", 2024-04-26T11:24:08.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067551471000000002 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480867+0000", 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6334000000000005e-05 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480982+0000", 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115395 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484440+0000", 2024-04-26T11:24:08.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003458259 2024-04-26T11:24:08.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493045+0000", 2024-04-26T11:24:08.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086047999999999993 2024-04-26T11:24:08.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493113+0000", 2024-04-26T11:24:08.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8040000000000006e-05 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493291+0000", 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017755900000000001 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 1306757~7740 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.9032795139999994, 2024-04-26T11:24:08.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.085136109000000001, 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416132+0000", 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416221+0000", 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8979000000000003e-05 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416233+0000", 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.202e-05 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416242+0000", 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3299999999999999e-06 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481553+0000", 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065311285999999996 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481603+0000", 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0191000000000001e-05 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481668+0000", 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4961000000000004e-05 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484444+0000", 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027755100000000001 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501161+0000", 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016716992999999999 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501229+0000", 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8664000000000005e-05 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501269+0000", 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9956999999999997e-05 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 1314497~14459 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.9024979109999993, 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.084463892999999998, 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:08.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416914+0000", 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416932+0000", 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416943+0000", 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0456e-05 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416950+0000", 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.345e-06 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482123+0000", 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065173399000000007 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482206+0000", 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2589000000000005e-05 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482318+0000", 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011194200000000001 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484979+0000", 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026616019999999999 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501313+0000", 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016333174999999998 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501343+0000", 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0056000000000002e-05 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501379+0000", 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5991999999999997e-05 2024-04-26T11:24:08.354 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 1328956~3568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.9005416339999996, 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082605777000000005, 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:08.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418870+0000", 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418878+0000", 2024-04-26T11:24:08.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8629999999999997e-06 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418895+0000", 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6886999999999999e-05 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418904+0000", 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5769999999999994e-06 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482753+0000", 2024-04-26T11:24:08.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063849218999999999 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482799+0000", 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5346999999999998e-05 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482864+0000", 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5124999999999997e-05 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484984+0000", 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021205820000000002 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501422+0000", 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016438066000000001 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501457+0000", 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5154999999999998e-05 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501477+0000", 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9417999999999999e-05 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 1332524~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.9005001369999999, 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082655731999999996, 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418912+0000", 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418920+0000", 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418927+0000", 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6399999999999997e-06 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418933+0000", 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9270000000000002e-06 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483248+0000", 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064314274000000005 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483345+0000", 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7065000000000007e-05 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483458+0000", 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113285 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484989+0000", 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001531012 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501510+0000", 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016520981000000001 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501535+0000", 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T11:24:08.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501568+0000", 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2808000000000002e-05 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 1333928~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.9004740449999993, 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082729079999999997, 2024-04-26T11:24:08.365 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.366 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418938+0000", 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418946+0000", 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9929999999999995e-06 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418966+0000", 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0095e-05 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418973+0000", 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483863+0000", 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064890529000000002 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483929+0000", 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5665000000000002e-05 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484000+0000", 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0903999999999997e-05 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485480+0000", 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001480084 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501598+0000", 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016118789000000001 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501631+0000", 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3015000000000002e-05 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501668+0000", 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6239999999999999e-05 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 1336693~3915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.9003244329999998, 2024-04-26T11:24:08.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082682631000000006, 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419095+0000", 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7219999999999999e-06 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419120+0000", 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4854e-05 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419127+0000", 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4540000000000004e-06 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484461+0000", 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065334619999999996 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484507+0000", 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5906999999999999e-05 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484612+0000", 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104813 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.486851+0000", 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022388479999999999 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501706+0000", 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014855419999999999 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501734+0000", 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7617999999999999e-05 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501771+0000", 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 1340608~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.375 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.8973169789999993, 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079811516999999998, 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422094+0000", 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422107+0000", 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2762000000000001e-05 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422121+0000", 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3784999999999999e-05 2024-04-26T11:24:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422134+0000", 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3304e-05 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485009+0000", 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.062874860000000005 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485053+0000", 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3949000000000002e-05 2024-04-26T11:24:08.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485172+0000", 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011921699999999999 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487692+0000", 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025201939999999999 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501818+0000", 2024-04-26T11:24:08.379 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014125499 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501864+0000", 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6403999999999998e-05 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501907+0000", 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3266000000000002e-05 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.380 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:558 3.2 3:4272d415:::200.0000000b:head [write 1343057~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.897268382, 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079859576000000002, 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422153+0000", 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909999999999999e-06 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422161+0000", 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4319999999999999e-06 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422168+0000", 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485516+0000", 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063348074000000004 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485624+0000", 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485781+0000", 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015710100000000001 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487700+0000", 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001918746 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501949+0000", 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014249114 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501973+0000", 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4627e-05 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502004+0000", 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:559 3.2 3:4272d415:::200.0000000b:head [write 1345015~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.8972393239999992, 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079931344000000001, 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422183+0000", 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8959999999999998e-06 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422190+0000", 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7669999999999998e-06 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422195+0000", 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.011e-06 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487222+0000", 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065027153000000004 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487263+0000", 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1201000000000001e-05 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487330+0000", 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6507999999999994e-05 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488866+0000", 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001536747 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502050+0000", 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013183540000000001 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502085+0000", 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4952e-05 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502105+0000", 2024-04-26T11:24:08.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9947999999999999e-05 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:560 3.2 3:4272d415:::200.0000000b:head [write 1349228~3445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.8972125010000003, 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079997483999999994, 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.391 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.392 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422208+0000", 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0309999999999998e-06 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422214+0000", 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6560000000000003e-06 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422220+0000", 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6489999999999996e-06 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487739+0000", 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065519226 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487833+0000", 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4106999999999999e-05 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487972+0000", 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013830099999999999 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492072+0000", 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040998379999999997 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502140+0000", 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010068238 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502165+0000", 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5454999999999999e-05 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502198+0000", 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2478999999999999e-05 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:561 3.2 3:4272d415:::200.0000000b:head [write 1352673~4505 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.8971855739999999, 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080048127999999996, 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422235+0000", 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422242+0000", 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7670000000000003e-06 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422248+0000", 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488886+0000", 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066638785000000006 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488982+0000", 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5387e-05 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489141+0000", 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015913400000000001 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492079+0000", 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029382509999999998 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502233+0000", 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010154379 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502259+0000", 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5029999999999999e-05 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502275+0000", 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6735000000000002e-05 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:562 3.2 3:4272d415:::200.0000000b:head [write 1357178~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.8971591950000004, 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080110050000000002, 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.401 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422253+0000", 2024-04-26T11:24:08.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422257+0000", 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422263+0000", 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0580000000000003e-06 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422268+0000", 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489892+0000", 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067623600000000006 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490047+0000", 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154933 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490335+0000", 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028846200000000002 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497761+0000", 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074257460000000004 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502307+0000", 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045457910000000004 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502331+0000", 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4601e-05 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502364+0000", 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2224000000000002e-05 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:563 3.2 3:4272d415:::200.0000000b:head [write 1358582~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.8971398480000001, 2024-04-26T11:24:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080161018000000001, 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422272+0000", 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422280+0000", 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0250000000000002e-06 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422288+0000", 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422293+0000", 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3669999999999996e-06 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491197+0000", 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068903765000000006 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491329+0000", 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013223400000000001 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491443+0000", 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114159 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497769+0000", 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063253190000000003 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502392+0000", 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004622915 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502415+0000", 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3626e-05 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502434+0000", 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8703999999999999e-05 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:564 3.2 3:4272d415:::200.0000000b:head [write 1360496~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.8971126070000004, 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080221908999999994, 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422304+0000", 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9360000000000001e-06 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422311+0000", 2024-04-26T11:24:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422317+0000", 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492152+0000", 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069834487000000001 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492258+0000", 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106351 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492423+0000", 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016443600000000001 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497775+0000", 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053519650000000002 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502465+0000", 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046902660000000002 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502490+0000", 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4777999999999999e-05 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502522+0000", 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2369999999999997e-05 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:565 3.2 3:4272d415:::200.0000000b:head [write 1362424~12956 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.8960255660000005, 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079271854000000003, 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423386+0000", 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423436+0000", 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0121999999999999e-05 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423449+0000", 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2863e-05 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423459+0000", 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493380+0000", 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069921187999999995 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493456+0000", 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6416999999999997e-05 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493584+0000", 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000128009 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499173+0000", 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055883599999999997 2024-04-26T11:24:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502578+0000", 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034056020000000002 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502625+0000", 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6285000000000002e-05 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502659+0000", 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:566 3.2 3:4272d415:::200.0000000b:head [write 1375380~4794 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.893635519, 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.078877303999999995, 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425775+0000", 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425794+0000", 2024-04-26T11:24:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425810+0000", 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.525e-05 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425821+0000", 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0981e-05 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494069+0000", 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068247996000000005 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494115+0000", 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310999999999998e-05 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494183+0000", 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7841000000000003e-05 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499177+0000", 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049940109999999996 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504563+0000", 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053863339999999996 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504614+0000", 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0334999999999998e-05 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504654+0000", 2024-04-26T11:24:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0976000000000002e-05 2024-04-26T11:24:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:08.427 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:08.428 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:24:08.429 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:08.431 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:08.426+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:08.530 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:08.528+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:08.562 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:08.562 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:08.562 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:24:08.562 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:08.576 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:08.631 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:08.628+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:08.699 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:08.700 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:08.700 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:24:08.700 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:24:08.700 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:08.715 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:08.760 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:08.758+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:08.832 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:08.828+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:08.860 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:24:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:24:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:08.860 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2615 3.d 3:b02ffd62:::200.00000010:head [write 2546869~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4515377330000003, 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070123572999999995, 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.861 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406472+0000", 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.862 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406483+0000", 2024-04-26T11:24:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1219999999999999e-05 2024-04-26T11:24:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406499+0000", 2024-04-26T11:24:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5452999999999999e-05 2024-04-26T11:24:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.863 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406511+0000", 2024-04-26T11:24:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1769e-05 2024-04-26T11:24:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472319+0000", 2024-04-26T11:24:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065808723 2024-04-26T11:24:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472411+0000", 2024-04-26T11:24:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1896000000000002e-05 2024-04-26T11:24:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476347+0000", 2024-04-26T11:24:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039353060000000004 2024-04-26T11:24:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.865 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476433+0000", 2024-04-26T11:24:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6487000000000001e-05 2024-04-26T11:24:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476597+0000", 2024-04-26T11:24:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163461 2024-04-26T11:24:08.866 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2616 3.d 3:b02ffd62:::200.00000010:head [write 2548776~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4514910250000002, 2024-04-26T11:24:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070199544000000003, 2024-04-26T11:24:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.867 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.868 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406519+0000", 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406531+0000", 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.172e-05 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406546+0000", 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5685999999999999e-05 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.869 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406556+0000", 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0071000000000001e-05 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473252+0000", 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066695915999999994 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473332+0000", 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:24:08.870 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476611+0000", 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032787630000000001 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476656+0000", 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5096999999999999e-05 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476719+0000", 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3332999999999998e-05 2024-04-26T11:24:08.871 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2617 3.d 3:b02ffd62:::200.00000010:head [write 2552653~1113 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4514454150000002, 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073674075000000006, 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.872 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406564+0000", 2024-04-26T11:24:08.873 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406570+0000", 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6520000000000003e-06 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406583+0000", 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2679e-05 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.874 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406594+0000", 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1032999999999999e-05 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474020+0000", 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.067425944000000002 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474102+0000", 2024-04-26T11:24:08.875 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2806999999999995e-05 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480120+0000", 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060174729999999997 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480169+0000", 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9570999999999997e-05 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.876 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480239+0000", 2024-04-26T11:24:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0026999999999999e-05 2024-04-26T11:24:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2618 3.d 3:b02ffd62:::200.00000010:head [write 2553766~1050 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:08.877 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.44866575, 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071002984000000005, 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:08.878 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409344+0000", 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409353+0000", 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9150000000000002e-06 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.879 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409371+0000", 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8904000000000001e-05 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409384+0000", 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2566e-05 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065596495000000005 2024-04-26T11:24:08.880 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475126+0000", 2024-04-26T11:24:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145329 2024-04-26T11:24:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480249+0000", 2024-04-26T11:24:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005123102 2024-04-26T11:24:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.881 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480288+0000", 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9285000000000001e-05 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480348+0000", 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9728999999999997e-05 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.882 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:14995 4.5 4:a0840aa3:::10000003880.00000000:head [write 85470~33722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4486064919999997, 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071045135999999995, 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14995 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.883 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.884 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409431+0000", 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7233000000000002e-05 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409440+0000", 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5859999999999994e-06 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409446+0000", 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9429999999999997e-06 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.885 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065534244000000005 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475214+0000", 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023348600000000001 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480357+0000", 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051425710000000003 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.886 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480394+0000", 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7289000000000002e-05 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480449+0000", 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5507000000000002e-05 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2619 3.d 3:b02ffd62:::200.00000010:head [write 2554816~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.887 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4479804019999998, 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071786804999999995, 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.888 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410029+0000", 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410037+0000", 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2760000000000003e-06 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410047+0000", 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0555e-05 2024-04-26T11:24:08.889 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410054+0000", 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9399999999999996e-06 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476866+0000", 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066812270000000007 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.890 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.477059+0000", 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019292199999999999 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481712+0000", 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046527210000000003 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481754+0000", 2024-04-26T11:24:08.891 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2017000000000001e-05 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481817+0000", 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3054999999999999e-05 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2620 3.d 3:b02ffd62:::200.00000010:head [write 2557602~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.892 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4449886630000002, 2024-04-26T11:24:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073204069999999996, 2024-04-26T11:24:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.893 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413021+0000", 2024-04-26T11:24:08.894 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413038+0000", 2024-04-26T11:24:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6787999999999999e-05 2024-04-26T11:24:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413052+0000", 2024-04-26T11:24:08.895 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4606999999999999e-05 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413062+0000", 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9669999999999996e-06 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478002+0000", 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064940093000000004 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.896 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478080+0000", 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7985999999999995e-05 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486106+0000", 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080256040000000004 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.897 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486157+0000", 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1063000000000002e-05 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486226+0000", 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9078000000000005e-05 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.898 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2621 3.d 3:b02ffd62:::200.00000010:head [write 2559526~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4421624399999997, 2024-04-26T11:24:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070487039000000001, 2024-04-26T11:24:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.899 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415847+0000", 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.900 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415855+0000", 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6929999999999996e-06 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415888+0000", 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2954999999999999e-05 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415902+0000", 2024-04-26T11:24:08.901 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3706000000000001e-05 2024-04-26T11:24:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478597+0000", 2024-04-26T11:24:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062695089999999995 2024-04-26T11:24:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478709+0000", 2024-04-26T11:24:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111777 2024-04-26T11:24:08.902 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486236+0000", 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075266700000000001 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486276+0000", 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9966999999999999e-05 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486335+0000", 2024-04-26T11:24:08.903 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9713000000000002e-05 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2622 3.d 3:b02ffd62:::200.00000010:head [write 2561446~5986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4420450999999996, 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.072007783000000006, 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.904 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.905 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415965+0000", 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415979+0000", 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4697e-05 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415993+0000", 2024-04-26T11:24:08.906 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3947e-05 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416003+0000", 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479418+0000", 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063414807000000004 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.907 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479500+0000", 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1631999999999994e-05 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487756+0000", 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082565529999999998 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487831+0000", 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4449999999999994e-05 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.908 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487973+0000", 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014249999999999999 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2623 3.d 3:b02ffd62:::200.00000010:head [write 2567432~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4416737160000004, 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071791032000000005, 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.909 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416336+0000", 2024-04-26T11:24:08.910 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416343+0000", 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.827e-06 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416354+0000", 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1168e-05 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416364+0000", 2024-04-26T11:24:08.911 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7520000000000008e-06 2024-04-26T11:24:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480382+0000", 2024-04-26T11:24:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064018284999999994 2024-04-26T11:24:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480487+0000", 2024-04-26T11:24:08.912 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010463099999999999 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487984+0000", 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074974000000000004 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488035+0000", 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0702999999999999e-05 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.913 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488128+0000", 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3246999999999997e-05 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2624 3.d 3:b02ffd62:::200.00000010:head [write 2569339~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4416331019999999, 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071901926000000005, 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.914 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416377+0000", 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.915 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416380+0000", 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.287e-06 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416386+0000", 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4559999999999999e-06 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416390+0000", 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0659999999999997e-06 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.916 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481222+0000", 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064831753000000006 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481290+0000", 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8425999999999998e-05 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488139+0000", 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068488289999999999 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.917 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488191+0000", 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1629000000000003e-05 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488280+0000", 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9009000000000001e-05 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.918 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:15009 4.1d 4:b80503fc:::10000003240.00000000:head [write 897504~130300] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4399473189999998, 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069065685000000002, 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 15009 2024-04-26T11:24:08.919 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.920 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418062+0000", 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418222+0000", 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016041800000000001 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418233+0000", 2024-04-26T11:24:08.921 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0604999999999999e-05 2024-04-26T11:24:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418240+0000", 2024-04-26T11:24:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:24:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481210+0000", 2024-04-26T11:24:08.922 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062970672000000005 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481312+0000", 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101834 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487023+0000", 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057108910000000001 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.923 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487065+0000", 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1553e-05 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487129+0000", 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4394999999999996e-05 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.924 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2625 3.d 3:b02ffd62:::200.00000010:head [write 2571246~11889 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4396310979999996, 2024-04-26T11:24:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069981421000000002, 2024-04-26T11:24:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.925 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418379+0000", 2024-04-26T11:24:08.926 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418393+0000", 2024-04-26T11:24:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4819e-05 2024-04-26T11:24:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418405+0000", 2024-04-26T11:24:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1756999999999999e-05 2024-04-26T11:24:08.927 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418413+0000", 2024-04-26T11:24:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6839999999999996e-06 2024-04-26T11:24:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481846+0000", 2024-04-26T11:24:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063433324999999999 2024-04-26T11:24:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.928 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481927+0000", 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0531000000000005e-05 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488289+0000", 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063617559999999997 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.929 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488322+0000", 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3130999999999998e-05 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488361+0000", 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9385000000000003e-05 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2626 3.d 3:b02ffd62:::200.00000010:head [write 2583135~1955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.930 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.438647789, 2024-04-26T11:24:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071468652999999993, 2024-04-26T11:24:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.931 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419362+0000", 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419368+0000", 2024-04-26T11:24:08.932 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2260000000000002e-06 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419379+0000", 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0920999999999999e-05 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419388+0000", 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1740000000000006e-06 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482729+0000", 2024-04-26T11:24:08.933 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063340152999999996 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482840+0000", 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011119400000000001 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490744+0000", 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079037740000000006 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.934 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490781+0000", 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.735e-05 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490832+0000", 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0729000000000002e-05 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.935 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2627 3.d 3:b02ffd62:::200.00000010:head [write 2585090~9888 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4371659680000004, 2024-04-26T11:24:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070072738999999995, 2024-04-26T11:24:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.936 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.937 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420844+0000", 2024-04-26T11:24:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420857+0000", 2024-04-26T11:24:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2974e-05 2024-04-26T11:24:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.938 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420868+0000", 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1063999999999999e-05 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420876+0000", 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2060000000000007e-06 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483561+0000", 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062684472000000005 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.939 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483646+0000", 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5006000000000006e-05 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490839+0000", 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071929979999999999 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490872+0000", 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3550999999999998e-05 2024-04-26T11:24:08.940 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490917+0000", 2024-04-26T11:24:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5426000000000002e-05 2024-04-26T11:24:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2628 3.d 3:b02ffd62:::200.00000010:head [write 2594978~23633 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.941 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4357332810000001, 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068718354999999995, 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:08.942 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422276+0000", 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422309+0000", 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.943 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422319+0000", 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0254e-05 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422326+0000", 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4509999999999997e-06 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484314+0000", 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.061988468999999997 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.944 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484428+0000", 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011424799999999999 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490923+0000", 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064948699999999998 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490950+0000", 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7163000000000001e-05 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.945 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490996+0000", 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5423000000000002e-05 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2629 3.d 3:b02ffd62:::200.00000010:head [write 2618611~3263 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.435676645, 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068771545000000003, 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.946 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.947 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422337+0000", 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5659999999999998e-06 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422342+0000", 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000002e-06 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422346+0000", 2024-04-26T11:24:08.948 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8419999999999998e-06 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485397+0000", 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063051691000000007 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485487+0000", 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9986000000000002e-05 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.949 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491001+0000", 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055139899999999999 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491030+0000", 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8314999999999999e-05 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491106+0000", 2024-04-26T11:24:08.950 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5845000000000003e-05 2024-04-26T11:24:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2634 3.d 3:b02ffd62:::200.00000010:head [write 2639450~2419 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4317641090000004, 2024-04-26T11:24:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070097349000000003, 2024-04-26T11:24:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.951 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.952 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426246+0000", 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426250+0000", 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4750000000000004e-06 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426257+0000", 2024-04-26T11:24:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4320000000000004e-06 2024-04-26T11:24:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426261+0000", 2024-04-26T11:24:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.732e-06 2024-04-26T11:24:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491320+0000", 2024-04-26T11:24:08.954 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065059326000000001 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491435+0000", 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011479 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496253+0000", 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004818676 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.955 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496292+0000", 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8640999999999998e-05 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496344+0000", 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1870000000000003e-05 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.956 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2635 3.d 3:b02ffd62:::200.00000010:head [write 2641869~3599 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4317078480000003, 2024-04-26T11:24:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071646847999999999, 2024-04-26T11:24:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.957 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426302+0000", 2024-04-26T11:24:08.958 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426306+0000", 2024-04-26T11:24:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6169999999999998e-06 2024-04-26T11:24:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426314+0000", 2024-04-26T11:24:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1079999999999993e-06 2024-04-26T11:24:08.959 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426318+0000", 2024-04-26T11:24:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3769999999999998e-06 2024-04-26T11:24:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492040+0000", 2024-04-26T11:24:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065721110999999999 2024-04-26T11:24:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.960 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492102+0000", 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2378999999999993e-05 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497865+0000", 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057628710000000001 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497901+0000", 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5963000000000001e-05 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.961 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497950+0000", 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8968000000000003e-05 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2636 3.d 3:b02ffd62:::200.00000010:head [write 2645468~4496 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 4.4297751190000003, 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069794832000000001, 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:08.962 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428235+0000", 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:08.963 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428244+0000", 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8580000000000006e-06 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428253+0000", 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5289999999999997e-06 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428261+0000", 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3189999999999997e-06 2024-04-26T11:24:08.964 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492846+0000", 2024-04-26T11:24:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064585646999999996 2024-04-26T11:24:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492940+0000", 2024-04-26T11:24:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3393000000000005e-05 2024-04-26T11:24:08.965 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497957+0000", 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050173370000000002 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497986+0000", 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8946e-05 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.498030+0000", 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4561000000000002e-05 2024-04-26T11:24:08.966 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:08.967 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:08.967 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:08.968 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:08.969 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:08.964+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:08.985 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T11:24:08.985 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T11:24:09.069 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:09.064+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:09.096 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:09.096 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:09.096 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:24:09.096 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:09.111 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:09.202 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:09.200+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:09.271 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:09.268+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:09.279 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:24:09.279 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:24:09.279 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:09.294 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:09.378 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:09.376+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:09.467 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:24:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:24:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 1284087~3916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.467 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.050315595000001, 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075641310000000003, 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:09.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413130+0000", 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6770000000000001e-06 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413138+0000", 2024-04-26T11:24:09.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.277e-06 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413143+0000", 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5609999999999998e-06 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478754+0000", 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065610702000000007 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478846+0000", 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1525000000000002e-05 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478916+0000", 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0630000000000006e-05 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481402+0000", 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00248577 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488675+0000", 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007273219 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488724+0000", 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8525e-05 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488764+0000", 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0095000000000002e-05 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 1288003~3903 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.050288662, 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075709753000000005, 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413158+0000", 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-04-26T11:24:09.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413175+0000", 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7008999999999999e-05 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413181+0000", 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479410+0000", 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066228713999999994 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479498+0000", 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7478000000000005e-05 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479629+0000", 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013174500000000001 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482049+0000", 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024196249999999999 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488812+0000", 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067625810000000001 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488842+0000", 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0281e-05 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488859+0000", 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7306e-05 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.477 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 1291906~6986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.050250989, 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079787192000000007, 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413195+0000", 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413204+0000", 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7839999999999992e-06 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413210+0000", 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8440000000000003e-06 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480166+0000", 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066956565999999995 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480263+0000", 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6997999999999995e-05 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480359+0000", 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5858000000000003e-05 2024-04-26T11:24:09.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482071+0000", 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001711918 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492877+0000", 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010805465 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492942+0000", 2024-04-26T11:24:09.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5456999999999993e-05 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492974+0000", 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2162000000000001e-05 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 1298892~7865 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.050222931, 2024-04-26T11:24:09.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080075681999999995, 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413225+0000", 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0767e-05 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413233+0000", 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4540000000000001e-06 2024-04-26T11:24:09.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413239+0000", 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0959999999999997e-06 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480790+0000", 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067551471000000002 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480867+0000", 2024-04-26T11:24:09.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6334000000000005e-05 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480982+0000", 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115395 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484440+0000", 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003458259 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493045+0000", 2024-04-26T11:24:09.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086047999999999993 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493113+0000", 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8040000000000006e-05 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493291+0000", 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017755900000000001 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 1306757~7740 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.047304856, 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.085136109000000001, 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416132+0000", 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416221+0000", 2024-04-26T11:24:09.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8979000000000003e-05 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416233+0000", 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.202e-05 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416242+0000", 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3299999999999999e-06 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481553+0000", 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065311285999999996 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481603+0000", 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0191000000000001e-05 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481668+0000", 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4961000000000004e-05 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484444+0000", 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027755100000000001 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501161+0000", 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016716992999999999 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501229+0000", 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8664000000000005e-05 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501269+0000", 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9956999999999997e-05 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 1314497~14459 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.046523253, 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.084463892999999998, 2024-04-26T11:24:09.494 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416914+0000", 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416932+0000", 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416943+0000", 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0456e-05 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416950+0000", 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.345e-06 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482123+0000", 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065173399000000007 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482206+0000", 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2589000000000005e-05 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482318+0000", 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011194200000000001 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484979+0000", 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026616019999999999 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501313+0000", 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016333174999999998 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501343+0000", 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0056000000000002e-05 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501379+0000", 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5991999999999997e-05 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.499 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 1328956~3568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.044566976, 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082605777000000005, 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:09.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418870+0000", 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418878+0000", 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8629999999999997e-06 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418895+0000", 2024-04-26T11:24:09.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6886999999999999e-05 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418904+0000", 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5769999999999994e-06 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482753+0000", 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063849218999999999 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482799+0000", 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5346999999999998e-05 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482864+0000", 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5124999999999997e-05 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484984+0000", 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021205820000000002 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501422+0000", 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016438066000000001 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501457+0000", 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5154999999999998e-05 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501477+0000", 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9417999999999999e-05 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.504 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 1332524~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.044525479000001, 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082655731999999996, 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418912+0000", 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418920+0000", 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:09.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418927+0000", 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6399999999999997e-06 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418933+0000", 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9270000000000002e-06 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483248+0000", 2024-04-26T11:24:09.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064314274000000005 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483345+0000", 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7065000000000007e-05 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483458+0000", 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113285 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484989+0000", 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001531012 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501510+0000", 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016520981000000001 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501535+0000", 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501568+0000", 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2808000000000002e-05 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 1333928~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.044499387, 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082729079999999997, 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.510 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:09.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:09.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418938+0000", 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418946+0000", 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9929999999999995e-06 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418966+0000", 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0095e-05 2024-04-26T11:24:09.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418973+0000", 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483863+0000", 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064890529000000002 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483929+0000", 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5665000000000002e-05 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484000+0000", 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0903999999999997e-05 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485480+0000", 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001480084 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501598+0000", 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016118789000000001 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501631+0000", 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3015000000000002e-05 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501668+0000", 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6239999999999999e-05 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.515 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 1336693~3915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.044349775000001, 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082682631000000006, 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419095+0000", 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7219999999999999e-06 2024-04-26T11:24:09.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419120+0000", 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4854e-05 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419127+0000", 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4540000000000004e-06 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484461+0000", 2024-04-26T11:24:09.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065334619999999996 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484507+0000", 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5906999999999999e-05 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484612+0000", 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104813 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.486851+0000", 2024-04-26T11:24:09.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022388479999999999 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501706+0000", 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014855419999999999 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501734+0000", 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7617999999999999e-05 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501771+0000", 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 1340608~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.041342321, 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079811516999999998, 2024-04-26T11:24:09.521 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.522 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.522 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:09.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422094+0000", 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422107+0000", 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2762000000000001e-05 2024-04-26T11:24:09.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422121+0000", 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3784999999999999e-05 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422134+0000", 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3304e-05 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485009+0000", 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.062874860000000005 2024-04-26T11:24:09.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485053+0000", 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3949000000000002e-05 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485172+0000", 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011921699999999999 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487692+0000", 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025201939999999999 2024-04-26T11:24:09.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501818+0000", 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014125499 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501864+0000", 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6403999999999998e-05 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501907+0000", 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3266000000000002e-05 2024-04-26T11:24:09.526 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:558 3.2 3:4272d415:::200.0000000b:head [write 1343057~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.041293724000001, 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079859576000000002, 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422153+0000", 2024-04-26T11:24:09.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909999999999999e-06 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422161+0000", 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4319999999999999e-06 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422168+0000", 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485516+0000", 2024-04-26T11:24:09.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063348074000000004 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485624+0000", 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485781+0000", 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015710100000000001 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487700+0000", 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001918746 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501949+0000", 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014249114 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501973+0000", 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4627e-05 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502004+0000", 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:559 3.2 3:4272d415:::200.0000000b:head [write 1345015~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.041264666, 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079931344000000001, 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.532 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:09.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:09.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422183+0000", 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8959999999999998e-06 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422190+0000", 2024-04-26T11:24:09.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7669999999999998e-06 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422195+0000", 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.011e-06 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487222+0000", 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065027153000000004 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487263+0000", 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1201000000000001e-05 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487330+0000", 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6507999999999994e-05 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488866+0000", 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001536747 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502050+0000", 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013183540000000001 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502085+0000", 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4952e-05 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502105+0000", 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9947999999999999e-05 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:560 3.2 3:4272d415:::200.0000000b:head [write 1349228~3445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.041237842999999, 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079997483999999994, 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422208+0000", 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0309999999999998e-06 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422214+0000", 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6560000000000003e-06 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422220+0000", 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6489999999999996e-06 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487739+0000", 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065519226 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487833+0000", 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4106999999999999e-05 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487972+0000", 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013830099999999999 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492072+0000", 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040998379999999997 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502140+0000", 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010068238 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502165+0000", 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5454999999999999e-05 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502198+0000", 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2478999999999999e-05 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.542 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:561 3.2 3:4272d415:::200.0000000b:head [write 1352673~4505 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.041210916000001, 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080048127999999996, 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422235+0000", 2024-04-26T11:24:09.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422242+0000", 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7670000000000003e-06 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422248+0000", 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488886+0000", 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066638785000000006 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488982+0000", 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5387e-05 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489141+0000", 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015913400000000001 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492079+0000", 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029382509999999998 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502233+0000", 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010154379 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502259+0000", 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5029999999999999e-05 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502275+0000", 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6735000000000002e-05 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:562 3.2 3:4272d415:::200.0000000b:head [write 1357178~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.041184536999999, 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080110050000000002, 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422253+0000", 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422257+0000", 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422263+0000", 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0580000000000003e-06 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422268+0000", 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489892+0000", 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067623600000000006 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490047+0000", 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154933 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490335+0000", 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028846200000000002 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497761+0000", 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074257460000000004 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502307+0000", 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045457910000000004 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502331+0000", 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4601e-05 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502364+0000", 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2224000000000002e-05 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:563 3.2 3:4272d415:::200.0000000b:head [write 1358582~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.041165189999999, 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080161018000000001, 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422272+0000", 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422280+0000", 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0250000000000002e-06 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422288+0000", 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422293+0000", 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3669999999999996e-06 2024-04-26T11:24:09.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491197+0000", 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068903765000000006 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491329+0000", 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013223400000000001 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491443+0000", 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114159 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497769+0000", 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063253190000000003 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502392+0000", 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004622915 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502415+0000", 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3626e-05 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502434+0000", 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8703999999999999e-05 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:564 3.2 3:4272d415:::200.0000000b:head [write 1360496~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.041137948999999, 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080221908999999994, 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.558 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:09.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422304+0000", 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9360000000000001e-06 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422311+0000", 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422317+0000", 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:24:09.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492152+0000", 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069834487000000001 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492258+0000", 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106351 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492423+0000", 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016443600000000001 2024-04-26T11:24:09.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497775+0000", 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053519650000000002 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502465+0000", 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046902660000000002 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502490+0000", 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4777999999999999e-05 2024-04-26T11:24:09.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502522+0000", 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2369999999999997e-05 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:565 3.2 3:4272d415:::200.0000000b:head [write 1362424~12956 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.040050908, 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079271854000000003, 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.563 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423386+0000", 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423436+0000", 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0121999999999999e-05 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423449+0000", 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2863e-05 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423459+0000", 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493380+0000", 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069921187999999995 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493456+0000", 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6416999999999997e-05 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493584+0000", 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000128009 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499173+0000", 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055883599999999997 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502578+0000", 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034056020000000002 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502625+0000", 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6285000000000002e-05 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502659+0000", 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:566 3.2 3:4272d415:::200.0000000b:head [write 1375380~4794 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:09.568 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.037660861000001, 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.078877303999999995, 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425775+0000", 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425794+0000", 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425810+0000", 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.525e-05 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425821+0000", 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0981e-05 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494069+0000", 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068247996000000005 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494115+0000", 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310999999999998e-05 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494183+0000", 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7841000000000003e-05 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499177+0000", 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049940109999999996 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504563+0000", 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053863339999999996 2024-04-26T11:24:09.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504614+0000", 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0334999999999998e-05 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504654+0000", 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0976000000000002e-05 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:09.573 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:09.574 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:09.575 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:09.572+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:09.575 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:09.583 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:24:09.676 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:09.670+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:09.708 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:09.708 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:09.708 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:24:09.709 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:09.713 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:24:09.723 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:09.734 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:24:09.735 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:24:09.756 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:24:09.756 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:24:09.759 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:24:09.759 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:24:09.776 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:09.772+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:09.877 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:09.872+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:09.925 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:09.926 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:09.943 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:09.989 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:09.986+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:10.057 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:10.057 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:10.071 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:10.119 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:10.116+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:10.180 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:10.174+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:10.202 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:10.202 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:10.217 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:10.302 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:10.300+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:10.381 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:10.376+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:10.382 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:10.382 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:10.397 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:10.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:24:10.482 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:10.478+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:10.562 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:10.562 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:10.576 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:10.584 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:10.580+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:10.684 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:10.678+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:10.714 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:10.715 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:10.730 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:10.821 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:10.818+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:10.887 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:10.884+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:10.900 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:10.900 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:10.915 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:10.987 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:10.984+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:11.088 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:11.086+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:11.089 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:11.089 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:11.105 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:11.189 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:11.186+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:11.238 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:11.238 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:11.251 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:11.290 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:11.286+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:11.373 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:11.373 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:11.387 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:11.390 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:11.386+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:11.437 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:24:11.491 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:11.486+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:11.507 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:11.508 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:11.522 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:11.592 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:11.586+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:11.662 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:11.662 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:11.677 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:11.693 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:11.692+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:11.760 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:24:11.794 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:11.790+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:11.862 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:11.862 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:11.881 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:11.886 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:24:11.894 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:11.892+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:11.906 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:24:11.906 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:24:11.926 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:24:11.926 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:24:11.929 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:24:11.929 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:24:11.996 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:11.990+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:12.043 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:12.044 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:24:12.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:24:12.044 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:12.044 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.044 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2615 3.d 3:b02ffd62:::200.00000010:head [write 2546869~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.044 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:12.044 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6357255540000004, 2024-04-26T11:24:12.044 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070123572999999995, 2024-04-26T11:24:12.044 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.044 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.044 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406472+0000", 2024-04-26T11:24:12.045 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406483+0000", 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1219999999999999e-05 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406499+0000", 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5452999999999999e-05 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.046 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406511+0000", 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1769e-05 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472319+0000", 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065808723 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472411+0000", 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1896000000000002e-05 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.047 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476347+0000", 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039353060000000004 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476433+0000", 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6487000000000001e-05 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476597+0000", 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163461 2024-04-26T11:24:12.048 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2616 3.d 3:b02ffd62:::200.00000010:head [write 2548776~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6356788460000002, 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070199544000000003, 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:12.049 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406519+0000", 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.050 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406531+0000", 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.172e-05 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406546+0000", 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5685999999999999e-05 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406556+0000", 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0071000000000001e-05 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.051 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473252+0000", 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066695915999999994 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473332+0000", 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476611+0000", 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032787630000000001 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.052 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476656+0000", 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5096999999999999e-05 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476719+0000", 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3332999999999998e-05 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2617 3.d 3:b02ffd62:::200.00000010:head [write 2552653~1113 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:12.053 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6356332360000003, 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073674075000000006, 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.054 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406564+0000", 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406570+0000", 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6520000000000003e-06 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406583+0000", 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2679e-05 2024-04-26T11:24:12.055 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406594+0000", 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1032999999999999e-05 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474020+0000", 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.067425944000000002 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474102+0000", 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2806999999999995e-05 2024-04-26T11:24:12.056 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480120+0000", 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060174729999999997 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480169+0000", 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9570999999999997e-05 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480239+0000", 2024-04-26T11:24:12.057 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0026999999999999e-05 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2618 3.d 3:b02ffd62:::200.00000010:head [write 2553766~1050 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6328535710000001, 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071002984000000005, 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.058 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.059 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409344+0000", 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409353+0000", 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9150000000000002e-06 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409371+0000", 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8904000000000001e-05 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.060 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409384+0000", 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2566e-05 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065596495000000005 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475126+0000", 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145329 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.061 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480249+0000", 2024-04-26T11:24:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005123102 2024-04-26T11:24:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480288+0000", 2024-04-26T11:24:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9285000000000001e-05 2024-04-26T11:24:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.062 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480348+0000", 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9728999999999997e-05 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:14995 4.5 4:a0840aa3:::10000003880.00000000:head [write 85470~33722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6327943129999998, 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071045135999999995, 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:12.063 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14995 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.064 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409431+0000", 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7233000000000002e-05 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409440+0000", 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5859999999999994e-06 2024-04-26T11:24:12.065 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409446+0000", 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9429999999999997e-06 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065534244000000005 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475214+0000", 2024-04-26T11:24:12.066 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023348600000000001 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480357+0000", 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051425710000000003 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480394+0000", 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7289000000000002e-05 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.067 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480449+0000", 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5507000000000002e-05 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2619 3.d 3:b02ffd62:::200.00000010:head [write 2554816~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6321682229999999, 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071786804999999995, 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.068 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410029+0000", 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410037+0000", 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2760000000000003e-06 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410047+0000", 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0555e-05 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410054+0000", 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9399999999999996e-06 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476866+0000", 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066812270000000007 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.477059+0000", 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019292199999999999 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481712+0000", 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046527210000000003 2024-04-26T11:24:12.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481754+0000", 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2017000000000001e-05 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481817+0000", 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3054999999999999e-05 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2620 3.d 3:b02ffd62:::200.00000010:head [write 2557602~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6291764840000003, 2024-04-26T11:24:12.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073204069999999996, 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.074 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413021+0000", 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413038+0000", 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6787999999999999e-05 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413052+0000", 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4606999999999999e-05 2024-04-26T11:24:12.075 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413062+0000", 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9669999999999996e-06 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478002+0000", 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064940093000000004 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478080+0000", 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7985999999999995e-05 2024-04-26T11:24:12.076 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486106+0000", 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080256040000000004 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486157+0000", 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1063000000000002e-05 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486226+0000", 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9078000000000005e-05 2024-04-26T11:24:12.077 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2621 3.d 3:b02ffd62:::200.00000010:head [write 2559526~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6263502609999998, 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070487039000000001, 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.078 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415847+0000", 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.079 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415855+0000", 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6929999999999996e-06 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415888+0000", 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2954999999999999e-05 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415902+0000", 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3706000000000001e-05 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.080 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478597+0000", 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062695089999999995 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478709+0000", 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111777 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486236+0000", 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075266700000000001 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.081 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486276+0000", 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9966999999999999e-05 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486335+0000", 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9713000000000002e-05 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2622 3.d 3:b02ffd62:::200.00000010:head [write 2561446~5986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.082 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6262329209999997, 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.072007783000000006, 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:12.083 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415965+0000", 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415979+0000", 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4697e-05 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415993+0000", 2024-04-26T11:24:12.084 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3947e-05 2024-04-26T11:24:12.085 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.085 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.085 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.086 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416003+0000", 2024-04-26T11:24:12.086 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:24:12.086 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479418+0000", 2024-04-26T11:24:12.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063414807000000004 2024-04-26T11:24:12.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.087 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.087 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479500+0000", 2024-04-26T11:24:12.087 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1631999999999994e-05 2024-04-26T11:24:12.087 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.087 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487756+0000", 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082565529999999998 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487831+0000", 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4449999999999994e-05 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487973+0000", 2024-04-26T11:24:12.088 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014249999999999999 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2623 3.d 3:b02ffd62:::200.00000010:head [write 2567432~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6258615370000005, 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071791032000000005, 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.089 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.090 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416336+0000", 2024-04-26T11:24:12.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416343+0000", 2024-04-26T11:24:12.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.827e-06 2024-04-26T11:24:12.091 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.091 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.091 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.091 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416354+0000", 2024-04-26T11:24:12.091 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1168e-05 2024-04-26T11:24:12.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416364+0000", 2024-04-26T11:24:12.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7520000000000008e-06 2024-04-26T11:24:12.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.092 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.092 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.092 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480382+0000", 2024-04-26T11:24:12.092 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064018284999999994 2024-04-26T11:24:12.092 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480487+0000", 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010463099999999999 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487984+0000", 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074974000000000004 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.093 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488035+0000", 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0702999999999999e-05 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488128+0000", 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3246999999999997e-05 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.094 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2624 3.d 3:b02ffd62:::200.00000010:head [write 2569339~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.625820923, 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071901926000000005, 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.095 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:12.096 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.096 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.096 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.096 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.096 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416377+0000", 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416380+0000", 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.287e-06 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416386+0000", 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4559999999999999e-06 2024-04-26T11:24:12.097 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416390+0000", 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0659999999999997e-06 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481222+0000", 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064831753000000006 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.098 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481290+0000", 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8425999999999998e-05 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488139+0000", 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068488289999999999 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488191+0000", 2024-04-26T11:24:12.099 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1629000000000003e-05 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488280+0000", 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9009000000000001e-05 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:15009 4.1d 4:b80503fc:::10000003240.00000000:head [write 897504~130300] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:12.100 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6241351399999999, 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069065685000000002, 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 15009 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.101 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418062+0000", 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:12.102 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418222+0000", 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016041800000000001 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418233+0000", 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0604999999999999e-05 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.103 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418240+0000", 2024-04-26T11:24:12.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:24:12.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481210+0000", 2024-04-26T11:24:12.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062970672000000005 2024-04-26T11:24:12.104 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.104 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.104 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.104 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481312+0000", 2024-04-26T11:24:12.104 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101834 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487023+0000", 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057108910000000001 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487065+0000", 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1553e-05 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.105 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.106 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487129+0000", 2024-04-26T11:24:12.106 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4394999999999996e-05 2024-04-26T11:24:12.106 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.106 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.106 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.107 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.107 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2625 3.d 3:b02ffd62:::200.00000010:head [write 2571246~11889 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.107 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:12.107 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6238189189999996, 2024-04-26T11:24:12.107 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069981421000000002, 2024-04-26T11:24:12.107 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.107 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.107 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.107 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418379+0000", 2024-04-26T11:24:12.108 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418393+0000", 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4819e-05 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418405+0000", 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1756999999999999e-05 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.109 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418413+0000", 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6839999999999996e-06 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481846+0000", 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063433324999999999 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481927+0000", 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0531000000000005e-05 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.110 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488289+0000", 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063617559999999997 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488322+0000", 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3130999999999998e-05 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488361+0000", 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9385000000000003e-05 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.111 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2626 3.d 3:b02ffd62:::200.00000010:head [write 2583135~1955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6228356100000001, 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071468652999999993, 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.112 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419362+0000", 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419368+0000", 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2260000000000002e-06 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.113 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419379+0000", 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0920999999999999e-05 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419388+0000", 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1740000000000006e-06 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482729+0000", 2024-04-26T11:24:12.114 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063340152999999996 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482840+0000", 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011119400000000001 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490744+0000", 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079037740000000006 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.115 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490781+0000", 2024-04-26T11:24:12.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.735e-05 2024-04-26T11:24:12.116 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.116 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.116 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.116 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490832+0000", 2024-04-26T11:24:12.116 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0729000000000002e-05 2024-04-26T11:24:12.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.116 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.116 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.117 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.117 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.117 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2627 3.d 3:b02ffd62:::200.00000010:head [write 2585090~9888 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.117 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:12.117 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6213537890000005, 2024-04-26T11:24:12.117 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070072738999999995, 2024-04-26T11:24:12.117 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.117 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.117 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.118 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420844+0000", 2024-04-26T11:24:12.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.119 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420857+0000", 2024-04-26T11:24:12.119 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2974e-05 2024-04-26T11:24:12.119 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.119 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.119 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420868+0000", 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1063999999999999e-05 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420876+0000", 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2060000000000007e-06 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483561+0000", 2024-04-26T11:24:12.120 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062684472000000005 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483646+0000", 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5006000000000006e-05 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490839+0000", 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071929979999999999 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.121 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490872+0000", 2024-04-26T11:24:12.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3550999999999998e-05 2024-04-26T11:24:12.122 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.122 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.122 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.122 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490917+0000", 2024-04-26T11:24:12.122 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5426000000000002e-05 2024-04-26T11:24:12.122 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.122 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2628 3.d 3:b02ffd62:::200.00000010:head [write 2594978~23633 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6199211020000002, 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068718354999999995, 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.123 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:12.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:12.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.124 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.124 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.124 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.124 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422276+0000", 2024-04-26T11:24:12.124 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422309+0000", 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422319+0000", 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0254e-05 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.125 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422326+0000", 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4509999999999997e-06 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484314+0000", 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.061988468999999997 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484428+0000", 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011424799999999999 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.126 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490923+0000", 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064948699999999998 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490950+0000", 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7163000000000001e-05 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490996+0000", 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5423000000000002e-05 2024-04-26T11:24:12.127 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2629 3.d 3:b02ffd62:::200.00000010:head [write 2618611~3263 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6198644660000001, 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068771545000000003, 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.128 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.129 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422337+0000", 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5659999999999998e-06 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422342+0000", 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000002e-06 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422346+0000", 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8419999999999998e-06 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.130 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485397+0000", 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063051691000000007 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485487+0000", 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9986000000000002e-05 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491001+0000", 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055139899999999999 2024-04-26T11:24:12.131 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491030+0000", 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8314999999999999e-05 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491106+0000", 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5845000000000003e-05 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.132 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2634 3.d 3:b02ffd62:::200.00000010:head [write 2639450~2419 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6159519299999996, 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070097349000000003, 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.133 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426246+0000", 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426250+0000", 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4750000000000004e-06 2024-04-26T11:24:12.134 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426257+0000", 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4320000000000004e-06 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426261+0000", 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.732e-06 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491320+0000", 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065059326000000001 2024-04-26T11:24:12.135 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491435+0000", 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011479 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496253+0000", 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004818676 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496292+0000", 2024-04-26T11:24:12.136 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8640999999999998e-05 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496344+0000", 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1870000000000003e-05 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2635 3.d 3:b02ffd62:::200.00000010:head [write 2641869~3599 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6158956690000004, 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071646847999999999, 2024-04-26T11:24:12.137 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.138 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426302+0000", 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426306+0000", 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6169999999999998e-06 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426314+0000", 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1079999999999993e-06 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.139 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426318+0000", 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3769999999999998e-06 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492040+0000", 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065721110999999999 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492102+0000", 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2378999999999993e-05 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.140 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497865+0000", 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057628710000000001 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497901+0000", 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5963000000000001e-05 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497950+0000", 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8968000000000003e-05 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.141 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2636 3.d 3:b02ffd62:::200.00000010:head [write 2645468~4496 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 7.6139629400000004, 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069794832000000001, 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:12.142 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428235+0000", 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428244+0000", 2024-04-26T11:24:12.143 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8580000000000006e-06 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428253+0000", 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5289999999999997e-06 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428261+0000", 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3189999999999997e-06 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.144 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492846+0000", 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064585646999999996 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492940+0000", 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3393000000000005e-05 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497957+0000", 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050173370000000002 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.145 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497986+0000", 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8946e-05 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.498030+0000", 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4561000000000002e-05 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.146 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:12.148 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:12.148 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:12.144+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:12.249 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:12.246+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:12.284 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:12.284 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:24:12.284 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:12.299 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:12.350 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:12.350+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:12.427 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:12.427 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:12.427 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:24:12.428 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:24:12.428 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:12.443 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:12.451 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:12.446+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:12.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~47s 2024-04-26T11:24:12.552 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:12.548+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:12.568 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 1284087~3916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.153610393999999, 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075641310000000003, 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413130+0000", 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6770000000000001e-06 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413138+0000", 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.277e-06 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413143+0000", 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5609999999999998e-06 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478754+0000", 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065610702000000007 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478846+0000", 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1525000000000002e-05 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478916+0000", 2024-04-26T11:24:12.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0630000000000006e-05 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481402+0000", 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00248577 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488675+0000", 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007273219 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488724+0000", 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8525e-05 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488764+0000", 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0095000000000002e-05 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 1288003~3903 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.574 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.153583461, 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075709753000000005, 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:12.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413158+0000", 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413175+0000", 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7008999999999999e-05 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413181+0000", 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479410+0000", 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066228713999999994 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479498+0000", 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7478000000000005e-05 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479629+0000", 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013174500000000001 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482049+0000", 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024196249999999999 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488812+0000", 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067625810000000001 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488842+0000", 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0281e-05 2024-04-26T11:24:12.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488859+0000", 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7306e-05 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 1291906~6986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:12.580 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.153545788000001, 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079787192000000007, 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:12.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:12.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413195+0000", 2024-04-26T11:24:12.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:24:12.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413204+0000", 2024-04-26T11:24:12.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7839999999999992e-06 2024-04-26T11:24:12.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413210+0000", 2024-04-26T11:24:12.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8440000000000003e-06 2024-04-26T11:24:12.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480166+0000", 2024-04-26T11:24:12.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066956565999999995 2024-04-26T11:24:12.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480263+0000", 2024-04-26T11:24:12.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6997999999999995e-05 2024-04-26T11:24:12.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480359+0000", 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5858000000000003e-05 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482071+0000", 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001711918 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492877+0000", 2024-04-26T11:24:12.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010805465 2024-04-26T11:24:12.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492942+0000", 2024-04-26T11:24:12.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5456999999999993e-05 2024-04-26T11:24:12.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492974+0000", 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2162000000000001e-05 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 1298892~7865 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.153517730000001, 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080075681999999995, 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.587 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.588 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:12.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:12.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:12.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413225+0000", 2024-04-26T11:24:12.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0767e-05 2024-04-26T11:24:12.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413233+0000", 2024-04-26T11:24:12.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4540000000000001e-06 2024-04-26T11:24:12.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413239+0000", 2024-04-26T11:24:12.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0959999999999997e-06 2024-04-26T11:24:12.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480790+0000", 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067551471000000002 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480867+0000", 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6334000000000005e-05 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480982+0000", 2024-04-26T11:24:12.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115395 2024-04-26T11:24:12.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484440+0000", 2024-04-26T11:24:12.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003458259 2024-04-26T11:24:12.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493045+0000", 2024-04-26T11:24:12.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086047999999999993 2024-04-26T11:24:12.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493113+0000", 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8040000000000006e-05 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493291+0000", 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017755900000000001 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.594 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 1306757~7740 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.594 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:12.594 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.150599655000001, 2024-04-26T11:24:12.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.085136109000000001, 2024-04-26T11:24:12.594 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.594 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.594 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416132+0000", 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416221+0000", 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8979000000000003e-05 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416233+0000", 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.202e-05 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416242+0000", 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3299999999999999e-06 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481553+0000", 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065311285999999996 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481603+0000", 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0191000000000001e-05 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481668+0000", 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4961000000000004e-05 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484444+0000", 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027755100000000001 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501161+0000", 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016716992999999999 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501229+0000", 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8664000000000005e-05 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501269+0000", 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9956999999999997e-05 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 1314497~14459 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.149818052000001, 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.084463892999999998, 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.599 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416914+0000", 2024-04-26T11:24:12.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416932+0000", 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416943+0000", 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0456e-05 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416950+0000", 2024-04-26T11:24:12.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.345e-06 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482123+0000", 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065173399000000007 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482206+0000", 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2589000000000005e-05 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482318+0000", 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011194200000000001 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484979+0000", 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026616019999999999 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501313+0000", 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016333174999999998 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501343+0000", 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0056000000000002e-05 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501379+0000", 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5991999999999997e-05 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 1328956~3568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.147861775000001, 2024-04-26T11:24:12.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082605777000000005, 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418870+0000", 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418878+0000", 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8629999999999997e-06 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418895+0000", 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6886999999999999e-05 2024-04-26T11:24:12.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418904+0000", 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5769999999999994e-06 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482753+0000", 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063849218999999999 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482799+0000", 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5346999999999998e-05 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482864+0000", 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5124999999999997e-05 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484984+0000", 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021205820000000002 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501422+0000", 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016438066000000001 2024-04-26T11:24:12.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501457+0000", 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5154999999999998e-05 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501477+0000", 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9417999999999999e-05 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.609 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 1332524~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.147820277999999, 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082655731999999996, 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418912+0000", 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418920+0000", 2024-04-26T11:24:12.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418927+0000", 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6399999999999997e-06 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418933+0000", 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9270000000000002e-06 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483248+0000", 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064314274000000005 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483345+0000", 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7065000000000007e-05 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483458+0000", 2024-04-26T11:24:12.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113285 2024-04-26T11:24:12.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484989+0000", 2024-04-26T11:24:12.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001531012 2024-04-26T11:24:12.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501510+0000", 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016520981000000001 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501535+0000", 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501568+0000", 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2808000000000002e-05 2024-04-26T11:24:12.615 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.616 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.616 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.616 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 1333928~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.616 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:12.616 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.147794186, 2024-04-26T11:24:12.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082729079999999997, 2024-04-26T11:24:12.616 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.616 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.616 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418938+0000", 2024-04-26T11:24:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418946+0000", 2024-04-26T11:24:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9929999999999995e-06 2024-04-26T11:24:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418966+0000", 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0095e-05 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418973+0000", 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483863+0000", 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064890529000000002 2024-04-26T11:24:12.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483929+0000", 2024-04-26T11:24:12.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5665000000000002e-05 2024-04-26T11:24:12.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484000+0000", 2024-04-26T11:24:12.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0903999999999997e-05 2024-04-26T11:24:12.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485480+0000", 2024-04-26T11:24:12.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001480084 2024-04-26T11:24:12.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501598+0000", 2024-04-26T11:24:12.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016118789000000001 2024-04-26T11:24:12.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501631+0000", 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3015000000000002e-05 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501668+0000", 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6239999999999999e-05 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 1336693~3915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.147644573999999, 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082682631000000006, 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419095+0000", 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7219999999999999e-06 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419120+0000", 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4854e-05 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419127+0000", 2024-04-26T11:24:12.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4540000000000004e-06 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484461+0000", 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065334619999999996 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484507+0000", 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5906999999999999e-05 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484612+0000", 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104813 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.486851+0000", 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022388479999999999 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501706+0000", 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014855419999999999 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501734+0000", 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7617999999999999e-05 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501771+0000", 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T11:24:12.628 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 1340608~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.144637120000001, 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079811516999999998, 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422094+0000", 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422107+0000", 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2762000000000001e-05 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422121+0000", 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3784999999999999e-05 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422134+0000", 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3304e-05 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485009+0000", 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.062874860000000005 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485053+0000", 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3949000000000002e-05 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485172+0000", 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011921699999999999 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487692+0000", 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025201939999999999 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501818+0000", 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014125499 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501864+0000", 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6403999999999998e-05 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501907+0000", 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3266000000000002e-05 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:558 3.2 3:4272d415:::200.0000000b:head [write 1343057~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.144588522999999, 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079859576000000002, 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.634 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422153+0000", 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909999999999999e-06 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422161+0000", 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4319999999999999e-06 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422168+0000", 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:24:12.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485516+0000", 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063348074000000004 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485624+0000", 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485781+0000", 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015710100000000001 2024-04-26T11:24:12.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487700+0000", 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001918746 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501949+0000", 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014249114 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501973+0000", 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4627e-05 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502004+0000", 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.639 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:559 3.2 3:4272d415:::200.0000000b:head [write 1345015~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.144559465, 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079931344000000001, 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422183+0000", 2024-04-26T11:24:12.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8959999999999998e-06 2024-04-26T11:24:12.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422190+0000", 2024-04-26T11:24:12.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7669999999999998e-06 2024-04-26T11:24:12.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422195+0000", 2024-04-26T11:24:12.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.011e-06 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487222+0000", 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065027153000000004 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487263+0000", 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1201000000000001e-05 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487330+0000", 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6507999999999994e-05 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488866+0000", 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001536747 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502050+0000", 2024-04-26T11:24:12.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013183540000000001 2024-04-26T11:24:12.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502085+0000", 2024-04-26T11:24:12.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4952e-05 2024-04-26T11:24:12.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502105+0000", 2024-04-26T11:24:12.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9947999999999999e-05 2024-04-26T11:24:12.646 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.646 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.646 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.646 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:560 3.2 3:4272d415:::200.0000000b:head [write 1349228~3445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.646 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:12.647 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.144532642, 2024-04-26T11:24:12.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079997483999999994, 2024-04-26T11:24:12.647 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.647 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.647 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:12.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:12.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:12.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422208+0000", 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0309999999999998e-06 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422214+0000", 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6560000000000003e-06 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422220+0000", 2024-04-26T11:24:12.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6489999999999996e-06 2024-04-26T11:24:12.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487739+0000", 2024-04-26T11:24:12.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065519226 2024-04-26T11:24:12.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487833+0000", 2024-04-26T11:24:12.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4106999999999999e-05 2024-04-26T11:24:12.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487972+0000", 2024-04-26T11:24:12.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013830099999999999 2024-04-26T11:24:12.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492072+0000", 2024-04-26T11:24:12.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040998379999999997 2024-04-26T11:24:12.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502140+0000", 2024-04-26T11:24:12.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010068238 2024-04-26T11:24:12.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502165+0000", 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5454999999999999e-05 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502198+0000", 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2478999999999999e-05 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.653 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:561 3.2 3:4272d415:::200.0000000b:head [write 1352673~4505 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.144505714999999, 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080048127999999996, 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422235+0000", 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422242+0000", 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7670000000000003e-06 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422248+0000", 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488886+0000", 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066638785000000006 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488982+0000", 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5387e-05 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489141+0000", 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015913400000000001 2024-04-26T11:24:12.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492079+0000", 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029382509999999998 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502233+0000", 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010154379 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502259+0000", 2024-04-26T11:24:12.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5029999999999999e-05 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502275+0000", 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6735000000000002e-05 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:562 3.2 3:4272d415:::200.0000000b:head [write 1357178~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.144479336, 2024-04-26T11:24:12.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080110050000000002, 2024-04-26T11:24:12.660 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.660 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.660 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:12.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422253+0000", 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422257+0000", 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-04-26T11:24:12.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422263+0000", 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0580000000000003e-06 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422268+0000", 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489892+0000", 2024-04-26T11:24:12.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067623600000000006 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490047+0000", 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154933 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490335+0000", 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028846200000000002 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497761+0000", 2024-04-26T11:24:12.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074257460000000004 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502307+0000", 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045457910000000004 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502331+0000", 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4601e-05 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502364+0000", 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2224000000000002e-05 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:563 3.2 3:4272d415:::200.0000000b:head [write 1358582~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.144459989, 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080161018000000001, 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422272+0000", 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422280+0000", 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0250000000000002e-06 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422288+0000", 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422293+0000", 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3669999999999996e-06 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491197+0000", 2024-04-26T11:24:12.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068903765000000006 2024-04-26T11:24:12.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491329+0000", 2024-04-26T11:24:12.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013223400000000001 2024-04-26T11:24:12.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491443+0000", 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114159 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497769+0000", 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063253190000000003 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502392+0000", 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004622915 2024-04-26T11:24:12.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502415+0000", 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3626e-05 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502434+0000", 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8703999999999999e-05 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.670 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.671 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:564 3.2 3:4272d415:::200.0000000b:head [write 1360496~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.671 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:12.671 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.144432748, 2024-04-26T11:24:12.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080221908999999994, 2024-04-26T11:24:12.671 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.671 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.671 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422304+0000", 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9360000000000001e-06 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422311+0000", 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422317+0000", 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492152+0000", 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069834487000000001 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492258+0000", 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106351 2024-04-26T11:24:12.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492423+0000", 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016443600000000001 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497775+0000", 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053519650000000002 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502465+0000", 2024-04-26T11:24:12.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046902660000000002 2024-04-26T11:24:12.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502490+0000", 2024-04-26T11:24:12.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4777999999999999e-05 2024-04-26T11:24:12.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502522+0000", 2024-04-26T11:24:12.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2369999999999997e-05 2024-04-26T11:24:12.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.677 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.677 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:565 3.2 3:4272d415:::200.0000000b:head [write 1362424~12956 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.677 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:12.677 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.143345707, 2024-04-26T11:24:12.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079271854000000003, 2024-04-26T11:24:12.677 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.678 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.678 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:12.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:12.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423386+0000", 2024-04-26T11:24:12.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:12.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423436+0000", 2024-04-26T11:24:12.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0121999999999999e-05 2024-04-26T11:24:12.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423449+0000", 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2863e-05 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423459+0000", 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493380+0000", 2024-04-26T11:24:12.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069921187999999995 2024-04-26T11:24:12.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493456+0000", 2024-04-26T11:24:12.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6416999999999997e-05 2024-04-26T11:24:12.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493584+0000", 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000128009 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499173+0000", 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055883599999999997 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502578+0000", 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034056020000000002 2024-04-26T11:24:12.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502625+0000", 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6285000000000002e-05 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502659+0000", 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:566 3.2 3:4272d415:::200.0000000b:head [write 1375380~4794 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.140955659999999, 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.078877303999999995, 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:12.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425775+0000", 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:12.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:12.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425794+0000", 2024-04-26T11:24:12.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:24:12.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:12.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425810+0000", 2024-04-26T11:24:12.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.525e-05 2024-04-26T11:24:12.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425821+0000", 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0981e-05 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494069+0000", 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068247996000000005 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:12.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494115+0000", 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310999999999998e-05 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494183+0000", 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7841000000000003e-05 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499177+0000", 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049940109999999996 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504563+0000", 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053863339999999996 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504614+0000", 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0334999999999998e-05 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504654+0000", 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0976000000000002e-05 2024-04-26T11:24:12.689 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.690 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.690 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.690 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:12.690 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:12.690 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:12.691 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:12.688+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:12.692 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:12.792 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:12.788+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:8542 4.d 4:b30b6e5e:::10000001549.00000000:head [delete] snapc 1=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:12.838448+0000", 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.00036123699999999998, 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00041891900000000002, 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.839 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:12.838448+0000", 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:12.838448+0000", 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:12.838447+0000", 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:12.840 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:12.838451+0000", 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8369999999999999e-06 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:12.838459+0000", 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.8599999999999993e-06 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:12.838464+0000", 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.7840000000000003e-06 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.841 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:12.838492+0000", 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8249e-05 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:12.838562+0000", 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0180999999999998e-05 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-04-26T11:24:12.842 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:12.857 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:12.904 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:12.902+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:12.993 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:12.988+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:13.000 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:24:13.000 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:24:13.000 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:13.014 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:13.101 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:13.098+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:13.184 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:24:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:24:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.184 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2615 3.d 3:b02ffd62:::200.00000010:head [write 2546869~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7746428939999994, 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070123572999999995, 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:13.185 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406472+0000", 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406483+0000", 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1219999999999999e-05 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.186 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406499+0000", 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5452999999999999e-05 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406511+0000", 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1769e-05 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472319+0000", 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065808723 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.187 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472411+0000", 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1896000000000002e-05 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476347+0000", 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039353060000000004 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476433+0000", 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6487000000000001e-05 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.188 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476597+0000", 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163461 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2616 3.d 3:b02ffd62:::200.00000010:head [write 2548776~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7745961860000001, 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070199544000000003, 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.189 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406519+0000", 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.190 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406531+0000", 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.172e-05 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406546+0000", 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5685999999999999e-05 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406556+0000", 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0071000000000001e-05 2024-04-26T11:24:13.191 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473252+0000", 2024-04-26T11:24:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066695915999999994 2024-04-26T11:24:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473332+0000", 2024-04-26T11:24:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:24:13.192 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476611+0000", 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032787630000000001 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476656+0000", 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5096999999999999e-05 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.193 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476719+0000", 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3332999999999998e-05 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2617 3.d 3:b02ffd62:::200.00000010:head [write 2552653~1113 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7745505759999993, 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073674075000000006, 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.194 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406564+0000", 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.195 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406570+0000", 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6520000000000003e-06 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406583+0000", 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2679e-05 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406594+0000", 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1032999999999999e-05 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.196 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474020+0000", 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.067425944000000002 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474102+0000", 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2806999999999995e-05 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480120+0000", 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060174729999999997 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.197 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480169+0000", 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9570999999999997e-05 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480239+0000", 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0026999999999999e-05 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.198 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2618 3.d 3:b02ffd62:::200.00000010:head [write 2553766~1050 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7717709110000008, 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071002984000000005, 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.199 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409344+0000", 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409353+0000", 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9150000000000002e-06 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.200 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409371+0000", 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8904000000000001e-05 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409384+0000", 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2566e-05 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065596495000000005 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.201 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475126+0000", 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145329 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480249+0000", 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005123102 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480288+0000", 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9285000000000001e-05 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.202 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480348+0000", 2024-04-26T11:24:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9728999999999997e-05 2024-04-26T11:24:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:14995 4.5 4:a0840aa3:::10000003880.00000000:head [write 85470~33722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:13.203 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7717116530000006, 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071045135999999995, 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14995 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:13.204 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409431+0000", 2024-04-26T11:24:13.205 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7233000000000002e-05 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409440+0000", 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5859999999999994e-06 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409446+0000", 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9429999999999997e-06 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:13.206 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065534244000000005 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475214+0000", 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023348600000000001 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480357+0000", 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051425710000000003 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.207 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480394+0000", 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7289000000000002e-05 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480449+0000", 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5507000000000002e-05 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2619 3.d 3:b02ffd62:::200.00000010:head [write 2554816~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7710855629999998, 2024-04-26T11:24:13.208 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071786804999999995, 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.209 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410029+0000", 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410037+0000", 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2760000000000003e-06 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410047+0000", 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0555e-05 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.210 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410054+0000", 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9399999999999996e-06 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476866+0000", 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066812270000000007 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.477059+0000", 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019292199999999999 2024-04-26T11:24:13.211 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481712+0000", 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046527210000000003 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481754+0000", 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2017000000000001e-05 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481817+0000", 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3054999999999999e-05 2024-04-26T11:24:13.212 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2620 3.d 3:b02ffd62:::200.00000010:head [write 2557602~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7680938239999993, 2024-04-26T11:24:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073204069999999996, 2024-04-26T11:24:13.213 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.214 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413021+0000", 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413038+0000", 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6787999999999999e-05 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413052+0000", 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4606999999999999e-05 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.215 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413062+0000", 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9669999999999996e-06 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478002+0000", 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064940093000000004 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478080+0000", 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7985999999999995e-05 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.216 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486106+0000", 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080256040000000004 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486157+0000", 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1063000000000002e-05 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486226+0000", 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9078000000000005e-05 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.217 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2621 3.d 3:b02ffd62:::200.00000010:head [write 2559526~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7652676009999997, 2024-04-26T11:24:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070487039000000001, 2024-04-26T11:24:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.218 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.219 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415847+0000", 2024-04-26T11:24:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.221 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415855+0000", 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6929999999999996e-06 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415888+0000", 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2954999999999999e-05 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415902+0000", 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3706000000000001e-05 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.222 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478597+0000", 2024-04-26T11:24:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062695089999999995 2024-04-26T11:24:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478709+0000", 2024-04-26T11:24:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111777 2024-04-26T11:24:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.223 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486236+0000", 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075266700000000001 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486276+0000", 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9966999999999999e-05 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486335+0000", 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9713000000000002e-05 2024-04-26T11:24:13.224 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2622 3.d 3:b02ffd62:::200.00000010:head [write 2561446~5986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7651502610000005, 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.072007783000000006, 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:13.225 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415965+0000", 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415979+0000", 2024-04-26T11:24:13.226 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4697e-05 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415993+0000", 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3947e-05 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416003+0000", 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.227 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479418+0000", 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063414807000000004 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479500+0000", 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1631999999999994e-05 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487756+0000", 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082565529999999998 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.228 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487831+0000", 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4449999999999994e-05 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487973+0000", 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014249999999999999 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2623 3.d 3:b02ffd62:::200.00000010:head [write 2567432~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7647788769999995, 2024-04-26T11:24:13.229 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071791032000000005, 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.230 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416336+0000", 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416343+0000", 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.827e-06 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416354+0000", 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1168e-05 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.231 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416364+0000", 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7520000000000008e-06 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480382+0000", 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064018284999999994 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480487+0000", 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010463099999999999 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.232 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487984+0000", 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074974000000000004 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488035+0000", 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0702999999999999e-05 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488128+0000", 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3246999999999997e-05 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.233 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2624 3.d 3:b02ffd62:::200.00000010:head [write 2569339~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.234 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7647382629999999, 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071901926000000005, 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.235 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416377+0000", 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416380+0000", 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.287e-06 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.236 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416386+0000", 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4559999999999999e-06 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416390+0000", 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0659999999999997e-06 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481222+0000", 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064831753000000006 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.237 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481290+0000", 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8425999999999998e-05 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488139+0000", 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068488289999999999 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488191+0000", 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1629000000000003e-05 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.238 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488280+0000", 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9009000000000001e-05 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:15009 4.1d 4:b80503fc:::10000003240.00000000:head [write 897504~130300] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7630524800000007, 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069065685000000002, 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:13.239 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 15009 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.240 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418062+0000", 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418222+0000", 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016041800000000001 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418233+0000", 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0604999999999999e-05 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.241 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418240+0000", 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481210+0000", 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062970672000000005 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481312+0000", 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101834 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.242 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487023+0000", 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057108910000000001 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487065+0000", 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1553e-05 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487129+0000", 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4394999999999996e-05 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.243 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2625 3.d 3:b02ffd62:::200.00000010:head [write 2571246~11889 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7627362590000004, 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069981421000000002, 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.244 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418379+0000", 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.245 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418393+0000", 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4819e-05 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418405+0000", 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1756999999999999e-05 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418413+0000", 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6839999999999996e-06 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.246 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481846+0000", 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063433324999999999 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481927+0000", 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0531000000000005e-05 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488289+0000", 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063617559999999997 2024-04-26T11:24:13.247 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488322+0000", 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3130999999999998e-05 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488361+0000", 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9385000000000003e-05 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.248 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2626 3.d 3:b02ffd62:::200.00000010:head [write 2583135~1955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.76175295, 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071468652999999993, 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.249 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419362+0000", 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419368+0000", 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2260000000000002e-06 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.250 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419379+0000", 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0920999999999999e-05 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419388+0000", 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1740000000000006e-06 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482729+0000", 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063340152999999996 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.251 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482840+0000", 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011119400000000001 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490744+0000", 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079037740000000006 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490781+0000", 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.735e-05 2024-04-26T11:24:13.252 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490832+0000", 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0729000000000002e-05 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2627 3.d 3:b02ffd62:::200.00000010:head [write 2585090~9888 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7602711289999995, 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070072738999999995, 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.253 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.254 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420844+0000", 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420857+0000", 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2974e-05 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420868+0000", 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1063999999999999e-05 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.255 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420876+0000", 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2060000000000007e-06 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483561+0000", 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062684472000000005 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483646+0000", 2024-04-26T11:24:13.256 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5006000000000006e-05 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490839+0000", 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071929979999999999 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490872+0000", 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3550999999999998e-05 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.257 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490917+0000", 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5426000000000002e-05 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2628 3.d 3:b02ffd62:::200.00000010:head [write 2594978~23633 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7588384420000001, 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068718354999999995, 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.258 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422276+0000", 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.259 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422309+0000", 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422319+0000", 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0254e-05 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422326+0000", 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4509999999999997e-06 2024-04-26T11:24:13.260 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484314+0000", 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.061988468999999997 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484428+0000", 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011424799999999999 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490923+0000", 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064948699999999998 2024-04-26T11:24:13.261 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490950+0000", 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7163000000000001e-05 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490996+0000", 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5423000000000002e-05 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.262 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2629 3.d 3:b02ffd62:::200.00000010:head [write 2618611~3263 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.758781806, 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068771545000000003, 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.263 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422337+0000", 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5659999999999998e-06 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422342+0000", 2024-04-26T11:24:13.264 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000002e-06 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422346+0000", 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8419999999999998e-06 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485397+0000", 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063051691000000007 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485487+0000", 2024-04-26T11:24:13.265 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9986000000000002e-05 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491001+0000", 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055139899999999999 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491030+0000", 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8314999999999999e-05 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.266 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491106+0000", 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5845000000000003e-05 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2634 3.d 3:b02ffd62:::200.00000010:head [write 2639450~2419 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7548692700000004, 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070097349000000003, 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.267 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426246+0000", 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.268 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426250+0000", 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4750000000000004e-06 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426257+0000", 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4320000000000004e-06 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426261+0000", 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.732e-06 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.269 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491320+0000", 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065059326000000001 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491435+0000", 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011479 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496253+0000", 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004818676 2024-04-26T11:24:13.270 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496292+0000", 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8640999999999998e-05 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496344+0000", 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1870000000000003e-05 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.271 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2635 3.d 3:b02ffd62:::200.00000010:head [write 2641869~3599 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7548130089999994, 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071646847999999999, 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426302+0000", 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426306+0000", 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6169999999999998e-06 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426314+0000", 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1079999999999993e-06 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426318+0000", 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3769999999999998e-06 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492040+0000", 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065721110999999999 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492102+0000", 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2378999999999993e-05 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497865+0000", 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057628710000000001 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497901+0000", 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5963000000000001e-05 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497950+0000", 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8968000000000003e-05 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2636 3.d 3:b02ffd62:::200.00000010:head [write 2645468~4496 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 8.7528802799999994, 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069794832000000001, 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:13.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428235+0000", 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428244+0000", 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8580000000000006e-06 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428253+0000", 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5289999999999997e-06 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428261+0000", 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3189999999999997e-06 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492846+0000", 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064585646999999996 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492940+0000", 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3393000000000005e-05 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497957+0000", 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050173370000000002 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497986+0000", 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8946e-05 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.498030+0000", 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4561000000000002e-05 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:13.280 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:13.282 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:13.282 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:13.276+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:13.383 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:13.380+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:13.419 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:13.419 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:13.419 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:24:13.419 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:13.434 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:13.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T11:24:13.484 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:13.482+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:13.585 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:13.580+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:13.603 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:13.604 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:13.604 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:24:13.604 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:24:13.604 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:13.618 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:13.686 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:13.682+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:13.787 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:13.786+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:13.804 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:13.804 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:24:13.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:24:13.804 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:13.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.804 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 1284087~3916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.804 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:13.804 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.386898533, 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075641310000000003, 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413130+0000", 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6770000000000001e-06 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413138+0000", 2024-04-26T11:24:13.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.277e-06 2024-04-26T11:24:13.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413143+0000", 2024-04-26T11:24:13.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5609999999999998e-06 2024-04-26T11:24:13.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478754+0000", 2024-04-26T11:24:13.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065610702000000007 2024-04-26T11:24:13.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478846+0000", 2024-04-26T11:24:13.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1525000000000002e-05 2024-04-26T11:24:13.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478916+0000", 2024-04-26T11:24:13.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0630000000000006e-05 2024-04-26T11:24:13.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481402+0000", 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00248577 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488675+0000", 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007273219 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488724+0000", 2024-04-26T11:24:13.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8525e-05 2024-04-26T11:24:13.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488764+0000", 2024-04-26T11:24:13.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0095000000000002e-05 2024-04-26T11:24:13.810 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.810 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.810 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 1288003~3903 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.386871599999999, 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075709753000000005, 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413158+0000", 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413175+0000", 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7008999999999999e-05 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413181+0000", 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479410+0000", 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066228713999999994 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479498+0000", 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7478000000000005e-05 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479629+0000", 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013174500000000001 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482049+0000", 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024196249999999999 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488812+0000", 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067625810000000001 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488842+0000", 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0281e-05 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488859+0000", 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7306e-05 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 1291906~6986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.386833927, 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079787192000000007, 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413195+0000", 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413204+0000", 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7839999999999992e-06 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413210+0000", 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8440000000000003e-06 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480166+0000", 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066956565999999995 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480263+0000", 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6997999999999995e-05 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480359+0000", 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5858000000000003e-05 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482071+0000", 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001711918 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492877+0000", 2024-04-26T11:24:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010805465 2024-04-26T11:24:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492942+0000", 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5456999999999993e-05 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492974+0000", 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2162000000000001e-05 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 1298892~7865 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.386805869, 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080075681999999995, 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413225+0000", 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0767e-05 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413233+0000", 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4540000000000001e-06 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413239+0000", 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0959999999999997e-06 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480790+0000", 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067551471000000002 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480867+0000", 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6334000000000005e-05 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480982+0000", 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115395 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484440+0000", 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003458259 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493045+0000", 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086047999999999993 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493113+0000", 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8040000000000006e-05 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493291+0000", 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017755900000000001 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.826 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 1306757~7740 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.383887794, 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.085136109000000001, 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:13.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416132+0000", 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416221+0000", 2024-04-26T11:24:13.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8979000000000003e-05 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416233+0000", 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.202e-05 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416242+0000", 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3299999999999999e-06 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481553+0000", 2024-04-26T11:24:13.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065311285999999996 2024-04-26T11:24:13.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481603+0000", 2024-04-26T11:24:13.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0191000000000001e-05 2024-04-26T11:24:13.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481668+0000", 2024-04-26T11:24:13.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4961000000000004e-05 2024-04-26T11:24:13.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484444+0000", 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027755100000000001 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501161+0000", 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016716992999999999 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501229+0000", 2024-04-26T11:24:13.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8664000000000005e-05 2024-04-26T11:24:13.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501269+0000", 2024-04-26T11:24:13.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9956999999999997e-05 2024-04-26T11:24:13.836 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.836 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 1314497~14459 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.383106191, 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.084463892999999998, 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:13.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416914+0000", 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416932+0000", 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416943+0000", 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0456e-05 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416950+0000", 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.345e-06 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482123+0000", 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065173399000000007 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482206+0000", 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2589000000000005e-05 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482318+0000", 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011194200000000001 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484979+0000", 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026616019999999999 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501313+0000", 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016333174999999998 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501343+0000", 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0056000000000002e-05 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501379+0000", 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5991999999999997e-05 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 1328956~3568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.381149914, 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082605777000000005, 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418870+0000", 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418878+0000", 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8629999999999997e-06 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418895+0000", 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6886999999999999e-05 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418904+0000", 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5769999999999994e-06 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482753+0000", 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063849218999999999 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482799+0000", 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5346999999999998e-05 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482864+0000", 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5124999999999997e-05 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484984+0000", 2024-04-26T11:24:13.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021205820000000002 2024-04-26T11:24:13.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501422+0000", 2024-04-26T11:24:13.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016438066000000001 2024-04-26T11:24:13.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501457+0000", 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5154999999999998e-05 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501477+0000", 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9417999999999999e-05 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 1332524~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.381108417, 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082655731999999996, 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418912+0000", 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418920+0000", 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:13.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418927+0000", 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6399999999999997e-06 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418933+0000", 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9270000000000002e-06 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483248+0000", 2024-04-26T11:24:13.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064314274000000005 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483345+0000", 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7065000000000007e-05 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483458+0000", 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113285 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484989+0000", 2024-04-26T11:24:13.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001531012 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501510+0000", 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016520981000000001 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501535+0000", 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501568+0000", 2024-04-26T11:24:13.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2808000000000002e-05 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 1333928~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.381082324999999, 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082729079999999997, 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:13.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:13.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418938+0000", 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418946+0000", 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9929999999999995e-06 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418966+0000", 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0095e-05 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418973+0000", 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483863+0000", 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064890529000000002 2024-04-26T11:24:13.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483929+0000", 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5665000000000002e-05 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484000+0000", 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0903999999999997e-05 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485480+0000", 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001480084 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501598+0000", 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016118789000000001 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501631+0000", 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3015000000000002e-05 2024-04-26T11:24:13.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501668+0000", 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6239999999999999e-05 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 1336693~3915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.380932713, 2024-04-26T11:24:13.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082682631000000006, 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419095+0000", 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7219999999999999e-06 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419120+0000", 2024-04-26T11:24:13.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4854e-05 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419127+0000", 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4540000000000004e-06 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484461+0000", 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065334619999999996 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484507+0000", 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5906999999999999e-05 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484612+0000", 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104813 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.486851+0000", 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022388479999999999 2024-04-26T11:24:13.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501706+0000", 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014855419999999999 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501734+0000", 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7617999999999999e-05 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501771+0000", 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 1340608~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.377925259, 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079811516999999998, 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422094+0000", 2024-04-26T11:24:13.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422107+0000", 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2762000000000001e-05 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422121+0000", 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3784999999999999e-05 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422134+0000", 2024-04-26T11:24:13.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3304e-05 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485009+0000", 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.062874860000000005 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485053+0000", 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3949000000000002e-05 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485172+0000", 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011921699999999999 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487692+0000", 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025201939999999999 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501818+0000", 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014125499 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501864+0000", 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6403999999999998e-05 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501907+0000", 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3266000000000002e-05 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:558 3.2 3:4272d415:::200.0000000b:head [write 1343057~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.870 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.377876662, 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079859576000000002, 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422153+0000", 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909999999999999e-06 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422161+0000", 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4319999999999999e-06 2024-04-26T11:24:13.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422168+0000", 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485516+0000", 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063348074000000004 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485624+0000", 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805 2024-04-26T11:24:13.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485781+0000", 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015710100000000001 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487700+0000", 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001918746 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501949+0000", 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014249114 2024-04-26T11:24:13.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501973+0000", 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4627e-05 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502004+0000", 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:559 3.2 3:4272d415:::200.0000000b:head [write 1345015~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.875 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.377847603999999, 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079931344000000001, 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:13.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422183+0000", 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8959999999999998e-06 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422190+0000", 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7669999999999998e-06 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422195+0000", 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.011e-06 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487222+0000", 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065027153000000004 2024-04-26T11:24:13.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487263+0000", 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1201000000000001e-05 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487330+0000", 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6507999999999994e-05 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488866+0000", 2024-04-26T11:24:13.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001536747 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502050+0000", 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013183540000000001 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502085+0000", 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4952e-05 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502105+0000", 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9947999999999999e-05 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:560 3.2 3:4272d415:::200.0000000b:head [write 1349228~3445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.377820781, 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079997483999999994, 2024-04-26T11:24:13.881 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422208+0000", 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0309999999999998e-06 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422214+0000", 2024-04-26T11:24:13.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6560000000000003e-06 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422220+0000", 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6489999999999996e-06 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487739+0000", 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065519226 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487833+0000", 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4106999999999999e-05 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487972+0000", 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013830099999999999 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492072+0000", 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040998379999999997 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502140+0000", 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010068238 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502165+0000", 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5454999999999999e-05 2024-04-26T11:24:13.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502198+0000", 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2478999999999999e-05 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:561 3.2 3:4272d415:::200.0000000b:head [write 1352673~4505 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.377793854, 2024-04-26T11:24:13.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080048127999999996, 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422235+0000", 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422242+0000", 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7670000000000003e-06 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422248+0000", 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488886+0000", 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066638785000000006 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488982+0000", 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5387e-05 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489141+0000", 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015913400000000001 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492079+0000", 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029382509999999998 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502233+0000", 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010154379 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502259+0000", 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5029999999999999e-05 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502275+0000", 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6735000000000002e-05 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.892 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:562 3.2 3:4272d415:::200.0000000b:head [write 1357178~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.377767475000001, 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080110050000000002, 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422253+0000", 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422257+0000", 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422263+0000", 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0580000000000003e-06 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422268+0000", 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489892+0000", 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067623600000000006 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490047+0000", 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154933 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490335+0000", 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028846200000000002 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497761+0000", 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074257460000000004 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502307+0000", 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045457910000000004 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502331+0000", 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4601e-05 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502364+0000", 2024-04-26T11:24:13.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2224000000000002e-05 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:563 3.2 3:4272d415:::200.0000000b:head [write 1358582~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.377748128, 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080161018000000001, 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422272+0000", 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422280+0000", 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0250000000000002e-06 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422288+0000", 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422293+0000", 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3669999999999996e-06 2024-04-26T11:24:13.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491197+0000", 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068903765000000006 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491329+0000", 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013223400000000001 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491443+0000", 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114159 2024-04-26T11:24:13.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497769+0000", 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063253190000000003 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502392+0000", 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004622915 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502415+0000", 2024-04-26T11:24:13.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3626e-05 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502434+0000", 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8703999999999999e-05 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:564 3.2 3:4272d415:::200.0000000b:head [write 1360496~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.377720887000001, 2024-04-26T11:24:13.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080221908999999994, 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422304+0000", 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9360000000000001e-06 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422311+0000", 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:24:13.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422317+0000", 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492152+0000", 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069834487000000001 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492258+0000", 2024-04-26T11:24:13.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106351 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492423+0000", 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016443600000000001 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497775+0000", 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053519650000000002 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502465+0000", 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046902660000000002 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502490+0000", 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4777999999999999e-05 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502522+0000", 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2369999999999997e-05 2024-04-26T11:24:13.908 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.909 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.909 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:565 3.2 3:4272d415:::200.0000000b:head [write 1362424~12956 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.909 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:13.909 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.376633846000001, 2024-04-26T11:24:13.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079271854000000003, 2024-04-26T11:24:13.909 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.909 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.909 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:13.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:13.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423386+0000", 2024-04-26T11:24:13.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:13.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423436+0000", 2024-04-26T11:24:13.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0121999999999999e-05 2024-04-26T11:24:13.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423449+0000", 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2863e-05 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423459+0000", 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493380+0000", 2024-04-26T11:24:13.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069921187999999995 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493456+0000", 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6416999999999997e-05 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493584+0000", 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000128009 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499173+0000", 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055883599999999997 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502578+0000", 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034056020000000002 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502625+0000", 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6285000000000002e-05 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502659+0000", 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:566 3.2 3:4272d415:::200.0000000b:head [write 1375380~4794 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.374243799, 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.078877303999999995, 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:13.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425775+0000", 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:13.916 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425794+0000", 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425810+0000", 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.525e-05 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425821+0000", 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0981e-05 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494069+0000", 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068247996000000005 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494115+0000", 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310999999999998e-05 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:13.918 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494183+0000", 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7841000000000003e-05 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499177+0000", 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049940109999999996 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504563+0000", 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053863339999999996 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.919 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504614+0000", 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0334999999999998e-05 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504654+0000", 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0976000000000002e-05 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:13.920 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:13.922 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:13.923 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:13.918+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:13.930 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:24:14.023 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:14.020+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:14.052 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:24:14.069 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:14.069 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:14.069 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:11115 3.14 3:2e600548:::200.0000001a:head [write 1223588~6680 [fadvise_dontneed] in=6680b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e67)", 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:14.067446+0000", 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 0.0022148239999999998, 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0022782229999999998, 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "started", 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:14.067446+0000", 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:14.070 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:14.067446+0000", 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:14.067445+0000", 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:14.067461+0000", 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5877999999999999e-05 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:14.071 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:14.067472+0000", 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0575e-05 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:14.067477+0000", 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1660000000000002e-06 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:14.067505+0000", 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8068e-05 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:14.072 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:14.073 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:14.067550+0000", 2024-04-26T11:24:14.073 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4759999999999998e-05 2024-04-26T11:24:14.073 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:14.073 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:14.073 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:14.073 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:14.073 INFO:teuthology.orchestra.run.smithi107.stdout: ], 2024-04-26T11:24:14.073 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 1 2024-04-26T11:24:14.073 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:14.073 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:24:14.074 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:24:14.086 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:14.095 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:24:14.096 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:24:14.098 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:24:14.099 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:24:14.125 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:14.120+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:14.206 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:14.207 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:14.221 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:14.265 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:14.262+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:14.325 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:14.322+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:14.359 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:14.360 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:14.376 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:14.426 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:14.422+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:14.435 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is set 2024-04-26T11:24:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:14.521 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:14.567 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:14.564+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:14.628 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:14.626+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:14.644 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:14.644 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:14.658 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:14.729 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:14.726+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:14.831 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:14.826+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:14.833 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:14.833 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:14.854 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:14.931 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:14.926+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:15.032 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:15.030+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:15.033 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:15.033 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:15.047 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:15.134 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:15.128+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:15.207 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:15.207 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:15.221 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:15.234 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:15.232+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:15.335 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:15.332+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:15.337 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:15.337 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:15.352 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:15.437 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:15.434+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:15.490 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:15.490 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:15.505 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:15.538 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:15.538+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:15.628 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:15.628 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:15.639 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:15.638+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:15.643 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:15.740 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:15.736+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:15.759 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:15.759 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:15.774 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:15.840 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:15.838+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:15.941 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:15.938+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:15.944 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:15.945 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:15.965 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:16.042 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:16.036+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:16.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:24:16.133 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:16.133 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:16.143 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:16.140+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:16.147 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:16.225 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:24:16.244 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:16.242+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:16.246 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:24:16.246 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:24:16.268 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:24:16.268 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:24:16.271 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:24:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:24:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2615 3.d 3:b02ffd62:::200.00000010:head [write 2546869~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.271 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.861261567, 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070123572999999995, 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.272 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406472+0000", 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406483+0000", 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1219999999999999e-05 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406499+0000", 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5452999999999999e-05 2024-04-26T11:24:16.273 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406511+0000", 2024-04-26T11:24:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1769e-05 2024-04-26T11:24:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472319+0000", 2024-04-26T11:24:16.274 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065808723 2024-04-26T11:24:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472411+0000", 2024-04-26T11:24:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1896000000000002e-05 2024-04-26T11:24:16.275 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476347+0000", 2024-04-26T11:24:16.276 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039353060000000004 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476433+0000", 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6487000000000001e-05 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476597+0000", 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163461 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.277 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2616 3.d 3:b02ffd62:::200.00000010:head [write 2548776~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.861214859, 2024-04-26T11:24:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070199544000000003, 2024-04-26T11:24:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:16.278 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.279 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406519+0000", 2024-04-26T11:24:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.280 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406531+0000", 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.172e-05 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406546+0000", 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5685999999999999e-05 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406556+0000", 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0071000000000001e-05 2024-04-26T11:24:16.281 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473252+0000", 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066695915999999994 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473332+0000", 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476611+0000", 2024-04-26T11:24:16.282 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032787630000000001 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476656+0000", 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5096999999999999e-05 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476719+0000", 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3332999999999998e-05 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.283 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2617 3.d 3:b02ffd62:::200.00000010:head [write 2552653~1113 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.861169249, 2024-04-26T11:24:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073674075000000006, 2024-04-26T11:24:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.284 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.285 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.286 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406564+0000", 2024-04-26T11:24:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.287 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406570+0000", 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6520000000000003e-06 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406583+0000", 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2679e-05 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406594+0000", 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1032999999999999e-05 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.288 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474020+0000", 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.067425944000000002 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474102+0000", 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2806999999999995e-05 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480120+0000", 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060174729999999997 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.289 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480169+0000", 2024-04-26T11:24:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9570999999999997e-05 2024-04-26T11:24:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480239+0000", 2024-04-26T11:24:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0026999999999999e-05 2024-04-26T11:24:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.290 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2618 3.d 3:b02ffd62:::200.00000010:head [write 2553766~1050 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.858389583999999, 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071002984000000005, 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.291 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409344+0000", 2024-04-26T11:24:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.292 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409353+0000", 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9150000000000002e-06 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409371+0000", 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8904000000000001e-05 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409384+0000", 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2566e-05 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.293 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065596495000000005 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475126+0000", 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145329 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480249+0000", 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005123102 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.294 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480288+0000", 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9285000000000001e-05 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480348+0000", 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9728999999999997e-05 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.295 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:14995 4.5 4:a0840aa3:::10000003880.00000000:head [write 85470~33722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.858330326000001, 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071045135999999995, 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14995 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:16.296 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.297 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409431+0000", 2024-04-26T11:24:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7233000000000002e-05 2024-04-26T11:24:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.298 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409440+0000", 2024-04-26T11:24:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5859999999999994e-06 2024-04-26T11:24:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409446+0000", 2024-04-26T11:24:16.299 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9429999999999997e-06 2024-04-26T11:24:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065534244000000005 2024-04-26T11:24:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.300 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475214+0000", 2024-04-26T11:24:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023348600000000001 2024-04-26T11:24:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480357+0000", 2024-04-26T11:24:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051425710000000003 2024-04-26T11:24:16.301 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480394+0000", 2024-04-26T11:24:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7289000000000002e-05 2024-04-26T11:24:16.302 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480449+0000", 2024-04-26T11:24:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5507000000000002e-05 2024-04-26T11:24:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.303 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2619 3.d 3:b02ffd62:::200.00000010:head [write 2554816~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.857704236, 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071786804999999995, 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.304 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.305 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410029+0000", 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410037+0000", 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2760000000000003e-06 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.306 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410047+0000", 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0555e-05 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410054+0000", 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9399999999999996e-06 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476866+0000", 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066812270000000007 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.307 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.477059+0000", 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019292199999999999 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481712+0000", 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046527210000000003 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481754+0000", 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2017000000000001e-05 2024-04-26T11:24:16.308 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481817+0000", 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3054999999999999e-05 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2620 3.d 3:b02ffd62:::200.00000010:head [write 2557602~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:16.309 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.854712497, 2024-04-26T11:24:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073204069999999996, 2024-04-26T11:24:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.310 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413021+0000", 2024-04-26T11:24:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.311 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413038+0000", 2024-04-26T11:24:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6787999999999999e-05 2024-04-26T11:24:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.312 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413052+0000", 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4606999999999999e-05 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413062+0000", 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9669999999999996e-06 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478002+0000", 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064940093000000004 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.313 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478080+0000", 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7985999999999995e-05 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486106+0000", 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080256040000000004 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486157+0000", 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1063000000000002e-05 2024-04-26T11:24:16.314 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486226+0000", 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9078000000000005e-05 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2621 3.d 3:b02ffd62:::200.00000010:head [write 2559526~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.851886274, 2024-04-26T11:24:16.315 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070487039000000001, 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.316 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415847+0000", 2024-04-26T11:24:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415855+0000", 2024-04-26T11:24:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6929999999999996e-06 2024-04-26T11:24:16.317 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415888+0000", 2024-04-26T11:24:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2954999999999999e-05 2024-04-26T11:24:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415902+0000", 2024-04-26T11:24:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3706000000000001e-05 2024-04-26T11:24:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.318 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478597+0000", 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062695089999999995 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478709+0000", 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111777 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486236+0000", 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075266700000000001 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.319 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486276+0000", 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9966999999999999e-05 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486335+0000", 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9713000000000002e-05 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2622 3.d 3:b02ffd62:::200.00000010:head [write 2561446~5986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.320 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.851768934000001, 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.072007783000000006, 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.321 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415965+0000", 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415979+0000", 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4697e-05 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415993+0000", 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3947e-05 2024-04-26T11:24:16.322 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416003+0000", 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479418+0000", 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063414807000000004 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.323 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479500+0000", 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1631999999999994e-05 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487756+0000", 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082565529999999998 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487831+0000", 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4449999999999994e-05 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.324 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487973+0000", 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014249999999999999 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2623 3.d 3:b02ffd62:::200.00000010:head [write 2567432~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.85139755, 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071791032000000005, 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.325 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416336+0000", 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.326 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416343+0000", 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.827e-06 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416354+0000", 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1168e-05 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416364+0000", 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7520000000000008e-06 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.327 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480382+0000", 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064018284999999994 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480487+0000", 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010463099999999999 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487984+0000", 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074974000000000004 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.328 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488035+0000", 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0702999999999999e-05 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488128+0000", 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3246999999999997e-05 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2624 3.d 3:b02ffd62:::200.00000010:head [write 2569339~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.329 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.851356936, 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071901926000000005, 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.330 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416377+0000", 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416380+0000", 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.287e-06 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416386+0000", 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4559999999999999e-06 2024-04-26T11:24:16.331 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416390+0000", 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0659999999999997e-06 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481222+0000", 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064831753000000006 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481290+0000", 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8425999999999998e-05 2024-04-26T11:24:16.332 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488139+0000", 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068488289999999999 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488191+0000", 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1629000000000003e-05 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488280+0000", 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9009000000000001e-05 2024-04-26T11:24:16.333 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:15009 4.1d 4:b80503fc:::10000003240.00000000:head [write 897504~130300] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.849671152999999, 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069065685000000002, 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 15009 2024-04-26T11:24:16.334 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418062+0000", 2024-04-26T11:24:16.335 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418222+0000", 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016041800000000001 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418233+0000", 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0604999999999999e-05 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.336 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418240+0000", 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481210+0000", 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062970672000000005 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481312+0000", 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101834 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.337 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487023+0000", 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057108910000000001 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487065+0000", 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1553e-05 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487129+0000", 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4394999999999996e-05 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.338 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2625 3.d 3:b02ffd62:::200.00000010:head [write 2571246~11889 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.849354932000001, 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069981421000000002, 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.339 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418379+0000", 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418393+0000", 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4819e-05 2024-04-26T11:24:16.340 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418405+0000", 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1756999999999999e-05 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418413+0000", 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6839999999999996e-06 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481846+0000", 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063433324999999999 2024-04-26T11:24:16.341 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481927+0000", 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0531000000000005e-05 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488289+0000", 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063617559999999997 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488322+0000", 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3130999999999998e-05 2024-04-26T11:24:16.342 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488361+0000", 2024-04-26T11:24:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9385000000000003e-05 2024-04-26T11:24:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.343 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2626 3.d 3:b02ffd62:::200.00000010:head [write 2583135~1955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.848371623, 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071468652999999993, 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:16.344 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419362+0000", 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419368+0000", 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2260000000000002e-06 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419379+0000", 2024-04-26T11:24:16.345 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0920999999999999e-05 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419388+0000", 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1740000000000006e-06 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482729+0000", 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063340152999999996 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482840+0000", 2024-04-26T11:24:16.346 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011119400000000001 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490744+0000", 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079037740000000006 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490781+0000", 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.735e-05 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490832+0000", 2024-04-26T11:24:16.347 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0729000000000002e-05 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2627 3.d 3:b02ffd62:::200.00000010:head [write 2585090~9888 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.846889802, 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070072738999999995, 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.348 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420844+0000", 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.349 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420857+0000", 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2974e-05 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420868+0000", 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1063999999999999e-05 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420876+0000", 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2060000000000007e-06 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.350 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483561+0000", 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062684472000000005 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483646+0000", 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5006000000000006e-05 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490839+0000", 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071929979999999999 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.351 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490872+0000", 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3550999999999998e-05 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490917+0000", 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5426000000000002e-05 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2628 3.d 3:b02ffd62:::200.00000010:head [write 2594978~23633 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.352 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.845457115, 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068718354999999995, 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.353 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422276+0000", 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422309+0000", 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422319+0000", 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0254e-05 2024-04-26T11:24:16.354 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422326+0000", 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4509999999999997e-06 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484314+0000", 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.061988468999999997 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484428+0000", 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011424799999999999 2024-04-26T11:24:16.355 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490923+0000", 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064948699999999998 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490950+0000", 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7163000000000001e-05 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490996+0000", 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5423000000000002e-05 2024-04-26T11:24:16.356 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2629 3.d 3:b02ffd62:::200.00000010:head [write 2618611~3263 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.845400479, 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068771545000000003, 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:16.357 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422337+0000", 2024-04-26T11:24:16.358 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5659999999999998e-06 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422342+0000", 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000002e-06 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422346+0000", 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8419999999999998e-06 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485397+0000", 2024-04-26T11:24:16.359 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063051691000000007 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485487+0000", 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9986000000000002e-05 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491001+0000", 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055139899999999999 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491030+0000", 2024-04-26T11:24:16.360 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8314999999999999e-05 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491106+0000", 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5845000000000003e-05 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2634 3.d 3:b02ffd62:::200.00000010:head [write 2639450~2419 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.841487943000001, 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070097349000000003, 2024-04-26T11:24:16.361 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.362 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426246+0000", 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426250+0000", 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4750000000000004e-06 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426257+0000", 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4320000000000004e-06 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.363 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426261+0000", 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.732e-06 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491320+0000", 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065059326000000001 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491435+0000", 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011479 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.364 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496253+0000", 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004818676 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496292+0000", 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8640999999999998e-05 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496344+0000", 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1870000000000003e-05 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.365 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2635 3.d 3:b02ffd62:::200.00000010:head [write 2641869~3599 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.841431682, 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071646847999999999, 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.366 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426302+0000", 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426306+0000", 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6169999999999998e-06 2024-04-26T11:24:16.367 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426314+0000", 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1079999999999993e-06 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426318+0000", 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3769999999999998e-06 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492040+0000", 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065721110999999999 2024-04-26T11:24:16.368 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492102+0000", 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2378999999999993e-05 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497865+0000", 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057628710000000001 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497901+0000", 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5963000000000001e-05 2024-04-26T11:24:16.369 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497950+0000", 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8968000000000003e-05 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2636 3.d 3:b02ffd62:::200.00000010:head [write 2645468~4496 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 11.839498953, 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069794832000000001, 2024-04-26T11:24:16.370 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:16.371 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428235+0000", 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428244+0000", 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8580000000000006e-06 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428253+0000", 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5289999999999997e-06 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.372 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428261+0000", 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3189999999999997e-06 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492846+0000", 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064585646999999996 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492940+0000", 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3393000000000005e-05 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:16.373 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497957+0000", 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050173370000000002 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497986+0000", 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8946e-05 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.498030+0000", 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4561000000000002e-05 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.374 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:16.375 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:16.375 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:16.376 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:24:16.377 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:24:16.377 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:16.377 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:16.374+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:16.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T11:24:16.477 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:16.474+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:16.517 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:16.517 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:16.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:15347 3.16 3:6b6b4f13:::200.0000001c:head [write 2230148~3236 [fadvise_dontneed] in=3236b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e68)", 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:16.515926+0000", 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.001516063, 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001563879, 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:16.515926+0000", 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:16.515926+0000", 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:16.515924+0000", 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:16.515938+0000", 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3583e-05 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:16.515968+0000", 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0216999999999999e-05 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:16.515981+0000", 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3726e-05 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:16.516034+0000", 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2704000000000002e-05 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:16.516116+0000", 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2155000000000002e-05 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:16.517461+0000", 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001344954 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 1 2024-04-26T11:24:16.521 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:16.532 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:16.578 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:16.574+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:16.657 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:24:16.657 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:24:16.657 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:16.671 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:16.722 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:16.720+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:16.780 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:16.776+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:16.808 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:16.808 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 1284087~3916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.392792088, 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075641310000000003, 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:16.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413130+0000", 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6770000000000001e-06 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413138+0000", 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.277e-06 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413143+0000", 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5609999999999998e-06 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478754+0000", 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065610702000000007 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478846+0000", 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1525000000000002e-05 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478916+0000", 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0630000000000006e-05 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481402+0000", 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00248577 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488675+0000", 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007273219 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488724+0000", 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8525e-05 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488764+0000", 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0095000000000002e-05 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 1288003~3903 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.392765154999999, 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075709753000000005, 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.814 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413158+0000", 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413175+0000", 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7008999999999999e-05 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413181+0000", 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479410+0000", 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066228713999999994 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479498+0000", 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7478000000000005e-05 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.817 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479629+0000", 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013174500000000001 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482049+0000", 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024196249999999999 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488812+0000", 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067625810000000001 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.818 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488842+0000", 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0281e-05 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488859+0000", 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7306e-05 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 1291906~6986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:16.819 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.392727482000002, 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079787192000000007, 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413195+0000", 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413204+0000", 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7839999999999992e-06 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413210+0000", 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8440000000000003e-06 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480166+0000", 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066956565999999995 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480263+0000", 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6997999999999995e-05 2024-04-26T11:24:16.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480359+0000", 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5858000000000003e-05 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482071+0000", 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001711918 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492877+0000", 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010805465 2024-04-26T11:24:16.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492942+0000", 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5456999999999993e-05 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492974+0000", 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2162000000000001e-05 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.824 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 1298892~7865 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.392699424, 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080075681999999995, 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:16.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413225+0000", 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0767e-05 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413233+0000", 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4540000000000001e-06 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413239+0000", 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0959999999999997e-06 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480790+0000", 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067551471000000002 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480867+0000", 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6334000000000005e-05 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480982+0000", 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115395 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484440+0000", 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003458259 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493045+0000", 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086047999999999993 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493113+0000", 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8040000000000006e-05 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493291+0000", 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017755900000000001 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 1306757~7740 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.389781349, 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.085136109000000001, 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416132+0000", 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416221+0000", 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8979000000000003e-05 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416233+0000", 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.202e-05 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416242+0000", 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3299999999999999e-06 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481553+0000", 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065311285999999996 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481603+0000", 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0191000000000001e-05 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481668+0000", 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4961000000000004e-05 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484444+0000", 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027755100000000001 2024-04-26T11:24:16.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501161+0000", 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016716992999999999 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501229+0000", 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8664000000000005e-05 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501269+0000", 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9956999999999997e-05 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 1314497~14459 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.388999746, 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.084463892999999998, 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.835 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416914+0000", 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416932+0000", 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416943+0000", 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0456e-05 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416950+0000", 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.345e-06 2024-04-26T11:24:16.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482123+0000", 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065173399000000007 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482206+0000", 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2589000000000005e-05 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482318+0000", 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011194200000000001 2024-04-26T11:24:16.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484979+0000", 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026616019999999999 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501313+0000", 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016333174999999998 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501343+0000", 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0056000000000002e-05 2024-04-26T11:24:16.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501379+0000", 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5991999999999997e-05 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 1328956~3568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.387043468999998, 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082605777000000005, 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.840 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418870+0000", 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:16.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418878+0000", 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8629999999999997e-06 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418895+0000", 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6886999999999999e-05 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418904+0000", 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5769999999999994e-06 2024-04-26T11:24:16.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482753+0000", 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063849218999999999 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482799+0000", 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5346999999999998e-05 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482864+0000", 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5124999999999997e-05 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484984+0000", 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021205820000000002 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501422+0000", 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016438066000000001 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501457+0000", 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5154999999999998e-05 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501477+0000", 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9417999999999999e-05 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 1332524~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.387001972, 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082655731999999996, 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418912+0000", 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418920+0000", 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418927+0000", 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6399999999999997e-06 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418933+0000", 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9270000000000002e-06 2024-04-26T11:24:16.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483248+0000", 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064314274000000005 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483345+0000", 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7065000000000007e-05 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483458+0000", 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113285 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484989+0000", 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001531012 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501510+0000", 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016520981000000001 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501535+0000", 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501568+0000", 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2808000000000002e-05 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 1333928~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.386975880000001, 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082729079999999997, 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.850 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418938+0000", 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418946+0000", 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9929999999999995e-06 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418966+0000", 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0095e-05 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418973+0000", 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.852 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483863+0000", 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064890529000000002 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483929+0000", 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5665000000000002e-05 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484000+0000", 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0903999999999997e-05 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485480+0000", 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001480084 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501598+0000", 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016118789000000001 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501631+0000", 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3015000000000002e-05 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501668+0000", 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6239999999999999e-05 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 1336693~3915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.386826268, 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082682631000000006, 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419095+0000", 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7219999999999999e-06 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419120+0000", 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4854e-05 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419127+0000", 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4540000000000004e-06 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484461+0000", 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065334619999999996 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484507+0000", 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5906999999999999e-05 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484612+0000", 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104813 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.486851+0000", 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022388479999999999 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501706+0000", 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014855419999999999 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501734+0000", 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7617999999999999e-05 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501771+0000", 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 1340608~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.383818814000001, 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079811516999999998, 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422094+0000", 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422107+0000", 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2762000000000001e-05 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422121+0000", 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3784999999999999e-05 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422134+0000", 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3304e-05 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485009+0000", 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.062874860000000005 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485053+0000", 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3949000000000002e-05 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485172+0000", 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011921699999999999 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487692+0000", 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025201939999999999 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501818+0000", 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014125499 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501864+0000", 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6403999999999998e-05 2024-04-26T11:24:16.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501907+0000", 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3266000000000002e-05 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:558 3.2 3:4272d415:::200.0000000b:head [write 1343057~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.383770216999999, 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079859576000000002, 2024-04-26T11:24:16.865 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422153+0000", 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909999999999999e-06 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422161+0000", 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4319999999999999e-06 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422168+0000", 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485516+0000", 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063348074000000004 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485624+0000", 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485781+0000", 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015710100000000001 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487700+0000", 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001918746 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501949+0000", 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014249114 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501973+0000", 2024-04-26T11:24:16.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4627e-05 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502004+0000", 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:559 3.2 3:4272d415:::200.0000000b:head [write 1345015~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.383741158999999, 2024-04-26T11:24:16.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079931344000000001, 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422183+0000", 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8959999999999998e-06 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422190+0000", 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7669999999999998e-06 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422195+0000", 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.011e-06 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487222+0000", 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065027153000000004 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487263+0000", 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1201000000000001e-05 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487330+0000", 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6507999999999994e-05 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488866+0000", 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001536747 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502050+0000", 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013183540000000001 2024-04-26T11:24:16.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502085+0000", 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4952e-05 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502105+0000", 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9947999999999999e-05 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.875 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:560 3.2 3:4272d415:::200.0000000b:head [write 1349228~3445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.383714336000001, 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079997483999999994, 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:16.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422208+0000", 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0309999999999998e-06 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422214+0000", 2024-04-26T11:24:16.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6560000000000003e-06 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422220+0000", 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6489999999999996e-06 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487739+0000", 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065519226 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487833+0000", 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4106999999999999e-05 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487972+0000", 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013830099999999999 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492072+0000", 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040998379999999997 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502140+0000", 2024-04-26T11:24:16.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010068238 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502165+0000", 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5454999999999999e-05 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502198+0000", 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2478999999999999e-05 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:561 3.2 3:4272d415:::200.0000000b:head [write 1352673~4505 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.383687409, 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080048127999999996, 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422235+0000", 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.882 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422242+0000", 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7670000000000003e-06 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422248+0000", 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488886+0000", 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066638785000000006 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488982+0000", 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5387e-05 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489141+0000", 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015913400000000001 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492079+0000", 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029382509999999998 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502233+0000", 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010154379 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502259+0000", 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5029999999999999e-05 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502275+0000", 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6735000000000002e-05 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:562 3.2 3:4272d415:::200.0000000b:head [write 1357178~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.383661029999999, 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080110050000000002, 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422253+0000", 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422257+0000", 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.887 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422263+0000", 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0580000000000003e-06 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422268+0000", 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489892+0000", 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067623600000000006 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490047+0000", 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154933 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490335+0000", 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028846200000000002 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497761+0000", 2024-04-26T11:24:16.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074257460000000004 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502307+0000", 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045457910000000004 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502331+0000", 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4601e-05 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502364+0000", 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2224000000000002e-05 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:563 3.2 3:4272d415:::200.0000000b:head [write 1358582~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.383641683, 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080161018000000001, 2024-04-26T11:24:16.891 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422272+0000", 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422280+0000", 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0250000000000002e-06 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422288+0000", 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422293+0000", 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3669999999999996e-06 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491197+0000", 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068903765000000006 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491329+0000", 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013223400000000001 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491443+0000", 2024-04-26T11:24:16.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114159 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497769+0000", 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063253190000000003 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502392+0000", 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004622915 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502415+0000", 2024-04-26T11:24:16.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3626e-05 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502434+0000", 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8703999999999999e-05 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:564 3.2 3:4272d415:::200.0000000b:head [write 1360496~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.383614441999999, 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080221908999999994, 2024-04-26T11:24:16.896 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422304+0000", 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9360000000000001e-06 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422311+0000", 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422317+0000", 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492152+0000", 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069834487000000001 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492258+0000", 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106351 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492423+0000", 2024-04-26T11:24:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016443600000000001 2024-04-26T11:24:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497775+0000", 2024-04-26T11:24:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053519650000000002 2024-04-26T11:24:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502465+0000", 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046902660000000002 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502490+0000", 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4777999999999999e-05 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502522+0000", 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2369999999999997e-05 2024-04-26T11:24:16.902 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:565 3.2 3:4272d415:::200.0000000b:head [write 1362424~12956 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.382527401000001, 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079271854000000003, 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423386+0000", 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423436+0000", 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0121999999999999e-05 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423449+0000", 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2863e-05 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423459+0000", 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493380+0000", 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069921187999999995 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493456+0000", 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6416999999999997e-05 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493584+0000", 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000128009 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.906 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499173+0000", 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055883599999999997 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502578+0000", 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034056020000000002 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502625+0000", 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6285000000000002e-05 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502659+0000", 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:566 3.2 3:4272d415:::200.0000000b:head [write 1375380~4794 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.380137353999999, 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.078877303999999995, 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:16.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425775+0000", 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425794+0000", 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425810+0000", 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.525e-05 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425821+0000", 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0981e-05 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494069+0000", 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068247996000000005 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494115+0000", 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310999999999998e-05 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494183+0000", 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7841000000000003e-05 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.911 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499177+0000", 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049940109999999996 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504563+0000", 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053863339999999996 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504614+0000", 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0334999999999998e-05 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:16.912 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504654+0000", 2024-04-26T11:24:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0976000000000002e-05 2024-04-26T11:24:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:16.913 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:16.913 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:16.915 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:16.915 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:16.910+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:17.015 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:17.010+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:17.031 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:17.031 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:17.031 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:24:17.032 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:17.047 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:17.136 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:17.134+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:17.210 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:17.211 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:17.211 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:24:17.211 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:24:17.211 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:17.217 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:17.212+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:17.226 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:17.318 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:17.314+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:17.396 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:24:17.396 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:24:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2615 3.d 3:b02ffd62:::200.00000010:head [write 2546869~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.986732722999999, 2024-04-26T11:24:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070123572999999995, 2024-04-26T11:24:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.397 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406472+0000", 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.398 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406483+0000", 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1219999999999999e-05 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406499+0000", 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5452999999999999e-05 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.399 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406511+0000", 2024-04-26T11:24:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1769e-05 2024-04-26T11:24:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472319+0000", 2024-04-26T11:24:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065808723 2024-04-26T11:24:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.400 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472411+0000", 2024-04-26T11:24:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1896000000000002e-05 2024-04-26T11:24:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476347+0000", 2024-04-26T11:24:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039353060000000004 2024-04-26T11:24:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.401 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476433+0000", 2024-04-26T11:24:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6487000000000001e-05 2024-04-26T11:24:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476597+0000", 2024-04-26T11:24:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163461 2024-04-26T11:24:17.402 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2616 3.d 3:b02ffd62:::200.00000010:head [write 2548776~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.986686015, 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070199544000000003, 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.403 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406519+0000", 2024-04-26T11:24:17.404 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406531+0000", 2024-04-26T11:24:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.172e-05 2024-04-26T11:24:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.405 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406546+0000", 2024-04-26T11:24:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5685999999999999e-05 2024-04-26T11:24:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.406 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406556+0000", 2024-04-26T11:24:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0071000000000001e-05 2024-04-26T11:24:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.407 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473252+0000", 2024-04-26T11:24:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066695915999999994 2024-04-26T11:24:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.408 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473332+0000", 2024-04-26T11:24:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:24:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476611+0000", 2024-04-26T11:24:17.409 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032787630000000001 2024-04-26T11:24:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476656+0000", 2024-04-26T11:24:17.410 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5096999999999999e-05 2024-04-26T11:24:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476719+0000", 2024-04-26T11:24:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3332999999999998e-05 2024-04-26T11:24:17.411 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2617 3.d 3:b02ffd62:::200.00000010:head [write 2552653~1113 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.412 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.986640404999999, 2024-04-26T11:24:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073674075000000006, 2024-04-26T11:24:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.413 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:17.414 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406564+0000", 2024-04-26T11:24:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.415 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406570+0000", 2024-04-26T11:24:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6520000000000003e-06 2024-04-26T11:24:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406583+0000", 2024-04-26T11:24:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2679e-05 2024-04-26T11:24:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.416 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406594+0000", 2024-04-26T11:24:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1032999999999999e-05 2024-04-26T11:24:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474020+0000", 2024-04-26T11:24:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.067425944000000002 2024-04-26T11:24:17.417 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474102+0000", 2024-04-26T11:24:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2806999999999995e-05 2024-04-26T11:24:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480120+0000", 2024-04-26T11:24:17.418 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060174729999999997 2024-04-26T11:24:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480169+0000", 2024-04-26T11:24:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9570999999999997e-05 2024-04-26T11:24:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.419 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480239+0000", 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0026999999999999e-05 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2618 3.d 3:b02ffd62:::200.00000010:head [write 2553766~1050 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.983860740000001, 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071002984000000005, 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.420 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409344+0000", 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:17.421 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409353+0000", 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9150000000000002e-06 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409371+0000", 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8904000000000001e-05 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.422 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409384+0000", 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2566e-05 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065596495000000005 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475126+0000", 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145329 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.423 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480249+0000", 2024-04-26T11:24:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005123102 2024-04-26T11:24:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480288+0000", 2024-04-26T11:24:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9285000000000001e-05 2024-04-26T11:24:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.424 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480348+0000", 2024-04-26T11:24:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9728999999999997e-05 2024-04-26T11:24:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:14995 4.5 4:a0840aa3:::10000003880.00000000:head [write 85470~33722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:17.425 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.983801482000001, 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071045135999999995, 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14995 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:17.426 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409431+0000", 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7233000000000002e-05 2024-04-26T11:24:17.427 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409440+0000", 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5859999999999994e-06 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409446+0000", 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9429999999999997e-06 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065534244000000005 2024-04-26T11:24:17.428 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475214+0000", 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023348600000000001 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480357+0000", 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051425710000000003 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480394+0000", 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7289000000000002e-05 2024-04-26T11:24:17.429 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480449+0000", 2024-04-26T11:24:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5507000000000002e-05 2024-04-26T11:24:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.430 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2619 3.d 3:b02ffd62:::200.00000010:head [write 2554816~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.983175392, 2024-04-26T11:24:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071786804999999995, 2024-04-26T11:24:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.431 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.432 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410029+0000", 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410037+0000", 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2760000000000003e-06 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410047+0000", 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0555e-05 2024-04-26T11:24:17.433 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410054+0000", 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9399999999999996e-06 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476866+0000", 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066812270000000007 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.434 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.477059+0000", 2024-04-26T11:24:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019292199999999999 2024-04-26T11:24:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481712+0000", 2024-04-26T11:24:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046527210000000003 2024-04-26T11:24:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.435 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481754+0000", 2024-04-26T11:24:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2017000000000001e-05 2024-04-26T11:24:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481817+0000", 2024-04-26T11:24:17.436 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3054999999999999e-05 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2620 3.d 3:b02ffd62:::200.00000010:head [write 2557602~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.980183652999999, 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073204069999999996, 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.437 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413021+0000", 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.438 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413038+0000", 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6787999999999999e-05 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413052+0000", 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4606999999999999e-05 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413062+0000", 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9669999999999996e-06 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.439 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478002+0000", 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064940093000000004 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478080+0000", 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7985999999999995e-05 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486106+0000", 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080256040000000004 2024-04-26T11:24:17.440 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486157+0000", 2024-04-26T11:24:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1063000000000002e-05 2024-04-26T11:24:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486226+0000", 2024-04-26T11:24:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9078000000000005e-05 2024-04-26T11:24:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.441 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2621 3.d 3:b02ffd62:::200.00000010:head [write 2559526~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.97735743, 2024-04-26T11:24:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070487039000000001, 2024-04-26T11:24:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.442 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.443 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415847+0000", 2024-04-26T11:24:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415855+0000", 2024-04-26T11:24:17.444 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6929999999999996e-06 2024-04-26T11:24:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415888+0000", 2024-04-26T11:24:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2954999999999999e-05 2024-04-26T11:24:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.445 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415902+0000", 2024-04-26T11:24:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3706000000000001e-05 2024-04-26T11:24:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478597+0000", 2024-04-26T11:24:17.446 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062695089999999995 2024-04-26T11:24:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478709+0000", 2024-04-26T11:24:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111777 2024-04-26T11:24:17.447 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486236+0000", 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075266700000000001 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486276+0000", 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9966999999999999e-05 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486335+0000", 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9713000000000002e-05 2024-04-26T11:24:17.448 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2622 3.d 3:b02ffd62:::200.00000010:head [write 2561446~5986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.97724009, 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.072007783000000006, 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:17.449 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415965+0000", 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.450 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415979+0000", 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4697e-05 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415993+0000", 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3947e-05 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416003+0000", 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.451 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479418+0000", 2024-04-26T11:24:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063414807000000004 2024-04-26T11:24:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479500+0000", 2024-04-26T11:24:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1631999999999994e-05 2024-04-26T11:24:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.452 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487756+0000", 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082565529999999998 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487831+0000", 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4449999999999994e-05 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487973+0000", 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014249999999999999 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.453 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2623 3.d 3:b02ffd62:::200.00000010:head [write 2567432~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.976868705999999, 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071791032000000005, 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:17.454 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416336+0000", 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416343+0000", 2024-04-26T11:24:17.455 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.827e-06 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416354+0000", 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1168e-05 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416364+0000", 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7520000000000008e-06 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.456 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480382+0000", 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064018284999999994 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480487+0000", 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010463099999999999 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487984+0000", 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074974000000000004 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.457 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488035+0000", 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0702999999999999e-05 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488128+0000", 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3246999999999997e-05 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.458 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2624 3.d 3:b02ffd62:::200.00000010:head [write 2569339~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.976828092, 2024-04-26T11:24:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071901926000000005, 2024-04-26T11:24:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.459 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.460 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.461 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416377+0000", 2024-04-26T11:24:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.462 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416380+0000", 2024-04-26T11:24:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.287e-06 2024-04-26T11:24:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416386+0000", 2024-04-26T11:24:17.463 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4559999999999999e-06 2024-04-26T11:24:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416390+0000", 2024-04-26T11:24:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0659999999999997e-06 2024-04-26T11:24:17.464 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481222+0000", 2024-04-26T11:24:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064831753000000006 2024-04-26T11:24:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.465 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481290+0000", 2024-04-26T11:24:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8425999999999998e-05 2024-04-26T11:24:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.466 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488139+0000", 2024-04-26T11:24:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068488289999999999 2024-04-26T11:24:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.467 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488191+0000", 2024-04-26T11:24:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1629000000000003e-05 2024-04-26T11:24:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488280+0000", 2024-04-26T11:24:17.468 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9009000000000001e-05 2024-04-26T11:24:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.469 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:15009 4.1d 4:b80503fc:::10000003240.00000000:head [write 897504~130300] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.975142309000001, 2024-04-26T11:24:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069065685000000002, 2024-04-26T11:24:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.470 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 15009 2024-04-26T11:24:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.471 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.472 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.473 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418062+0000", 2024-04-26T11:24:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.474 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418222+0000", 2024-04-26T11:24:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016041800000000001 2024-04-26T11:24:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.475 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418233+0000", 2024-04-26T11:24:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0604999999999999e-05 2024-04-26T11:24:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.476 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418240+0000", 2024-04-26T11:24:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:24:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.477 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481210+0000", 2024-04-26T11:24:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062970672000000005 2024-04-26T11:24:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481312+0000", 2024-04-26T11:24:17.478 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101834 2024-04-26T11:24:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487023+0000", 2024-04-26T11:24:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057108910000000001 2024-04-26T11:24:17.479 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487065+0000", 2024-04-26T11:24:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1553e-05 2024-04-26T11:24:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.480 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487129+0000", 2024-04-26T11:24:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4394999999999996e-05 2024-04-26T11:24:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.481 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2625 3.d 3:b02ffd62:::200.00000010:head [write 2571246~11889 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.974826088, 2024-04-26T11:24:17.482 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069981421000000002, 2024-04-26T11:24:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.483 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.484 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.485 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418379+0000", 2024-04-26T11:24:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418393+0000", 2024-04-26T11:24:17.486 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4819e-05 2024-04-26T11:24:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418405+0000", 2024-04-26T11:24:17.487 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1756999999999999e-05 2024-04-26T11:24:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418413+0000", 2024-04-26T11:24:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6839999999999996e-06 2024-04-26T11:24:17.488 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481846+0000", 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063433324999999999 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481927+0000", 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0531000000000005e-05 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.489 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488289+0000", 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063617559999999997 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488322+0000", 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3130999999999998e-05 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488361+0000", 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9385000000000003e-05 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.490 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2626 3.d 3:b02ffd62:::200.00000010:head [write 2583135~1955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.973842779, 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071468652999999993, 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.491 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419362+0000", 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419368+0000", 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2260000000000002e-06 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.492 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419379+0000", 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0920999999999999e-05 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419388+0000", 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1740000000000006e-06 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482729+0000", 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063340152999999996 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.493 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482840+0000", 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011119400000000001 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490744+0000", 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079037740000000006 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490781+0000", 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.735e-05 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.494 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490832+0000", 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0729000000000002e-05 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2627 3.d 3:b02ffd62:::200.00000010:head [write 2585090~9888 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.972360957999999, 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070072738999999995, 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.495 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420844+0000", 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.496 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420857+0000", 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2974e-05 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420868+0000", 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1063999999999999e-05 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420876+0000", 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2060000000000007e-06 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.497 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483561+0000", 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062684472000000005 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483646+0000", 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5006000000000006e-05 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490839+0000", 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071929979999999999 2024-04-26T11:24:17.498 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490872+0000", 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3550999999999998e-05 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490917+0000", 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5426000000000002e-05 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.499 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2628 3.d 3:b02ffd62:::200.00000010:head [write 2594978~23633 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.970928271, 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068718354999999995, 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:17.500 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422276+0000", 2024-04-26T11:24:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422309+0000", 2024-04-26T11:24:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-04-26T11:24:17.501 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422319+0000", 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0254e-05 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422326+0000", 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4509999999999997e-06 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.502 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484314+0000", 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.061988468999999997 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484428+0000", 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011424799999999999 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490923+0000", 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064948699999999998 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.503 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490950+0000", 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7163000000000001e-05 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490996+0000", 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5423000000000002e-05 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2629 3.d 3:b02ffd62:::200.00000010:head [write 2618611~3263 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:17.504 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.970871635, 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068771545000000003, 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422337+0000", 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5659999999999998e-06 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422342+0000", 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000002e-06 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422346+0000", 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8419999999999998e-06 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485397+0000", 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063051691000000007 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485487+0000", 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9986000000000002e-05 2024-04-26T11:24:17.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491001+0000", 2024-04-26T11:24:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055139899999999999 2024-04-26T11:24:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491030+0000", 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8314999999999999e-05 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491106+0000", 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5845000000000003e-05 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2634 3.d 3:b02ffd62:::200.00000010:head [write 2639450~2419 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:17.510 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.966959099, 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070097349000000003, 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426246+0000", 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426250+0000", 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4750000000000004e-06 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426257+0000", 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4320000000000004e-06 2024-04-26T11:24:17.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426261+0000", 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.732e-06 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491320+0000", 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065059326000000001 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491435+0000", 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011479 2024-04-26T11:24:17.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496253+0000", 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004818676 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496292+0000", 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8640999999999998e-05 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496344+0000", 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1870000000000003e-05 2024-04-26T11:24:17.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2635 3.d 3:b02ffd62:::200.00000010:head [write 2641869~3599 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.966902837999999, 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071646847999999999, 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:17.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426302+0000", 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426306+0000", 2024-04-26T11:24:17.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6169999999999998e-06 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426314+0000", 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1079999999999993e-06 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426318+0000", 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3769999999999998e-06 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492040+0000", 2024-04-26T11:24:17.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065721110999999999 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492102+0000", 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2378999999999993e-05 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497865+0000", 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057628710000000001 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497901+0000", 2024-04-26T11:24:17.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5963000000000001e-05 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497950+0000", 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8968000000000003e-05 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2636 3.d 3:b02ffd62:::200.00000010:head [write 2645468~4496 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 12.964970108999999, 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069794832000000001, 2024-04-26T11:24:17.519 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:17.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428235+0000", 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428244+0000", 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8580000000000006e-06 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428253+0000", 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5289999999999997e-06 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428261+0000", 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3189999999999997e-06 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492846+0000", 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064585646999999996 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492940+0000", 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3393000000000005e-05 2024-04-26T11:24:17.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497957+0000", 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050173370000000002 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497986+0000", 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8946e-05 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.498030+0000", 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4561000000000002e-05 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.523 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:17.524 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:17.524 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:17.526 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is set 2024-04-26T11:24:17.526 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:17.526 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:17.522+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:17.626 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:17.626+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:17.672 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:17.672 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:17.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:17.672 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:16547 3.5 3:a055a6fb:::200.0000001d:head [write 2268610~19594 [fadvise_dontneed] in=19594b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e69)", 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:24:17.670000+0000", 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.002215247, 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002301492, 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:17.670000+0000", 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:17.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:17.670000+0000", 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:17.669998+0000", 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:17.670042+0000", 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4796000000000003e-05 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:17.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:17.670072+0000", 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9646999999999999e-05 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:17.670086+0000", 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3703000000000001e-05 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:17.670179+0000", 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3325000000000005e-05 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:17.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:17.670316+0000", 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013674100000000001 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:17.672036+0000", 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017200379999999999 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:24:17.672195+0000", 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000159617 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:17.676 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:17.677 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-26T11:24:17.677 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 1 2024-04-26T11:24:17.677 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:17.689 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:17.735 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:17.732+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:17.816 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:17.816 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:17.816 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:24:17.816 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:24:17.816 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:17.829 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:17.822+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:17.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:17.928 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:17.922+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:18.029 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:18.026+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:18.034 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:24:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:24:18.034 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 1284087~3916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.617631839000001, 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075641310000000003, 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413130+0000", 2024-04-26T11:24:18.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6770000000000001e-06 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413138+0000", 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.277e-06 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413143+0000", 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5609999999999998e-06 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478754+0000", 2024-04-26T11:24:18.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065610702000000007 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478846+0000", 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1525000000000002e-05 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478916+0000", 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0630000000000006e-05 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481402+0000", 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00248577 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488675+0000", 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007273219 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488724+0000", 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8525e-05 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488764+0000", 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0095000000000002e-05 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 1288003~3903 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.617604906, 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075709753000000005, 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.040 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:18.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413158+0000", 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413175+0000", 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7008999999999999e-05 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413181+0000", 2024-04-26T11:24:18.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479410+0000", 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066228713999999994 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479498+0000", 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7478000000000005e-05 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479629+0000", 2024-04-26T11:24:18.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013174500000000001 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482049+0000", 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024196249999999999 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488812+0000", 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067625810000000001 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488842+0000", 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0281e-05 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488859+0000", 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7306e-05 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 1291906~6986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:18.045 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.617567232999999, 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079787192000000007, 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413195+0000", 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413204+0000", 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7839999999999992e-06 2024-04-26T11:24:18.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413210+0000", 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8440000000000003e-06 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480166+0000", 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066956565999999995 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480263+0000", 2024-04-26T11:24:18.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6997999999999995e-05 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480359+0000", 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5858000000000003e-05 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482071+0000", 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001711918 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492877+0000", 2024-04-26T11:24:18.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010805465 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492942+0000", 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5456999999999993e-05 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492974+0000", 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2162000000000001e-05 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 1298892~7865 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.617539175000001, 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080075681999999995, 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413225+0000", 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0767e-05 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413233+0000", 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4540000000000001e-06 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413239+0000", 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0959999999999997e-06 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480790+0000", 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067551471000000002 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480867+0000", 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6334000000000005e-05 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480982+0000", 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115395 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484440+0000", 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003458259 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493045+0000", 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086047999999999993 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493113+0000", 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8040000000000006e-05 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493291+0000", 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017755900000000001 2024-04-26T11:24:18.055 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 1306757~7740 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.614621100000001, 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.085136109000000001, 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:18.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416132+0000", 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416221+0000", 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8979000000000003e-05 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416233+0000", 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.202e-05 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416242+0000", 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3299999999999999e-06 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481553+0000", 2024-04-26T11:24:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065311285999999996 2024-04-26T11:24:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481603+0000", 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0191000000000001e-05 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481668+0000", 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4961000000000004e-05 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484444+0000", 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027755100000000001 2024-04-26T11:24:18.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501161+0000", 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016716992999999999 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501229+0000", 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8664000000000005e-05 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501269+0000", 2024-04-26T11:24:18.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9956999999999997e-05 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 1314497~14459 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.613839497000001, 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.084463892999999998, 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416914+0000", 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416932+0000", 2024-04-26T11:24:18.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:24:18.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416943+0000", 2024-04-26T11:24:18.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0456e-05 2024-04-26T11:24:18.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416950+0000", 2024-04-26T11:24:18.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.345e-06 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482123+0000", 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065173399000000007 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482206+0000", 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2589000000000005e-05 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482318+0000", 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011194200000000001 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484979+0000", 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026616019999999999 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501313+0000", 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016333174999999998 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501343+0000", 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0056000000000002e-05 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501379+0000", 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5991999999999997e-05 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 1328956~3568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:18.070 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.611883219999999, 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082605777000000005, 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418870+0000", 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418878+0000", 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8629999999999997e-06 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418895+0000", 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6886999999999999e-05 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418904+0000", 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5769999999999994e-06 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482753+0000", 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063849218999999999 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482799+0000", 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5346999999999998e-05 2024-04-26T11:24:18.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482864+0000", 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5124999999999997e-05 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484984+0000", 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021205820000000002 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501422+0000", 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016438066000000001 2024-04-26T11:24:18.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501457+0000", 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5154999999999998e-05 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501477+0000", 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9417999999999999e-05 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.075 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 1332524~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.611841723000001, 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082655731999999996, 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418912+0000", 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418920+0000", 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418927+0000", 2024-04-26T11:24:18.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6399999999999997e-06 2024-04-26T11:24:18.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418933+0000", 2024-04-26T11:24:18.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9270000000000002e-06 2024-04-26T11:24:18.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483248+0000", 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064314274000000005 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483345+0000", 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7065000000000007e-05 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483458+0000", 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113285 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484989+0000", 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001531012 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501510+0000", 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016520981000000001 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501535+0000", 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501568+0000", 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2808000000000002e-05 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 1333928~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.611815630999999, 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082729079999999997, 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.081 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418938+0000", 2024-04-26T11:24:18.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418946+0000", 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9929999999999995e-06 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418966+0000", 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0095e-05 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418973+0000", 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483863+0000", 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064890529000000002 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483929+0000", 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5665000000000002e-05 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484000+0000", 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0903999999999997e-05 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485480+0000", 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001480084 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501598+0000", 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016118789000000001 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501631+0000", 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3015000000000002e-05 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501668+0000", 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6239999999999999e-05 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 1336693~3915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:18.086 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.611666019000001, 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082682631000000006, 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419095+0000", 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7219999999999999e-06 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419120+0000", 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4854e-05 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419127+0000", 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4540000000000004e-06 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484461+0000", 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065334619999999996 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484507+0000", 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5906999999999999e-05 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484612+0000", 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104813 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.486851+0000", 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022388479999999999 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501706+0000", 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014855419999999999 2024-04-26T11:24:18.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501734+0000", 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7617999999999999e-05 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501771+0000", 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.091 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 1340608~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.608658564999999, 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079811516999999998, 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:18.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422094+0000", 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422107+0000", 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2762000000000001e-05 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422121+0000", 2024-04-26T11:24:18.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3784999999999999e-05 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422134+0000", 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3304e-05 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485009+0000", 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.062874860000000005 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485053+0000", 2024-04-26T11:24:18.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3949000000000002e-05 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485172+0000", 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011921699999999999 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487692+0000", 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025201939999999999 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501818+0000", 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014125499 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501864+0000", 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6403999999999998e-05 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501907+0000", 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3266000000000002e-05 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:558 3.2 3:4272d415:::200.0000000b:head [write 1343057~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.608609968, 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079859576000000002, 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422153+0000", 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909999999999999e-06 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422161+0000", 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4319999999999999e-06 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422168+0000", 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485516+0000", 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063348074000000004 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485624+0000", 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485781+0000", 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015710100000000001 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487700+0000", 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001918746 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501949+0000", 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014249114 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501973+0000", 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4627e-05 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502004+0000", 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:559 3.2 3:4272d415:::200.0000000b:head [write 1345015~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.608580910000001, 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079931344000000001, 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422183+0000", 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8959999999999998e-06 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422190+0000", 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7669999999999998e-06 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422195+0000", 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.011e-06 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487222+0000", 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065027153000000004 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487263+0000", 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1201000000000001e-05 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487330+0000", 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6507999999999994e-05 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488866+0000", 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001536747 2024-04-26T11:24:18.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502050+0000", 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013183540000000001 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502085+0000", 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4952e-05 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502105+0000", 2024-04-26T11:24:18.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9947999999999999e-05 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:560 3.2 3:4272d415:::200.0000000b:head [write 1349228~3445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.608554087000002, 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079997483999999994, 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422208+0000", 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0309999999999998e-06 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422214+0000", 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6560000000000003e-06 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422220+0000", 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6489999999999996e-06 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487739+0000", 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065519226 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487833+0000", 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4106999999999999e-05 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487972+0000", 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013830099999999999 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492072+0000", 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040998379999999997 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502140+0000", 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010068238 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502165+0000", 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5454999999999999e-05 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502198+0000", 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2478999999999999e-05 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:561 3.2 3:4272d415:::200.0000000b:head [write 1352673~4505 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.608527160000001, 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080048127999999996, 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.112 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422235+0000", 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422242+0000", 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7670000000000003e-06 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422248+0000", 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:24:18.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488886+0000", 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066638785000000006 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488982+0000", 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5387e-05 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489141+0000", 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015913400000000001 2024-04-26T11:24:18.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492079+0000", 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029382509999999998 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502233+0000", 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010154379 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502259+0000", 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5029999999999999e-05 2024-04-26T11:24:18.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502275+0000", 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6735000000000002e-05 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:562 3.2 3:4272d415:::200.0000000b:head [write 1357178~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.608500781, 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080110050000000002, 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.117 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422253+0000", 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422257+0000", 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422263+0000", 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0580000000000003e-06 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422268+0000", 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489892+0000", 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067623600000000006 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490047+0000", 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154933 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490335+0000", 2024-04-26T11:24:18.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028846200000000002 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497761+0000", 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074257460000000004 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502307+0000", 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045457910000000004 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502331+0000", 2024-04-26T11:24:18.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4601e-05 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502364+0000", 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2224000000000002e-05 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:563 3.2 3:4272d415:::200.0000000b:head [write 1358582~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.608481434000002, 2024-04-26T11:24:18.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080161018000000001, 2024-04-26T11:24:18.123 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.123 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.123 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:18.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:18.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422272+0000", 2024-04-26T11:24:18.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422280+0000", 2024-04-26T11:24:18.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0250000000000002e-06 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422288+0000", 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422293+0000", 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3669999999999996e-06 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491197+0000", 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068903765000000006 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491329+0000", 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013223400000000001 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491443+0000", 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114159 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497769+0000", 2024-04-26T11:24:18.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063253190000000003 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502392+0000", 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004622915 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502415+0000", 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3626e-05 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502434+0000", 2024-04-26T11:24:18.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8703999999999999e-05 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:564 3.2 3:4272d415:::200.0000000b:head [write 1360496~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.608454193, 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080221908999999994, 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422304+0000", 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9360000000000001e-06 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422311+0000", 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422317+0000", 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492152+0000", 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069834487000000001 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492258+0000", 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106351 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492423+0000", 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016443600000000001 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497775+0000", 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053519650000000002 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502465+0000", 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046902660000000002 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502490+0000", 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4777999999999999e-05 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502522+0000", 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2369999999999997e-05 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:565 3.2 3:4272d415:::200.0000000b:head [write 1362424~12956 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.607367151999998, 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079271854000000003, 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.134 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423386+0000", 2024-04-26T11:24:18.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423436+0000", 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0121999999999999e-05 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423449+0000", 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2863e-05 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423459+0000", 2024-04-26T11:24:18.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493380+0000", 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069921187999999995 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493456+0000", 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6416999999999997e-05 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493584+0000", 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000128009 2024-04-26T11:24:18.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499173+0000", 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055883599999999997 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502578+0000", 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034056020000000002 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502625+0000", 2024-04-26T11:24:18.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6285000000000002e-05 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502659+0000", 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:566 3.2 3:4272d415:::200.0000000b:head [write 1375380~4794 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.604977105, 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.078877303999999995, 2024-04-26T11:24:18.139 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:18.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425775+0000", 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425794+0000", 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425810+0000", 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.525e-05 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:18.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425821+0000", 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0981e-05 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494069+0000", 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068247996000000005 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494115+0000", 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310999999999998e-05 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494183+0000", 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7841000000000003e-05 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499177+0000", 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049940109999999996 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504563+0000", 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053863339999999996 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504614+0000", 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0334999999999998e-05 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504654+0000", 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0976000000000002e-05 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:18.144 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:18.146 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:18.140+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:18.146 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:18.247 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:18.244+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:18.278 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:18.278 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:18.278 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:24:18.278 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:18.291 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:18.348 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:18.344+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:18.378 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:24:18.413 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:24:18.413 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:24:18.413 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:18.427 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:18.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2024-04-26T11:24:18.473 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:18.470+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:18.508 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:24:18.528 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:24:18.529 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:24:18.548 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:24:18.549 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:18.549 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:18.549 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:24:18.550 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:18.546+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:18.551 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:24:18.551 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:24:18.563 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:18.651 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:18.648+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:18.705 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:18.705 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:18.721 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:18.752 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:18.750+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:18.854 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:18.850+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:18.937 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:18.937 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:18.955 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:18.950+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:18.963 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:19.056 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:19.052+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:19.090 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:19.090 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:19.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:19.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:19.154+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:19.235 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:19.235 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:19.250 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:19.293 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:19.290+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:19.359 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:19.356+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:19.420 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:19.420 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:19.434 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:19.480 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:19.478+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:19.527 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:24:19.560 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:19.554+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:19.562 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:19.562 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:19.576 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:19.639 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-26T11:24:19.639 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T11:24:19.661 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:19.656+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:19.703 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:19.703 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:19.716 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:19.762 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:19.756+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:19.864 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:19.858+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:19.897 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:19.897 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:19.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:19.950 DEBUG:teuthology.parallel:result is None 2024-04-26T11:24:19.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T11:24:19.966 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:19.964+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:19.970 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T11:24:19.971 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-26T11:24:19.984 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-26T11:24:19.984 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:24:19.984 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T11:24:20.020 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:24:20.020 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T11:24:20.048 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:20.049 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:20.062 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:20.065 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:20.062+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:20.071 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:24:20.166 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:20.164+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:20.189 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:20.189 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:20.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:20.267 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:20.264+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:20.322 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:20.322 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:20.336 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:20.381 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:20.378+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:20.410 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:24:20.410 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":69,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:24:17.442969+0000","last_up_change":"2024-04-26T11:23:22.452731+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5806080,"flags_set":["nodeep-scrub","noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.7032623291015625,"average_primary_affinity":0.69999998807907104,"average_primary_affinity_weighted":0.69999998807907104}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.7032623291015625,"average_primary_affinity":0.69999998807907104,"average_primary_affinity_weighted":0.69999998807907104}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.9600000381469727,"score_stable":1.9600000381469727,"optimal_score":0.67000001668930054,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":0.7032623291015625,"average_primary_affinity":0.69999998807907104,"average_primary_affinity_weighted":0.69999998807907104}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.059999942779541,"score_stable":2.059999942779541,"optimal_score":0.67000001668930054,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":0.7032623291015625,"average_primary_affinity":0.69999998807907104,"average_primary_affinity_weighted":0.69999998807907104}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":46,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":0.1097869873046875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:24:20.429 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:21:41.373843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:21:48.112664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:21:52.071918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.9600000381469727, 'score_stable': 1.9600000381469727, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:21:52.677679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}] 2024-04-26T11:24:20.430 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:24:20.450 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:20.450 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:20.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:20.469 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:24:20.505 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:20.502+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:20.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T11:24:20.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:20.566+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:20.594 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:20.594 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:20.608 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:20.670 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:20.664+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:20.671 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:24:20.692 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:24:20.692 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:24:20.712 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:24:20.712 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:24:20.715 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:24:20.715 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:24:20.728 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:24:20.728 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:24:20.728 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:20.728 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-26T11:24:20.743 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:20.747 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:24:20.771 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:20.766+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:20.872 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:20.868+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:20.943 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:20.943 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:24:20.943 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:24:20.943 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 1284087~3916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.527423967000001, 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075641310000000003, 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.944 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.945 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413130+0000", 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6770000000000001e-06 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413138+0000", 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.277e-06 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413143+0000", 2024-04-26T11:24:20.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5609999999999998e-06 2024-04-26T11:24:20.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:20.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478754+0000", 2024-04-26T11:24:20.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065610702000000007 2024-04-26T11:24:20.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:20.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478846+0000", 2024-04-26T11:24:20.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1525000000000002e-05 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478916+0000", 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0630000000000006e-05 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481402+0000", 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00248577 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:20.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488675+0000", 2024-04-26T11:24:20.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007273219 2024-04-26T11:24:20.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:20.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488724+0000", 2024-04-26T11:24:20.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8525e-05 2024-04-26T11:24:20.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:20.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488764+0000", 2024-04-26T11:24:20.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0095000000000002e-05 2024-04-26T11:24:20.950 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.950 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:20.950 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.952 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 1288003~3903 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:20.952 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:20.952 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.527397034, 2024-04-26T11:24:20.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075709753000000005, 2024-04-26T11:24:20.952 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:20.952 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:20.952 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:20.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.952 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:20.952 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:20.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413158+0000", 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413175+0000", 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7008999999999999e-05 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413181+0000", 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479410+0000", 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066228713999999994 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479498+0000", 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7478000000000005e-05 2024-04-26T11:24:20.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:20.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479629+0000", 2024-04-26T11:24:20.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013174500000000001 2024-04-26T11:24:20.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:20.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482049+0000", 2024-04-26T11:24:20.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024196249999999999 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488812+0000", 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067625810000000001 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488842+0000", 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0281e-05 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488859+0000", 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7306e-05 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 1291906~6986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.527359360999998, 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079787192000000007, 2024-04-26T11:24:20.958 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413195+0000", 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:20.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413204+0000", 2024-04-26T11:24:20.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7839999999999992e-06 2024-04-26T11:24:20.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:20.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413210+0000", 2024-04-26T11:24:20.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8440000000000003e-06 2024-04-26T11:24:20.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:20.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480166+0000", 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066956565999999995 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480263+0000", 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6997999999999995e-05 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480359+0000", 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5858000000000003e-05 2024-04-26T11:24:20.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482071+0000", 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001711918 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492877+0000", 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010805465 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492942+0000", 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5456999999999993e-05 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492974+0000", 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2162000000000001e-05 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.965 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 1298892~7865 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:20.965 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:20.965 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.527331303, 2024-04-26T11:24:20.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080075681999999995, 2024-04-26T11:24:20.965 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:20.965 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:20.965 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:20.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:20.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:20.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:20.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413225+0000", 2024-04-26T11:24:20.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0767e-05 2024-04-26T11:24:20.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:20.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413233+0000", 2024-04-26T11:24:20.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4540000000000001e-06 2024-04-26T11:24:20.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413239+0000", 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0959999999999997e-06 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480790+0000", 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067551471000000002 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:20.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480867+0000", 2024-04-26T11:24:20.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6334000000000005e-05 2024-04-26T11:24:20.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.969 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:20.969 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480982+0000", 2024-04-26T11:24:20.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115395 2024-04-26T11:24:20.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:20.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484440+0000", 2024-04-26T11:24:20.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003458259 2024-04-26T11:24:20.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:20.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493045+0000", 2024-04-26T11:24:20.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086047999999999993 2024-04-26T11:24:20.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:20.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493113+0000", 2024-04-26T11:24:20.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8040000000000006e-05 2024-04-26T11:24:20.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:20.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493291+0000", 2024-04-26T11:24:20.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017755900000000001 2024-04-26T11:24:20.971 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.971 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:20.971 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.972 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 1306757~7740 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:20.972 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:20.972 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.524413228, 2024-04-26T11:24:20.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.085136109000000001, 2024-04-26T11:24:20.972 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:20.972 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:20.972 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:20.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:20.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:20.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:20.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:20.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:20.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416132+0000", 2024-04-26T11:24:20.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:20.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.974 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:20.974 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416221+0000", 2024-04-26T11:24:20.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8979000000000003e-05 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416233+0000", 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.202e-05 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416242+0000", 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3299999999999999e-06 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481553+0000", 2024-04-26T11:24:20.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065311285999999996 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481603+0000", 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0191000000000001e-05 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481668+0000", 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4961000000000004e-05 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484444+0000", 2024-04-26T11:24:20.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027755100000000001 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501161+0000", 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016716992999999999 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501229+0000", 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8664000000000005e-05 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:20.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501269+0000", 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9956999999999997e-05 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 1314497~14459 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.523631625, 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.084463892999999998, 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:20.978 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416914+0000", 2024-04-26T11:24:20.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416932+0000", 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416943+0000", 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0456e-05 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416950+0000", 2024-04-26T11:24:20.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.345e-06 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482123+0000", 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065173399000000007 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482206+0000", 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2589000000000005e-05 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482318+0000", 2024-04-26T11:24:20.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011194200000000001 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484979+0000", 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026616019999999999 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501313+0000", 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016333174999999998 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501343+0000", 2024-04-26T11:24:20.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0056000000000002e-05 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501379+0000", 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5991999999999997e-05 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 1328956~3568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.521675347999999, 2024-04-26T11:24:20.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082605777000000005, 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:20.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418870+0000", 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418878+0000", 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8629999999999997e-06 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418895+0000", 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6886999999999999e-05 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:20.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418904+0000", 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5769999999999994e-06 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482753+0000", 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063849218999999999 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482799+0000", 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5346999999999998e-05 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:20.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482864+0000", 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5124999999999997e-05 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484984+0000", 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021205820000000002 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501422+0000", 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016438066000000001 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:20.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501457+0000", 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5154999999999998e-05 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501477+0000", 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9417999999999999e-05 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 1332524~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.521633851000001, 2024-04-26T11:24:20.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082655731999999996, 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418912+0000", 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418920+0000", 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418927+0000", 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6399999999999997e-06 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418933+0000", 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9270000000000002e-06 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483248+0000", 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064314274000000005 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483345+0000", 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7065000000000007e-05 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483458+0000", 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113285 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484989+0000", 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001531012 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501510+0000", 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016520981000000001 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501535+0000", 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501568+0000", 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2808000000000002e-05 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 1333928~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:20.993 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.521607758999998, 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082729079999999997, 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418938+0000", 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418946+0000", 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9929999999999995e-06 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418966+0000", 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0095e-05 2024-04-26T11:24:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418973+0000", 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483863+0000", 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064890529000000002 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483929+0000", 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5665000000000002e-05 2024-04-26T11:24:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484000+0000", 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0903999999999997e-05 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485480+0000", 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001480084 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501598+0000", 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016118789000000001 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501631+0000", 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3015000000000002e-05 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501668+0000", 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6239999999999999e-05 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 1336693~3915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.521458147000001, 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082682631000000006, 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419095+0000", 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7219999999999999e-06 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419120+0000", 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4854e-05 2024-04-26T11:24:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419127+0000", 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4540000000000004e-06 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484461+0000", 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065334619999999996 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484507+0000", 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5906999999999999e-05 2024-04-26T11:24:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484612+0000", 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104813 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.486851+0000", 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022388479999999999 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501706+0000", 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014855419999999999 2024-04-26T11:24:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501734+0000", 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7617999999999999e-05 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501771+0000", 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 1340608~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.518450692999998, 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079811516999999998, 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422094+0000", 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422107+0000", 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2762000000000001e-05 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422121+0000", 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3784999999999999e-05 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422134+0000", 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3304e-05 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485009+0000", 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.062874860000000005 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485053+0000", 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3949000000000002e-05 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485172+0000", 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011921699999999999 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487692+0000", 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025201939999999999 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501818+0000", 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014125499 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501864+0000", 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6403999999999998e-05 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501907+0000", 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3266000000000002e-05 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:558 3.2 3:4272d415:::200.0000000b:head [write 1343057~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.518402095999999, 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079859576000000002, 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422153+0000", 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909999999999999e-06 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422161+0000", 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4319999999999999e-06 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422168+0000", 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485516+0000", 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063348074000000004 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485624+0000", 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485781+0000", 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015710100000000001 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487700+0000", 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001918746 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501949+0000", 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014249114 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501973+0000", 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4627e-05 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502004+0000", 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:559 3.2 3:4272d415:::200.0000000b:head [write 1345015~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.518373038, 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079931344000000001, 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422183+0000", 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8959999999999998e-06 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422190+0000", 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7669999999999998e-06 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422195+0000", 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.011e-06 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487222+0000", 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065027153000000004 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487263+0000", 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1201000000000001e-05 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487330+0000", 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6507999999999994e-05 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488866+0000", 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001536747 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502050+0000", 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013183540000000001 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502085+0000", 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4952e-05 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502105+0000", 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9947999999999999e-05 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:560 3.2 3:4272d415:::200.0000000b:head [write 1349228~3445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.518346215000001, 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079997483999999994, 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422208+0000", 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0309999999999998e-06 2024-04-26T11:24:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422214+0000", 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6560000000000003e-06 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422220+0000", 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6489999999999996e-06 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487739+0000", 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065519226 2024-04-26T11:24:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487833+0000", 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4106999999999999e-05 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487972+0000", 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013830099999999999 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492072+0000", 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040998379999999997 2024-04-26T11:24:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502140+0000", 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010068238 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502165+0000", 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5454999999999999e-05 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502198+0000", 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2478999999999999e-05 2024-04-26T11:24:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:561 3.2 3:4272d415:::200.0000000b:head [write 1352673~4505 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.518319288000001, 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080048127999999996, 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422235+0000", 2024-04-26T11:24:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422242+0000", 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7670000000000003e-06 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422248+0000", 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488886+0000", 2024-04-26T11:24:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066638785000000006 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488982+0000", 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5387e-05 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489141+0000", 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015913400000000001 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492079+0000", 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029382509999999998 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502233+0000", 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010154379 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502259+0000", 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5029999999999999e-05 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502275+0000", 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6735000000000002e-05 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:562 3.2 3:4272d415:::200.0000000b:head [write 1357178~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.518292908999999, 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080110050000000002, 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422253+0000", 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422257+0000", 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422263+0000", 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0580000000000003e-06 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422268+0000", 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-04-26T11:24:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489892+0000", 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067623600000000006 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490047+0000", 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154933 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490335+0000", 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028846200000000002 2024-04-26T11:24:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497761+0000", 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074257460000000004 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502307+0000", 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045457910000000004 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502331+0000", 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4601e-05 2024-04-26T11:24:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502364+0000", 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2224000000000002e-05 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:563 3.2 3:4272d415:::200.0000000b:head [write 1358582~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.518273562000001, 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080161018000000001, 2024-04-26T11:24:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422272+0000", 2024-04-26T11:24:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422280+0000", 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0250000000000002e-06 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422288+0000", 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422293+0000", 2024-04-26T11:24:21.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3669999999999996e-06 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491197+0000", 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068903765000000006 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491329+0000", 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013223400000000001 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491443+0000", 2024-04-26T11:24:21.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114159 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497769+0000", 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063253190000000003 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502392+0000", 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004622915 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502415+0000", 2024-04-26T11:24:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3626e-05 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502434+0000", 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8703999999999999e-05 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:564 3.2 3:4272d415:::200.0000000b:head [write 1360496~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.518246320999999, 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080221908999999994, 2024-04-26T11:24:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422304+0000", 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9360000000000001e-06 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422311+0000", 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422317+0000", 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492152+0000", 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069834487000000001 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492258+0000", 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106351 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492423+0000", 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016443600000000001 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497775+0000", 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053519650000000002 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502465+0000", 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046902660000000002 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502490+0000", 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4777999999999999e-05 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502522+0000", 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2369999999999997e-05 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:565 3.2 3:4272d415:::200.0000000b:head [write 1362424~12956 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.517159280000001, 2024-04-26T11:24:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079271854000000003, 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423386+0000", 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423436+0000", 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0121999999999999e-05 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423449+0000", 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2863e-05 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423459+0000", 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493380+0000", 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069921187999999995 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493456+0000", 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6416999999999997e-05 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493584+0000", 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000128009 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499173+0000", 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055883599999999997 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502578+0000", 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034056020000000002 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502625+0000", 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6285000000000002e-05 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502659+0000", 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:566 3.2 3:4272d415:::200.0000000b:head [write 1375380~4794 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.514769232999999, 2024-04-26T11:24:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.078877303999999995, 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425775+0000", 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425794+0000", 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425810+0000", 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.525e-05 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425821+0000", 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0981e-05 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494069+0000", 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068247996000000005 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494115+0000", 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310999999999998e-05 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494183+0000", 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7841000000000003e-05 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499177+0000", 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049940109999999996 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504563+0000", 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053863339999999996 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504614+0000", 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0334999999999998e-05 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504654+0000", 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0976000000000002e-05 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:21.054 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:21.056 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:21.052+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:21.056 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:21.074 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-26T11:24:21.091 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T11:24:21.157 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:21.154+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:21.189 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:21.189 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:24:21.189 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:21.203 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:21.257 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:21.256+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:21.358 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-26T11:24:21.359 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:21.356+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:21.368 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:21.368 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:21.368 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:24:21.368 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:24:21.368 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:21.376 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T11:24:21.382 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:21.459 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:21.454+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:21.502 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:21.502 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:24:21.502 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:24:21.502 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:21.503 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.503 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2615 3.d 3:b02ffd62:::200.00000010:head [write 2546869~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.503 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:21.503 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.092821899, 2024-04-26T11:24:21.503 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070123572999999995, 2024-04-26T11:24:21.503 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.503 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.504 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.504 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.504 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:21.504 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.504 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.504 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.505 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:21.505 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.505 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.505 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.505 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406472+0000", 2024-04-26T11:24:21.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.506 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406483+0000", 2024-04-26T11:24:21.506 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1219999999999999e-05 2024-04-26T11:24:21.506 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.506 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.506 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406499+0000", 2024-04-26T11:24:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5452999999999999e-05 2024-04-26T11:24:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.507 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406511+0000", 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1769e-05 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472319+0000", 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065808723 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472411+0000", 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1896000000000002e-05 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.508 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476347+0000", 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039353060000000004 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476433+0000", 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6487000000000001e-05 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.509 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476597+0000", 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163461 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2616 3.d 3:b02ffd62:::200.00000010:head [write 2548776~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.092775191000001, 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070199544000000003, 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.510 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406519+0000", 2024-04-26T11:24:21.511 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406531+0000", 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.172e-05 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406546+0000", 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5685999999999999e-05 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406556+0000", 2024-04-26T11:24:21.512 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0071000000000001e-05 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473252+0000", 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066695915999999994 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473332+0000", 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476611+0000", 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032787630000000001 2024-04-26T11:24:21.513 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476656+0000", 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5096999999999999e-05 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476719+0000", 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3332999999999998e-05 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.514 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2617 3.d 3:b02ffd62:::200.00000010:head [write 2552653~1113 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.092729581, 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073674075000000006, 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.515 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406564+0000", 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406570+0000", 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6520000000000003e-06 2024-04-26T11:24:21.516 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406583+0000", 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2679e-05 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406594+0000", 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1032999999999999e-05 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474020+0000", 2024-04-26T11:24:21.517 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.067425944000000002 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474102+0000", 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2806999999999995e-05 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480120+0000", 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060174729999999997 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.518 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480169+0000", 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9570999999999997e-05 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480239+0000", 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0026999999999999e-05 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2618 3.d 3:b02ffd62:::200.00000010:head [write 2553766~1050 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.519 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.089949915999998, 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071002984000000005, 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.520 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409344+0000", 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409353+0000", 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9150000000000002e-06 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409371+0000", 2024-04-26T11:24:21.521 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8904000000000001e-05 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409384+0000", 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2566e-05 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065596495000000005 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.522 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475126+0000", 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145329 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480249+0000", 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005123102 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480288+0000", 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9285000000000001e-05 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.523 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480348+0000", 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9728999999999997e-05 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:14995 4.5 4:a0840aa3:::10000003880.00000000:head [write 85470~33722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.089890658000002, 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071045135999999995, 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.524 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14995 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:21.525 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409431+0000", 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7233000000000002e-05 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.526 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409440+0000", 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5859999999999994e-06 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409446+0000", 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9429999999999997e-06 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065534244000000005 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.527 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475214+0000", 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023348600000000001 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480357+0000", 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051425710000000003 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480394+0000", 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7289000000000002e-05 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480449+0000", 2024-04-26T11:24:21.528 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5507000000000002e-05 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2619 3.d 3:b02ffd62:::200.00000010:head [write 2554816~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.089264568000001, 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071786804999999995, 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.529 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410029+0000", 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.530 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410037+0000", 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2760000000000003e-06 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410047+0000", 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0555e-05 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410054+0000", 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9399999999999996e-06 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.531 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476866+0000", 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066812270000000007 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.477059+0000", 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019292199999999999 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481712+0000", 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046527210000000003 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.532 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481754+0000", 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2017000000000001e-05 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481817+0000", 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3054999999999999e-05 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2620 3.d 3:b02ffd62:::200.00000010:head [write 2557602~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.086272828999999, 2024-04-26T11:24:21.533 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073204069999999996, 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.534 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413021+0000", 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413038+0000", 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6787999999999999e-05 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413052+0000", 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4606999999999999e-05 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.535 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413062+0000", 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9669999999999996e-06 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478002+0000", 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064940093000000004 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.536 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478080+0000", 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7985999999999995e-05 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486106+0000", 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080256040000000004 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486157+0000", 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1063000000000002e-05 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.537 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486226+0000", 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9078000000000005e-05 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2621 3.d 3:b02ffd62:::200.00000010:head [write 2559526~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.083446605999999, 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070487039000000001, 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.538 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415847+0000", 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.539 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415855+0000", 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6929999999999996e-06 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415888+0000", 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2954999999999999e-05 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415902+0000", 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3706000000000001e-05 2024-04-26T11:24:21.540 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478597+0000", 2024-04-26T11:24:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062695089999999995 2024-04-26T11:24:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478709+0000", 2024-04-26T11:24:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111777 2024-04-26T11:24:21.541 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486236+0000", 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075266700000000001 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486276+0000", 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9966999999999999e-05 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486335+0000", 2024-04-26T11:24:21.542 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9713000000000002e-05 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2622 3.d 3:b02ffd62:::200.00000010:head [write 2561446~5986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.083329266, 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.072007783000000006, 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:21.543 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415965+0000", 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415979+0000", 2024-04-26T11:24:21.544 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4697e-05 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415993+0000", 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3947e-05 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416003+0000", 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479418+0000", 2024-04-26T11:24:21.545 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063414807000000004 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479500+0000", 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1631999999999994e-05 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487756+0000", 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082565529999999998 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.546 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487831+0000", 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4449999999999994e-05 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487973+0000", 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014249999999999999 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2623 3.d 3:b02ffd62:::200.00000010:head [write 2567432~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.082957881999999, 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071791032000000005, 2024-04-26T11:24:21.547 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.548 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416336+0000", 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416343+0000", 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.827e-06 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416354+0000", 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1168e-05 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.549 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416364+0000", 2024-04-26T11:24:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7520000000000008e-06 2024-04-26T11:24:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480382+0000", 2024-04-26T11:24:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064018284999999994 2024-04-26T11:24:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.550 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480487+0000", 2024-04-26T11:24:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010463099999999999 2024-04-26T11:24:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487984+0000", 2024-04-26T11:24:21.551 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074974000000000004 2024-04-26T11:24:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488035+0000", 2024-04-26T11:24:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0702999999999999e-05 2024-04-26T11:24:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.552 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488128+0000", 2024-04-26T11:24:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3246999999999997e-05 2024-04-26T11:24:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.553 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2624 3.d 3:b02ffd62:::200.00000010:head [write 2569339~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.082917267999999, 2024-04-26T11:24:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071901926000000005, 2024-04-26T11:24:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.554 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.555 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416377+0000", 2024-04-26T11:24:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:21.556 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416380+0000", 2024-04-26T11:24:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.287e-06 2024-04-26T11:24:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.557 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416386+0000", 2024-04-26T11:24:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4559999999999999e-06 2024-04-26T11:24:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416390+0000", 2024-04-26T11:24:21.558 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0659999999999997e-06 2024-04-26T11:24:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481222+0000", 2024-04-26T11:24:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064831753000000006 2024-04-26T11:24:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.559 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481290+0000", 2024-04-26T11:24:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8425999999999998e-05 2024-04-26T11:24:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488139+0000", 2024-04-26T11:24:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068488289999999999 2024-04-26T11:24:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.560 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488191+0000", 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1629000000000003e-05 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488280+0000", 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9009000000000001e-05 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:15009 4.1d 4:b80503fc:::10000003240.00000000:head [write 897504~130300] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:21.561 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.081231485, 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069065685000000002, 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 15009 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:21.562 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418062+0000", 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418222+0000", 2024-04-26T11:24:21.563 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016041800000000001 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418233+0000", 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0604999999999999e-05 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418240+0000", 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481210+0000", 2024-04-26T11:24:21.564 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062970672000000005 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481312+0000", 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101834 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487023+0000", 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057108910000000001 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487065+0000", 2024-04-26T11:24:21.565 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1553e-05 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487129+0000", 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4394999999999996e-05 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2625 3.d 3:b02ffd62:::200.00000010:head [write 2571246~11889 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.080915264000001, 2024-04-26T11:24:21.566 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069981421000000002, 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:21.567 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418379+0000", 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418393+0000", 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4819e-05 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.568 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418405+0000", 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1756999999999999e-05 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418413+0000", 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6839999999999996e-06 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481846+0000", 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063433324999999999 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481927+0000", 2024-04-26T11:24:21.569 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0531000000000005e-05 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488289+0000", 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063617559999999997 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488322+0000", 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3130999999999998e-05 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.570 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488361+0000", 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9385000000000003e-05 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2626 3.d 3:b02ffd62:::200.00000010:head [write 2583135~1955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.079931954999999, 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071468652999999993, 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.571 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419362+0000", 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.572 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419368+0000", 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2260000000000002e-06 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419379+0000", 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0920999999999999e-05 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.573 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419388+0000", 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1740000000000006e-06 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482729+0000", 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063340152999999996 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482840+0000", 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011119400000000001 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.574 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490744+0000", 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079037740000000006 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490781+0000", 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.735e-05 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490832+0000", 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0729000000000002e-05 2024-04-26T11:24:21.575 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2627 3.d 3:b02ffd62:::200.00000010:head [write 2585090~9888 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.078450134000001, 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070072738999999995, 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.576 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.577 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420844+0000", 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420857+0000", 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2974e-05 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420868+0000", 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1063999999999999e-05 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.578 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420876+0000", 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2060000000000007e-06 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483561+0000", 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062684472000000005 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483646+0000", 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5006000000000006e-05 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.579 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490839+0000", 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071929979999999999 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490872+0000", 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3550999999999998e-05 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490917+0000", 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5426000000000002e-05 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.580 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2628 3.d 3:b02ffd62:::200.00000010:head [write 2594978~23633 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.077017446999999, 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068718354999999995, 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.581 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422276+0000", 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422309+0000", 2024-04-26T11:24:21.582 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422319+0000", 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0254e-05 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422326+0000", 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4509999999999997e-06 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484314+0000", 2024-04-26T11:24:21.583 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.061988468999999997 2024-04-26T11:24:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484428+0000", 2024-04-26T11:24:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011424799999999999 2024-04-26T11:24:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.584 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490923+0000", 2024-04-26T11:24:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064948699999999998 2024-04-26T11:24:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490950+0000", 2024-04-26T11:24:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7163000000000001e-05 2024-04-26T11:24:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.585 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490996+0000", 2024-04-26T11:24:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5423000000000002e-05 2024-04-26T11:24:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2629 3.d 3:b02ffd62:::200.00000010:head [write 2618611~3263 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.586 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.076960810999999, 2024-04-26T11:24:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068771545000000003, 2024-04-26T11:24:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:21.587 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.588 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422337+0000", 2024-04-26T11:24:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5659999999999998e-06 2024-04-26T11:24:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.589 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422342+0000", 2024-04-26T11:24:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000002e-06 2024-04-26T11:24:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422346+0000", 2024-04-26T11:24:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8419999999999998e-06 2024-04-26T11:24:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.590 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485397+0000", 2024-04-26T11:24:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063051691000000007 2024-04-26T11:24:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485487+0000", 2024-04-26T11:24:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9986000000000002e-05 2024-04-26T11:24:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.591 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491001+0000", 2024-04-26T11:24:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055139899999999999 2024-04-26T11:24:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491030+0000", 2024-04-26T11:24:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8314999999999999e-05 2024-04-26T11:24:21.592 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491106+0000", 2024-04-26T11:24:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5845000000000003e-05 2024-04-26T11:24:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.593 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2634 3.d 3:b02ffd62:::200.00000010:head [write 2639450~2419 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.073048275000001, 2024-04-26T11:24:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070097349000000003, 2024-04-26T11:24:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.594 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.595 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426246+0000", 2024-04-26T11:24:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426250+0000", 2024-04-26T11:24:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4750000000000004e-06 2024-04-26T11:24:21.596 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426257+0000", 2024-04-26T11:24:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4320000000000004e-06 2024-04-26T11:24:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426261+0000", 2024-04-26T11:24:21.597 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.732e-06 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491320+0000", 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065059326000000001 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491435+0000", 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011479 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.598 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496253+0000", 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004818676 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496292+0000", 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8640999999999998e-05 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496344+0000", 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1870000000000003e-05 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.599 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2635 3.d 3:b02ffd62:::200.00000010:head [write 2641869~3599 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.072992014, 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071646847999999999, 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.600 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426302+0000", 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426306+0000", 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6169999999999998e-06 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.601 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426314+0000", 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1079999999999993e-06 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426318+0000", 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3769999999999998e-06 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492040+0000", 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065721110999999999 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.602 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492102+0000", 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2378999999999993e-05 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497865+0000", 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057628710000000001 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497901+0000", 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5963000000000001e-05 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.603 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497950+0000", 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8968000000000003e-05 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2636 3.d 3:b02ffd62:::200.00000010:head [write 2645468~4496 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 17.071059285, 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069794832000000001, 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:21.604 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:21.605 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428235+0000", 2024-04-26T11:24:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428244+0000", 2024-04-26T11:24:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8580000000000006e-06 2024-04-26T11:24:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.607 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428253+0000", 2024-04-26T11:24:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5289999999999997e-06 2024-04-26T11:24:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:21.608 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428261+0000", 2024-04-26T11:24:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3189999999999997e-06 2024-04-26T11:24:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492846+0000", 2024-04-26T11:24:21.609 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064585646999999996 2024-04-26T11:24:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492940+0000", 2024-04-26T11:24:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3393000000000005e-05 2024-04-26T11:24:21.610 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497957+0000", 2024-04-26T11:24:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050173370000000002 2024-04-26T11:24:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.611 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497986+0000", 2024-04-26T11:24:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8946e-05 2024-04-26T11:24:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:21.612 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.498030+0000", 2024-04-26T11:24:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4561000000000002e-05 2024-04-26T11:24:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:21.613 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:21.614 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:21.616 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:21.617 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:21.612+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:21.661 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-26T11:24:21.681 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T11:24:21.716 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:21.712+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:21.747 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:21.747 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:21.747 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:24:21.748 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:21.761 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:21.817 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:21.814+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:21.918 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:21.916+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:21.953 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:21.953 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:21.953 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T11:24:21.953 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T11:24:21.953 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:21.967 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:21.967 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-26T11:24:21.984 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-04-26T11:24:21.984 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T11:24:21.989 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:24:22.059 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:22.056+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:22.121 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:22.116+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:22.136 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T11:24:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T11:24:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T11:24:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:546 3.2 3:4272d415:::200.0000000b:head [write 1284087~3916 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.720758958000001, 2024-04-26T11:24:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075641310000000003, 2024-04-26T11:24:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413122+0000", 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413130+0000", 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6770000000000001e-06 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413138+0000", 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.277e-06 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413143+0000", 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5609999999999998e-06 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478754+0000", 2024-04-26T11:24:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065610702000000007 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478846+0000", 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1525000000000002e-05 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.478916+0000", 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0630000000000006e-05 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481402+0000", 2024-04-26T11:24:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00248577 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488675+0000", 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007273219 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488724+0000", 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8525e-05 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488764+0000", 2024-04-26T11:24:22.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0095000000000002e-05 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:547 3.2 3:4272d415:::200.0000000b:head [write 1288003~3903 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.720732025, 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075709753000000005, 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413149+0000", 2024-04-26T11:24:22.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413158+0000", 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1640000000000007e-06 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413175+0000", 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7008999999999999e-05 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413181+0000", 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3249999999999996e-06 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479410+0000", 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066228713999999994 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479498+0000", 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7478000000000005e-05 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.479629+0000", 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013174500000000001 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482049+0000", 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024196249999999999 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488812+0000", 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067625810000000001 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488842+0000", 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0281e-05 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488859+0000", 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7306e-05 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:548 3.2 3:4272d415:::200.0000000b:head [write 1291906~6986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.720694351999999, 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079787192000000007, 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413187+0000", 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413195+0000", 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6780000000000006e-06 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413204+0000", 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7839999999999992e-06 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413210+0000", 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8440000000000003e-06 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480166+0000", 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066956565999999995 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480263+0000", 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6997999999999995e-05 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480359+0000", 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5858000000000003e-05 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482071+0000", 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001711918 2024-04-26T11:24:22.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492877+0000", 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010805465 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492942+0000", 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5456999999999993e-05 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492974+0000", 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2162000000000001e-05 2024-04-26T11:24:22.152 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:549 3.2 3:4272d415:::200.0000000b:head [write 1298892~7865 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.720666294000001, 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080075681999999995, 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413215+0000", 2024-04-26T11:24:22.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413225+0000", 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0767e-05 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413233+0000", 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4540000000000001e-06 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.413239+0000", 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0959999999999997e-06 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480790+0000", 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067551471000000002 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480867+0000", 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6334000000000005e-05 2024-04-26T11:24:22.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.480982+0000", 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000115395 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484440+0000", 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003458259 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493045+0000", 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086047999999999993 2024-04-26T11:24:22.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493113+0000", 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8040000000000006e-05 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493291+0000", 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017755900000000001 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:550 3.2 3:4272d415:::200.0000000b:head [write 1306757~7740 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.717748219000001, 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.085136109000000001, 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416133+0000", 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416132+0000", 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416221+0000", 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8979000000000003e-05 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416233+0000", 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.202e-05 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416242+0000", 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3299999999999999e-06 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481553+0000", 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065311285999999996 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481603+0000", 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0191000000000001e-05 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.481668+0000", 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4961000000000004e-05 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484444+0000", 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027755100000000001 2024-04-26T11:24:22.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501161+0000", 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016716992999999999 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501229+0000", 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8664000000000005e-05 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501269+0000", 2024-04-26T11:24:22.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9956999999999997e-05 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:552 3.2 3:4272d415:::200.0000000b:head [write 1314497~14459 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.716966616000001, 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.084463892999999998, 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:22.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416915+0000", 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416914+0000", 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416932+0000", 2024-04-26T11:24:22.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8263000000000001e-05 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416943+0000", 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0456e-05 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.416950+0000", 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.345e-06 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482123+0000", 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065173399000000007 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482206+0000", 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2589000000000005e-05 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482318+0000", 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011194200000000001 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484979+0000", 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026616019999999999 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501313+0000", 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016333174999999998 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501343+0000", 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0056000000000002e-05 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501379+0000", 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5991999999999997e-05 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:553 3.2 3:4272d415:::200.0000000b:head [write 1328956~3568 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.715010338999999, 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082605777000000005, 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418871+0000", 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418870+0000", 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418878+0000", 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8629999999999997e-06 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418895+0000", 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6886999999999999e-05 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418904+0000", 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5769999999999994e-06 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482753+0000", 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063849218999999999 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482799+0000", 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5346999999999998e-05 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.482864+0000", 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5124999999999997e-05 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484984+0000", 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021205820000000002 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501422+0000", 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016438066000000001 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501457+0000", 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5154999999999998e-05 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501477+0000", 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9417999999999999e-05 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:554 3.2 3:4272d415:::200.0000000b:head [write 1332524~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.714968842000001, 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082655731999999996, 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.174 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418913+0000", 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418912+0000", 2024-04-26T11:24:22.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418920+0000", 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418927+0000", 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6399999999999997e-06 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418933+0000", 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9270000000000002e-06 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483248+0000", 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064314274000000005 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483345+0000", 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7065000000000007e-05 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483458+0000", 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113285 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484989+0000", 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001531012 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501510+0000", 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016520981000000001 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501535+0000", 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501568+0000", 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2808000000000002e-05 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.179 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:555 3.2 3:4272d415:::200.0000000b:head [write 1333928~2765 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.714942749999999, 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082729079999999997, 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418939+0000", 2024-04-26T11:24:22.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418938+0000", 2024-04-26T11:24:22.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418946+0000", 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9929999999999995e-06 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418966+0000", 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0095e-05 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.418973+0000", 2024-04-26T11:24:22.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1929999999999998e-06 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483863+0000", 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.064890529000000002 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.483929+0000", 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5665000000000002e-05 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484000+0000", 2024-04-26T11:24:22.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0903999999999997e-05 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485480+0000", 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001480084 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501598+0000", 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016118789000000001 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501631+0000", 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3015000000000002e-05 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501668+0000", 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6239999999999999e-05 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:556 3.2 3:4272d415:::200.0000000b:head [write 1336693~3915 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:22.185 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.714793138000001, 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.082682631000000006, 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:22.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419088+0000", 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419095+0000", 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7219999999999999e-06 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419120+0000", 2024-04-26T11:24:22.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4854e-05 2024-04-26T11:24:22.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.419127+0000", 2024-04-26T11:24:22.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4540000000000004e-06 2024-04-26T11:24:22.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484461+0000", 2024-04-26T11:24:22.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065334619999999996 2024-04-26T11:24:22.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484507+0000", 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5906999999999999e-05 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.484612+0000", 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000104813 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.486851+0000", 2024-04-26T11:24:22.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022388479999999999 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501706+0000", 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014855419999999999 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501734+0000", 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7617999999999999e-05 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501771+0000", 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:557 3.2 3:4272d415:::200.0000000b:head [write 1340608~2449 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.711785683999999, 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079811516999999998, 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422096+0000", 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422094+0000", 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999981 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422107+0000", 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2762000000000001e-05 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422121+0000", 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3784999999999999e-05 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422134+0000", 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3304e-05 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485009+0000", 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.062874860000000005 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485053+0000", 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3949000000000002e-05 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485172+0000", 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011921699999999999 2024-04-26T11:24:22.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487692+0000", 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025201939999999999 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501818+0000", 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014125499 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501864+0000", 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6403999999999998e-05 2024-04-26T11:24:22.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501907+0000", 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3266000000000002e-05 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:558 3.2 3:4272d415:::200.0000000b:head [write 1343057~1958 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.711737086999999, 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079859576000000002, 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.196 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422144+0000", 2024-04-26T11:24:22.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422153+0000", 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909999999999999e-06 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422161+0000", 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4319999999999999e-06 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422168+0000", 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4049999999999997e-06 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485516+0000", 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.063348074000000004 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485624+0000", 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010805 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.485781+0000", 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015710100000000001 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487700+0000", 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001918746 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501949+0000", 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014249114 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.501973+0000", 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4627e-05 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502004+0000", 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0531999999999998e-05 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:559 3.2 3:4272d415:::200.0000000b:head [write 1345015~4213 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.711708029, 2024-04-26T11:24:22.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079931344000000001, 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422173+0000", 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422183+0000", 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8959999999999998e-06 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422190+0000", 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7669999999999998e-06 2024-04-26T11:24:22.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422195+0000", 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.011e-06 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487222+0000", 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065027153000000004 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487263+0000", 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1201000000000001e-05 2024-04-26T11:24:22.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487330+0000", 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6507999999999994e-05 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488866+0000", 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001536747 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502050+0000", 2024-04-26T11:24:22.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013183540000000001 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502085+0000", 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4952e-05 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502105+0000", 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9947999999999999e-05 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:560 3.2 3:4272d415:::200.0000000b:head [write 1349228~3445 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.711681206000002, 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079997483999999994, 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422200+0000", 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422208+0000", 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0309999999999998e-06 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422214+0000", 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6560000000000003e-06 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422220+0000", 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6489999999999996e-06 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487739+0000", 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.065519226 2024-04-26T11:24:22.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487833+0000", 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4106999999999999e-05 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.487972+0000", 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013830099999999999 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492072+0000", 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040998379999999997 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502140+0000", 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010068238 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502165+0000", 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5454999999999999e-05 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502198+0000", 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2478999999999999e-05 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:561 3.2 3:4272d415:::200.0000000b:head [write 1352673~4505 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.711654279000001, 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080048127999999996, 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422227+0000", 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422235+0000", 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8539999999999997e-06 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422242+0000", 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7670000000000003e-06 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422248+0000", 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1850000000000003e-06 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488886+0000", 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.066638785000000006 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.488982+0000", 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5387e-05 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489141+0000", 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015913400000000001 2024-04-26T11:24:22.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492079+0000", 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029382509999999998 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502233+0000", 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010154379 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502259+0000", 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5029999999999999e-05 2024-04-26T11:24:22.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502275+0000", 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6735000000000002e-05 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:562 3.2 3:4272d415:::200.0000000b:head [write 1357178~1404 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.7116279, 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080110050000000002, 2024-04-26T11:24:22.217 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422254+0000", 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422253+0000", 2024-04-26T11:24:22.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422257+0000", 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1840000000000001e-06 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422263+0000", 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0580000000000003e-06 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422268+0000", 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8919999999999999e-06 2024-04-26T11:24:22.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.489892+0000", 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067623600000000006 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490047+0000", 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154933 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.490335+0000", 2024-04-26T11:24:22.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028846200000000002 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497761+0000", 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074257460000000004 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502307+0000", 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0045457910000000004 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502331+0000", 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4601e-05 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502364+0000", 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2224000000000002e-05 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:563 3.2 3:4272d415:::200.0000000b:head [write 1358582~1914 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.711608553000001, 2024-04-26T11:24:22.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080161018000000001, 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422273+0000", 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422272+0000", 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422280+0000", 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0250000000000002e-06 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422288+0000", 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3050000000000004e-06 2024-04-26T11:24:22.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422293+0000", 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3669999999999996e-06 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491197+0000", 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068903765000000006 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491329+0000", 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013223400000000001 2024-04-26T11:24:22.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.491443+0000", 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114159 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497769+0000", 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063253190000000003 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502392+0000", 2024-04-26T11:24:22.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004622915 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502415+0000", 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3626e-05 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502434+0000", 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8703999999999999e-05 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:564 3.2 3:4272d415:::200.0000000b:head [write 1360496~1928 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.711581312, 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.080221908999999994, 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422300+0000", 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422304+0000", 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9360000000000001e-06 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422311+0000", 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0840000000000003e-06 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.422317+0000", 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6969999999999996e-06 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492152+0000", 2024-04-26T11:24:22.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069834487000000001 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492258+0000", 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000106351 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.492423+0000", 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016443600000000001 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.497775+0000", 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053519650000000002 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502465+0000", 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046902660000000002 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502490+0000", 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4777999999999999e-05 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502522+0000", 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2369999999999997e-05 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:565 3.2 3:4272d415:::200.0000000b:head [write 1362424~12956 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.710494271000002, 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.079271854000000003, 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423387+0000", 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423386+0000", 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423436+0000", 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0121999999999999e-05 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423449+0000", 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2863e-05 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.423459+0000", 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6099999999999995e-06 2024-04-26T11:24:22.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493380+0000", 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.069921187999999995 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493456+0000", 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6416999999999997e-05 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.493584+0000", 2024-04-26T11:24:22.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000128009 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499173+0000", 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055883599999999997 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502578+0000", 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034056020000000002 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502625+0000", 2024-04-26T11:24:22.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6285000000000002e-05 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.502659+0000", 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4464000000000001e-05 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(mds.0.3:566 3.2 3:4272d415:::200.0000000b:head [write 1375380~4794 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e62)", 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.708104224, 2024-04-26T11:24:22.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.078877303999999995, 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425777+0000", 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425775+0000", 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4294967295.9999976 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425794+0000", 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9434000000000001e-05 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425810+0000", 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.525e-05 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.425821+0000", 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0981e-05 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494069+0000", 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.068247996000000005 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494115+0000", 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6310999999999998e-05 2024-04-26T11:24:22.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for subops from 1", 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.494183+0000", 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7841000000000003e-05 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op_commit", 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.499177+0000", 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049940109999999996 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_commit_rec", 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504563+0000", 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053863339999999996 2024-04-26T11:24:22.244 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504614+0000", 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0334999999999998e-05 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T11:23:59.504654+0000", 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0976000000000002e-05 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T11:24:22.245 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T11:24:22.246 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:22.247 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:22.244+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:22.247 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:22.322 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:24:22.322 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":70,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:24:20.460876+0000","last_up_change":"2024-04-26T11:23:22.452731+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":0.7032623291015625,"average_primary_affinity":0.69999998807907104,"average_primary_affinity_weighted":0.69999998807907104}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.7032623291015625,"average_primary_affinity":0.69999998807907104,"average_primary_affinity_weighted":0.69999998807907104}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.9600000381469727,"score_stable":1.9600000381469727,"optimal_score":0.67000001668930054,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":0.7032623291015625,"average_primary_affinity":0.69999998807907104,"average_primary_affinity_weighted":0.69999998807907104}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.059999942779541,"score_stable":2.059999942779541,"optimal_score":0.67000001668930054,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":0.7032623291015625,"average_primary_affinity":0.69999998807907104,"average_primary_affinity_weighted":0.69999998807907104}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":46,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":21480},{"type":"v1","addr":"172.21.15.88:6801","nonce":21480}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":21480},{"type":"v1","addr":"172.21.15.88:6803","nonce":21480}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":21480},{"type":"v1","addr":"172.21.15.88:6807","nonce":21480}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":21480},{"type":"v1","addr":"172.21.15.88:6805","nonce":21480}]},"public_addr":"172.21.15.88:6801/21480","cluster_addr":"172.21.15.88:6803/21480","heartbeat_back_addr":"172.21.15.88:6807/21480","heartbeat_front_addr":"172.21.15.88:6805/21480","state":["exists"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":0.1097869873046875,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:24:22.342 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T11:21:41.373843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T11:21:48.112664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T11:21:52.071918+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.9600000381469727, 'score_stable': 1.9600000381469727, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T11:21:52.677679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.059999942779541, 'score_stable': 2.059999942779541, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 0.7032623291015625, 'average_primary_affinity': 0.699999988079071, 'average_primary_affinity_weighted': 0.699999988079071}}] 2024-04-26T11:24:22.342 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T11:24:22.348 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:22.344+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:22.377 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:22.377 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:22.378 INFO:teuthology.orchestra.run.smithi107.stdout: "num_ops": 0 2024-04-26T11:24:22.378 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:22.391 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:22.449 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:22.446+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:22.493 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:24:22.512 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:22.512 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [], 2024-04-26T11:24:22.512 INFO:teuthology.orchestra.run.smithi107.stdout: "complaint_time": 30, 2024-04-26T11:24:22.512 INFO:teuthology.orchestra.run.smithi107.stdout: "num_blocked_ops": 0 2024-04-26T11:24:22.512 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:22.526 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:22.569 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:22.566+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:22.635 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 1 2024-04-26T11:24:22.652 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T11:24:22.652 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:22.648+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:22.695 INFO:teuthology.orchestra.run.smithi107.stdout:{ 2024-04-26T11:24:22.695 INFO:teuthology.orchestra.run.smithi107.stdout: "size": 20, 2024-04-26T11:24:22.695 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 600, 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: "ops": [ 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2615 3.d 3:b02ffd62:::200.00000010:head [write 2546869~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.285671615999998, 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070123572999999995, 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.696 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406473+0000", 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406472+0000", 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406483+0000", 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1219999999999999e-05 2024-04-26T11:24:22.697 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406499+0000", 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5452999999999999e-05 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406511+0000", 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1769e-05 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472319+0000", 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065808723 2024-04-26T11:24:22.698 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.472411+0000", 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1896000000000002e-05 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476347+0000", 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0039353060000000004 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476433+0000", 2024-04-26T11:24:22.699 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6487000000000001e-05 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476597+0000", 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000163461 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2616 3.d 3:b02ffd62:::200.00000010:head [write 2548776~3877 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.285624907999999, 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070199544000000003, 2024-04-26T11:24:22.700 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406520+0000", 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.701 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406519+0000", 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406531+0000", 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.172e-05 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406546+0000", 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.5685999999999999e-05 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.702 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406556+0000", 2024-04-26T11:24:22.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0071000000000001e-05 2024-04-26T11:24:22.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.703 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473252+0000", 2024-04-26T11:24:22.703 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066695915999999994 2024-04-26T11:24:22.703 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.703 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.703 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.473332+0000", 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.9709000000000005e-05 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476611+0000", 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0032787630000000001 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476656+0000", 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5096999999999999e-05 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.704 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476719+0000", 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3332999999999998e-05 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2617 3.d 3:b02ffd62:::200.00000010:head [write 2552653~1113 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.285579297999998, 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073674075000000006, 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.705 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406565+0000", 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406564+0000", 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.706 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406570+0000", 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.6520000000000003e-06 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406583+0000", 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2679e-05 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.406594+0000", 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1032999999999999e-05 2024-04-26T11:24:22.707 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474020+0000", 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.067425944000000002 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474102+0000", 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2806999999999995e-05 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480120+0000", 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0060174729999999997 2024-04-26T11:24:22.708 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480169+0000", 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.9570999999999997e-05 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480239+0000", 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.0026999999999999e-05 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.709 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2618 3.d 3:b02ffd62:::200.00000010:head [write 2553766~1050 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.282799633, 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071002984000000005, 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.710 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409345+0000", 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409344+0000", 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409353+0000", 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9150000000000002e-06 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.711 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409371+0000", 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.8904000000000001e-05 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409384+0000", 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2566e-05 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065596495000000005 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.712 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475126+0000", 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000145329 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480249+0000", 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.005123102 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480288+0000", 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9285000000000001e-05 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.713 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480348+0000", 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9728999999999997e-05 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:14995 4.5 4:a0840aa3:::10000003880.00000000:head [write 85470~33722] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.282740374999999, 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071045135999999995, 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.714 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 14995 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.715 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409404+0000", 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409431+0000", 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7233000000000002e-05 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409440+0000", 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5859999999999994e-06 2024-04-26T11:24:22.716 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.409446+0000", 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9429999999999997e-06 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.474981+0000", 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065534244000000005 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.475214+0000", 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00023348600000000001 2024-04-26T11:24:22.717 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480357+0000", 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0051425710000000003 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480394+0000", 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.7289000000000002e-05 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.718 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480449+0000", 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.5507000000000002e-05 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2619 3.d 3:b02ffd62:::200.00000010:head [write 2554816~2786 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.282114284999999, 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071786804999999995, 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.719 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410030+0000", 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410029+0000", 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.720 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410037+0000", 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.2760000000000003e-06 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410047+0000", 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0555e-05 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.410054+0000", 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9399999999999996e-06 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.476866+0000", 2024-04-26T11:24:22.721 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.066812270000000007 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.477059+0000", 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00019292199999999999 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481712+0000", 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0046527210000000003 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.722 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481754+0000", 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.2017000000000001e-05 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481817+0000", 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.3054999999999999e-05 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2620 3.d 3:b02ffd62:::200.00000010:head [write 2557602~1924 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.279122546, 2024-04-26T11:24:22.723 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.073204069999999996, 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413022+0000", 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.724 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413021+0000", 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413038+0000", 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.6787999999999999e-05 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413052+0000", 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4606999999999999e-05 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.725 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.413062+0000", 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.9669999999999996e-06 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478002+0000", 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064940093000000004 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478080+0000", 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.7985999999999995e-05 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.726 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486106+0000", 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0080256040000000004 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486157+0000", 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1063000000000002e-05 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486226+0000", 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.9078000000000005e-05 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.727 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2621 3.d 3:b02ffd62:::200.00000010:head [write 2559526~1920 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.276296323, 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070487039000000001, 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.728 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415848+0000", 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415847+0000", 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415855+0000", 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.6929999999999996e-06 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.729 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415888+0000", 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2954999999999999e-05 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415902+0000", 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3706000000000001e-05 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478597+0000", 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062695089999999995 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.730 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.478709+0000", 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000111777 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486236+0000", 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0075266700000000001 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486276+0000", 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9966999999999999e-05 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.731 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.486335+0000", 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.9713000000000002e-05 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2622 3.d 3:b02ffd62:::200.00000010:head [write 2561446~5986 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.276178983000001, 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.072007783000000006, 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415966+0000", 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415965+0000", 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.733 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415979+0000", 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4697e-05 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.415993+0000", 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.3947e-05 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416003+0000", 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.023e-05 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.734 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479418+0000", 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063414807000000004 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.479500+0000", 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1631999999999994e-05 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487756+0000", 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0082565529999999998 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.735 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487831+0000", 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.4449999999999994e-05 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487973+0000", 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00014249999999999999 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2623 3.d 3:b02ffd62:::200.00000010:head [write 2567432~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:22.736 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.275807599, 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071791032000000005, 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416337+0000", 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.737 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416336+0000", 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416343+0000", 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.827e-06 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416354+0000", 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1168e-05 2024-04-26T11:24:22.738 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416364+0000", 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.7520000000000008e-06 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480382+0000", 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064018284999999994 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.480487+0000", 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00010463099999999999 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.739 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487984+0000", 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0074974000000000004 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488035+0000", 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0702999999999999e-05 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488128+0000", 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3246999999999997e-05 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.740 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2624 3.d 3:b02ffd62:::200.00000010:head [write 2569339~1907 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.275766985000001, 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071901926000000005, 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.741 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416378+0000", 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416377+0000", 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416380+0000", 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.287e-06 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.742 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416386+0000", 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.4559999999999999e-06 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.416390+0000", 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.0659999999999997e-06 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481222+0000", 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064831753000000006 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.743 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481290+0000", 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.8425999999999998e-05 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488139+0000", 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0068488289999999999 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488191+0000", 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1629000000000003e-05 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.744 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488280+0000", 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9009000000000001e-05 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(client.4728.0:15009 4.1d 4:b80503fc:::10000003240.00000000:head [write 897504~130300] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.274081202000001, 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069065685000000002, 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "client_info": { 2024-04-26T11:24:22.745 INFO:teuthology.orchestra.run.smithi107.stdout: "client": "client.4728", 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "client_addr": "192.168.0.1:0/298198185", 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "tid": 15009 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418063+0000", 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.746 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418062+0000", 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999986 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418222+0000", 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00016041800000000001 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418233+0000", 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0604999999999999e-05 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.747 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418240+0000", 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.7900000000000002e-06 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481210+0000", 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062970672000000005 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481312+0000", 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.000101834 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.748 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487023+0000", 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057108910000000001 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487065+0000", 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.1553e-05 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.487129+0000", 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4394999999999996e-05 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.749 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2625 3.d 3:b02ffd62:::200.00000010:head [write 2571246~11889 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.273764980999999, 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069981421000000002, 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:22.750 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418380+0000", 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418379+0000", 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418393+0000", 2024-04-26T11:24:22.751 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.4819e-05 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418405+0000", 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1756999999999999e-05 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.418413+0000", 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.6839999999999996e-06 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481846+0000", 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063433324999999999 2024-04-26T11:24:22.752 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.481927+0000", 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.0531000000000005e-05 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488289+0000", 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0063617559999999997 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488322+0000", 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3130999999999998e-05 2024-04-26T11:24:22.753 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.488361+0000", 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.9385000000000003e-05 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2626 3.d 3:b02ffd62:::200.00000010:head [write 2583135~1955 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.272781672000001, 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071468652999999993, 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.754 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419363+0000", 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419362+0000", 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.755 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419368+0000", 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2260000000000002e-06 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419379+0000", 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0920999999999999e-05 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.419388+0000", 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.1740000000000006e-06 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.756 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482729+0000", 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063340152999999996 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.482840+0000", 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011119400000000001 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490744+0000", 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0079037740000000006 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.757 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490781+0000", 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.735e-05 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490832+0000", 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.0729000000000002e-05 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2627 3.d 3:b02ffd62:::200.00000010:head [write 2585090~9888 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:22.758 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.271299850999998, 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070072738999999995, 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420845+0000", 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.759 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420844+0000", 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420857+0000", 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.2974e-05 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420868+0000", 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.1063999999999999e-05 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.420876+0000", 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.2060000000000007e-06 2024-04-26T11:24:22.760 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483561+0000", 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.062684472000000005 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.483646+0000", 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.5006000000000006e-05 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490839+0000", 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0071929979999999999 2024-04-26T11:24:22.761 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490872+0000", 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.3550999999999998e-05 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490917+0000", 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5426000000000002e-05 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.762 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2628 3.d 3:b02ffd62:::200.00000010:head [write 2594978~23633 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.269867164000001, 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068718354999999995, 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422277+0000", 2024-04-26T11:24:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422276+0000", 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422309+0000", 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.2440000000000001e-05 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422319+0000", 2024-04-26T11:24:22.764 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 1.0254e-05 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422326+0000", 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4509999999999997e-06 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484314+0000", 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.061988468999999997 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.484428+0000", 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011424799999999999 2024-04-26T11:24:22.765 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490923+0000", 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0064948699999999998 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490950+0000", 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.7163000000000001e-05 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.490996+0000", 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.5423000000000002e-05 2024-04-26T11:24:22.766 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2629 3.d 3:b02ffd62:::200.00000010:head [write 2618611~3263 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.269810528000001, 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.068771545000000003, 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:22.767 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422334+0000", 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422337+0000", 2024-04-26T11:24:22.768 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5659999999999998e-06 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422342+0000", 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8400000000000002e-06 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.422346+0000", 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8419999999999998e-06 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485397+0000", 2024-04-26T11:24:22.769 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.063051691000000007 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.485487+0000", 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.9986000000000002e-05 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491001+0000", 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0055139899999999999 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491030+0000", 2024-04-26T11:24:22.770 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8314999999999999e-05 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491106+0000", 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.5845000000000003e-05 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2634 3.d 3:b02ffd62:::200.00000010:head [write 2639450~2419 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.265897991999999, 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.070097349000000003, 2024-04-26T11:24:22.771 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426247+0000", 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.772 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426246+0000", 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426250+0000", 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4750000000000004e-06 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426257+0000", 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.4320000000000004e-06 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.773 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426261+0000", 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.732e-06 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491320+0000", 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065059326000000001 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.491435+0000", 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.00011479 2024-04-26T11:24:22.774 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496253+0000", 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.004818676 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496292+0000", 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.8640999999999998e-05 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.496344+0000", 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 5.1870000000000003e-05 2024-04-26T11:24:22.775 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2635 3.d 3:b02ffd62:::200.00000010:head [write 2641869~3599 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.265841730999998, 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.071646847999999999, 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.776 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426303+0000", 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426302+0000", 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.9999995 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426306+0000", 2024-04-26T11:24:22.777 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.6169999999999998e-06 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426314+0000", 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.1079999999999993e-06 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.426318+0000", 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.3769999999999998e-06 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.778 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492040+0000", 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.065721110999999999 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492102+0000", 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 6.2378999999999993e-05 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497865+0000", 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0057628710000000001 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497901+0000", 2024-04-26T11:24:22.779 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 3.5963000000000001e-05 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497950+0000", 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.8968000000000003e-05 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "description": "osd_op(mds.0.3:2636 3.d 3:b02ffd62:::200.00000010:head [write 2645468~4496 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e64)", 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "initiated_at": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "age": 18.263909001999998, 2024-04-26T11:24:22.780 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.069794832000000001, 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "type_data": { 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "events": [ 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "initiated", 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "throttled", 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428236+0000", 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.781 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "header_read", 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428235+0000", 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4294967295.999999 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "all_read", 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428244+0000", 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 8.8580000000000006e-06 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "dispatched", 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428253+0000", 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.5289999999999997e-06 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.782 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "queued_for_pg", 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.428261+0000", 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 7.3189999999999997e-06 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "reached_pg", 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492846+0000", 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.064585646999999996 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "started", 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.492940+0000", 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 9.3393000000000005e-05 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.783 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "op_commit", 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497957+0000", 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 0.0050173370000000002 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "commit_sent", 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.497986+0000", 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 2.8946e-05 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: }, 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "event": "done", 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "time": "2024-04-26T11:24:04.498030+0000", 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: "duration": 4.4561000000000002e-05 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.784 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-04-26T11:24:22.785 INFO:teuthology.orchestra.run.smithi107.stdout: ] 2024-04-26T11:24:22.785 INFO:teuthology.orchestra.run.smithi107.stdout:} 2024-04-26T11:24:22.785 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T11:24:22.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:22.788 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:22.784+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:22.887 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:22.882+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:22.895 INFO:teuthology.orchestra.run.smithi073.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-26T11:24:22.915 INFO:teuthology.orchestra.run.smithi073.stdout:osd.1: {} 2024-04-26T11:24:22.916 INFO:teuthology.orchestra.run.smithi073.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T11:24:22.916 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T11:24:22.916 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T11:24:22.916 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T11:24:22.916 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T11:24:22.930 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:22.933 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 8 2024-04-26T11:24:22.934 INFO:teuthology.orchestra.run.smithi073.stdout:osd.2: {} 2024-04-26T11:24:22.935 INFO:teuthology.orchestra.run.smithi073.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T11:24:22.937 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T11:24:22.938 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T11:24:22.950 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T11:24:22.988 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:22.986+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:23.049 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:23.050 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:23.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:23.110 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:23.108+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:23.186 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:23.186 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:23.190 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:23.186+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:23.200 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:23.261 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 32 2024-04-26T11:24:23.279 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T11:24:23.291 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:23.286+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:23.330 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:23.331 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:23.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:23.392 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:23.388+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:23.492 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:23.488+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:23.503 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:24:23.511 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:23.511 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:23.525 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:23.573 INFO:teuthology.orchestra.run.smithi073.stdout:pg_num: 64 2024-04-26T11:24:23.592 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T11:24:23.594 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:23.592+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:23.646 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:23.646 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:23.660 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:23.695 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:23.690+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:23.791 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:23.796 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:23.797 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:23.794+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:23.805 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:23.867 INFO:teuthology.orchestra.run.smithi073.stderr:listed 0 entries 2024-04-26T11:24:23.883 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2024-04-26T11:24:23.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:24:23.884 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-26T11:24:23.898 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:23.892+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:23.916 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:24:23.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi073.stderr:ceph-fuse[22838]: fuse finished with error 0 and tester_r 0 2024-04-26T11:24:23.920 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:23.920 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:23.934 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:23.986 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2024-04-26T11:24:23.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:24:23.987 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T11:24:24.022 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:24.020+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:24.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:24:24.047 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2024-04-26T11:24:24.096 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T11:24:24.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:24:24.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T11:24:24.097 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:24.097 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:24.099 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:24.096+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:24.111 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T11:24:24.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T11:24:24.152 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2024-04-26T11:24:24.200 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-04-26T11:24:24.194+0000 7fdd3b0da640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 21472) UID: 0 2024-04-26T11:24:24.241 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:24.241 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:24.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~59s 2024-04-26T11:24:24.255 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T11:24:24.301 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-26T11:24:24.296+0000 7f063055f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 21535) UID: 0 2024-04-26T11:24:24.317 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T11:24:24.326 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T11:24:24.420 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:24.420 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:24.434 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T11:24:24.550 INFO:teuthology.orchestra.run.smithi107.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:24.550 INFO:teuthology.orchestra.run.smithi107.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:24.565 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T11:24:24.698 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:24.699 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:24.712 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T11:24:24.834 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:24.834 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:24.849 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T11:24:24.969 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T11:24:24.969 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T11:24:25.521 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T11:24:26.505 INFO:teuthology.orchestra.run.smithi073.stderr:noscrub is unset 2024-04-26T11:24:26.531 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T11:24:27.529 INFO:teuthology.orchestra.run.smithi073.stderr:nodeep-scrub is unset 2024-04-26T11:24:30.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~64s 2024-04-26T11:24:35.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2024-04-26T11:24:41.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~76s 2024-04-26T11:24:47.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~82s 2024-04-26T11:24:53.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~88s 2024-04-26T11:24:59.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~93s 2024-04-26T11:25:04.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~99s 2024-04-26T11:25:10.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-04-26T11:25:16.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~111s 2024-04-26T11:25:22.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~117s 2024-04-26T11:25:28.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~122s 2024-04-26T11:25:33.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~128s 2024-04-26T11:25:39.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~134s 2024-04-26T11:25:45.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~140s 2024-04-26T11:25:51.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~146s 2024-04-26T11:25:57.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~151s 2024-04-26T11:26:01.663 DEBUG:teuthology.orchestra.console.smithi088:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  Initializing and establishing link...                     PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent. Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation CLIENT MAC ADDR: 0C C4 7A 8F D4 2D GUID: 00000000 0000 0000 0000 0CC47AD8A8F0 DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.88 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.88 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent.   Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D4 2D GUID: 00000000 0000 0000 0000 0CC47AD8A8F0 CLIENT IP: 172.21.15.88 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices...ok   iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d4:2d).... Configuring (net0 0c:c4:7a:8f:d4:2d)..... PXE-E61: Media test failure, check cable   GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************  Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.     The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-105-generic ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-105-generic (buildd@lcy02-amd64-007) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 (Ubuntu 5.15.0-105.115-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec3fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f76000-0x00000000798affff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798b0000-0x0000000079d4cfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4d000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.091 MHz processor [ 0.000418] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000599] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001896] last_pfn = 0x78ec4 max_arch_pfn = 0x400000000 [ 0.008243] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.008257] Using GB pages for direct mapping [ 0.008422] RAMDISK: [mem 0x300d1000-0x3405ffff] [ 0.008428] ACPI: Early table checksum verification disabled [ 0.008431] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.008434] ACPI: XSDT 0x00000000798B0098 0000B4 (v01 01072009 AMI 00010013) [ 0.008439] ACPI: FACP 0x00000000798E35B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008445] ACPI: DSDT 0x00000000798B01E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008448] ACPI: FACS 0x0000000079D4BF80 000040 [ 0.008450] ACPI: APIC 0x00000000798E36C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008453] ACPI: FPDT 0x00000000798E3788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008456] ACPI: FIDT 0x00000000798E37D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008459] ACPI: SPMI 0x00000000798E3870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008462] ACPI: MCFG 0x00000000798E38B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008465] ACPI: UEFI 0x00000000798E38F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008467] ACPI: HPET 0x00000000798E3938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008470] ACPI: WDDT 0x00000000798E3970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008473] ACPI: SSDT 0x00000000798E39B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008476] ACPI: SSDT 0x00000000798FAB30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008479] ACPI: SSDT 0x00000000798FD180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008481] ACPI: PRAD 0x00000000798FD1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008484] ACPI: DMAR 0x00000000798FD2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008487] ACPI: HEST 0x00000000798FD3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008490] ACPI: BERT 0x00000000798FD630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008493] ACPI: ERST 0x00000000798FD660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008496] ACPI: EINJ 0x00000000798FD890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008498] ACPI: Reserving FACP table memory at [mem 0x798e35b0-0x798e36bb] [ 0.008499] ACPI: Reserving DSDT table memory at [mem 0x798b01e8-0x798e35ab] [ 0.008501] ACPI: Reserving FACS table memory at [mem 0x79d4bf80-0x79d4bfbf] [ 0.008502] ACPI: Reserving APIC table memory at [mem 0x798e36c0-0x798e3787] [ 0.008503] ACPI: Reserving FPDT table memory at [mem 0x798e3788-0x798e37cb] [ 0.008504] ACPI: Reserving FIDT table memory at [mem 0x798e37d0-0x798e386b] [ 0.008504] ACPI: Reserving SPMI table memory at [mem 0x798e3870-0x798e38af] [ 0.008505] ACPI: Reserving MCFG table memory at [mem 0x798e38b0-0x798e38eb] [ 0.008506] ACPI: Reserving UEFI table memory at [mem 0x798e38f0-0x798e3931] [ 0.008507] ACPI: Reserving HPET table memory at [mem 0x798e3938-0x798e396f] [ 0.008508] ACPI: Reserving WDDT table memory at [mem 0x798e3970-0x798e39af] [ 0.008509] ACPI: Reserving SSDT table memory at [mem 0x798e39b0-0x798fab2e] [ 0.008510] ACPI: Reserving SSDT table memory at [mem 0x798fab30-0x798fd17b] [ 0.008511] ACPI: Reserving SSDT table memory at [mem 0x798fd180-0x798fd1e3] [ 0.008512] ACPI: Reserving PRAD table memory at [mem 0x798fd1e8-0x798fd2e9] [ 0.008513] ACPI: Reserving DMAR table memory at [mem 0x798fd2f0-0x798fd3ab] [ 0.008514] ACPI: Reserving HEST table memory at [mem 0x798fd3b0-0x798fd62b] [ 0.008515] ACPI: Reserving BERT table memory at [mem 0x798fd630-0x798fd65f] [ 0.008516] ACPI: Reserving ERST table memory at [mem 0x798fd660-0x798fd88f] [ 0.008517] ACPI: Reserving EINJ table memory at [mem 0x798fd890-0x798fd9bf] [ 0.008612] No NUMA configuration found [ 0.008613] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008622] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008953] Zone ranges: [ 0.008954] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008956] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008958] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008959] Device empty [ 0.008960] Movable zone start for each node [ 0.008963] Early memory node ranges [ 0.008963] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.008965] node 0: [mem 0x0000000000100000-0x0000000078ec3fff] [ 0.008966] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008970] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008975] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009010] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.078153] On node 0, zone Normal: 28988 pages in unavailable ranges [ 0.078267] ACPI: PM-Timer IO Port: 0x408 [ 0.078275] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.078277] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.078278] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.078279] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.078280] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.078281] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.078281] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.078282] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.078292] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.078296] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.078299] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.078301] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.078305] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.078307] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.078311] TSC deadline timer available [ 0.078312] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.078322] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.078324] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.078325] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.078326] PM: hibernation: Registered nosave memory: [mem 0x78ec4000-0x78f75fff] [ 0.078327] PM: hibernation: Registered nosave memory: [mem 0x78f76000-0x798affff] [ 0.078328] PM: hibernation: Registered nosave memory: [mem 0x798b0000-0x79d4cfff] [ 0.078329] PM: hibernation: Registered nosave memory: [mem 0x79d4d000-0x8fffffff] [ 0.078330] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.078331] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.078332] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.078332] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.078334] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.078336] Booting paravirtualized kernel on bare hardware [ 0.078338] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.078344] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.078553] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.078584] Built 1 zonelists, mobility grouping on. Total pages: 8228744 [ 0.078586] Policy zone: Normal [ 0.078587] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.078646] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic", will be passed to user space. [ 0.080782] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.081915] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.082006] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.166384] Memory: 32672704K/33438008K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765044K reserved, 0K cma-reserved) [ 0.166668] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.166683] Kernel/User page tables isolation: enabled [ 0.166713] ftrace: allocating 50694 entries in 199 pages [ 0.186558] ftrace: allocated 199 pages with 5 groups [ 0.186671] rcu: Hierarchical RCU implementation. [ 0.186673] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.186674] Rude variant of Tasks RCU enabled. [ 0.186675] Tracing variant of Tasks RCU enabled. [ 0.186676] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.186677] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.190085] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.190282] random: crng init done [ 0.195177] Console: colour VGA+ 80x25 [ 0.206454] printk: console [tty0] enabled [ 1.177721] printk: console [ttyS1] enabled [ 1.181981] ACPI: Core revision 20210730 [ 1.186141] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.195370] APIC: Switch to symmetric I/O mode setup [ 1.200407] DMAR: Host address width 46 [ 1.204311] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.209698] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.217795] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.225230] DMAR: ATSR flags: 0x0 [ 1.228618] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.234959] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.241382] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.247804] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.253271] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.253271] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.268447] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.273820] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.280125] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.303367] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3273a69c61c, max_idle_ns: 440795250530 ns [ 1.313980] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.18 BogoMIPS (lpj=14000364) [ 1.317995] CPU0: Thermal monitoring enabled (TM1) [ 1.322030] process: using mwait in idle threads [ 1.325980] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.329978] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.333979] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.337978] Spectre V2 : Mitigation: Retpolines [ 1.341978] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.345978] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.349978] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.353979] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.357978] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.361978] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.365981] MDS: Mitigation: Clear CPU buffers [ 1.369978] TAA: Mitigation: Clear CPU buffers [ 1.373978] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.377983] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.381978] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.385978] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.389978] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.393978] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.415511] Freeing SMP alternatives memory: 44K [ 1.417979] pid_max: default: 32768 minimum: 301 [ 1.421998] LSM: Security Framework initializing [ 1.425986] landlock: Up and running. [ 1.429978] Yama: becoming mindful. [ 1.433995] AppArmor: AppArmor initialized [ 1.438038] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.442018] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.446333] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.449983] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.454085] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.457979] ... version: 3 [ 1.461978] ... bit width: 48 [ 1.465978] ... generic registers: 4 [ 1.469978] ... value mask: 0000ffffffffffff [ 1.473978] ... max period: 00007fffffffffff [ 1.477978] ... fixed-purpose events: 3 [ 1.481978] ... event mask: 000000070000000f [ 1.486038] signal: max sigframe size: 1776 [ 1.489993] rcu: Hierarchical SRCU implementation. [ 1.494691] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.498042] smp: Bringing up secondary CPUs ... [ 1.502059] x86: Booting SMP configuration: [ 1.505980] .... node #0, CPUs: #1 #2 #3 #4 [ 1.513994] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.521978] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.525978] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.530075] #5 #6 #7 [ 1.530531] smp: Brought up 1 node, 8 CPUs [ 1.537980] smpboot: Max logical packages: 1 [ 1.541978] smpboot: Total of 8 processors activated (56001.45 BogoMIPS) [ 1.550125] devtmpfs: initialized [ 1.553395] x86/mm: Memory block size: 128MB [ 1.555577] ACPI: PM: Registering ACPI NVS region [mem 0x798b0000-0x79d4cfff] (4837376 bytes) [ 1.558055] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.561988] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.566025] pinctrl core: initialized pinctrl subsystem [ 1.570068] PM: RTC time: 11:25:29, date: 2024-04-26 [ 1.574083] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.578311] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.582275] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.586308] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.589988] audit: initializing netlink subsys (disabled) [ 1.593996] audit: type=2000 audit(1714130728.356:1): state=initialized audit_enabled=0 res=1 [ 1.594091] thermal_sys: Registered thermal governor 'fair_share' [ 1.597980] thermal_sys: Registered thermal governor 'bang_bang' [ 1.601978] thermal_sys: Registered thermal governor 'step_wise' [ 1.605978] thermal_sys: Registered thermal governor 'user_space' [ 1.609978] thermal_sys: Registered thermal governor 'power_allocator' [ 1.613983] EISA bus registered [ 1.621194] cpuidle: using governor ladder [ 1.621980] cpuidle: using governor menu [ 1.625993] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.629979] ACPI: bus type PCI registered [ 1.633979] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.638032] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.641980] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.645991] PCI: Using configuration type 1 for base access [ 1.650994] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.653994] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.657979] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.662052] ACPI: Added _OSI(Module Device) [ 1.665980] ACPI: Added _OSI(Processor Device) [ 1.669986] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.673978] ACPI: Added _OSI(Processor Aggregator Device) [ 1.677978] ACPI: Added _OSI(Linux-Dell-Video) [ 1.681978] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.685978] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.736835] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.741300] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.746129] ACPI: Dynamic OEM Table Load: [ 1.780804] ACPI: Interpreter enabled [ 1.781989] ACPI: PM: (supports S0 S4 S5) [ 1.785978] ACPI: Using IOAPIC for interrupt routing [ 1.790001] HEST: Enabling Firmware First mode for corrected errors. [ 1.794056] HEST: Table parsing has been initialized. [ 1.798126] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.801980] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.805978] PCI: Using E820 reservations for host bridge windows [ 1.810667] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.847377] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.849981] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.855966] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.859038] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.861978] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.866010] PCI host bridge to bus 0000:ff [ 1.869979] pci_bus 0000:ff: root bus resource [bus ff] [ 1.873989] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.878043] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.882031] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.886029] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.890031] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.894032] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.898029] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.902032] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.906033] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.910029] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.914030] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.918029] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.922029] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.926031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.930031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.934031] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.938031] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.942028] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.946029] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.950003] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.954040] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.958080] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.962042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.966042] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.970140] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.974045] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.978041] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.982033] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.986033] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.990043] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.994043] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.998042] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.002044] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.006031] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.010031] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.014031] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.018033] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.022042] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.026042] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.030043] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.034046] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.038035] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.042031] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.046032] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.050034] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.054032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.058031] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.062032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.066037] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.070033] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.074030] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.078030] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.082004] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.086032] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.090030] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.098448] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.101981] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.106322] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.110453] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.113979] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.118269] PCI host bridge to bus 0000:00 [ 2.121979] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.125978] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.129978] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.133978] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.137978] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.141978] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.145978] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.150085] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.154189] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.158044] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.162150] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.166043] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.170144] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.174044] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.178139] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.181997] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.186173] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.189997] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.194171] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.197997] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.202172] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.205997] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.210169] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.213997] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.218175] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.221997] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.226170] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.229997] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.234171] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.237997] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.242123] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.246199] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.250126] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.254148] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.257992] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.262219] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.266271] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.270000] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.273989] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.277990] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.281989] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.285989] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.289989] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.294019] pci 0000:00:11.4: PME# supported from D3hot [ 2.298132] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.302004] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.306054] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.310127] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.314004] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.318055] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.322123] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.326004] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.330055] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.334136] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.338001] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.342083] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.346139] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.350068] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.354141] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.358070] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.362140] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.366070] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.370149] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.374001] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.378083] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.382135] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.386254] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.389998] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.393988] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.397988] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.401988] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.405988] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.409988] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.414013] pci 0000:00:1f.2: PME# supported from D3hot [ 2.418123] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.422003] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.426010] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.430194] acpiphp: Slot [1] registered [ 2.433995] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.438158] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.441998] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.446020] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.449981] pci 0000:02:00.0: enabling Extended Tags [ 2.454082] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.457980] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.462160] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.466000] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.469987] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.474001] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.477987] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.482018] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.485999] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.489978] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.493991] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.497978] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.502140] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.505999] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.509987] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.514000] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.517987] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.522018] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.525995] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.529978] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.533991] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.537978] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.542111] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.545979] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.549979] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.553980] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.558009] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.562044] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.566067] pci 0000:05:00.0: enabling Extended Tags [ 2.570051] pci 0000:05:00.0: supports D1 D2 [ 2.573978] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.578070] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.581980] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.585979] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.590120] pci_bus 0000:06: extended config space not accessible [ 2.594013] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.598011] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.601995] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.605995] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.610063] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.614020] pci 0000:06:00.0: supports D1 D2 [ 2.617978] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.622089] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.625984] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.629981] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.634077] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.638005] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.642006] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.645993] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.650112] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.654017] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.657978] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.662004] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.665978] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.670153] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.674005] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.678006] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.681992] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.686108] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.690015] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.693978] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.698004] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.701978] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.706134] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.709980] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.713980] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.717981] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.722906] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.726028] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.730027] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.734026] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.738028] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.741978] ACPI: PCI: Interrupt link LNKE disabled [ 2.746026] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.749978] ACPI: PCI: Interrupt link LNKF disabled [ 2.754026] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.757978] ACPI: PCI: Interrupt link LNKG disabled [ 2.762026] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.765978] ACPI: PCI: Interrupt link LNKH disabled [ 2.770165] iommu: Default domain type: Translated [ 2.773980] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.778102] SCSI subsystem initialized [ 2.781988] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.785977] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.785978] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.789978] vgaarb: loaded [ 2.792763] ACPI: bus type USB registered [ 2.793987] usbcore: registered new interface driver usbfs [ 2.797982] usbcore: registered new interface driver hub [ 2.801983] usbcore: registered new device driver usb [ 2.805993] pps_core: LinuxPPS API ver. 1 registered [ 2.809978] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.813981] PTP clock support registered [ 2.817992] EDAC MC: Ver: 3.0.0 [ 2.821289] NetLabel: Initializing [ 2.821979] NetLabel: domain hash size = 128 [ 2.825978] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.829989] NetLabel: unlabeled traffic allowed by default [ 2.833988] PCI: Using ACPI for IRQ routing [ 2.843233] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.845979] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.852018] clocksource: Switched to clocksource tsc-early [ 2.864131] VFS: Disk quotas dquot_6.6.0 [ 2.868133] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.875166] AppArmor: AppArmor Filesystem Enabled [ 2.879966] pnp: PnP ACPI init [ 2.883548] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.889539] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.895525] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.901510] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.907498] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.913486] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.919469] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.926150] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.932832] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.939513] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.946197] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.952879] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.959560] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.966457] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.972449] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.978434] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.984415] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.990405] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.997367] pnp: PnP ACPI: found 5 devices [ 3.006890] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.015895] NET: Registered PF_INET protocol family [ 3.021005] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.030293] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.039110] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.047108] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.055513] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.063044] TCP: Hash tables configured (established 262144 bind 65536) [ 3.069868] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.077653] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.084675] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.092131] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.097857] NET: Registered PF_XDP protocol family [ 3.102734] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.114308] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.122220] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.127264] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.132297] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.139164] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.146816] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.154815] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.162555] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.170642] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.178294] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.186293] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.194031] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.202120] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.209769] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.217771] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.225509] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.233597] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.241247] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.249249] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.256986] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.265073] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.270101] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.276260] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.283115] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.290949] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.295999] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.301033] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.307205] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.314077] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.319372] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.325542] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.332404] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.340232] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.348155] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.355987] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.363901] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.368935] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.375096] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.381951] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.389787] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.396031] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.409986] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.416928] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.423869] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.430811] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.437752] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.444086] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.449726] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.456054] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.463363] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.469000] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.475331] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.480973] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.487307] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.492947] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.499275] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.506943] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.535846] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 21088 usecs [ 3.567840] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23915 usecs [ 3.575340] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.581895] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.581900] Trying to unpack rootfs image as initramfs... [ 3.588404] software IO TLB: mapped [mem 0x0000000074ec4000-0x0000000078ec4000] (64MB) [ 3.602344] Initialise system trusted keyrings [ 3.606866] Key type blacklist registered [ 3.610982] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.618450] zbud: loaded [ 3.621257] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.627318] fuse: init (API version 7.34) [ 3.631551] integrity: Platform Keyring initialized [ 3.644319] Key type asymmetric registered [ 3.648491] Asymmetric key parser 'x509' registered [ 3.653462] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.660994] io scheduler mq-deadline registered [ 3.666092] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.672130] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.678155] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.684122] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.690090] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.696048] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.702011] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.708922] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.714793] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.723252] ACPI: button: Power Button [PWRB] [ 3.727710] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.735228] ACPI: button: Power Button [PWRF] [ 3.740972] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.748546] pstore: Registered erst as persistent store backend [ 3.754665] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.781599] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.810508] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.820114] Linux agpgart interface v0.103 [ 3.825915] loop: module loaded [ 3.829353] tun: Universal TUN/TAP device driver, 1.6 [ 3.834500] PPP generic driver version 2.4.2 [ 3.838880] VFIO - User Level meta-driver version: 0.3 [ 3.844219] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.850818] ehci-pci: EHCI PCI platform driver [ 3.855481] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.860776] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.868271] ehci-pci 0000:00:1a.0: debug port 2 [ 3.876779] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.895739] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.901609] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.909964] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.917276] usb usb1: Product: EHCI Host Controller [ 3.922225] usb usb1: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 3.928738] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.933561] hub 1-0:1.0: USB hub found [ 3.935667] Freeing initrd memory: 65084K [ 3.937397] hub 1-0:1.0: 2 ports detected [ 3.945807] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.951108] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.958596] ehci-pci 0000:00:1d.0: debug port 2 [ 3.967099] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.987775] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.993642] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.001991] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.009294] usb usb2: Product: EHCI Host Controller [ 4.014238] usb usb2: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.020742] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.025512] hub 2-0:1.0: USB hub found [ 4.029327] hub 2-0:1.0: 2 ports detected [ 4.033522] ehci-platform: EHCI generic platform driver [ 4.038833] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.045080] ohci-pci: OHCI PCI platform driver [ 4.049607] ohci-platform: OHCI generic platform driver [ 4.054905] uhci_hcd: USB Universal Host Controller Interface driver [ 4.061368] i8042: PNP: No PS/2 controller found. [ 4.066187] mousedev: PS/2 mouse device common for all mice [ 4.071902] rtc_cmos 00:00: RTC can wake from S4 [ 4.076778] rtc_cmos 00:00: registered as rtc0 [ 4.081322] rtc_cmos 00:00: setting system clock to 2024-04-26T11:25:32 UTC (1714130732) [ 4.089517] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.096295] i2c_dev: i2c /dev entries driver [ 4.100800] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.113077] device-mapper: uevent: version 1.0.3 [ 4.117798] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.126344] platform eisa.0: Probing EISA bus 0 [ 4.130943] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.137796] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.144302] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.150809] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.157317] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.163827] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.170337] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.176846] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.183354] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.189862] platform eisa.0: EISA: Detected 0 cards [ 4.194854] intel_pstate: Intel P-state driver initializing [ 4.201573] ledtrig-cpu: registered to indicate activity on CPUs [ 4.207791] drop_monitor: Initializing network drop monitor service [ 4.214236] NET: Registered PF_INET6 protocol family [ 4.227160] Segment Routing with IPv6 [ 4.230916] In-situ OAM (IOAM) with IPv6 [ 4.234940] NET: Registered PF_PACKET protocol family [ 4.240134] Key type dns_resolver registered [ 4.245062] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.251048] microcode: Microcode Update Driver: v2.2. [ 4.251123] resctrl: L3 allocation detected [ 4.260482] resctrl: L3 monitoring detected [ 4.264731] IPI shorthand broadcast: enabled [ 4.269073] sched_clock: Marking stable (3221359834, 1047701046)->(5254186005, -985125125) [ 4.277647] registered taskstats version 1 [ 4.281817] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.288609] Loading compiled-in X.509 certificates [ 4.294021] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.304497] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.314738] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.324828] blacklist: Loading compiled-in revocation X.509 certificates [ 4.331609] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.341529] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.352074] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.362956] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.367767] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.373502] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.390896] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.401686] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.412478] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.424281] zswap: loaded using pool lzo/zbud [ 4.429002] Key type .fscrypt registered [ 4.432993] Key type fscrypt-provisioning registered [ 4.438081] pstore: Using crash dump compression: deflate [ 4.446826] Key type encrypted registered [ 4.448034] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.450898] AppArmor: AppArmor sha1 policy hashing enabled [ 4.459161] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.464748] ima: No TPM chip found, activating TPM-bypass! [ 4.475347] hub 1-1:1.0: USB hub found [ 4.485283] Loading compiled-in module X.509 certificates [ 4.489159] hub 1-1:1.0: 6 ports detected [ 4.495030] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.508667] ima: Allocated hash algorithm: sha1 [ 4.513282] ima: No architecture policies found [ 4.517880] evm: Initialising EVM extended attributes: [ 4.523084] evm: security.selinux [ 4.526469] evm: security.SMACK64 [ 4.529847] evm: security.SMACK64EXEC [ 4.533574] evm: security.SMACK64TRANSMUTE [ 4.537735] evm: security.SMACK64MMAP [ 4.540034] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.541461] evm: security.apparmor [ 4.549737] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.553212] evm: security.ima [ 4.563471] evm: security.capability [ 4.563816] hub 2-1:1.0: USB hub found [ 4.567107] evm: HMAC attrs: 0x1 [ 4.574432] hub 2-1:1.0: 8 ports detected [ 4.574482] PM: Magic number: 4:482:429 [ 4.582963] RAS: Correctable Errors collector initialized. [ 4.589487] Freeing unused decrypted memory: 2036K [ 4.594829] Freeing unused kernel image (initmem) memory: 3352K [ 4.623822] Write protecting the kernel read-only data: 30720k [ 4.627737] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.636003] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.646151] clocksource: Switched to clocksource tsc [ 4.651465] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.658384] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.703223] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.709725] x86/mm: Checking user space page tables [ 4.751594] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.758107] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.910037] dca service started, version 1.12.1 [ 4.916309] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.921615] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.930159] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.938211] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.947571] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.948228] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.960540] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.968025] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.974402] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.982759] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.990072] usb usb3: Product: xHCI Host Controller [ 4.995018] usb usb3: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 4.995991] scsi host0: ahci [ 5.001523] usb usb3: SerialNumber: 0000:00:14.0 [ 5.004608] scsi host1: ahci [ 5.009275] hub 3-0:1.0: USB hub found [ 5.012269] scsi host2: ahci [ 5.015945] hub 3-0:1.0: 15 ports detected [ 5.018987] scsi host3: ahci [ 5.025466] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.026065] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.026192] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.027161] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 5.027163] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.034344] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.041820] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.047716] usb usb4: Product: xHCI Host Controller [ 5.047719] usb usb4: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.053447] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.062753] usb usb4: SerialNumber: 0000:00:14.0 [ 5.070065] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.077625] hub 4-0:1.0: USB hub found [ 5.082706] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.089012] hub 4-0:1.0: 6 ports detected [ 5.089147] nvme nvme0: pci function 0000:02:00.0 [ 5.091542] nvme nvme0: 8/0/0 default/read/poll queues [ 5.096492] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.142566] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.142691] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.148035] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.159840] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.202538] igb 0000:07:00.0: added PHC on eth0 [ 5.204189] scsi host4: ahci [ 5.207164] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.210261] scsi host5: ahci [ 5.217023] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a8:f0 [ 5.220168] scsi host6: ahci [ 5.227253] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.230316] scsi host7: ahci [ 5.235345] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.238458] scsi host8: ahci [ 5.249092] scsi host9: ahci [ 5.252097] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 35 [ 5.259589] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 35 [ 5.267083] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 35 [ 5.274567] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 35 [ 5.282049] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 35 [ 5.289527] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 35 [ 5.301923] igb 0000:07:00.1: added PHC on eth1 [ 5.306550] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.313500] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a8:f1 [ 5.320793] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.326000] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.363797] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.398662] ata2: SATA link down (SStatus 0 SControl 300) [ 5.404151] ata1: SATA link down (SStatus 0 SControl 300) [ 5.409634] ata4: SATA link down (SStatus 0 SControl 300) [ 5.415146] ata3: SATA link down (SStatus 0 SControl 300) [ 5.515998] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.524377] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.532095] hub 3-12:1.0: USB hub found [ 5.536101] hub 3-12:1.0: 4 ports detected [ 5.610663] ata8: SATA link down (SStatus 0 SControl 300) [ 5.616168] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.622456] ata6: SATA link down (SStatus 0 SControl 300) [ 5.627950] ata9: SATA link down (SStatus 0 SControl 300) [ 5.633449] ata7: SATA link down (SStatus 0 SControl 300) [ 5.638954] ata10: SATA link down (SStatus 0 SControl 300) [ 5.644703] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.651593] ata5.00: NCQ Send/Recv Log not supported [ 5.656648] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.665165] ata5.00: NCQ Send/Recv Log not supported [ 5.670226] ata5.00: configured for UDMA/133 [ 5.674764] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.683226] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.683405] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.696395] sd 4:0:0:0: [sda] Write Protect is off [ 5.701280] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.721398] sda: sda1 [ 5.723948] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.731180] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.764387] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.847719] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.980130] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.988666] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.004008] hid: raw HID events driver (C) Jiri Kosina [ 6.011886] usbcore: registered new interface driver usbhid [ 6.017536] usbhid: USB HID core driver [ 6.023133] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.091875] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.103818] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.115629] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.352531] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.362928] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.371552] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.385795] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d4:2c [ 6.394229] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.564529] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.574928] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.583552] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.590683] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d4:2d [ 6.598994] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.606774] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.632676] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 197343/61054976 files, 6488428/244190336 blocks done. [ 13.719869] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.616427] systemd[1]: Inserted module 'autofs4' [ 14.736767] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.787908] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.818097] systemd[1]: Hostname set to . [ 16.180601] systemd[1]: Queued start job for default target Graphical Interface. [ 16.189334] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.212649] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.236378] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.259933] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.279972] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.304188] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.331906] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.359859] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.387895] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.415847] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.443848] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.471847] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.499960] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.523875] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.543885] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.567989] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.592110] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.617435] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.640144] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.660076] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.683971] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.708322] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.728068] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.748154] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.768229] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.792137] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.812051] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.833565] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.853475] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.877316] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.901437] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.920955] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 16.941410] RPC: Registered named UNIX socket transport module. [ 16.941763] systemd[1]: Starting Journal Service... [ 16.947409] RPC: Registered udp transport module. [ 16.947410] RPC: Registered tcp transport module. [ 16.947411] RPC: Registered tcp NFSv4.1 backchannel transport module. Starting Journal Service... [ 16.983951] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.994452] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 17.016892] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 17.040853] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 17.069280] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.092539] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.112535] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 17.132446] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.156794] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.180508] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.202509] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 17.209911] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.232509] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.251795] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.261560] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.271919] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.292488] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.316579] systemd[1]: Starting Coldplug All udev Devices... Starting Coldp[ 17.324568] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. lug All udev Devices... [ 17.345434] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ 17.359162] lp: driver loaded but no devices found [ OK ] Mounted Huge Pages File System. [ OK ] Mounted [0;[ 17.382097] Loading iSCSI transport class v2.0-870. 1;39mPOSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... Mounting Kernel Configuration File System... [ 17.702806] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 17.764804] systemd-journald[367]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. [ 17.911151] systemd-journald[367]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. Starting Create Volatile Files and Directories... [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. [ OK ] Started Rule-based Manager for Device Events and Files. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. Starting RPC bind portmap service... Starting Network Configuration... Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Found device /dev/ttyS1. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... [ OK ] Started ifup for enp3s0f1. Starting LVM event activation on device 259:0... Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Started RPC bind portmap service. [ OK ] Started Network Configuration. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Listening on Docker Socket for the API. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK tarted Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Started RPC Remote Quota Server. [ OK ] Finished Record successful boot for GRUB. [ OK ] Started User Login Management. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [ OK ] Started System Logging Service. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... + myips=172.21.15.88 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started Network Time Service. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Permit User Sessions. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.88 '!=' '' ']' + set -e + '[' -n 172.21.15.88 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.88 -nq -c1 172.21.0.1 ++ sed 's/\.com.*/\.com/g' ++ dig +short -x 172.21.15.88 @172.21.0.1 [ OK ] Started (i)SCSI target daemon. + newhostname=smithi088.front.sepia.ceph.com + '[' -n smithi088.front.sepia.ceph.com ']' + hostname smithi088.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi088 + echo smithi088 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.88 smithi088.front.sepia.ceph.com smithi088/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started The Apache HTTP Server. [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi088.front.sepia.ceph.com ttyS1 2024-04-26T11:26:01.664 DEBUG:teuthology.orchestra.console.smithi088:expect after: smithi088 login: 2024-04-26T11:26:01.718 DEBUG:teuthology.orchestra.console.smithi088:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80  el(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  Initializing and establishing link...                     PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent. Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation CLIENT MAC ADDR: 0C C4 7A 8F D4 2D GUID: 00000000 0000 0000 0000 0CC47AD8A8F0 DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.88 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.88 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  PXE-E61: Media test failure, check cable PXE-M0F: Exiting Intel Boot Agent.   Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D4 2D GUID: 00000000 0000 0000 0000 0CC47AD8A8F0 CLIENT IP: 172.21.15.88 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices...ok   iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d4:2d).... Configuring (net0 0c:c4:7a:8f:d4:2d)..... PXE-E61: Media test failure, check cable   GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************  Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.     The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     Loading Linux 5.15.0-105-generic ... [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.15.0-105-generic (buildd@lcy02-amd64-007) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #115-Ubuntu SMP Mon Apr 15 09:52:04 UTC 2024 (Ubuntu 5.15.0-105.115-generic 5.15.148) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec3fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f76000-0x00000000798affff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798b0000-0x0000000079d4cfff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4d000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.091 MHz processor [ 0.000418] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000599] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001896] last_pfn = 0x78ec4 max_arch_pfn = 0x400000000 [ 0.008243] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.008257] Using GB pages for direct mapping [ 0.008422] RAMDISK: [mem 0x300d1000-0x3405ffff] [ 0.008428] ACPI: Early table checksum verification disabled [ 0.008431] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.008434] ACPI: XSDT 0x00000000798B0098 0000B4 (v01 01072009 AMI 00010013) [ 0.008439] ACPI: FACP 0x00000000798E35B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008445] ACPI: DSDT 0x00000000798B01E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.008448] ACPI: FACS 0x0000000079D4BF80 000040 [ 0.008450] ACPI: APIC 0x00000000798E36C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008453] ACPI: FPDT 0x00000000798E3788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008456] ACPI: FIDT 0x00000000798E37D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.008459] ACPI: SPMI 0x00000000798E3870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.008462] ACPI: MCFG 0x00000000798E38B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.008465] ACPI: UEFI 0x00000000798E38F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.008467] ACPI: HPET 0x00000000798E3938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008470] ACPI: WDDT 0x00000000798E3970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.008473] ACPI: SSDT 0x00000000798E39B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.008476] ACPI: SSDT 0x00000000798FAB30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.008479] ACPI: SSDT 0x00000000798FD180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.008481] ACPI: PRAD 0x00000000798FD1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.008484] ACPI: DMAR 0x00000000798FD2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.008487] ACPI: HEST 0x00000000798FD3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008490] ACPI: BERT 0x00000000798FD630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008493] ACPI: ERST 0x00000000798FD660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008496] ACPI: EINJ 0x00000000798FD890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.008498] ACPI: Reserving FACP table memory at [mem 0x798e35b0-0x798e36bb] [ 0.008499] ACPI: Reserving DSDT table memory at [mem 0x798b01e8-0x798e35ab] [ 0.008501] ACPI: Reserving FACS table memory at [mem 0x79d4bf80-0x79d4bfbf] [ 0.008502] ACPI: Reserving APIC table memory at [mem 0x798e36c0-0x798e3787] [ 0.008503] ACPI: Reserving FPDT table memory at [mem 0x798e3788-0x798e37cb] [ 0.008504] ACPI: Reserving FIDT table memory at [mem 0x798e37d0-0x798e386b] [ 0.008504] ACPI: Reserving SPMI table memory at [mem 0x798e3870-0x798e38af] [ 0.008505] ACPI: Reserving MCFG table memory at [mem 0x798e38b0-0x798e38eb] [ 0.008506] ACPI: Reserving UEFI table memory at [mem 0x798e38f0-0x798e3931] [ 0.008507] ACPI: Reserving HPET table memory at [mem 0x798e3938-0x798e396f] [ 0.008508] ACPI: Reserving WDDT table memory at [mem 0x798e3970-0x798e39af] [ 0.008509] ACPI: Reserving SSDT table memory at [mem 0x798e39b0-0x798fab2e] [ 0.008510] ACPI: Reserving SSDT table memory at [mem 0x798fab30-0x798fd17b] [ 0.008511] ACPI: Reserving SSDT table memory at [mem 0x798fd180-0x798fd1e3] [ 0.008512] ACPI: Reserving PRAD table memory at [mem 0x798fd1e8-0x798fd2e9] [ 0.008513] ACPI: Reserving DMAR table memory at [mem 0x798fd2f0-0x798fd3ab] [ 0.008514] ACPI: Reserving HEST table memory at [mem 0x798fd3b0-0x798fd62b] [ 0.008515] ACPI: Reserving BERT table memory at [mem 0x798fd630-0x798fd65f] [ 0.008516] ACPI: Reserving ERST table memory at [mem 0x798fd660-0x798fd88f] [ 0.008517] ACPI: Reserving EINJ table memory at [mem 0x798fd890-0x798fd9bf] [ 0.008612] No NUMA configuration found [ 0.008613] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.008622] NODE_DATA(0) allocated [mem 0x87ffd6000-0x87fffffff] [ 0.008953] Zone ranges: [ 0.008954] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008956] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008958] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008959] Device empty [ 0.008960] Movable zone start for each node [ 0.008963] Early memory node ranges [ 0.008963] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.008965] node 0: [mem 0x0000000000100000-0x0000000078ec3fff] [ 0.008966] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008970] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.008975] On node 0, zone DMA: 1 pages in unavailable ranges [ 0.009010] On node 0, zone DMA: 117 pages in unavailable ranges [ 0.078153] On node 0, zone Normal: 28988 pages in unavailable ranges [ 0.078267] ACPI: PM-Timer IO Port: 0x408 [ 0.078275] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.078277] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.078278] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.078279] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.078280] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.078281] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.078281] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.078282] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.078292] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.078296] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.078299] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.078301] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.078305] ACPI: Using ACPI (MADT) for SMP configuration information [ 0.078307] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.078311] TSC deadline timer available [ 0.078312] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.078322] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.078324] PM: hibernation: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.078325] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.078326] PM: hibernation: Registered nosave memory: [mem 0x78ec4000-0x78f75fff] [ 0.078327] PM: hibernation: Registered nosave memory: [mem 0x78f76000-0x798affff] [ 0.078328] PM: hibernation: Registered nosave memory: [mem 0x798b0000-0x79d4cfff] [ 0.078329] PM: hibernation: Registered nosave memory: [mem 0x79d4d000-0x8fffffff] [ 0.078330] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.078331] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.078332] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.078332] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.078334] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.078336] Booting paravirtualized kernel on bare hardware [ 0.078338] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.078344] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.078553] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144 [ 0.078584] Built 1 zonelists, mobility grouping on. Total pages: 8228744 [ 0.078586] Policy zone: Normal [ 0.078587] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic root=UUID=7e9e2103-8bb7-4452-b35a-3b1230743254 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.078646] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-105-generic", will be passed to user space. [ 0.080782] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.081915] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.082006] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.166384] Memory: 32672704K/33438008K available (16393K kernel code, 4395K rwdata, 10948K rodata, 3352K init, 18716K bss, 765044K reserved, 0K cma-reserved) [ 0.166668] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.166683] Kernel/User page tables isolation: enabled [ 0.166713] ftrace: allocating 50694 entries in 199 pages [ 0.186558] ftrace: allocated 199 pages with 5 groups [ 0.186671] rcu: Hierarchical RCU implementation. [ 0.186673] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.186674] Rude variant of Tasks RCU enabled. [ 0.186675] Tracing variant of Tasks RCU enabled. [ 0.186676] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.186677] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.190085] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.190282] random: crng init done [ 0.195177] Console: colour VGA+ 80x25 [ 0.206454] printk: console [tty0] enabled [ 1.177721] printk: console [ttyS1] enabled [ 1.181981] ACPI: Core revision 20210730 [ 1.186141] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.195370] APIC: Switch to symmetric I/O mode setup [ 1.200407] DMAR: Host address width 46 [ 1.204311] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.209698] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.217795] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.225230] DMAR: ATSR flags: 0x0 [ 1.228618] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.234959] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.241382] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.247804] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.253271] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.253271] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.268447] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.273820] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.280125] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.303367] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3273a69c61c, max_idle_ns: 440795250530 ns [ 1.313980] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.18 BogoMIPS (lpj=14000364) [ 1.317995] CPU0: Thermal monitoring enabled (TM1) [ 1.322030] process: using mwait in idle threads [ 1.325980] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.329978] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.333979] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.337978] Spectre V2 : Mitigation: Retpolines [ 1.341978] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.345978] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.349978] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.353979] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.357978] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.361978] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.365981] MDS: Mitigation: Clear CPU buffers [ 1.369978] TAA: Mitigation: Clear CPU buffers [ 1.373978] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.377983] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.381978] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.385978] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.389978] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.393978] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.415511] Freeing SMP alternatives memory: 44K [ 1.417979] pid_max: default: 32768 minimum: 301 [ 1.421998] LSM: Security Framework initializing [ 1.425986] landlock: Up and running. [ 1.429978] Yama: becoming mindful. [ 1.433995] AppArmor: AppArmor initialized [ 1.438038] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.442018] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.446333] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 1.449983] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.454085] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.457979] ... version: 3 [ 1.461978] ... bit width: 48 [ 1.465978] ... generic registers: 4 [ 1.469978] ... value mask: 0000ffffffffffff [ 1.473978] ... max period: 00007fffffffffff [ 1.477978] ... fixed-purpose events: 3 [ 1.481978] ... event mask: 000000070000000f [ 1.486038] signal: max sigframe size: 1776 [ 1.489993] rcu: Hierarchical SRCU implementation. [ 1.494691] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.498042] smp: Bringing up secondary CPUs ... [ 1.502059] x86: Booting SMP configuration: [ 1.505980] .... node #0, CPUs: #1 #2 #3 #4 [ 1.513994] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.521978] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.525978] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.530075] #5 #6 #7 [ 1.530531] smp: Brought up 1 node, 8 CPUs [ 1.537980] smpboot: Max logical packages: 1 [ 1.541978] smpboot: Total of 8 processors activated (56001.45 BogoMIPS) [ 1.550125] devtmpfs: initialized [ 1.553395] x86/mm: Memory block size: 128MB [ 1.555577] ACPI: PM: Registering ACPI NVS region [mem 0x798b0000-0x79d4cfff] (4837376 bytes) [ 1.558055] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.561988] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.566025] pinctrl core: initialized pinctrl subsystem [ 1.570068] PM: RTC time: 11:25:29, date: 2024-04-26 [ 1.574083] NET: Registered PF_NETLINK/PF_ROUTE protocol family [ 1.578311] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 1.582275] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 1.586308] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 1.589988] audit: initializing netlink subsys (disabled) [ 1.593996] audit: type=2000 audit(1714130728.356:1): state=initialized audit_enabled=0 res=1 [ 1.594091] thermal_sys: Registered thermal governor 'fair_share' [ 1.597980] thermal_sys: Registered thermal governor 'bang_bang' [ 1.601978] thermal_sys: Registered thermal governor 'step_wise' [ 1.605978] thermal_sys: Registered thermal governor 'user_space' [ 1.609978] thermal_sys: Registered thermal governor 'power_allocator' [ 1.613983] EISA bus registered [ 1.621194] cpuidle: using governor ladder [ 1.621980] cpuidle: using governor menu [ 1.625993] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.629979] ACPI: bus type PCI registered [ 1.633979] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.638032] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.641980] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.645991] PCI: Using configuration type 1 for base access [ 1.650994] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. [ 1.653994] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.657979] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.662052] ACPI: Added _OSI(Module Device) [ 1.665980] ACPI: Added _OSI(Processor Device) [ 1.669986] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.673978] ACPI: Added _OSI(Processor Aggregator Device) [ 1.677978] ACPI: Added _OSI(Linux-Dell-Video) [ 1.681978] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.685978] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.736835] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.741300] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.746129] ACPI: Dynamic OEM Table Load: [ 1.780804] ACPI: Interpreter enabled [ 1.781989] ACPI: PM: (supports S0 S4 S5) [ 1.785978] ACPI: Using IOAPIC for interrupt routing [ 1.790001] HEST: Enabling Firmware First mode for corrected errors. [ 1.794056] HEST: Table parsing has been initialized. [ 1.798126] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 1.801980] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.805978] PCI: Using E820 reservations for host bridge windows [ 1.810667] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.847377] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.849981] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 1.855966] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 1.859038] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.861978] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.866010] PCI host bridge to bus 0000:ff [ 1.869979] pci_bus 0000:ff: root bus resource [bus ff] [ 1.873989] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.878043] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.882031] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.886029] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.890031] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.894032] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.898029] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.902032] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.906033] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.910029] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.914030] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.918029] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.922029] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.926031] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.930031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.934031] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.938031] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.942028] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.946029] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.950003] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.954040] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.958080] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.962042] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.966042] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.970140] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.974045] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.978041] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.982033] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.986033] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.990043] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.994043] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.998042] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 2.002044] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 2.006031] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.010031] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.014031] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.018033] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.022042] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.026042] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.030043] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.034046] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.038035] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.042031] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.046032] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.050034] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.054032] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.058031] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.062032] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.066037] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.070033] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.074030] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.078030] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.082004] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.086032] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.090030] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.098448] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.101981] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 2.106322] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 2.110453] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.113979] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.118269] PCI host bridge to bus 0000:00 [ 2.121979] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.125978] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.129978] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.133978] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.137978] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.141978] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.145978] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.150085] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.154189] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.158044] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.162150] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.166043] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.170144] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.174044] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.178139] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.181997] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.186173] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.189997] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.194171] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.197997] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.202172] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.205997] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.210169] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.213997] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.218175] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.221997] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.226170] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.229997] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.234171] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.237997] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.242123] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.246199] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.250126] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.254148] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.257992] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.262219] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.266271] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.270000] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.273989] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.277990] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.281989] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.285989] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.289989] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.294019] pci 0000:00:11.4: PME# supported from D3hot [ 2.298132] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.302004] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.306054] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.310127] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.314004] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.318055] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.322123] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.326004] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.330055] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.334136] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.338001] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.342083] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.346139] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.350068] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.354141] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.358070] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.362140] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.366070] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.370149] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.374001] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.378083] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.382135] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.386254] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.389998] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.393988] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.397988] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.401988] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.405988] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.409988] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.414013] pci 0000:00:1f.2: PME# supported from D3hot [ 2.418123] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.422003] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.426010] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.430194] acpiphp: Slot [1] registered [ 2.433995] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.438158] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.441998] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.446020] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.449981] pci 0000:02:00.0: enabling Extended Tags [ 2.454082] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.457980] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.462160] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.466000] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.469987] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.474001] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.477987] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.482018] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.485999] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.489978] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.493991] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.497978] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.502140] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.505999] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.509987] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.514000] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.517987] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.522018] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.525995] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.529978] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.533991] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.537978] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.542111] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.545979] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.549979] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.553980] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.558009] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.562044] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.566067] pci 0000:05:00.0: enabling Extended Tags [ 2.570051] pci 0000:05:00.0: supports D1 D2 [ 2.573978] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.578070] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.581980] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.585979] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.590120] pci_bus 0000:06: extended config space not accessible [ 2.594013] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.598011] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.601995] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.605995] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.610063] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 2.614020] pci 0000:06:00.0: supports D1 D2 [ 2.617978] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.622089] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.625984] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.629981] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.634077] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.638005] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.642006] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.645993] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 2.650112] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 2.654017] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.657978] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.662004] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.665978] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.670153] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 2.674005] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 2.678006] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 2.681992] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 2.686108] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 2.690015] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.693978] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 2.698004] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.701978] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 2.706134] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 2.709980] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 2.713980] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 2.717981] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 2.722906] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 2.726028] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 2.730027] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 2.734026] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 2.738028] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 2.741978] ACPI: PCI: Interrupt link LNKE disabled [ 2.746026] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 2.749978] ACPI: PCI: Interrupt link LNKF disabled [ 2.754026] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 2.757978] ACPI: PCI: Interrupt link LNKG disabled [ 2.762026] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 2.765978] ACPI: PCI: Interrupt link LNKH disabled [ 2.770165] iommu: Default domain type: Translated [ 2.773980] iommu: DMA domain TLB invalidation policy: lazy mode [ 2.778102] SCSI subsystem initialized [ 2.781988] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 2.785977] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 2.785978] pci 0000:06:00.0: vgaarb: bridge control possible [ 2.789978] vgaarb: loaded [ 2.792763] ACPI: bus type USB registered [ 2.793987] usbcore: registered new interface driver usbfs [ 2.797982] usbcore: registered new interface driver hub [ 2.801983] usbcore: registered new device driver usb [ 2.805993] pps_core: LinuxPPS API ver. 1 registered [ 2.809978] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 2.813981] PTP clock support registered [ 2.817992] EDAC MC: Ver: 3.0.0 [ 2.821289] NetLabel: Initializing [ 2.821979] NetLabel: domain hash size = 128 [ 2.825978] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 2.829989] NetLabel: unlabeled traffic allowed by default [ 2.833988] PCI: Using ACPI for IRQ routing [ 2.843233] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 2.845979] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 2.852018] clocksource: Switched to clocksource tsc-early [ 2.864131] VFS: Disk quotas dquot_6.6.0 [ 2.868133] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 2.875166] AppArmor: AppArmor Filesystem Enabled [ 2.879966] pnp: PnP ACPI init [ 2.883548] system 00:01: [io 0x0500-0x057f] has been reserved [ 2.889539] system 00:01: [io 0x0400-0x047f] has been reserved [ 2.895525] system 00:01: [io 0x0580-0x059f] has been reserved [ 2.901510] system 00:01: [io 0x0600-0x061f] has been reserved [ 2.907498] system 00:01: [io 0x0880-0x0883] has been reserved [ 2.913486] system 00:01: [io 0x0800-0x081f] has been reserved [ 2.919469] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 2.926150] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 2.932832] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 2.939513] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 2.946197] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 2.952879] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 2.959560] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 2.966457] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 2.972449] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 2.978434] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 2.984415] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 2.990405] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 2.997367] pnp: PnP ACPI: found 5 devices [ 3.006890] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.015895] NET: Registered PF_INET protocol family [ 3.021005] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.030293] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.039110] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) [ 3.047108] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.055513] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.063044] TCP: Hash tables configured (established 262144 bind 65536) [ 3.069868] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear) [ 3.077653] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.084675] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.092131] NET: Registered PF_UNIX/PF_LOCAL protocol family [ 3.097857] NET: Registered PF_XDP protocol family [ 3.102734] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.114308] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.122220] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.127264] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.132297] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.139164] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.146816] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.154815] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.162555] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.170642] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.178294] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.186293] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.194031] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.202120] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.209769] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.217771] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.225509] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.233597] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.241247] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.249249] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.256986] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.265073] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.270101] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.276260] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.283115] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.290949] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.295999] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.301033] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.307205] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.314077] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.319372] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.325542] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.332404] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.340232] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.348155] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.355987] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.363901] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.368935] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.375096] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.381951] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.389787] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.396031] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.409986] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.416928] pci_bus 0000:00: resource 7 [mem 0x90000000-0xfbffbfff window] [ 3.423869] pci_bus 0000:00: resource 8 [mem 0xfedb0000-0xfedb000f window] [ 3.430811] pci_bus 0000:00: resource 9 [mem 0xfedc0000-0xfedc000f window] [ 3.437752] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.444086] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.449726] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.456054] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.463363] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.469000] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.475331] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.480973] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.487307] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.492947] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.499275] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.506943] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 3.535846] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x160 took 21088 usecs [ 3.567840] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x160 took 23915 usecs [ 3.575340] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 3.581895] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 3.581900] Trying to unpack rootfs image as initramfs... [ 3.588404] software IO TLB: mapped [mem 0x0000000074ec4000-0x0000000078ec4000] (64MB) [ 3.602344] Initialise system trusted keyrings [ 3.606866] Key type blacklist registered [ 3.610982] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 3.618450] zbud: loaded [ 3.621257] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 3.627318] fuse: init (API version 7.34) [ 3.631551] integrity: Platform Keyring initialized [ 3.644319] Key type asymmetric registered [ 3.648491] Asymmetric key parser 'x509' registered [ 3.653462] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) [ 3.660994] io scheduler mq-deadline registered [ 3.666092] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 3.672130] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 3.678155] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 3.684122] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 3.690090] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 3.696048] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 3.702011] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 3.708922] ACPI: \_SB_.SCK0.CP00: Found 2 idle states [ 3.714793] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 3.723252] ACPI: button: Power Button [PWRB] [ 3.727710] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 3.735228] ACPI: button: Power Button [PWRF] [ 3.740972] ERST: Error Record Serialization Table (ERST) support is initialized. [ 3.748546] pstore: Registered erst as persistent store backend [ 3.754665] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 3.781599] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 3.810508] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 3.820114] Linux agpgart interface v0.103 [ 3.825915] loop: module loaded [ 3.829353] tun: Universal TUN/TAP device driver, 1.6 [ 3.834500] PPP generic driver version 2.4.2 [ 3.838880] VFIO - User Level meta-driver version: 0.3 [ 3.844219] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 3.850818] ehci-pci: EHCI PCI platform driver [ 3.855481] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 3.860776] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 3.868271] ehci-pci 0000:00:1a.0: debug port 2 [ 3.876779] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 3.895739] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 3.901609] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 3.909964] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 3.917276] usb usb1: Product: EHCI Host Controller [ 3.922225] usb usb1: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 3.928738] usb usb1: SerialNumber: 0000:00:1a.0 [ 3.933561] hub 1-0:1.0: USB hub found [ 3.935667] Freeing initrd memory: 65084K [ 3.937397] hub 1-0:1.0: 2 ports detected [ 3.945807] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 3.951108] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 3.958596] ehci-pci 0000:00:1d.0: debug port 2 [ 3.967099] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 3.987775] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 3.993642] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.001991] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.009294] usb usb2: Product: EHCI Host Controller [ 4.014238] usb usb2: Manufacturer: Linux 5.15.0-105-generic ehci_hcd [ 4.020742] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.025512] hub 2-0:1.0: USB hub found [ 4.029327] hub 2-0:1.0: 2 ports detected [ 4.033522] ehci-platform: EHCI generic platform driver [ 4.038833] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.045080] ohci-pci: OHCI PCI platform driver [ 4.049607] ohci-platform: OHCI generic platform driver [ 4.054905] uhci_hcd: USB Universal Host Controller Interface driver [ 4.061368] i8042: PNP: No PS/2 controller found. [ 4.066187] mousedev: PS/2 mouse device common for all mice [ 4.071902] rtc_cmos 00:00: RTC can wake from S4 [ 4.076778] rtc_cmos 00:00: registered as rtc0 [ 4.081322] rtc_cmos 00:00: setting system clock to 2024-04-26T11:25:32 UTC (1714130732) [ 4.089517] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram [ 4.096295] i2c_dev: i2c /dev entries driver [ 4.100800] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. [ 4.113077] device-mapper: uevent: version 1.0.3 [ 4.117798] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com [ 4.126344] platform eisa.0: Probing EISA bus 0 [ 4.130943] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 4.137796] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 4.144302] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 4.150809] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 4.157317] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 4.163827] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 4.170337] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 4.176846] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 4.183354] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 4.189862] platform eisa.0: EISA: Detected 0 cards [ 4.194854] intel_pstate: Intel P-state driver initializing [ 4.201573] ledtrig-cpu: registered to indicate activity on CPUs [ 4.207791] drop_monitor: Initializing network drop monitor service [ 4.214236] NET: Registered PF_INET6 protocol family [ 4.227160] Segment Routing with IPv6 [ 4.230916] In-situ OAM (IOAM) with IPv6 [ 4.234940] NET: Registered PF_PACKET protocol family [ 4.240134] Key type dns_resolver registered [ 4.245062] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 4.251048] microcode: Microcode Update Driver: v2.2. [ 4.251123] resctrl: L3 allocation detected [ 4.260482] resctrl: L3 monitoring detected [ 4.264731] IPI shorthand broadcast: enabled [ 4.269073] sched_clock: Marking stable (3221359834, 1047701046)->(5254186005, -985125125) [ 4.277647] registered taskstats version 1 [ 4.281817] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.288609] Loading compiled-in X.509 certificates [ 4.294021] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.304497] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 4.314738] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 4.324828] blacklist: Loading compiled-in revocation X.509 certificates [ 4.331609] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 4.341529] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 4.352074] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 4.362956] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 4.367767] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 4.373502] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 4.390896] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 4.401686] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 4.412478] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 4.424281] zswap: loaded using pool lzo/zbud [ 4.429002] Key type .fscrypt registered [ 4.432993] Key type fscrypt-provisioning registered [ 4.438081] pstore: Using crash dump compression: deflate [ 4.446826] Key type encrypted registered [ 4.448034] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 4.450898] AppArmor: AppArmor sha1 policy hashing enabled [ 4.459161] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.464748] ima: No TPM chip found, activating TPM-bypass! [ 4.475347] hub 1-1:1.0: USB hub found [ 4.485283] Loading compiled-in module X.509 certificates [ 4.489159] hub 1-1:1.0: 6 ports detected [ 4.495030] Loaded X.509 cert 'Build time autogenerated kernel key: 2031b00138f148c9752e8bea71b9285d2b2af682' [ 4.508667] ima: Allocated hash algorithm: sha1 [ 4.513282] ima: No architecture policies found [ 4.517880] evm: Initialising EVM extended attributes: [ 4.523084] evm: security.selinux [ 4.526469] evm: security.SMACK64 [ 4.529847] evm: security.SMACK64EXEC [ 4.533574] evm: security.SMACK64TRANSMUTE [ 4.537735] evm: security.SMACK64MMAP [ 4.540034] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 4.541461] evm: security.apparmor [ 4.549737] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 4.553212] evm: security.ima [ 4.563471] evm: security.capability [ 4.563816] hub 2-1:1.0: USB hub found [ 4.567107] evm: HMAC attrs: 0x1 [ 4.574432] hub 2-1:1.0: 8 ports detected [ 4.574482] PM: Magic number: 4:482:429 [ 4.582963] RAS: Correctable Errors collector initialized. [ 4.589487] Freeing unused decrypted memory: 2036K [ 4.594829] Freeing unused kernel image (initmem) memory: 3352K [ 4.623822] Write protecting the kernel read-only data: 30720k [ 4.627737] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 4.636003] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 4.646151] clocksource: Switched to clocksource tsc [ 4.651465] Freeing unused kernel image (text/rodata gap) memory: 2036K [ 4.658384] Freeing unused kernel image (rodata/data gap) memory: 1340K [ 4.703223] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.709725] x86/mm: Checking user space page tables [ 4.751594] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 4.758107] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.6 [ 4.910037] dca service started, version 1.12.1 [ 4.916309] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.921615] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.930159] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.938211] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 4.947571] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 4.948228] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.960540] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.968025] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.974402] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15 [ 4.982759] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.990072] usb usb3: Product: xHCI Host Controller [ 4.995018] usb usb3: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 4.995991] scsi host0: ahci [ 5.001523] usb usb3: SerialNumber: 0000:00:14.0 [ 5.004608] scsi host1: ahci [ 5.009275] hub 3-0:1.0: USB hub found [ 5.012269] scsi host2: ahci [ 5.015945] hub 3-0:1.0: 15 ports detected [ 5.018987] scsi host3: ahci [ 5.025466] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15 [ 5.026065] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 33 [ 5.026192] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 5.027161] i2c i2c-0: 2/8 memory slots populated (from DMI) [ 5.027163] i2c i2c-0: Systems with more than 4 memory slots not supported yet, not instantiating SPD [ 5.034344] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 5.041820] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 33 [ 5.047716] usb usb4: Product: xHCI Host Controller [ 5.047719] usb usb4: Manufacturer: Linux 5.15.0-105-generic xhci-hcd [ 5.053447] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 33 [ 5.062753] usb usb4: SerialNumber: 0000:00:14.0 [ 5.070065] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 33 [ 5.077625] hub 4-0:1.0: USB hub found [ 5.082706] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.089012] hub 4-0:1.0: 6 ports detected [ 5.089147] nvme nvme0: pci function 0000:02:00.0 [ 5.091542] nvme nvme0: 8/0/0 default/read/poll queues [ 5.096492] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.142566] igb: Intel(R) Gigabit Ethernet Network Driver [ 5.142691] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver [ 5.148035] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.159840] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.202538] igb 0000:07:00.0: added PHC on eth0 [ 5.204189] scsi host4: ahci [ 5.207164] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.210261] scsi host5: ahci [ 5.217023] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a8:f0 [ 5.220168] scsi host6: ahci [ 5.227253] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.230316] scsi host7: ahci [ 5.235345] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.238458] scsi host8: ahci [ 5.249092] scsi host9: ahci [ 5.252097] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 35 [ 5.259589] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 35 [ 5.267083] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 35 [ 5.274567] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 35 [ 5.282049] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 35 [ 5.289527] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 35 [ 5.301923] igb 0000:07:00.1: added PHC on eth1 [ 5.306550] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 5.313500] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a8:f1 [ 5.320793] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 5.326000] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.363797] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.398662] ata2: SATA link down (SStatus 0 SControl 300) [ 5.404151] ata1: SATA link down (SStatus 0 SControl 300) [ 5.409634] ata4: SATA link down (SStatus 0 SControl 300) [ 5.415146] ata3: SATA link down (SStatus 0 SControl 300) [ 5.515998] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.524377] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.532095] hub 3-12:1.0: USB hub found [ 5.536101] hub 3-12:1.0: 4 ports detected [ 5.610663] ata8: SATA link down (SStatus 0 SControl 300) [ 5.616168] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 5.622456] ata6: SATA link down (SStatus 0 SControl 300) [ 5.627950] ata9: SATA link down (SStatus 0 SControl 300) [ 5.633449] ata7: SATA link down (SStatus 0 SControl 300) [ 5.638954] ata10: SATA link down (SStatus 0 SControl 300) [ 5.644703] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 5.651593] ata5.00: NCQ Send/Recv Log not supported [ 5.656648] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 5.665165] ata5.00: NCQ Send/Recv Log not supported [ 5.670226] ata5.00: configured for UDMA/133 [ 5.674764] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 5.683226] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 5.683405] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 5.696395] sd 4:0:0:0: [sda] Write Protect is off [ 5.701280] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 5.721398] sda: sda1 [ 5.723948] sd 4:0:0:0: [sda] Attached SCSI disk [ 5.731180] igb 0000:07:00.0 eno1: renamed from eth0 [ 5.764387] igb 0000:07:00.1 eno2: renamed from eth1 [ 5.847719] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.980130] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.988666] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 6.004008] hid: raw HID events driver (C) Jiri Kosina [ 6.011886] usbcore: registered new interface driver usbhid [ 6.017536] usbhid: USB HID core driver [ 6.023133] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.091875] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.103818] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.115629] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.352531] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.362928] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.371552] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 6.385795] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d4:2c [ 6.394229] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 6.564529] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.574928] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 6.583552] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 6.590683] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d4:2d [ 6.598994] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 6.606774] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 6.632676] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.37.2 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: recovering journal /dev/sda1: Clearing orphaned inode 24691 (uid=0, gid=0, mode=0100644, size=4447536) /dev/sda1: clean, 197343/61054976 files, 6488428/244190336 blocks done. [ 13.719869] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 14.616427] systemd[1]: Inserted module 'autofs4' [ 14.736767] systemd[1]: systemd 249.11-0ubuntu3.6 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified) [ 14.787908] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 22.04.1 LTS! [ 14.818097] systemd[1]: Hostname set to . [ 16.180601] systemd[1]: Queued start job for default target Graphical Interface. [ 16.189334] systemd[1]: Created slice Slice /system/modprobe. [ OK ] Created slice Slice /system/modprobe. [ 16.212649] systemd[1]: Created slice Slice /system/serial-getty. [ OK ] Created slice Slice /system/serial-getty. [ 16.236378] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 16.259933] systemd[1]: Started ntp-systemd-netif.path. [ OK ] Started ntp-systemd-netif.path. [ 16.279972] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 16.304188] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 16.331906] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 16.359859] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 16.387895] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 16.415847] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 16.443848] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 16.471847] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 16.499960] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 16.523875] systemd[1]: Reached target Slice Units. [ OK ] Reached target Slice Units. [ 16.543885] systemd[1]: Reached target Local Verity Protected Volumes. [ OK ] Reached target Local Verity Protected Volumes. [ 16.567989] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 16.592110] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 16.617435] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 16.640144] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 16.660076] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 16.683971] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 16.708322] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 16.728068] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 16.748154] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 16.768229] systemd[1]: Listening on Network Service Netlink Socket. [ OK ] Listening on Network Service Netlink Socket. [ 16.792137] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 16.812051] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 16.833565] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 16.853475] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 16.877316] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 16.901437] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 16.920955] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 16.941410] RPC: Registered named UNIX socket transport module. [ 16.941763] systemd[1]: Starting Journal Service... [ 16.947409] RPC: Registered udp transport module. [ 16.947410] RPC: Registered tcp transport module. [ 16.947411] RPC: Registered tcp NFSv4.1 backchannel transport module. Starting Journal Service... [ 16.983951] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 16.994452] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 17.016892] systemd[1]: Starting Create List of Static Device Nodes... Starting Create List of Static Device Nodes... [ 17.040853] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 17.069280] systemd[1]: Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module chromeos_pstore... [ 17.092539] systemd[1]: Starting Load Kernel Module configfs... Starting Load Kernel Module configfs... [ 17.112535] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 17.132446] systemd[1]: Starting Load Kernel Module efi_pstore... Starting Load Kernel Module efi_pstore... [ 17.156794] systemd[1]: Starting Load Kernel Module fuse... Starting Load Kernel Module fuse... [ 17.180508] systemd[1]: Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_blk... [ 17.202509] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 17.209911] systemd[1]: Starting Load Kernel Module pstore_zone... Starting Load Kernel Module pstore_zone... [ 17.232509] systemd[1]: Starting Load Kernel Module ramoops... Starting Load Kernel Module ramoops... [ 17.251795] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 17.261560] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 17.271919] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 17.292488] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 17.316579] systemd[1]: Starting Coldplug All udev Devices... Starting Coldp[ 17.324568] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr. Quota mode: none. lug All udev Devices... [ 17.345434] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ 17.359162] lp: driver loaded but no devices found [ OK ] Mounted Huge Pages File System. [ OK ] Mounted [0;[ 17.382097] Loading iSCSI transport class v2.0-870. 1;39mPOSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create List of Static Device Nodes. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module configfs. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module fuse. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. Activating swap /swapfile... Mounting FUSE Control File System... Mounting Kernel Configuration File System... [ 17.702806] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Starting Initial Check File System Quotas... Starting Flush Journal to Persistent Storage... [ 17.764804] systemd-journald[367]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished Coldplug All udev Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Reached target Swaps. [ 17.911151] systemd-journald[367]: File /var/log/journal/5896a171b9d64a25b2db7eb12a64f597/system.journal corrupted or uncleanly shut down, renaming and replacing. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Initial Check File System Quotas. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Preparation for Local File Systems. [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting Rule-based Manage…for Device Events and Files... Starting Uncomplicated firewall... [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. [ OK ] Finished Uncomplicated firewall. [ OK ] Reached target Preparation for Network. Starting Create Volatile Files and Directories... [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. [ OK ] Started Rule-based Manager for Device Events and Files. Mounting RPC Pipe File System... Starting Load Kernel Module chromeos_pstore... Starting Load Kernel Module efi_pstore... Starting Load Kernel Module pstore_blk... Starting Load Kernel Module pstore_zone... Starting Load Kernel Module ramoops... [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Path Units. Starting RPC bind portmap service... Starting Network Configuration... Starting Record System Boot/Shutdown in UTMP... [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Mounted RPC Pipe File System. [ OK ] Finished Load Kernel Module chromeos_pstore. [ OK ] Finished Load Kernel Module efi_pstore. [ OK ] Finished Load Kernel Module pstore_blk. [ OK ] Finished Load Kernel Module pstore_zone. [ OK ] Finished Load Kernel Module ramoops. [ OK ] Found device /dev/ttyS1. [ OK ] Finished Record System Boot/Shutdown in UTMP. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice Slice /system/lvm2-pvscan. [ OK ] Reached target rpc_pipefs.target. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... [ OK ] Started ifup for enp3s0f1. Starting LVM event activation on device 259:0... Starting pNFS block layout mapping daemon... Starting NFSv4 ID-name mapping service... Starting NFSv4 Client Tracking Daemon... [ OK ] Reached target NFS client services. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Daily dpkg database backup timer. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timer Units. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API... [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Started RPC bind portmap service. [ OK ] Started Network Configuration. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Finished Helper to synchronize boot up for ifupdown. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Started NFSv4 Client Tracking Daemon. [ OK ] Listening on Docker Socket for the API. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Socket Units. [ OK ] Reached target Basic System. Starting Accounts Service... [ OK tarted Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting Dispatcher daemon for systemd-networkd... Starting Raise network interfaces... [ OK ] Started ntp-systemd-netif.service. Starting RPC Remote Quota Server... Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting User Login Management... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Started RPC Remote Quota Server. [ OK ] Finished Record successful boot for GRUB. [ OK ] Started User Login Management. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [ OK ] Started System Logging Service. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Wait for Network to be Configured. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Connect NVMe-oF s…s automatically during boot... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' Starting NFS status monitor for NFSv2/3 locking.... + myips=172.21.15.88 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. [ OK ] Finished Availability of block devices. [ OK ] Started Network Time Service. [ OK ] Started NFS status monitor for NFSv2/3 locking.. Starting NFS server and services... [ OK ] Started OpenBSD Secure Shell server. [ OK ] Finished Connect NVMe-oF s…ems automatically during boot. [ OK ] Reached target Preparation for Remote File Systems. [ OK ] Reached target Remote File Systems. Starting The Apache HTTP Server... Starting LSB: Collectl monitors system performance.... [ OK ] Started Regular background program processing daemon. [ OK ] Started Nagios Remote Plugin Executor. Starting LSB: radosgw RESTful rados gateway... Starting Permit User Sessions... [ OK ] Started ntp-systemd-netif.service. [ OK ] Finished Permit User Sessions. [ OK ] Finished Ubuntu FAN network setup. [ OK ] Finished NFS server and services. Starting Notify NFS peers of a restart... [ OK ] Started LSB: radosgw RESTful rados gateway. [ OK ] Started Notify NFS peers of a restart. + '[' 172.21.15.88 '!=' '' ']' + set -e + '[' -n 172.21.15.88 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.88 -nq -c1 172.21.0.1 ++ sed 's/\.com.*/\.com/g' ++ dig +short -x 172.21.15.88 @172.21.0.1 [ OK ] Started (i)SCSI target daemon. + newhostname=smithi088.front.sepia.ceph.com + '[' -n smithi088.front.sepia.ceph.com ']' + hostname smithi088.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi088 + echo smithi088 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.88 smithi088.front.sepia.ceph.com smithi088/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started The Apache HTTP Server. [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice Slice /system/getty. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started Docker Application Container Engine. [ OK ] Reached target Multi-User System. [ OK ] Reached target Graphical Interface. Starting Record Runlevel Change in UTMP... [ OK ] Finished Record Runlevel Change in UTMP. Ubuntu 22.04.1 LTS smithi088.front.sepia.ceph.com ttyS1 smithi088 login: [disconnect] 2024-04-26T11:26:01.822 INFO:teuthology.misc:Re-opening connections... 2024-04-26T11:26:01.822 INFO:teuthology.misc:trying to connect to ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T11:26:01.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-26T11:26:01.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T11:26:02.044 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-26T11:26:02.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-26T11:26:02.538 DEBUG:teuthology.misc:waited 0.7160053253173828 2024-04-26T11:26:02.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~157s 2024-04-26T11:26:03.539 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T11:26:03.539 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi088.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-04-26T11:26:03.540 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T11:26:03.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T11:26:03.647 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T11:26:03.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T11:26:03.691 INFO:tasks.ceph.osd.0:Started 2024-04-26T11:26:03.692 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:26:03.809 INFO:teuthology.orchestra.run.smithi088.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T11:26:03.811 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T11:26:03.812 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T11:26:04.868 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:26:04.384+0000 7f02aec167c0 -1 Falling back to public interface 2024-04-26T11:26:08.813 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:26:08.820 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:26:08.336+0000 7f02aec167c0 -1 osd.0 49 log_to_monitors true 2024-04-26T11:26:08.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-26T11:26:08.933 INFO:teuthology.orchestra.run.smithi088.stderr:no valid command found; 10 closest matches: 2024-04-26T11:26:08.934 INFO:teuthology.orchestra.run.smithi088.stderr:0 2024-04-26T11:26:08.934 INFO:teuthology.orchestra.run.smithi088.stderr:1 2024-04-26T11:26:08.934 INFO:teuthology.orchestra.run.smithi088.stderr:2 2024-04-26T11:26:08.934 INFO:teuthology.orchestra.run.smithi088.stderr:abort 2024-04-26T11:26:08.934 INFO:teuthology.orchestra.run.smithi088.stderr:assert 2024-04-26T11:26:08.934 INFO:teuthology.orchestra.run.smithi088.stderr:bluefs debug_inject_read_zeros 2024-04-26T11:26:08.934 INFO:teuthology.orchestra.run.smithi088.stderr:bluefs files list 2024-04-26T11:26:08.934 INFO:teuthology.orchestra.run.smithi088.stderr:bluefs stats 2024-04-26T11:26:08.934 INFO:teuthology.orchestra.run.smithi088.stderr:bluestore allocator dump block 2024-04-26T11:26:08.934 INFO:teuthology.orchestra.run.smithi088.stderr:bluestore allocator fragmentation block 2024-04-26T11:26:08.934 INFO:teuthology.orchestra.run.smithi088.stderr:admin_socket: invalid command 2024-04-26T11:26:08.935 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T11:26:08.936 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-26T11:26:09.653 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-04-26T11:26:09.168+0000 7f02a29ee640 -1 osd.0 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T11:26:13.937 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T11:26:14.073 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-04-26T11:26:14.074 INFO:teuthology.orchestra.run.smithi088.stdout: "ops": [], 2024-04-26T11:26:14.074 INFO:teuthology.orchestra.run.smithi088.stdout: "num_ops": 0 2024-04-26T11:26:14.074 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-04-26T11:26:19.090 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T11:26:19.234 INFO:teuthology.orchestra.run.smithi073.stdout:mon.a: {} 2024-04-26T11:26:19.234 INFO:teuthology.orchestra.run.smithi073.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:26:19.242 INFO:teuthology.orchestra.run.smithi073.stdout:mon.b: {} 2024-04-26T11:26:19.242 INFO:teuthology.orchestra.run.smithi073.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:26:19.251 INFO:teuthology.orchestra.run.smithi073.stdout:mon.c: {} 2024-04-26T11:26:19.252 INFO:teuthology.orchestra.run.smithi073.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T11:26:19.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T11:26:20.369 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T11:26:20.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T11:26:21.378 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T11:26:21.402 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T11:26:22.361 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T11:26:22.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T11:26:23.365 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T11:26:23.388 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T11:26:24.371 INFO:teuthology.orchestra.run.smithi073.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T11:26:24.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T11:26:25.373 INFO:teuthology.orchestra.run.smithi073.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T11:26:25.397 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T11:26:25.397 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T11:26:25.397 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T11:26:25.397 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T11:26:25.397 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T11:26:25.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:26:25.697 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:25.697 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":90,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:26:25.364631+0000","last_up_change":"2024-04-26T11:26:10.538684+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":49,"up_from":75,"up_thru":89,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1525},{"type":"v1","addr":"172.21.15.88:6801","nonce":1525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1525},{"type":"v1","addr":"172.21.15.88:6803","nonce":1525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1525},{"type":"v1","addr":"172.21.15.88:6807","nonce":1525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1525},{"type":"v1","addr":"172.21.15.88:6805","nonce":1525}]},"public_addr":"172.21.15.88:6801/1525","cluster_addr":"172.21.15.88:6803/1525","heartbeat_back_addr":"172.21.15.88:6807/1525","heartbeat_front_addr":"172.21.15.88:6805/1525","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.0","osds":[2]},{"pgid":"4.2","osds":[1]},{"pgid":"4.a","osds":[2]},{"pgid":"4.c","osds":[2]},{"pgid":"4.d","osds":[1]},{"pgid":"4.e","osds":[1]},{"pgid":"4.11","osds":[2]},{"pgid":"4.18","osds":[2]},{"pgid":"4.1a","osds":[2]},{"pgid":"4.1d","osds":[1]},{"pgid":"4.1f","osds":[1]},{"pgid":"4.20","osds":[2]},{"pgid":"4.22","osds":[1]},{"pgid":"4.25","osds":[1]},{"pgid":"4.27","osds":[1]},{"pgid":"4.2a","osds":[1]},{"pgid":"4.2b","osds":[2]},{"pgid":"4.2c","osds":[2]},{"pgid":"4.35","osds":[2]},{"pgid":"4.3a","osds":[2]},{"pgid":"4.3c","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:26:25.716 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T11:26:25.717 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:26:26.009 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:26.010 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":90,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:26:25.364631+0000","last_up_change":"2024-04-26T11:26:10.538684+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.309999942779541,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":49,"up_from":75,"up_thru":89,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1525},{"type":"v1","addr":"172.21.15.88:6801","nonce":1525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1525},{"type":"v1","addr":"172.21.15.88:6803","nonce":1525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1525},{"type":"v1","addr":"172.21.15.88:6807","nonce":1525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1525},{"type":"v1","addr":"172.21.15.88:6805","nonce":1525}]},"public_addr":"172.21.15.88:6801/1525","cluster_addr":"172.21.15.88:6803/1525","heartbeat_back_addr":"172.21.15.88:6807/1525","heartbeat_front_addr":"172.21.15.88:6805/1525","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"4.0","osds":[2]},{"pgid":"4.2","osds":[1]},{"pgid":"4.a","osds":[2]},{"pgid":"4.c","osds":[2]},{"pgid":"4.d","osds":[1]},{"pgid":"4.e","osds":[1]},{"pgid":"4.11","osds":[2]},{"pgid":"4.18","osds":[2]},{"pgid":"4.1a","osds":[2]},{"pgid":"4.1d","osds":[1]},{"pgid":"4.1f","osds":[1]},{"pgid":"4.20","osds":[2]},{"pgid":"4.22","osds":[1]},{"pgid":"4.25","osds":[1]},{"pgid":"4.27","osds":[1]},{"pgid":"4.2a","osds":[1]},{"pgid":"4.2b","osds":[2]},{"pgid":"4.2c","osds":[2]},{"pgid":"4.35","osds":[2]},{"pgid":"4.3a","osds":[2]},{"pgid":"4.3c","osds":[2]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:26:26.030 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T11:26:26.030 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T11:26:26.031 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T11:26:26.188 INFO:teuthology.orchestra.run.smithi073.stdout:34359738429 2024-04-26T11:26:26.189 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:26:26.196 INFO:teuthology.orchestra.run.smithi073.stdout:322122547205 2024-04-26T11:26:26.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:26:26.201 INFO:teuthology.orchestra.run.smithi073.stdout:34359738429 2024-04-26T11:26:26.201 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:26:26.492 INFO:teuthology.orchestra.run.smithi073.stdout:34359738428 2024-04-26T11:26:26.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.1 2024-04-26T11:26:26.530 INFO:teuthology.orchestra.run.smithi073.stdout:34359738428 2024-04-26T11:26:26.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.2 2024-04-26T11:26:26.553 INFO:teuthology.orchestra.run.smithi073.stdout:322122547204 2024-04-26T11:26:26.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 322122547205 got 322122547204 for osd.0 2024-04-26T11:26:27.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:26:27.548 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:26:27.571 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:26:27.824 INFO:teuthology.orchestra.run.smithi073.stdout:34359738428 2024-04-26T11:26:27.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.1 2024-04-26T11:26:27.846 INFO:teuthology.orchestra.run.smithi073.stdout:34359738428 2024-04-26T11:26:27.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738428 for osd.2 2024-04-26T11:26:27.891 INFO:teuthology.orchestra.run.smithi073.stdout:322122547204 2024-04-26T11:26:27.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 322122547205 got 322122547204 for osd.0 2024-04-26T11:26:28.842 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T11:26:28.865 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T11:26:28.909 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T11:26:29.158 INFO:teuthology.orchestra.run.smithi073.stdout:34359738430 2024-04-26T11:26:29.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738430 for osd.1 2024-04-26T11:26:29.176 DEBUG:teuthology.parallel:result is None 2024-04-26T11:26:29.179 INFO:teuthology.orchestra.run.smithi073.stdout:34359738430 2024-04-26T11:26:29.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738429 got 34359738430 for osd.2 2024-04-26T11:26:29.196 DEBUG:teuthology.parallel:result is None 2024-04-26T11:26:29.221 INFO:teuthology.orchestra.run.smithi073.stdout:322122547205 2024-04-26T11:26:29.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 322122547205 got 322122547205 for osd.0 2024-04-26T11:26:29.239 DEBUG:teuthology.parallel:result is None 2024-04-26T11:26:29.239 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T11:26:29.239 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:29.581 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:29.583 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:29.600 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-04-26T11:26:29.448437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3443,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3836,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":189,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":324176,"kb_used_data":79516,"kb_used_omap":10,"kb_used_meta":244597,"kb_avail":282791344,"statfs":{"total":289910292480,"available":289578336256,"internally_reserved":0,"allocated":81424384,"data_stored":259296453,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":250468227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":210,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":792,"num_bytes_recovered":-4194394,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001609"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":494,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377999+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:25.377999+0000","last_peered":"2024-04-26T11:26:25.377999+0000","last_clean":"2024-04-26T11:26:25.377999+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:25.377999+0000","last_undegraded":"2024-04-26T11:26:25.377999+0000","last_fullsized":"2024-04-26T11:26:25.377999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":550,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377195+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:25.377195+0000","last_peered":"2024-04-26T11:26:25.377195+0000","last_clean":"2024-04-26T11:26:25.377195+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:25.377195+0000","last_undegraded":"2024-04-26T11:26:25.377195+0000","last_fullsized":"2024-04-26T11:26:25.377195+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":424,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:24.176216+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:24.176216+0000","last_peered":"2024-04-26T11:26:24.176216+0000","last_clean":"2024-04-26T11:26:24.176216+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:24.176216+0000","last_undegraded":"2024-04-26T11:26:24.176216+0000","last_fullsized":"2024-04-26T11:26:24.176216+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":705,"reported_epoch":91,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T11:26:26.488311+0000","last_change":"2024-04-26T11:26:26.077769+0000","last_active":"2024-04-26T11:26:26.488311+0000","last_peered":"2024-04-26T11:26:26.488311+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.734418+0000","last_became_peered":"2024-04-26T11:26:12.734418+0000","last_unstale":"2024-04-26T11:26:26.488311+0000","last_undegraded":"2024-04-26T11:26:26.488311+0000","last_fullsized":"2024-04-26T11:26:12.575615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":525,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376236+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:25.376236+0000","last_peered":"2024-04-26T11:26:25.376236+0000","last_clean":"2024-04-26T11:26:25.376236+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:25.376236+0000","last_undegraded":"2024-04-26T11:26:25.376236+0000","last_fullsized":"2024-04-26T11:26:25.376236+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":489,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.373603+0000","last_change":"2024-04-26T11:26:12.740983+0000","last_active":"2024-04-26T11:26:25.373603+0000","last_peered":"2024-04-26T11:26:25.373603+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.735655+0000","last_became_peered":"2024-04-26T11:26:12.735655+0000","last_unstale":"2024-04-26T11:26:25.373603+0000","last_undegraded":"2024-04-26T11:26:12.599944+0000","last_fullsized":"2024-04-26T11:26:12.574839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:19.324388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":578,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:24.175736+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:24.175736+0000","last_peered":"2024-04-26T11:26:24.175736+0000","last_clean":"2024-04-26T11:26:24.175736+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:24.175736+0000","last_undegraded":"2024-04-26T11:26:24.175736+0000","last_fullsized":"2024-04-26T11:26:24.175736+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":439,"reported_epoch":90,"state":"peering","last_fresh":"2024-04-26T11:26:25.357383+0000","last_change":"2024-04-26T11:26:25.690769+0000","last_active":"2024-04-26T11:26:25.690769+0000","last_peered":"2024-04-26T11:26:25.357383+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.733184+0000","last_became_peered":"2024-04-26T11:26:12.733184+0000","last_unstale":"2024-04-26T11:26:25.357383+0000","last_undegraded":"2024-04-26T11:26:25.357383+0000","last_fullsized":"2024-04-26T11:26:12.574673+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":581,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375605+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:25.375605+0000","last_peered":"2024-04-26T11:26:25.375605+0000","last_clean":"2024-04-26T11:26:25.375605+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:25.375605+0000","last_undegraded":"2024-04-26T11:26:25.375605+0000","last_fullsized":"2024-04-26T11:26:25.375605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":491,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377440+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:25.377440+0000","last_peered":"2024-04-26T11:26:25.377440+0000","last_clean":"2024-04-26T11:26:25.377440+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:25.377440+0000","last_undegraded":"2024-04-26T11:26:25.377440+0000","last_fullsized":"2024-04-26T11:26:25.377440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":480,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374614+0000","last_change":"2024-04-26T11:26:12.745926+0000","last_active":"2024-04-26T11:26:25.374614+0000","last_peered":"2024-04-26T11:26:25.374614+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.741978+0000","last_became_peered":"2024-04-26T11:26:12.741978+0000","last_unstale":"2024-04-26T11:26:25.374614+0000","last_undegraded":"2024-04-26T11:26:12.595341+0000","last_fullsized":"2024-04-26T11:26:12.575641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:33.135319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":767,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376714+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:25.376714+0000","last_peered":"2024-04-26T11:26:25.376714+0000","last_clean":"2024-04-26T11:26:25.376714+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:25.376714+0000","last_undegraded":"2024-04-26T11:26:25.376714+0000","last_fullsized":"2024-04-26T11:26:25.376714+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":438,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375963+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:25.375963+0000","last_peered":"2024-04-26T11:26:25.375963+0000","last_clean":"2024-04-26T11:26:25.375963+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:25.375963+0000","last_undegraded":"2024-04-26T11:26:25.375963+0000","last_fullsized":"2024-04-26T11:26:25.375963+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":466,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:24.175846+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:24.175846+0000","last_peered":"2024-04-26T11:26:24.175846+0000","last_clean":"2024-04-26T11:26:24.175846+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:24.175846+0000","last_undegraded":"2024-04-26T11:26:24.175846+0000","last_fullsized":"2024-04-26T11:26:24.175846+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":522,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894317+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:23.894317+0000","last_peered":"2024-04-26T11:26:23.894317+0000","last_clean":"2024-04-26T11:26:23.894317+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:23.894317+0000","last_undegraded":"2024-04-26T11:26:23.894317+0000","last_fullsized":"2024-04-26T11:26:23.894317+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":587,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:24.910704+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:24.910704+0000","last_peered":"2024-04-26T11:26:24.910704+0000","last_clean":"2024-04-26T11:26:24.910704+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:24.910704+0000","last_undegraded":"2024-04-26T11:26:24.910704+0000","last_fullsized":"2024-04-26T11:26:24.910704+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":561,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376670+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:25.376670+0000","last_peered":"2024-04-26T11:26:25.376670+0000","last_clean":"2024-04-26T11:26:25.376670+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:25.376670+0000","last_undegraded":"2024-04-26T11:26:25.376670+0000","last_fullsized":"2024-04-26T11:26:25.376670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":569,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377689+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:25.377689+0000","last_peered":"2024-04-26T11:26:25.377689+0000","last_clean":"2024-04-26T11:26:25.377689+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:25.377689+0000","last_undegraded":"2024-04-26T11:26:25.377689+0000","last_fullsized":"2024-04-26T11:26:25.377689+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":608,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.383468+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:26.383468+0000","last_peered":"2024-04-26T11:26:26.383468+0000","last_clean":"2024-04-26T11:26:26.383468+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:26.383468+0000","last_undegraded":"2024-04-26T11:26:26.383468+0000","last_fullsized":"2024-04-26T11:26:26.383468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":608,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.373926+0000","last_change":"2024-04-26T11:26:12.741252+0000","last_active":"2024-04-26T11:26:25.373926+0000","last_peered":"2024-04-26T11:26:25.373926+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.735943+0000","last_became_peered":"2024-04-26T11:26:12.735943+0000","last_unstale":"2024-04-26T11:26:25.373926+0000","last_undegraded":"2024-04-26T11:26:12.602319+0000","last_fullsized":"2024-04-26T11:26:12.575709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.922648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":553,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.375456+0000","last_change":"2024-04-26T11:26:12.748380+0000","last_active":"2024-04-26T11:26:25.375456+0000","last_peered":"2024-04-26T11:26:25.375456+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743161+0000","last_became_peered":"2024-04-26T11:26:12.743161+0000","last_unstale":"2024-04-26T11:26:25.375456+0000","last_undegraded":"2024-04-26T11:26:12.608799+0000","last_fullsized":"2024-04-26T11:26:12.600138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:44.695371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":575,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:26.170244+0000","last_change":"2024-04-26T11:26:22.400914+0000","last_active":"2024-04-26T11:26:26.170244+0000","last_peered":"2024-04-26T11:26:26.170244+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.377454+0000","last_became_peered":"2024-04-26T11:26:22.377454+0000","last_unstale":"2024-04-26T11:26:26.170244+0000","last_undegraded":"2024-04-26T11:26:22.364727+0000","last_fullsized":"2024-04-26T11:26:22.364125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:07.478987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":917,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.178126+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:26.178126+0000","last_peered":"2024-04-26T11:26:26.178126+0000","last_clean":"2024-04-26T11:26:26.178126+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:26.178126+0000","last_undegraded":"2024-04-26T11:26:26.178126+0000","last_fullsized":"2024-04-26T11:26:26.178126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":500,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375615+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:25.375615+0000","last_peered":"2024-04-26T11:26:25.375615+0000","last_clean":"2024-04-26T11:26:25.375615+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:25.375615+0000","last_undegraded":"2024-04-26T11:26:25.375615+0000","last_fullsized":"2024-04-26T11:26:25.375615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":535,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.378329+0000","last_change":"2024-04-26T11:26:22.397597+0000","last_active":"2024-04-26T11:26:25.378329+0000","last_peered":"2024-04-26T11:26:25.378329+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.382999+0000","last_became_peered":"2024-04-26T11:26:22.382999+0000","last_unstale":"2024-04-26T11:26:25.378329+0000","last_undegraded":"2024-04-26T11:26:22.367987+0000","last_fullsized":"2024-04-26T11:26:22.367405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:27.346211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1039,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375857+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:25.375857+0000","last_peered":"2024-04-26T11:26:25.375857+0000","last_clean":"2024-04-26T11:26:25.375857+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:25.375857+0000","last_undegraded":"2024-04-26T11:26:25.375857+0000","last_fullsized":"2024-04-26T11:26:25.375857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":553,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.378027+0000","last_change":"2024-04-26T11:26:12.756200+0000","last_active":"2024-04-26T11:26:25.378027+0000","last_peered":"2024-04-26T11:26:25.378027+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.752743+0000","last_became_peered":"2024-04-26T11:26:12.752743+0000","last_unstale":"2024-04-26T11:26:25.378027+0000","last_undegraded":"2024-04-26T11:26:12.617552+0000","last_fullsized":"2024-04-26T11:26:12.615167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:41.631936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":936,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.392116+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:26.392116+0000","last_peered":"2024-04-26T11:26:26.392116+0000","last_clean":"2024-04-26T11:26:26.392116+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:26.392116+0000","last_undegraded":"2024-04-26T11:26:26.392116+0000","last_fullsized":"2024-04-26T11:26:26.392116+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":493,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374605+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:25.374605+0000","last_peered":"2024-04-26T11:26:25.374605+0000","last_clean":"2024-04-26T11:26:25.374605+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:25.374605+0000","last_undegraded":"2024-04-26T11:26:25.374605+0000","last_fullsized":"2024-04-26T11:26:25.374605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":605,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.376469+0000","last_change":"2024-04-26T11:26:22.407504+0000","last_active":"2024-04-26T11:26:25.376469+0000","last_peered":"2024-04-26T11:26:25.376469+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.402212+0000","last_became_peered":"2024-04-26T11:26:22.402212+0000","last_unstale":"2024-04-26T11:26:25.376469+0000","last_undegraded":"2024-04-26T11:26:22.372226+0000","last_fullsized":"2024-04-26T11:26:22.371421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:02.822376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":613,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.373316+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:25.373316+0000","last_peered":"2024-04-26T11:26:25.373316+0000","last_clean":"2024-04-26T11:26:25.373316+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:25.373316+0000","last_undegraded":"2024-04-26T11:26:25.373316+0000","last_fullsized":"2024-04-26T11:26:25.373316+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":507,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.373940+0000","last_change":"2024-04-26T11:26:12.752759+0000","last_active":"2024-04-26T11:26:25.373940+0000","last_peered":"2024-04-26T11:26:25.373940+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749360+0000","last_became_peered":"2024-04-26T11:26:12.749360+0000","last_unstale":"2024-04-26T11:26:25.373940+0000","last_undegraded":"2024-04-26T11:26:12.617888+0000","last_fullsized":"2024-04-26T11:26:12.605870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.669370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":470,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376932+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:25.376932+0000","last_peered":"2024-04-26T11:26:25.376932+0000","last_clean":"2024-04-26T11:26:25.376932+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:25.376932+0000","last_undegraded":"2024-04-26T11:26:25.376932+0000","last_fullsized":"2024-04-26T11:26:25.376932+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":534,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895766+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:23.895766+0000","last_peered":"2024-04-26T11:26:23.895766+0000","last_clean":"2024-04-26T11:26:23.895766+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:23.895766+0000","last_undegraded":"2024-04-26T11:26:23.895766+0000","last_fullsized":"2024-04-26T11:26:23.895766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":490,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377405+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:25.377405+0000","last_peered":"2024-04-26T11:26:25.377405+0000","last_clean":"2024-04-26T11:26:25.377405+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:25.377405+0000","last_undegraded":"2024-04-26T11:26:25.377405+0000","last_fullsized":"2024-04-26T11:26:25.377405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374055+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:25.374055+0000","last_peered":"2024-04-26T11:26:25.374055+0000","last_clean":"2024-04-26T11:26:25.374055+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:25.374055+0000","last_undegraded":"2024-04-26T11:26:25.374055+0000","last_fullsized":"2024-04-26T11:26:25.374055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":982,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376279+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:25.376279+0000","last_peered":"2024-04-26T11:26:25.376279+0000","last_clean":"2024-04-26T11:26:25.376279+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:25.376279+0000","last_undegraded":"2024-04-26T11:26:25.376279+0000","last_fullsized":"2024-04-26T11:26:25.376279+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":148,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375861+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:25.375861+0000","last_peered":"2024-04-26T11:26:25.375861+0000","last_clean":"2024-04-26T11:26:25.375861+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:25.375861+0000","last_undegraded":"2024-04-26T11:26:25.375861+0000","last_fullsized":"2024-04-26T11:26:25.375861+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":922,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375859+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:25.375859+0000","last_peered":"2024-04-26T11:26:25.375859+0000","last_clean":"2024-04-26T11:26:25.375859+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:25.375859+0000","last_undegraded":"2024-04-26T11:26:25.375859+0000","last_fullsized":"2024-04-26T11:26:25.375859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.893614+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:23.893614+0000","last_peered":"2024-04-26T11:26:23.893614+0000","last_clean":"2024-04-26T11:26:23.893614+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:23.893614+0000","last_undegraded":"2024-04-26T11:26:23.893614+0000","last_fullsized":"2024-04-26T11:26:23.893614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":226,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.896360+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:23.896360+0000","last_peered":"2024-04-26T11:26:23.896360+0000","last_clean":"2024-04-26T11:26:23.896360+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:23.896360+0000","last_undegraded":"2024-04-26T11:26:23.896360+0000","last_fullsized":"2024-04-26T11:26:23.896360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":861,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375611+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:25.375611+0000","last_peered":"2024-04-26T11:26:25.375611+0000","last_clean":"2024-04-26T11:26:25.375611+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:25.375611+0000","last_undegraded":"2024-04-26T11:26:25.375611+0000","last_fullsized":"2024-04-26T11:26:25.375611+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":386,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.170682+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:26.170682+0000","last_peered":"2024-04-26T11:26:26.170682+0000","last_clean":"2024-04-26T11:26:26.170682+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:26.170682+0000","last_undegraded":"2024-04-26T11:26:26.170682+0000","last_fullsized":"2024-04-26T11:26:26.170682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":565,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375583+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:25.375583+0000","last_peered":"2024-04-26T11:26:25.375583+0000","last_clean":"2024-04-26T11:26:25.375583+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:25.375583+0000","last_undegraded":"2024-04-26T11:26:25.375583+0000","last_fullsized":"2024-04-26T11:26:25.375583+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":629,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.896015+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:23.896015+0000","last_peered":"2024-04-26T11:26:23.896015+0000","last_clean":"2024-04-26T11:26:23.896015+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:23.896015+0000","last_undegraded":"2024-04-26T11:26:23.896015+0000","last_fullsized":"2024-04-26T11:26:23.896015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":537,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374409+0000","last_change":"2024-04-26T11:26:12.752679+0000","last_active":"2024-04-26T11:26:25.374409+0000","last_peered":"2024-04-26T11:26:25.374409+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749414+0000","last_became_peered":"2024-04-26T11:26:12.749414+0000","last_unstale":"2024-04-26T11:26:25.374409+0000","last_undegraded":"2024-04-26T11:26:12.616453+0000","last_fullsized":"2024-04-26T11:26:12.605189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:29.120239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.896863+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:23.896863+0000","last_peered":"2024-04-26T11:26:23.896863+0000","last_clean":"2024-04-26T11:26:23.896863+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:23.896863+0000","last_undegraded":"2024-04-26T11:26:23.896863+0000","last_fullsized":"2024-04-26T11:26:23.896863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":943,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.178318+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:26.178318+0000","last_peered":"2024-04-26T11:26:26.178318+0000","last_clean":"2024-04-26T11:26:26.178318+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:26.178318+0000","last_undegraded":"2024-04-26T11:26:26.178318+0000","last_fullsized":"2024-04-26T11:26:26.178318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":295,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.178382+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:26.178382+0000","last_peered":"2024-04-26T11:26:26.178382+0000","last_clean":"2024-04-26T11:26:26.178382+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:26.178382+0000","last_undegraded":"2024-04-26T11:26:26.178382+0000","last_fullsized":"2024-04-26T11:26:26.178382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":530,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374429+0000","last_change":"2024-04-26T11:26:12.748367+0000","last_active":"2024-04-26T11:26:25.374429+0000","last_peered":"2024-04-26T11:26:25.374429+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743318+0000","last_became_peered":"2024-04-26T11:26:12.743318+0000","last_unstale":"2024-04-26T11:26:25.374429+0000","last_undegraded":"2024-04-26T11:26:12.617383+0000","last_fullsized":"2024-04-26T11:26:12.604987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:55.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":279,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894149+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:23.894149+0000","last_peered":"2024-04-26T11:26:23.894149+0000","last_clean":"2024-04-26T11:26:23.894149+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:23.894149+0000","last_undegraded":"2024-04-26T11:26:23.894149+0000","last_fullsized":"2024-04-26T11:26:23.894149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":822,"reported_epoch":90,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:26:26.072933+0000","last_change":"2024-04-26T11:26:26.073496+0000","last_active":"2024-04-26T11:26:26.072933+0000","last_peered":"2024-04-26T11:26:26.072933+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749593+0000","last_became_peered":"2024-04-26T11:26:12.749593+0000","last_unstale":"2024-04-26T11:26:26.072933+0000","last_undegraded":"2024-04-26T11:26:26.072933+0000","last_fullsized":"2024-04-26T11:26:12.611420+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:49.811634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":136,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376118+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:25.376118+0000","last_peered":"2024-04-26T11:26:25.376118+0000","last_clean":"2024-04-26T11:26:25.376118+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:25.376118+0000","last_undegraded":"2024-04-26T11:26:25.376118+0000","last_fullsized":"2024-04-26T11:26:25.376118+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":446,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.377256+0000","last_change":"2024-04-26T11:26:13.612347+0000","last_active":"2024-04-26T11:26:25.377256+0000","last_peered":"2024-04-26T11:26:25.377256+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.722568+0000","last_became_peered":"2024-04-26T11:26:12.722568+0000","last_unstale":"2024-04-26T11:26:25.377256+0000","last_undegraded":"2024-04-26T11:26:13.611673+0000","last_fullsized":"2024-04-26T11:26:12.579570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:52.599455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":337,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375889+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:25.375889+0000","last_peered":"2024-04-26T11:26:25.375889+0000","last_clean":"2024-04-26T11:26:25.375889+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:25.375889+0000","last_undegraded":"2024-04-26T11:26:25.375889+0000","last_fullsized":"2024-04-26T11:26:25.375889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":538,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.383590+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:26.383590+0000","last_peered":"2024-04-26T11:26:26.383590+0000","last_clean":"2024-04-26T11:26:26.383590+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:26.383590+0000","last_undegraded":"2024-04-26T11:26:26.383590+0000","last_fullsized":"2024-04-26T11:26:26.383590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":231,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.893450+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:23.893450+0000","last_peered":"2024-04-26T11:26:23.893450+0000","last_clean":"2024-04-26T11:26:23.893450+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:23.893450+0000","last_undegraded":"2024-04-26T11:26:23.893450+0000","last_fullsized":"2024-04-26T11:26:23.893450+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894072+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:23.894072+0000","last_peered":"2024-04-26T11:26:23.894072+0000","last_clean":"2024-04-26T11:26:23.894072+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:23.894072+0000","last_undegraded":"2024-04-26T11:26:23.894072+0000","last_fullsized":"2024-04-26T11:26:23.894072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":836,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376081+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:25.376081+0000","last_peered":"2024-04-26T11:26:25.376081+0000","last_clean":"2024-04-26T11:26:25.376081+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:25.376081+0000","last_undegraded":"2024-04-26T11:26:25.376081+0000","last_fullsized":"2024-04-26T11:26:25.376081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":498,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:24.910671+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:24.910671+0000","last_peered":"2024-04-26T11:26:24.910671+0000","last_clean":"2024-04-26T11:26:24.910671+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:24.910671+0000","last_undegraded":"2024-04-26T11:26:24.910671+0000","last_fullsized":"2024-04-26T11:26:24.910671+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895786+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:23.895786+0000","last_peered":"2024-04-26T11:26:23.895786+0000","last_clean":"2024-04-26T11:26:23.895786+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:23.895786+0000","last_undegraded":"2024-04-26T11:26:23.895786+0000","last_fullsized":"2024-04-26T11:26:23.895786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":277,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374085+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:25.374085+0000","last_peered":"2024-04-26T11:26:25.374085+0000","last_clean":"2024-04-26T11:26:25.374085+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:25.374085+0000","last_undegraded":"2024-04-26T11:26:25.374085+0000","last_fullsized":"2024-04-26T11:26:25.374085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":547,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377687+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:25.377687+0000","last_peered":"2024-04-26T11:26:25.377687+0000","last_clean":"2024-04-26T11:26:25.377687+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:25.377687+0000","last_undegraded":"2024-04-26T11:26:25.377687+0000","last_fullsized":"2024-04-26T11:26:25.377687+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374536+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:25.374536+0000","last_peered":"2024-04-26T11:26:25.374536+0000","last_clean":"2024-04-26T11:26:25.374536+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:25.374536+0000","last_undegraded":"2024-04-26T11:26:25.374536+0000","last_fullsized":"2024-04-26T11:26:25.374536+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":467,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376068+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:25.376068+0000","last_peered":"2024-04-26T11:26:25.376068+0000","last_clean":"2024-04-26T11:26:25.376068+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:25.376068+0000","last_undegraded":"2024-04-26T11:26:25.376068+0000","last_fullsized":"2024-04-26T11:26:25.376068+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":438,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376158+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:25.376158+0000","last_peered":"2024-04-26T11:26:25.376158+0000","last_clean":"2024-04-26T11:26:25.376158+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:25.376158+0000","last_undegraded":"2024-04-26T11:26:25.376158+0000","last_fullsized":"2024-04-26T11:26:25.376158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.893792+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:23.893792+0000","last_peered":"2024-04-26T11:26:23.893792+0000","last_clean":"2024-04-26T11:26:23.893792+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:23.893792+0000","last_undegraded":"2024-04-26T11:26:23.893792+0000","last_fullsized":"2024-04-26T11:26:23.893792+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894091+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:23.894091+0000","last_peered":"2024-04-26T11:26:23.894091+0000","last_clean":"2024-04-26T11:26:23.894091+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:23.894091+0000","last_undegraded":"2024-04-26T11:26:23.894091+0000","last_fullsized":"2024-04-26T11:26:23.894091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":547,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375586+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:25.375586+0000","last_peered":"2024-04-26T11:26:25.375586+0000","last_clean":"2024-04-26T11:26:25.375586+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:25.375586+0000","last_undegraded":"2024-04-26T11:26:25.375586+0000","last_fullsized":"2024-04-26T11:26:25.375586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":554,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895095+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:23.895095+0000","last_peered":"2024-04-26T11:26:23.895095+0000","last_clean":"2024-04-26T11:26:23.895095+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:23.895095+0000","last_undegraded":"2024-04-26T11:26:23.895095+0000","last_fullsized":"2024-04-26T11:26:23.895095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376291+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:25.376291+0000","last_peered":"2024-04-26T11:26:25.376291+0000","last_clean":"2024-04-26T11:26:25.376291+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:25.376291+0000","last_undegraded":"2024-04-26T11:26:25.376291+0000","last_fullsized":"2024-04-26T11:26:25.376291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":453,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.376240+0000","last_change":"2024-04-26T11:26:22.404169+0000","last_active":"2024-04-26T11:26:25.376240+0000","last_peered":"2024-04-26T11:26:25.376240+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.397567+0000","last_became_peered":"2024-04-26T11:26:22.397567+0000","last_unstale":"2024-04-26T11:26:25.376240+0000","last_undegraded":"2024-04-26T11:26:22.370292+0000","last_fullsized":"2024-04-26T11:26:22.365457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:00.871852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375841+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:25.375841+0000","last_peered":"2024-04-26T11:26:25.375841+0000","last_clean":"2024-04-26T11:26:25.375841+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:25.375841+0000","last_undegraded":"2024-04-26T11:26:25.375841+0000","last_fullsized":"2024-04-26T11:26:25.375841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.378188+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:25.378188+0000","last_peered":"2024-04-26T11:26:25.378188+0000","last_clean":"2024-04-26T11:26:25.378188+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:25.378188+0000","last_undegraded":"2024-04-26T11:26:25.378188+0000","last_fullsized":"2024-04-26T11:26:25.378188+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":802,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376190+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:25.376190+0000","last_peered":"2024-04-26T11:26:25.376190+0000","last_clean":"2024-04-26T11:26:25.376190+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:25.376190+0000","last_undegraded":"2024-04-26T11:26:25.376190+0000","last_fullsized":"2024-04-26T11:26:25.376190+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376793+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:25.376793+0000","last_peered":"2024-04-26T11:26:25.376793+0000","last_clean":"2024-04-26T11:26:25.376793+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:25.376793+0000","last_undegraded":"2024-04-26T11:26:25.376793+0000","last_fullsized":"2024-04-26T11:26:25.376793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376543+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:25.376543+0000","last_peered":"2024-04-26T11:26:25.376543+0000","last_clean":"2024-04-26T11:26:25.376543+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:25.376543+0000","last_undegraded":"2024-04-26T11:26:25.376543+0000","last_fullsized":"2024-04-26T11:26:25.376543+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":531,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.375238+0000","last_change":"2024-04-26T11:26:12.748928+0000","last_active":"2024-04-26T11:26:25.375238+0000","last_peered":"2024-04-26T11:26:25.375238+0000","last_clean":"2024-04-26T11:23:20.666513+0000","last_became_active":"2024-04-26T11:26:12.743721+0000","last_became_peered":"2024-04-26T11:26:12.743721+0000","last_unstale":"2024-04-26T11:26:25.375238+0000","last_undegraded":"2024-04-26T11:26:12.621233+0000","last_fullsized":"2024-04-26T11:26:12.616597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:38.029361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":175,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376515+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:25.376515+0000","last_peered":"2024-04-26T11:26:25.376515+0000","last_clean":"2024-04-26T11:26:25.376515+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:25.376515+0000","last_undegraded":"2024-04-26T11:26:25.376515+0000","last_fullsized":"2024-04-26T11:26:25.376515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895518+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:23.895518+0000","last_peered":"2024-04-26T11:26:23.895518+0000","last_clean":"2024-04-26T11:26:23.895518+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:23.895518+0000","last_undegraded":"2024-04-26T11:26:23.895518+0000","last_fullsized":"2024-04-26T11:26:23.895518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":915,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375947+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:25.375947+0000","last_peered":"2024-04-26T11:26:25.375947+0000","last_clean":"2024-04-26T11:26:25.375947+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:25.375947+0000","last_undegraded":"2024-04-26T11:26:25.375947+0000","last_fullsized":"2024-04-26T11:26:25.375947+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":496,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894868+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:23.894868+0000","last_peered":"2024-04-26T11:26:23.894868+0000","last_clean":"2024-04-26T11:26:23.894868+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:23.894868+0000","last_undegraded":"2024-04-26T11:26:23.894868+0000","last_fullsized":"2024-04-26T11:26:23.894868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":475,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.896348+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:23.896348+0000","last_peered":"2024-04-26T11:26:23.896348+0000","last_clean":"2024-04-26T11:26:23.896348+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:23.896348+0000","last_undegraded":"2024-04-26T11:26:23.896348+0000","last_fullsized":"2024-04-26T11:26:23.896348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":540,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.373630+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:25.373630+0000","last_peered":"2024-04-26T11:26:25.373630+0000","last_clean":"2024-04-26T11:26:25.373630+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:25.373630+0000","last_undegraded":"2024-04-26T11:26:25.373630+0000","last_fullsized":"2024-04-26T11:26:25.373630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377832+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:25.377832+0000","last_peered":"2024-04-26T11:26:25.377832+0000","last_clean":"2024-04-26T11:26:25.377832+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:25.377832+0000","last_undegraded":"2024-04-26T11:26:25.377832+0000","last_fullsized":"2024-04-26T11:26:25.377832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":400,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895630+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:23.895630+0000","last_peered":"2024-04-26T11:26:23.895630+0000","last_clean":"2024-04-26T11:26:23.895630+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:23.895630+0000","last_undegraded":"2024-04-26T11:26:23.895630+0000","last_fullsized":"2024-04-26T11:26:23.895630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":597,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374755+0000","last_change":"2024-04-26T11:26:12.748851+0000","last_active":"2024-04-26T11:26:25.374755+0000","last_peered":"2024-04-26T11:26:25.374755+0000","last_clean":"2024-04-26T11:23:20.666469+0000","last_became_active":"2024-04-26T11:26:12.743007+0000","last_became_peered":"2024-04-26T11:26:12.743007+0000","last_unstale":"2024-04-26T11:26:25.374755+0000","last_undegraded":"2024-04-26T11:26:12.606150+0000","last_fullsized":"2024-04-26T11:26:12.595590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:06.439297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376667+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:25.376667+0000","last_peered":"2024-04-26T11:26:25.376667+0000","last_clean":"2024-04-26T11:26:25.376667+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:25.376667+0000","last_undegraded":"2024-04-26T11:26:25.376667+0000","last_fullsized":"2024-04-26T11:26:25.376667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":554,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374779+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:25.374779+0000","last_peered":"2024-04-26T11:26:25.374779+0000","last_clean":"2024-04-26T11:26:25.374779+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:25.374779+0000","last_undegraded":"2024-04-26T11:26:25.374779+0000","last_fullsized":"2024-04-26T11:26:25.374779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":459,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.378645+0000","last_change":"2024-04-26T11:26:22.400653+0000","last_active":"2024-04-26T11:26:25.378645+0000","last_peered":"2024-04-26T11:26:25.378645+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.389958+0000","last_became_peered":"2024-04-26T11:26:22.389958+0000","last_unstale":"2024-04-26T11:26:25.378645+0000","last_undegraded":"2024-04-26T11:26:22.368768+0000","last_fullsized":"2024-04-26T11:26:22.368227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:02.099186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":154,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":672,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375353+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:25.375353+0000","last_peered":"2024-04-26T11:26:25.375353+0000","last_clean":"2024-04-26T11:26:25.375353+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:25.375353+0000","last_undegraded":"2024-04-26T11:26:25.375353+0000","last_fullsized":"2024-04-26T11:26:25.375353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":907,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375984+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:25.375984+0000","last_peered":"2024-04-26T11:26:25.375984+0000","last_clean":"2024-04-26T11:26:25.375984+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:25.375984+0000","last_undegraded":"2024-04-26T11:26:25.375984+0000","last_fullsized":"2024-04-26T11:26:25.375984+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":379,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.373831+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:25.373831+0000","last_peered":"2024-04-26T11:26:25.373831+0000","last_clean":"2024-04-26T11:26:25.373831+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:25.373831+0000","last_undegraded":"2024-04-26T11:26:25.373831+0000","last_fullsized":"2024-04-26T11:26:25.373831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":659,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.377340+0000","last_change":"2024-04-26T11:26:22.404414+0000","last_active":"2024-04-26T11:26:25.377340+0000","last_peered":"2024-04-26T11:26:25.377340+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.387346+0000","last_became_peered":"2024-04-26T11:26:22.387346+0000","last_unstale":"2024-04-26T11:26:25.377340+0000","last_undegraded":"2024-04-26T11:26:22.368665+0000","last_fullsized":"2024-04-26T11:26:22.368295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:13.764286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":416,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376653+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:25.376653+0000","last_peered":"2024-04-26T11:26:25.376653+0000","last_clean":"2024-04-26T11:26:25.376653+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:25.376653+0000","last_undegraded":"2024-04-26T11:26:25.376653+0000","last_fullsized":"2024-04-26T11:26:25.376653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":484,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376834+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:25.376834+0000","last_peered":"2024-04-26T11:26:25.376834+0000","last_clean":"2024-04-26T11:26:25.376834+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:25.376834+0000","last_undegraded":"2024-04-26T11:26:25.376834+0000","last_fullsized":"2024-04-26T11:26:25.376834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376367+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:25.376367+0000","last_peered":"2024-04-26T11:26:25.376367+0000","last_clean":"2024-04-26T11:26:25.376367+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:25.376367+0000","last_undegraded":"2024-04-26T11:26:25.376367+0000","last_fullsized":"2024-04-26T11:26:25.376367+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":459,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894623+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:23.894623+0000","last_peered":"2024-04-26T11:26:23.894623+0000","last_clean":"2024-04-26T11:26:23.894623+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:23.894623+0000","last_undegraded":"2024-04-26T11:26:23.894623+0000","last_fullsized":"2024-04-26T11:26:23.894623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":388,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895992+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:23.895992+0000","last_peered":"2024-04-26T11:26:23.895992+0000","last_clean":"2024-04-26T11:26:23.895992+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:23.895992+0000","last_undegraded":"2024-04-26T11:26:23.895992+0000","last_fullsized":"2024-04-26T11:26:23.895992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":490,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374080+0000","last_change":"2024-04-26T11:26:12.744889+0000","last_active":"2024-04-26T11:26:25.374080+0000","last_peered":"2024-04-26T11:26:25.374080+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.737082+0000","last_became_peered":"2024-04-26T11:26:12.737082+0000","last_unstale":"2024-04-26T11:26:25.374080+0000","last_undegraded":"2024-04-26T11:26:12.611355+0000","last_fullsized":"2024-04-26T11:26:12.595288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:20.864858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":482,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377665+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:25.377665+0000","last_peered":"2024-04-26T11:26:25.377665+0000","last_clean":"2024-04-26T11:26:25.377665+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:25.377665+0000","last_undegraded":"2024-04-26T11:26:25.377665+0000","last_fullsized":"2024-04-26T11:26:25.377665+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":483,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376151+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:25.376151+0000","last_peered":"2024-04-26T11:26:25.376151+0000","last_clean":"2024-04-26T11:26:25.376151+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:25.376151+0000","last_undegraded":"2024-04-26T11:26:25.376151+0000","last_fullsized":"2024-04-26T11:26:25.376151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376363+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:25.376363+0000","last_peered":"2024-04-26T11:26:25.376363+0000","last_clean":"2024-04-26T11:26:25.376363+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:25.376363+0000","last_undegraded":"2024-04-26T11:26:25.376363+0000","last_fullsized":"2024-04-26T11:26:25.376363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":543,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.373434+0000","last_change":"2024-04-26T11:26:12.746698+0000","last_active":"2024-04-26T11:26:25.373434+0000","last_peered":"2024-04-26T11:26:25.373434+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.738414+0000","last_became_peered":"2024-04-26T11:26:12.738414+0000","last_unstale":"2024-04-26T11:26:25.373434+0000","last_undegraded":"2024-04-26T11:26:12.613606+0000","last_fullsized":"2024-04-26T11:26:12.600100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:58.547950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":241,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376415+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:25.376415+0000","last_peered":"2024-04-26T11:26:25.376415+0000","last_clean":"2024-04-26T11:26:25.376415+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:25.376415+0000","last_undegraded":"2024-04-26T11:26:25.376415+0000","last_fullsized":"2024-04-26T11:26:25.376415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3443,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3812,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":107,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142268,"kb_used_data":30828,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229572,"statfs":{"total":96636764160,"available":96491081728,"internally_reserved":0,"allocated":31567872,"data_stored":81541315,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124188,"kb_used_data":30792,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247652,"statfs":{"total":96636764160,"available":96509595648,"internally_reserved":0,"allocated":31531008,"data_stored":86045435,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.77800000000000002}]}]},{"osd":0,"up_from":75,"seq":322122547205,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57720,"kb_used_data":17896,"kb_used_omap":7,"kb_used_meta":39800,"kb_avail":94314120,"statfs":{"total":96636764160,"available":96577658880,"internally_reserved":0,"allocated":18325504,"data_stored":91709703,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":40756215},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:29.605 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:29.942 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:29.944 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:29.959 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-04-26T11:26:29.448437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3443,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3836,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":189,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":324176,"kb_used_data":79516,"kb_used_omap":10,"kb_used_meta":244597,"kb_avail":282791344,"statfs":{"total":289910292480,"available":289578336256,"internally_reserved":0,"allocated":81424384,"data_stored":259296453,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":250468227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":210,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":792,"num_bytes_recovered":-4194394,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001609"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":494,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377999+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:25.377999+0000","last_peered":"2024-04-26T11:26:25.377999+0000","last_clean":"2024-04-26T11:26:25.377999+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:25.377999+0000","last_undegraded":"2024-04-26T11:26:25.377999+0000","last_fullsized":"2024-04-26T11:26:25.377999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":550,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377195+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:25.377195+0000","last_peered":"2024-04-26T11:26:25.377195+0000","last_clean":"2024-04-26T11:26:25.377195+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:25.377195+0000","last_undegraded":"2024-04-26T11:26:25.377195+0000","last_fullsized":"2024-04-26T11:26:25.377195+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":424,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:24.176216+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:24.176216+0000","last_peered":"2024-04-26T11:26:24.176216+0000","last_clean":"2024-04-26T11:26:24.176216+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:24.176216+0000","last_undegraded":"2024-04-26T11:26:24.176216+0000","last_fullsized":"2024-04-26T11:26:24.176216+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":705,"reported_epoch":91,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T11:26:26.488311+0000","last_change":"2024-04-26T11:26:26.077769+0000","last_active":"2024-04-26T11:26:26.488311+0000","last_peered":"2024-04-26T11:26:26.488311+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.734418+0000","last_became_peered":"2024-04-26T11:26:12.734418+0000","last_unstale":"2024-04-26T11:26:26.488311+0000","last_undegraded":"2024-04-26T11:26:26.488311+0000","last_fullsized":"2024-04-26T11:26:12.575615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":525,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376236+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:25.376236+0000","last_peered":"2024-04-26T11:26:25.376236+0000","last_clean":"2024-04-26T11:26:25.376236+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:25.376236+0000","last_undegraded":"2024-04-26T11:26:25.376236+0000","last_fullsized":"2024-04-26T11:26:25.376236+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":489,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.373603+0000","last_change":"2024-04-26T11:26:12.740983+0000","last_active":"2024-04-26T11:26:25.373603+0000","last_peered":"2024-04-26T11:26:25.373603+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.735655+0000","last_became_peered":"2024-04-26T11:26:12.735655+0000","last_unstale":"2024-04-26T11:26:25.373603+0000","last_undegraded":"2024-04-26T11:26:12.599944+0000","last_fullsized":"2024-04-26T11:26:12.574839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:19.324388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":170,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":578,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:24.175736+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:24.175736+0000","last_peered":"2024-04-26T11:26:24.175736+0000","last_clean":"2024-04-26T11:26:24.175736+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:24.175736+0000","last_undegraded":"2024-04-26T11:26:24.175736+0000","last_fullsized":"2024-04-26T11:26:24.175736+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":439,"reported_epoch":90,"state":"peering","last_fresh":"2024-04-26T11:26:25.357383+0000","last_change":"2024-04-26T11:26:25.690769+0000","last_active":"2024-04-26T11:26:25.690769+0000","last_peered":"2024-04-26T11:26:25.357383+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.733184+0000","last_became_peered":"2024-04-26T11:26:12.733184+0000","last_unstale":"2024-04-26T11:26:25.357383+0000","last_undegraded":"2024-04-26T11:26:25.357383+0000","last_fullsized":"2024-04-26T11:26:12.574673+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":581,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375605+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:25.375605+0000","last_peered":"2024-04-26T11:26:25.375605+0000","last_clean":"2024-04-26T11:26:25.375605+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:25.375605+0000","last_undegraded":"2024-04-26T11:26:25.375605+0000","last_fullsized":"2024-04-26T11:26:25.375605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":491,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377440+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:25.377440+0000","last_peered":"2024-04-26T11:26:25.377440+0000","last_clean":"2024-04-26T11:26:25.377440+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:25.377440+0000","last_undegraded":"2024-04-26T11:26:25.377440+0000","last_fullsized":"2024-04-26T11:26:25.377440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":480,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374614+0000","last_change":"2024-04-26T11:26:12.745926+0000","last_active":"2024-04-26T11:26:25.374614+0000","last_peered":"2024-04-26T11:26:25.374614+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.741978+0000","last_became_peered":"2024-04-26T11:26:12.741978+0000","last_unstale":"2024-04-26T11:26:25.374614+0000","last_undegraded":"2024-04-26T11:26:12.595341+0000","last_fullsized":"2024-04-26T11:26:12.575641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:33.135319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":767,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376714+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:25.376714+0000","last_peered":"2024-04-26T11:26:25.376714+0000","last_clean":"2024-04-26T11:26:25.376714+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:25.376714+0000","last_undegraded":"2024-04-26T11:26:25.376714+0000","last_fullsized":"2024-04-26T11:26:25.376714+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":438,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375963+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:25.375963+0000","last_peered":"2024-04-26T11:26:25.375963+0000","last_clean":"2024-04-26T11:26:25.375963+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:25.375963+0000","last_undegraded":"2024-04-26T11:26:25.375963+0000","last_fullsized":"2024-04-26T11:26:25.375963+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":466,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:24.175846+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:24.175846+0000","last_peered":"2024-04-26T11:26:24.175846+0000","last_clean":"2024-04-26T11:26:24.175846+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:24.175846+0000","last_undegraded":"2024-04-26T11:26:24.175846+0000","last_fullsized":"2024-04-26T11:26:24.175846+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":522,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894317+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:23.894317+0000","last_peered":"2024-04-26T11:26:23.894317+0000","last_clean":"2024-04-26T11:26:23.894317+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:23.894317+0000","last_undegraded":"2024-04-26T11:26:23.894317+0000","last_fullsized":"2024-04-26T11:26:23.894317+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":587,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:24.910704+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:24.910704+0000","last_peered":"2024-04-26T11:26:24.910704+0000","last_clean":"2024-04-26T11:26:24.910704+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:24.910704+0000","last_undegraded":"2024-04-26T11:26:24.910704+0000","last_fullsized":"2024-04-26T11:26:24.910704+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":561,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376670+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:25.376670+0000","last_peered":"2024-04-26T11:26:25.376670+0000","last_clean":"2024-04-26T11:26:25.376670+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:25.376670+0000","last_undegraded":"2024-04-26T11:26:25.376670+0000","last_fullsized":"2024-04-26T11:26:25.376670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":569,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377689+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:25.377689+0000","last_peered":"2024-04-26T11:26:25.377689+0000","last_clean":"2024-04-26T11:26:25.377689+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:25.377689+0000","last_undegraded":"2024-04-26T11:26:25.377689+0000","last_fullsized":"2024-04-26T11:26:25.377689+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":608,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.383468+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:26.383468+0000","last_peered":"2024-04-26T11:26:26.383468+0000","last_clean":"2024-04-26T11:26:26.383468+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:26.383468+0000","last_undegraded":"2024-04-26T11:26:26.383468+0000","last_fullsized":"2024-04-26T11:26:26.383468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":608,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.373926+0000","last_change":"2024-04-26T11:26:12.741252+0000","last_active":"2024-04-26T11:26:25.373926+0000","last_peered":"2024-04-26T11:26:25.373926+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.735943+0000","last_became_peered":"2024-04-26T11:26:12.735943+0000","last_unstale":"2024-04-26T11:26:25.373926+0000","last_undegraded":"2024-04-26T11:26:12.602319+0000","last_fullsized":"2024-04-26T11:26:12.575709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:21:30.922648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":195,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":553,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.375456+0000","last_change":"2024-04-26T11:26:12.748380+0000","last_active":"2024-04-26T11:26:25.375456+0000","last_peered":"2024-04-26T11:26:25.375456+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743161+0000","last_became_peered":"2024-04-26T11:26:12.743161+0000","last_unstale":"2024-04-26T11:26:25.375456+0000","last_undegraded":"2024-04-26T11:26:12.608799+0000","last_fullsized":"2024-04-26T11:26:12.600138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:44.695371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":575,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:26.170244+0000","last_change":"2024-04-26T11:26:22.400914+0000","last_active":"2024-04-26T11:26:26.170244+0000","last_peered":"2024-04-26T11:26:26.170244+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.377454+0000","last_became_peered":"2024-04-26T11:26:22.377454+0000","last_unstale":"2024-04-26T11:26:26.170244+0000","last_undegraded":"2024-04-26T11:26:22.364727+0000","last_fullsized":"2024-04-26T11:26:22.364125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:07.478987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":917,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.178126+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:26.178126+0000","last_peered":"2024-04-26T11:26:26.178126+0000","last_clean":"2024-04-26T11:26:26.178126+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:26.178126+0000","last_undegraded":"2024-04-26T11:26:26.178126+0000","last_fullsized":"2024-04-26T11:26:26.178126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":500,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375615+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:25.375615+0000","last_peered":"2024-04-26T11:26:25.375615+0000","last_clean":"2024-04-26T11:26:25.375615+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:25.375615+0000","last_undegraded":"2024-04-26T11:26:25.375615+0000","last_fullsized":"2024-04-26T11:26:25.375615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":535,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.378329+0000","last_change":"2024-04-26T11:26:22.397597+0000","last_active":"2024-04-26T11:26:25.378329+0000","last_peered":"2024-04-26T11:26:25.378329+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.382999+0000","last_became_peered":"2024-04-26T11:26:22.382999+0000","last_unstale":"2024-04-26T11:26:25.378329+0000","last_undegraded":"2024-04-26T11:26:22.367987+0000","last_fullsized":"2024-04-26T11:26:22.367405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:27.346211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1039,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375857+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:25.375857+0000","last_peered":"2024-04-26T11:26:25.375857+0000","last_clean":"2024-04-26T11:26:25.375857+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:25.375857+0000","last_undegraded":"2024-04-26T11:26:25.375857+0000","last_fullsized":"2024-04-26T11:26:25.375857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":553,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.378027+0000","last_change":"2024-04-26T11:26:12.756200+0000","last_active":"2024-04-26T11:26:25.378027+0000","last_peered":"2024-04-26T11:26:25.378027+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.752743+0000","last_became_peered":"2024-04-26T11:26:12.752743+0000","last_unstale":"2024-04-26T11:26:25.378027+0000","last_undegraded":"2024-04-26T11:26:12.617552+0000","last_fullsized":"2024-04-26T11:26:12.615167+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:41.631936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":936,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.392116+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:26.392116+0000","last_peered":"2024-04-26T11:26:26.392116+0000","last_clean":"2024-04-26T11:26:26.392116+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:26.392116+0000","last_undegraded":"2024-04-26T11:26:26.392116+0000","last_fullsized":"2024-04-26T11:26:26.392116+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":493,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374605+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:25.374605+0000","last_peered":"2024-04-26T11:26:25.374605+0000","last_clean":"2024-04-26T11:26:25.374605+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:25.374605+0000","last_undegraded":"2024-04-26T11:26:25.374605+0000","last_fullsized":"2024-04-26T11:26:25.374605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":605,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.376469+0000","last_change":"2024-04-26T11:26:22.407504+0000","last_active":"2024-04-26T11:26:25.376469+0000","last_peered":"2024-04-26T11:26:25.376469+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.402212+0000","last_became_peered":"2024-04-26T11:26:22.402212+0000","last_unstale":"2024-04-26T11:26:25.376469+0000","last_undegraded":"2024-04-26T11:26:22.372226+0000","last_fullsized":"2024-04-26T11:26:22.371421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:02.822376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":613,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.373316+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:25.373316+0000","last_peered":"2024-04-26T11:26:25.373316+0000","last_clean":"2024-04-26T11:26:25.373316+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:25.373316+0000","last_undegraded":"2024-04-26T11:26:25.373316+0000","last_fullsized":"2024-04-26T11:26:25.373316+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":507,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.373940+0000","last_change":"2024-04-26T11:26:12.752759+0000","last_active":"2024-04-26T11:26:25.373940+0000","last_peered":"2024-04-26T11:26:25.373940+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749360+0000","last_became_peered":"2024-04-26T11:26:12.749360+0000","last_unstale":"2024-04-26T11:26:25.373940+0000","last_undegraded":"2024-04-26T11:26:12.617888+0000","last_fullsized":"2024-04-26T11:26:12.605870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.669370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":470,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376932+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:25.376932+0000","last_peered":"2024-04-26T11:26:25.376932+0000","last_clean":"2024-04-26T11:26:25.376932+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:25.376932+0000","last_undegraded":"2024-04-26T11:26:25.376932+0000","last_fullsized":"2024-04-26T11:26:25.376932+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":534,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895766+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:23.895766+0000","last_peered":"2024-04-26T11:26:23.895766+0000","last_clean":"2024-04-26T11:26:23.895766+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:23.895766+0000","last_undegraded":"2024-04-26T11:26:23.895766+0000","last_fullsized":"2024-04-26T11:26:23.895766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":490,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377405+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:25.377405+0000","last_peered":"2024-04-26T11:26:25.377405+0000","last_clean":"2024-04-26T11:26:25.377405+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:25.377405+0000","last_undegraded":"2024-04-26T11:26:25.377405+0000","last_fullsized":"2024-04-26T11:26:25.377405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374055+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:25.374055+0000","last_peered":"2024-04-26T11:26:25.374055+0000","last_clean":"2024-04-26T11:26:25.374055+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:25.374055+0000","last_undegraded":"2024-04-26T11:26:25.374055+0000","last_fullsized":"2024-04-26T11:26:25.374055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":982,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376279+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:25.376279+0000","last_peered":"2024-04-26T11:26:25.376279+0000","last_clean":"2024-04-26T11:26:25.376279+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:25.376279+0000","last_undegraded":"2024-04-26T11:26:25.376279+0000","last_fullsized":"2024-04-26T11:26:25.376279+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":148,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375861+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:25.375861+0000","last_peered":"2024-04-26T11:26:25.375861+0000","last_clean":"2024-04-26T11:26:25.375861+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:25.375861+0000","last_undegraded":"2024-04-26T11:26:25.375861+0000","last_fullsized":"2024-04-26T11:26:25.375861+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":922,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375859+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:25.375859+0000","last_peered":"2024-04-26T11:26:25.375859+0000","last_clean":"2024-04-26T11:26:25.375859+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:25.375859+0000","last_undegraded":"2024-04-26T11:26:25.375859+0000","last_fullsized":"2024-04-26T11:26:25.375859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.893614+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:23.893614+0000","last_peered":"2024-04-26T11:26:23.893614+0000","last_clean":"2024-04-26T11:26:23.893614+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:23.893614+0000","last_undegraded":"2024-04-26T11:26:23.893614+0000","last_fullsized":"2024-04-26T11:26:23.893614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":226,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.896360+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:23.896360+0000","last_peered":"2024-04-26T11:26:23.896360+0000","last_clean":"2024-04-26T11:26:23.896360+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:23.896360+0000","last_undegraded":"2024-04-26T11:26:23.896360+0000","last_fullsized":"2024-04-26T11:26:23.896360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":861,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375611+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:25.375611+0000","last_peered":"2024-04-26T11:26:25.375611+0000","last_clean":"2024-04-26T11:26:25.375611+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:25.375611+0000","last_undegraded":"2024-04-26T11:26:25.375611+0000","last_fullsized":"2024-04-26T11:26:25.375611+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":386,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.170682+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:26.170682+0000","last_peered":"2024-04-26T11:26:26.170682+0000","last_clean":"2024-04-26T11:26:26.170682+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:26.170682+0000","last_undegraded":"2024-04-26T11:26:26.170682+0000","last_fullsized":"2024-04-26T11:26:26.170682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":565,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375583+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:25.375583+0000","last_peered":"2024-04-26T11:26:25.375583+0000","last_clean":"2024-04-26T11:26:25.375583+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:25.375583+0000","last_undegraded":"2024-04-26T11:26:25.375583+0000","last_fullsized":"2024-04-26T11:26:25.375583+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":629,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.896015+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:23.896015+0000","last_peered":"2024-04-26T11:26:23.896015+0000","last_clean":"2024-04-26T11:26:23.896015+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:23.896015+0000","last_undegraded":"2024-04-26T11:26:23.896015+0000","last_fullsized":"2024-04-26T11:26:23.896015+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":537,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374409+0000","last_change":"2024-04-26T11:26:12.752679+0000","last_active":"2024-04-26T11:26:25.374409+0000","last_peered":"2024-04-26T11:26:25.374409+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749414+0000","last_became_peered":"2024-04-26T11:26:12.749414+0000","last_unstale":"2024-04-26T11:26:25.374409+0000","last_undegraded":"2024-04-26T11:26:12.616453+0000","last_fullsized":"2024-04-26T11:26:12.605189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:29.120239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.896863+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:23.896863+0000","last_peered":"2024-04-26T11:26:23.896863+0000","last_clean":"2024-04-26T11:26:23.896863+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:23.896863+0000","last_undegraded":"2024-04-26T11:26:23.896863+0000","last_fullsized":"2024-04-26T11:26:23.896863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":943,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.178318+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:26.178318+0000","last_peered":"2024-04-26T11:26:26.178318+0000","last_clean":"2024-04-26T11:26:26.178318+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:26.178318+0000","last_undegraded":"2024-04-26T11:26:26.178318+0000","last_fullsized":"2024-04-26T11:26:26.178318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":295,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.178382+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:26.178382+0000","last_peered":"2024-04-26T11:26:26.178382+0000","last_clean":"2024-04-26T11:26:26.178382+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:26.178382+0000","last_undegraded":"2024-04-26T11:26:26.178382+0000","last_fullsized":"2024-04-26T11:26:26.178382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":530,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374429+0000","last_change":"2024-04-26T11:26:12.748367+0000","last_active":"2024-04-26T11:26:25.374429+0000","last_peered":"2024-04-26T11:26:25.374429+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743318+0000","last_became_peered":"2024-04-26T11:26:12.743318+0000","last_unstale":"2024-04-26T11:26:25.374429+0000","last_undegraded":"2024-04-26T11:26:12.617383+0000","last_fullsized":"2024-04-26T11:26:12.604987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:55.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":279,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894149+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:23.894149+0000","last_peered":"2024-04-26T11:26:23.894149+0000","last_clean":"2024-04-26T11:26:23.894149+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:23.894149+0000","last_undegraded":"2024-04-26T11:26:23.894149+0000","last_fullsized":"2024-04-26T11:26:23.894149+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":822,"reported_epoch":90,"state":"active+undersized+remapped","last_fresh":"2024-04-26T11:26:26.072933+0000","last_change":"2024-04-26T11:26:26.073496+0000","last_active":"2024-04-26T11:26:26.072933+0000","last_peered":"2024-04-26T11:26:26.072933+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749593+0000","last_became_peered":"2024-04-26T11:26:12.749593+0000","last_unstale":"2024-04-26T11:26:26.072933+0000","last_undegraded":"2024-04-26T11:26:26.072933+0000","last_fullsized":"2024-04-26T11:26:12.611420+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:49.811634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":136,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376118+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:25.376118+0000","last_peered":"2024-04-26T11:26:25.376118+0000","last_clean":"2024-04-26T11:26:25.376118+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:25.376118+0000","last_undegraded":"2024-04-26T11:26:25.376118+0000","last_fullsized":"2024-04-26T11:26:25.376118+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":446,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.377256+0000","last_change":"2024-04-26T11:26:13.612347+0000","last_active":"2024-04-26T11:26:25.377256+0000","last_peered":"2024-04-26T11:26:25.377256+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.722568+0000","last_became_peered":"2024-04-26T11:26:12.722568+0000","last_unstale":"2024-04-26T11:26:25.377256+0000","last_undegraded":"2024-04-26T11:26:13.611673+0000","last_fullsized":"2024-04-26T11:26:12.579570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:52.599455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":337,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375889+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:25.375889+0000","last_peered":"2024-04-26T11:26:25.375889+0000","last_clean":"2024-04-26T11:26:25.375889+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:25.375889+0000","last_undegraded":"2024-04-26T11:26:25.375889+0000","last_fullsized":"2024-04-26T11:26:25.375889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":538,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.383590+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:26.383590+0000","last_peered":"2024-04-26T11:26:26.383590+0000","last_clean":"2024-04-26T11:26:26.383590+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:26.383590+0000","last_undegraded":"2024-04-26T11:26:26.383590+0000","last_fullsized":"2024-04-26T11:26:26.383590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":231,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.893450+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:23.893450+0000","last_peered":"2024-04-26T11:26:23.893450+0000","last_clean":"2024-04-26T11:26:23.893450+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:23.893450+0000","last_undegraded":"2024-04-26T11:26:23.893450+0000","last_fullsized":"2024-04-26T11:26:23.893450+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894072+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:23.894072+0000","last_peered":"2024-04-26T11:26:23.894072+0000","last_clean":"2024-04-26T11:26:23.894072+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:23.894072+0000","last_undegraded":"2024-04-26T11:26:23.894072+0000","last_fullsized":"2024-04-26T11:26:23.894072+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":836,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376081+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:25.376081+0000","last_peered":"2024-04-26T11:26:25.376081+0000","last_clean":"2024-04-26T11:26:25.376081+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:25.376081+0000","last_undegraded":"2024-04-26T11:26:25.376081+0000","last_fullsized":"2024-04-26T11:26:25.376081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":498,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:24.910671+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:24.910671+0000","last_peered":"2024-04-26T11:26:24.910671+0000","last_clean":"2024-04-26T11:26:24.910671+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:24.910671+0000","last_undegraded":"2024-04-26T11:26:24.910671+0000","last_fullsized":"2024-04-26T11:26:24.910671+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895786+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:23.895786+0000","last_peered":"2024-04-26T11:26:23.895786+0000","last_clean":"2024-04-26T11:26:23.895786+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:23.895786+0000","last_undegraded":"2024-04-26T11:26:23.895786+0000","last_fullsized":"2024-04-26T11:26:23.895786+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":277,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374085+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:25.374085+0000","last_peered":"2024-04-26T11:26:25.374085+0000","last_clean":"2024-04-26T11:26:25.374085+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:25.374085+0000","last_undegraded":"2024-04-26T11:26:25.374085+0000","last_fullsized":"2024-04-26T11:26:25.374085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":547,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377687+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:25.377687+0000","last_peered":"2024-04-26T11:26:25.377687+0000","last_clean":"2024-04-26T11:26:25.377687+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:25.377687+0000","last_undegraded":"2024-04-26T11:26:25.377687+0000","last_fullsized":"2024-04-26T11:26:25.377687+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374536+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:25.374536+0000","last_peered":"2024-04-26T11:26:25.374536+0000","last_clean":"2024-04-26T11:26:25.374536+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:25.374536+0000","last_undegraded":"2024-04-26T11:26:25.374536+0000","last_fullsized":"2024-04-26T11:26:25.374536+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":467,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376068+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:25.376068+0000","last_peered":"2024-04-26T11:26:25.376068+0000","last_clean":"2024-04-26T11:26:25.376068+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:25.376068+0000","last_undegraded":"2024-04-26T11:26:25.376068+0000","last_fullsized":"2024-04-26T11:26:25.376068+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":438,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376158+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:25.376158+0000","last_peered":"2024-04-26T11:26:25.376158+0000","last_clean":"2024-04-26T11:26:25.376158+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:25.376158+0000","last_undegraded":"2024-04-26T11:26:25.376158+0000","last_fullsized":"2024-04-26T11:26:25.376158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.893792+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:23.893792+0000","last_peered":"2024-04-26T11:26:23.893792+0000","last_clean":"2024-04-26T11:26:23.893792+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:23.893792+0000","last_undegraded":"2024-04-26T11:26:23.893792+0000","last_fullsized":"2024-04-26T11:26:23.893792+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894091+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:23.894091+0000","last_peered":"2024-04-26T11:26:23.894091+0000","last_clean":"2024-04-26T11:26:23.894091+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:23.894091+0000","last_undegraded":"2024-04-26T11:26:23.894091+0000","last_fullsized":"2024-04-26T11:26:23.894091+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":547,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375586+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:25.375586+0000","last_peered":"2024-04-26T11:26:25.375586+0000","last_clean":"2024-04-26T11:26:25.375586+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:25.375586+0000","last_undegraded":"2024-04-26T11:26:25.375586+0000","last_fullsized":"2024-04-26T11:26:25.375586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":554,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895095+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:23.895095+0000","last_peered":"2024-04-26T11:26:23.895095+0000","last_clean":"2024-04-26T11:26:23.895095+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:23.895095+0000","last_undegraded":"2024-04-26T11:26:23.895095+0000","last_fullsized":"2024-04-26T11:26:23.895095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376291+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:25.376291+0000","last_peered":"2024-04-26T11:26:25.376291+0000","last_clean":"2024-04-26T11:26:25.376291+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:25.376291+0000","last_undegraded":"2024-04-26T11:26:25.376291+0000","last_fullsized":"2024-04-26T11:26:25.376291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":453,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.376240+0000","last_change":"2024-04-26T11:26:22.404169+0000","last_active":"2024-04-26T11:26:25.376240+0000","last_peered":"2024-04-26T11:26:25.376240+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.397567+0000","last_became_peered":"2024-04-26T11:26:22.397567+0000","last_unstale":"2024-04-26T11:26:25.376240+0000","last_undegraded":"2024-04-26T11:26:22.370292+0000","last_fullsized":"2024-04-26T11:26:22.365457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:00.871852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375841+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:25.375841+0000","last_peered":"2024-04-26T11:26:25.375841+0000","last_clean":"2024-04-26T11:26:25.375841+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:25.375841+0000","last_undegraded":"2024-04-26T11:26:25.375841+0000","last_fullsized":"2024-04-26T11:26:25.375841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.378188+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:25.378188+0000","last_peered":"2024-04-26T11:26:25.378188+0000","last_clean":"2024-04-26T11:26:25.378188+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:25.378188+0000","last_undegraded":"2024-04-26T11:26:25.378188+0000","last_fullsized":"2024-04-26T11:26:25.378188+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":802,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376190+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:25.376190+0000","last_peered":"2024-04-26T11:26:25.376190+0000","last_clean":"2024-04-26T11:26:25.376190+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:25.376190+0000","last_undegraded":"2024-04-26T11:26:25.376190+0000","last_fullsized":"2024-04-26T11:26:25.376190+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376793+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:25.376793+0000","last_peered":"2024-04-26T11:26:25.376793+0000","last_clean":"2024-04-26T11:26:25.376793+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:25.376793+0000","last_undegraded":"2024-04-26T11:26:25.376793+0000","last_fullsized":"2024-04-26T11:26:25.376793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376543+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:25.376543+0000","last_peered":"2024-04-26T11:26:25.376543+0000","last_clean":"2024-04-26T11:26:25.376543+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:25.376543+0000","last_undegraded":"2024-04-26T11:26:25.376543+0000","last_fullsized":"2024-04-26T11:26:25.376543+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":531,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.375238+0000","last_change":"2024-04-26T11:26:12.748928+0000","last_active":"2024-04-26T11:26:25.375238+0000","last_peered":"2024-04-26T11:26:25.375238+0000","last_clean":"2024-04-26T11:23:20.666513+0000","last_became_active":"2024-04-26T11:26:12.743721+0000","last_became_peered":"2024-04-26T11:26:12.743721+0000","last_unstale":"2024-04-26T11:26:25.375238+0000","last_undegraded":"2024-04-26T11:26:12.621233+0000","last_fullsized":"2024-04-26T11:26:12.616597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:38.029361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":175,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376515+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:25.376515+0000","last_peered":"2024-04-26T11:26:25.376515+0000","last_clean":"2024-04-26T11:26:25.376515+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:25.376515+0000","last_undegraded":"2024-04-26T11:26:25.376515+0000","last_fullsized":"2024-04-26T11:26:25.376515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895518+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:23.895518+0000","last_peered":"2024-04-26T11:26:23.895518+0000","last_clean":"2024-04-26T11:26:23.895518+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:23.895518+0000","last_undegraded":"2024-04-26T11:26:23.895518+0000","last_fullsized":"2024-04-26T11:26:23.895518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":915,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375947+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:25.375947+0000","last_peered":"2024-04-26T11:26:25.375947+0000","last_clean":"2024-04-26T11:26:25.375947+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:25.375947+0000","last_undegraded":"2024-04-26T11:26:25.375947+0000","last_fullsized":"2024-04-26T11:26:25.375947+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":496,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894868+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:23.894868+0000","last_peered":"2024-04-26T11:26:23.894868+0000","last_clean":"2024-04-26T11:26:23.894868+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:23.894868+0000","last_undegraded":"2024-04-26T11:26:23.894868+0000","last_fullsized":"2024-04-26T11:26:23.894868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":475,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.896348+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:23.896348+0000","last_peered":"2024-04-26T11:26:23.896348+0000","last_clean":"2024-04-26T11:26:23.896348+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:23.896348+0000","last_undegraded":"2024-04-26T11:26:23.896348+0000","last_fullsized":"2024-04-26T11:26:23.896348+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":540,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.373630+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:25.373630+0000","last_peered":"2024-04-26T11:26:25.373630+0000","last_clean":"2024-04-26T11:26:25.373630+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:25.373630+0000","last_undegraded":"2024-04-26T11:26:25.373630+0000","last_fullsized":"2024-04-26T11:26:25.373630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377832+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:25.377832+0000","last_peered":"2024-04-26T11:26:25.377832+0000","last_clean":"2024-04-26T11:26:25.377832+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:25.377832+0000","last_undegraded":"2024-04-26T11:26:25.377832+0000","last_fullsized":"2024-04-26T11:26:25.377832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":400,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895630+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:23.895630+0000","last_peered":"2024-04-26T11:26:23.895630+0000","last_clean":"2024-04-26T11:26:23.895630+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:23.895630+0000","last_undegraded":"2024-04-26T11:26:23.895630+0000","last_fullsized":"2024-04-26T11:26:23.895630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":597,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374755+0000","last_change":"2024-04-26T11:26:12.748851+0000","last_active":"2024-04-26T11:26:25.374755+0000","last_peered":"2024-04-26T11:26:25.374755+0000","last_clean":"2024-04-26T11:23:20.666469+0000","last_became_active":"2024-04-26T11:26:12.743007+0000","last_became_peered":"2024-04-26T11:26:12.743007+0000","last_unstale":"2024-04-26T11:26:25.374755+0000","last_undegraded":"2024-04-26T11:26:12.606150+0000","last_fullsized":"2024-04-26T11:26:12.595590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:06.439297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376667+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:25.376667+0000","last_peered":"2024-04-26T11:26:25.376667+0000","last_clean":"2024-04-26T11:26:25.376667+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:25.376667+0000","last_undegraded":"2024-04-26T11:26:25.376667+0000","last_fullsized":"2024-04-26T11:26:25.376667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":554,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374779+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:25.374779+0000","last_peered":"2024-04-26T11:26:25.374779+0000","last_clean":"2024-04-26T11:26:25.374779+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:25.374779+0000","last_undegraded":"2024-04-26T11:26:25.374779+0000","last_fullsized":"2024-04-26T11:26:25.374779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":459,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.378645+0000","last_change":"2024-04-26T11:26:22.400653+0000","last_active":"2024-04-26T11:26:25.378645+0000","last_peered":"2024-04-26T11:26:25.378645+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.389958+0000","last_became_peered":"2024-04-26T11:26:22.389958+0000","last_unstale":"2024-04-26T11:26:25.378645+0000","last_undegraded":"2024-04-26T11:26:22.368768+0000","last_fullsized":"2024-04-26T11:26:22.368227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:02.099186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":154,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":672,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375353+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:25.375353+0000","last_peered":"2024-04-26T11:26:25.375353+0000","last_clean":"2024-04-26T11:26:25.375353+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:25.375353+0000","last_undegraded":"2024-04-26T11:26:25.375353+0000","last_fullsized":"2024-04-26T11:26:25.375353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":907,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375984+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:25.375984+0000","last_peered":"2024-04-26T11:26:25.375984+0000","last_clean":"2024-04-26T11:26:25.375984+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:25.375984+0000","last_undegraded":"2024-04-26T11:26:25.375984+0000","last_fullsized":"2024-04-26T11:26:25.375984+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":379,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.373831+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:25.373831+0000","last_peered":"2024-04-26T11:26:25.373831+0000","last_clean":"2024-04-26T11:26:25.373831+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:25.373831+0000","last_undegraded":"2024-04-26T11:26:25.373831+0000","last_fullsized":"2024-04-26T11:26:25.373831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":659,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.377340+0000","last_change":"2024-04-26T11:26:22.404414+0000","last_active":"2024-04-26T11:26:25.377340+0000","last_peered":"2024-04-26T11:26:25.377340+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.387346+0000","last_became_peered":"2024-04-26T11:26:22.387346+0000","last_unstale":"2024-04-26T11:26:25.377340+0000","last_undegraded":"2024-04-26T11:26:22.368665+0000","last_fullsized":"2024-04-26T11:26:22.368295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:13.764286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":416,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376653+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:25.376653+0000","last_peered":"2024-04-26T11:26:25.376653+0000","last_clean":"2024-04-26T11:26:25.376653+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:25.376653+0000","last_undegraded":"2024-04-26T11:26:25.376653+0000","last_fullsized":"2024-04-26T11:26:25.376653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":484,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376834+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:25.376834+0000","last_peered":"2024-04-26T11:26:25.376834+0000","last_clean":"2024-04-26T11:26:25.376834+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:25.376834+0000","last_undegraded":"2024-04-26T11:26:25.376834+0000","last_fullsized":"2024-04-26T11:26:25.376834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376367+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:25.376367+0000","last_peered":"2024-04-26T11:26:25.376367+0000","last_clean":"2024-04-26T11:26:25.376367+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:25.376367+0000","last_undegraded":"2024-04-26T11:26:25.376367+0000","last_fullsized":"2024-04-26T11:26:25.376367+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":459,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.894623+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:23.894623+0000","last_peered":"2024-04-26T11:26:23.894623+0000","last_clean":"2024-04-26T11:26:23.894623+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:23.894623+0000","last_undegraded":"2024-04-26T11:26:23.894623+0000","last_fullsized":"2024-04-26T11:26:23.894623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":388,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T11:26:23.895992+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:23.895992+0000","last_peered":"2024-04-26T11:26:23.895992+0000","last_clean":"2024-04-26T11:26:23.895992+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:23.895992+0000","last_undegraded":"2024-04-26T11:26:23.895992+0000","last_fullsized":"2024-04-26T11:26:23.895992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":490,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374080+0000","last_change":"2024-04-26T11:26:12.744889+0000","last_active":"2024-04-26T11:26:25.374080+0000","last_peered":"2024-04-26T11:26:25.374080+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.737082+0000","last_became_peered":"2024-04-26T11:26:12.737082+0000","last_unstale":"2024-04-26T11:26:25.374080+0000","last_undegraded":"2024-04-26T11:26:12.611355+0000","last_fullsized":"2024-04-26T11:26:12.595288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:20.864858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":482,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377665+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:25.377665+0000","last_peered":"2024-04-26T11:26:25.377665+0000","last_clean":"2024-04-26T11:26:25.377665+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:25.377665+0000","last_undegraded":"2024-04-26T11:26:25.377665+0000","last_fullsized":"2024-04-26T11:26:25.377665+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":483,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376151+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:25.376151+0000","last_peered":"2024-04-26T11:26:25.376151+0000","last_clean":"2024-04-26T11:26:25.376151+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:25.376151+0000","last_undegraded":"2024-04-26T11:26:25.376151+0000","last_fullsized":"2024-04-26T11:26:25.376151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376363+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:25.376363+0000","last_peered":"2024-04-26T11:26:25.376363+0000","last_clean":"2024-04-26T11:26:25.376363+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:25.376363+0000","last_undegraded":"2024-04-26T11:26:25.376363+0000","last_fullsized":"2024-04-26T11:26:25.376363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":543,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.373434+0000","last_change":"2024-04-26T11:26:12.746698+0000","last_active":"2024-04-26T11:26:25.373434+0000","last_peered":"2024-04-26T11:26:25.373434+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.738414+0000","last_became_peered":"2024-04-26T11:26:12.738414+0000","last_unstale":"2024-04-26T11:26:25.373434+0000","last_undegraded":"2024-04-26T11:26:12.613606+0000","last_fullsized":"2024-04-26T11:26:12.600100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:58.547950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":241,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376415+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:25.376415+0000","last_peered":"2024-04-26T11:26:25.376415+0000","last_clean":"2024-04-26T11:26:25.376415+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:25.376415+0000","last_undegraded":"2024-04-26T11:26:25.376415+0000","last_fullsized":"2024-04-26T11:26:25.376415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":3443,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3812,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":107,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142268,"kb_used_data":30828,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229572,"statfs":{"total":96636764160,"available":96491081728,"internally_reserved":0,"allocated":31567872,"data_stored":81541315,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124188,"kb_used_data":30792,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247652,"statfs":{"total":96636764160,"available":96509595648,"internally_reserved":0,"allocated":31531008,"data_stored":86045435,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.77800000000000002}]}]},{"osd":0,"up_from":75,"seq":322122547205,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57720,"kb_used_data":17896,"kb_used_omap":7,"kb_used_meta":39800,"kb_avail":94314120,"statfs":{"total":96636764160,"available":96577658880,"internally_reserved":0,"allocated":18325504,"data_stored":91709703,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":40756215},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:29.964 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:26:30.345 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:30.345 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 3443/110 objects degraded (3130.000%), 19 pgs degraded","count":19},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":297,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":94,"num_osds":3,"num_up_osds":3,"osd_up_since":1714130770,"num_in_osds":3,"osd_in_since":1714130493,"num_remapped_pgs":15},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":83},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":19},{"state_name":"peering","count":1},{"state_name":"active+undersized+remapped","count":1},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129078864,"bytes_used":331956224,"bytes_avail":289578336256,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":3443,"degraded_total":110,"degraded_ratio":31.300000000000001,"recovering_objects_per_sec":421,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1685,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4207}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-26T11:23:01.341628+0000","services":{}},"progress_events":{}} 2024-04-26T11:26:30.364 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:26:30.365 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:30.666 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:30.668 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:30.687 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-04-26T11:26:30.373387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2747,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4587,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":195,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":316020,"kb_used_data":79552,"kb_used_omap":10,"kb_used_meta":236405,"kb_avail":282799500,"statfs":{"total":289910292480,"available":289586688000,"internally_reserved":0,"allocated":81461248,"data_stored":259310640,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":242079619},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-696,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":831,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.993463"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":494,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377999+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:25.377999+0000","last_peered":"2024-04-26T11:26:25.377999+0000","last_clean":"2024-04-26T11:26:25.377999+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:25.377999+0000","last_undegraded":"2024-04-26T11:26:25.377999+0000","last_fullsized":"2024-04-26T11:26:25.377999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":550,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377195+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:25.377195+0000","last_peered":"2024-04-26T11:26:25.377195+0000","last_clean":"2024-04-26T11:26:25.377195+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:25.377195+0000","last_undegraded":"2024-04-26T11:26:25.377195+0000","last_fullsized":"2024-04-26T11:26:25.377195+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":428,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.894635+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:27.894635+0000","last_peered":"2024-04-26T11:26:27.894635+0000","last_clean":"2024-04-26T11:26:27.894635+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:27.894635+0000","last_undegraded":"2024-04-26T11:26:27.894635+0000","last_fullsized":"2024-04-26T11:26:27.894635+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":477,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.899215+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:28.899215+0000","last_peered":"2024-04-26T11:26:28.899215+0000","last_clean":"2024-04-26T11:26:28.899215+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:28.899215+0000","last_undegraded":"2024-04-26T11:26:28.899215+0000","last_fullsized":"2024-04-26T11:26:28.899215+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":525,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376236+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:25.376236+0000","last_peered":"2024-04-26T11:26:25.376236+0000","last_clean":"2024-04-26T11:26:25.376236+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:25.376236+0000","last_undegraded":"2024-04-26T11:26:25.376236+0000","last_fullsized":"2024-04-26T11:26:25.376236+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":481,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.911800+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:28.911800+0000","last_peered":"2024-04-26T11:26:28.911800+0000","last_clean":"2024-04-26T11:26:28.911800+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:28.911800+0000","last_undegraded":"2024-04-26T11:26:28.911800+0000","last_fullsized":"2024-04-26T11:26:28.911800+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":582,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892245+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:27.892245+0000","last_peered":"2024-04-26T11:26:27.892245+0000","last_clean":"2024-04-26T11:26:27.892245+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:27.892245+0000","last_undegraded":"2024-04-26T11:26:27.892245+0000","last_fullsized":"2024-04-26T11:26:27.892245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":450,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892095+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:27.892095+0000","last_peered":"2024-04-26T11:26:27.892095+0000","last_clean":"2024-04-26T11:26:27.892095+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:27.892095+0000","last_undegraded":"2024-04-26T11:26:27.892095+0000","last_fullsized":"2024-04-26T11:26:27.892095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":581,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375605+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:25.375605+0000","last_peered":"2024-04-26T11:26:25.375605+0000","last_clean":"2024-04-26T11:26:25.375605+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:25.375605+0000","last_undegraded":"2024-04-26T11:26:25.375605+0000","last_fullsized":"2024-04-26T11:26:25.375605+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":491,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377440+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:25.377440+0000","last_peered":"2024-04-26T11:26:25.377440+0000","last_clean":"2024-04-26T11:26:25.377440+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:25.377440+0000","last_undegraded":"2024-04-26T11:26:25.377440+0000","last_fullsized":"2024-04-26T11:26:25.377440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":480,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374614+0000","last_change":"2024-04-26T11:26:12.745926+0000","last_active":"2024-04-26T11:26:25.374614+0000","last_peered":"2024-04-26T11:26:25.374614+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.741978+0000","last_became_peered":"2024-04-26T11:26:12.741978+0000","last_unstale":"2024-04-26T11:26:25.374614+0000","last_undegraded":"2024-04-26T11:26:12.595341+0000","last_fullsized":"2024-04-26T11:26:12.575641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:33.135319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":167,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":767,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376714+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:25.376714+0000","last_peered":"2024-04-26T11:26:25.376714+0000","last_clean":"2024-04-26T11:26:25.376714+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:25.376714+0000","last_undegraded":"2024-04-26T11:26:25.376714+0000","last_fullsized":"2024-04-26T11:26:25.376714+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":438,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375963+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:25.375963+0000","last_peered":"2024-04-26T11:26:25.375963+0000","last_clean":"2024-04-26T11:26:25.375963+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:25.375963+0000","last_undegraded":"2024-04-26T11:26:25.375963+0000","last_fullsized":"2024-04-26T11:26:25.375963+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":470,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892626+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:27.892626+0000","last_peered":"2024-04-26T11:26:27.892626+0000","last_clean":"2024-04-26T11:26:27.892626+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:27.892626+0000","last_undegraded":"2024-04-26T11:26:27.892626+0000","last_fullsized":"2024-04-26T11:26:27.892626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":526,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891953+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:27.891953+0000","last_peered":"2024-04-26T11:26:27.891953+0000","last_clean":"2024-04-26T11:26:27.891953+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:27.891953+0000","last_undegraded":"2024-04-26T11:26:27.891953+0000","last_fullsized":"2024-04-26T11:26:27.891953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":591,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892354+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:27.892354+0000","last_peered":"2024-04-26T11:26:27.892354+0000","last_clean":"2024-04-26T11:26:27.892354+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:27.892354+0000","last_undegraded":"2024-04-26T11:26:27.892354+0000","last_fullsized":"2024-04-26T11:26:27.892354+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":561,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376670+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:25.376670+0000","last_peered":"2024-04-26T11:26:25.376670+0000","last_clean":"2024-04-26T11:26:25.376670+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:25.376670+0000","last_undegraded":"2024-04-26T11:26:25.376670+0000","last_fullsized":"2024-04-26T11:26:25.376670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":569,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377689+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:25.377689+0000","last_peered":"2024-04-26T11:26:25.377689+0000","last_clean":"2024-04-26T11:26:25.377689+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:25.377689+0000","last_undegraded":"2024-04-26T11:26:25.377689+0000","last_fullsized":"2024-04-26T11:26:25.377689+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":608,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.383468+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:26.383468+0000","last_peered":"2024-04-26T11:26:26.383468+0000","last_clean":"2024-04-26T11:26:26.383468+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:26.383468+0000","last_undegraded":"2024-04-26T11:26:26.383468+0000","last_fullsized":"2024-04-26T11:26:26.383468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":592,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-26T11:26:29.261045+0000","last_change":"2024-04-26T11:26:29.177466+0000","last_active":"2024-04-26T11:26:29.177466+0000","last_peered":"2024-04-26T11:26:29.261045+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.735943+0000","last_became_peered":"2024-04-26T11:26:12.735943+0000","last_unstale":"2024-04-26T11:26:29.261045+0000","last_undegraded":"2024-04-26T11:26:29.261045+0000","last_fullsized":"2024-04-26T11:26:12.575709+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":553,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.375456+0000","last_change":"2024-04-26T11:26:12.748380+0000","last_active":"2024-04-26T11:26:25.375456+0000","last_peered":"2024-04-26T11:26:25.375456+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743161+0000","last_became_peered":"2024-04-26T11:26:12.743161+0000","last_unstale":"2024-04-26T11:26:25.375456+0000","last_undegraded":"2024-04-26T11:26:12.608799+0000","last_fullsized":"2024-04-26T11:26:12.600138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:44.695371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":575,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:26.170244+0000","last_change":"2024-04-26T11:26:22.400914+0000","last_active":"2024-04-26T11:26:26.170244+0000","last_peered":"2024-04-26T11:26:26.170244+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.377454+0000","last_became_peered":"2024-04-26T11:26:22.377454+0000","last_unstale":"2024-04-26T11:26:26.170244+0000","last_undegraded":"2024-04-26T11:26:22.364727+0000","last_fullsized":"2024-04-26T11:26:22.364125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:07.478987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":917,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.178126+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:26.178126+0000","last_peered":"2024-04-26T11:26:26.178126+0000","last_clean":"2024-04-26T11:26:26.178126+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:26.178126+0000","last_undegraded":"2024-04-26T11:26:26.178126+0000","last_fullsized":"2024-04-26T11:26:26.178126+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":500,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375615+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:25.375615+0000","last_peered":"2024-04-26T11:26:25.375615+0000","last_clean":"2024-04-26T11:26:25.375615+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:25.375615+0000","last_undegraded":"2024-04-26T11:26:25.375615+0000","last_fullsized":"2024-04-26T11:26:25.375615+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":535,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.378329+0000","last_change":"2024-04-26T11:26:22.397597+0000","last_active":"2024-04-26T11:26:25.378329+0000","last_peered":"2024-04-26T11:26:25.378329+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.382999+0000","last_became_peered":"2024-04-26T11:26:22.382999+0000","last_unstale":"2024-04-26T11:26:25.378329+0000","last_undegraded":"2024-04-26T11:26:22.367987+0000","last_fullsized":"2024-04-26T11:26:22.367405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:27.346211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":194,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1039,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375857+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:25.375857+0000","last_peered":"2024-04-26T11:26:25.375857+0000","last_clean":"2024-04-26T11:26:25.375857+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:25.375857+0000","last_undegraded":"2024-04-26T11:26:25.375857+0000","last_fullsized":"2024-04-26T11:26:25.375857+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":546,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.900747+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:28.900747+0000","last_peered":"2024-04-26T11:26:28.900747+0000","last_clean":"2024-04-26T11:26:28.900747+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:28.900747+0000","last_undegraded":"2024-04-26T11:26:28.900747+0000","last_fullsized":"2024-04-26T11:26:28.900747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":936,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.392116+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:26.392116+0000","last_peered":"2024-04-26T11:26:26.392116+0000","last_clean":"2024-04-26T11:26:26.392116+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:26.392116+0000","last_undegraded":"2024-04-26T11:26:26.392116+0000","last_fullsized":"2024-04-26T11:26:26.392116+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":493,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374605+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:25.374605+0000","last_peered":"2024-04-26T11:26:25.374605+0000","last_clean":"2024-04-26T11:26:25.374605+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:25.374605+0000","last_undegraded":"2024-04-26T11:26:25.374605+0000","last_fullsized":"2024-04-26T11:26:25.374605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":605,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.376469+0000","last_change":"2024-04-26T11:26:22.407504+0000","last_active":"2024-04-26T11:26:25.376469+0000","last_peered":"2024-04-26T11:26:25.376469+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.402212+0000","last_became_peered":"2024-04-26T11:26:22.402212+0000","last_unstale":"2024-04-26T11:26:25.376469+0000","last_undegraded":"2024-04-26T11:26:22.372226+0000","last_fullsized":"2024-04-26T11:26:22.371421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:02.822376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":613,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.373316+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:25.373316+0000","last_peered":"2024-04-26T11:26:25.373316+0000","last_clean":"2024-04-26T11:26:25.373316+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:25.373316+0000","last_undegraded":"2024-04-26T11:26:25.373316+0000","last_fullsized":"2024-04-26T11:26:25.373316+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":507,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.373940+0000","last_change":"2024-04-26T11:26:12.752759+0000","last_active":"2024-04-26T11:26:25.373940+0000","last_peered":"2024-04-26T11:26:25.373940+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749360+0000","last_became_peered":"2024-04-26T11:26:12.749360+0000","last_unstale":"2024-04-26T11:26:25.373940+0000","last_undegraded":"2024-04-26T11:26:12.617888+0000","last_fullsized":"2024-04-26T11:26:12.605870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.669370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":470,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376932+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:25.376932+0000","last_peered":"2024-04-26T11:26:25.376932+0000","last_clean":"2024-04-26T11:26:25.376932+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:25.376932+0000","last_undegraded":"2024-04-26T11:26:25.376932+0000","last_fullsized":"2024-04-26T11:26:25.376932+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":538,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891639+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:27.891639+0000","last_peered":"2024-04-26T11:26:27.891639+0000","last_clean":"2024-04-26T11:26:27.891639+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:27.891639+0000","last_undegraded":"2024-04-26T11:26:27.891639+0000","last_fullsized":"2024-04-26T11:26:27.891639+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":490,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377405+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:25.377405+0000","last_peered":"2024-04-26T11:26:25.377405+0000","last_clean":"2024-04-26T11:26:25.377405+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:25.377405+0000","last_undegraded":"2024-04-26T11:26:25.377405+0000","last_fullsized":"2024-04-26T11:26:25.377405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374055+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:25.374055+0000","last_peered":"2024-04-26T11:26:25.374055+0000","last_clean":"2024-04-26T11:26:25.374055+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:25.374055+0000","last_undegraded":"2024-04-26T11:26:25.374055+0000","last_fullsized":"2024-04-26T11:26:25.374055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":982,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376279+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:25.376279+0000","last_peered":"2024-04-26T11:26:25.376279+0000","last_clean":"2024-04-26T11:26:25.376279+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:25.376279+0000","last_undegraded":"2024-04-26T11:26:25.376279+0000","last_fullsized":"2024-04-26T11:26:25.376279+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":148,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375861+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:25.375861+0000","last_peered":"2024-04-26T11:26:25.375861+0000","last_clean":"2024-04-26T11:26:25.375861+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:25.375861+0000","last_undegraded":"2024-04-26T11:26:25.375861+0000","last_fullsized":"2024-04-26T11:26:25.375861+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":922,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375859+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:25.375859+0000","last_peered":"2024-04-26T11:26:25.375859+0000","last_clean":"2024-04-26T11:26:25.375859+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:25.375859+0000","last_undegraded":"2024-04-26T11:26:25.375859+0000","last_fullsized":"2024-04-26T11:26:25.375859+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.890960+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:27.890960+0000","last_peered":"2024-04-26T11:26:27.890960+0000","last_clean":"2024-04-26T11:26:27.890960+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:27.890960+0000","last_undegraded":"2024-04-26T11:26:27.890960+0000","last_fullsized":"2024-04-26T11:26:27.890960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":230,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.895043+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:27.895043+0000","last_peered":"2024-04-26T11:26:27.895043+0000","last_clean":"2024-04-26T11:26:27.895043+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:27.895043+0000","last_undegraded":"2024-04-26T11:26:27.895043+0000","last_fullsized":"2024-04-26T11:26:27.895043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":861,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375611+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:25.375611+0000","last_peered":"2024-04-26T11:26:25.375611+0000","last_clean":"2024-04-26T11:26:25.375611+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:25.375611+0000","last_undegraded":"2024-04-26T11:26:25.375611+0000","last_fullsized":"2024-04-26T11:26:25.375611+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":386,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.170682+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:26.170682+0000","last_peered":"2024-04-26T11:26:26.170682+0000","last_clean":"2024-04-26T11:26:26.170682+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:26.170682+0000","last_undegraded":"2024-04-26T11:26:26.170682+0000","last_fullsized":"2024-04-26T11:26:26.170682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":565,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375583+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:25.375583+0000","last_peered":"2024-04-26T11:26:25.375583+0000","last_clean":"2024-04-26T11:26:25.375583+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:25.375583+0000","last_undegraded":"2024-04-26T11:26:25.375583+0000","last_fullsized":"2024-04-26T11:26:25.375583+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":633,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.893510+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:27.893510+0000","last_peered":"2024-04-26T11:26:27.893510+0000","last_clean":"2024-04-26T11:26:27.893510+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:27.893510+0000","last_undegraded":"2024-04-26T11:26:27.893510+0000","last_fullsized":"2024-04-26T11:26:27.893510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":537,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374409+0000","last_change":"2024-04-26T11:26:12.752679+0000","last_active":"2024-04-26T11:26:25.374409+0000","last_peered":"2024-04-26T11:26:25.374409+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749414+0000","last_became_peered":"2024-04-26T11:26:12.749414+0000","last_unstale":"2024-04-26T11:26:25.374409+0000","last_undegraded":"2024-04-26T11:26:12.616453+0000","last_fullsized":"2024-04-26T11:26:12.605189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:29.120239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892832+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:27.892832+0000","last_peered":"2024-04-26T11:26:27.892832+0000","last_clean":"2024-04-26T11:26:27.892832+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:27.892832+0000","last_undegraded":"2024-04-26T11:26:27.892832+0000","last_fullsized":"2024-04-26T11:26:27.892832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":943,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.178318+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:26.178318+0000","last_peered":"2024-04-26T11:26:26.178318+0000","last_clean":"2024-04-26T11:26:26.178318+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:26.178318+0000","last_undegraded":"2024-04-26T11:26:26.178318+0000","last_fullsized":"2024-04-26T11:26:26.178318+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":295,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.178382+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:26.178382+0000","last_peered":"2024-04-26T11:26:26.178382+0000","last_clean":"2024-04-26T11:26:26.178382+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:26.178382+0000","last_undegraded":"2024-04-26T11:26:26.178382+0000","last_fullsized":"2024-04-26T11:26:26.178382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":530,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374429+0000","last_change":"2024-04-26T11:26:12.748367+0000","last_active":"2024-04-26T11:26:25.374429+0000","last_peered":"2024-04-26T11:26:25.374429+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743318+0000","last_became_peered":"2024-04-26T11:26:12.743318+0000","last_unstale":"2024-04-26T11:26:25.374429+0000","last_undegraded":"2024-04-26T11:26:12.617383+0000","last_fullsized":"2024-04-26T11:26:12.604987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:55.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":283,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891881+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:27.891881+0000","last_peered":"2024-04-26T11:26:27.891881+0000","last_clean":"2024-04-26T11:26:27.891881+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:27.891881+0000","last_undegraded":"2024-04-26T11:26:27.891881+0000","last_fullsized":"2024-04-26T11:26:27.891881+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":459,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.900076+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:28.900076+0000","last_peered":"2024-04-26T11:26:28.900076+0000","last_clean":"2024-04-26T11:26:28.900076+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:28.900076+0000","last_undegraded":"2024-04-26T11:26:28.900076+0000","last_fullsized":"2024-04-26T11:26:28.900076+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":136,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376118+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:25.376118+0000","last_peered":"2024-04-26T11:26:25.376118+0000","last_clean":"2024-04-26T11:26:25.376118+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:25.376118+0000","last_undegraded":"2024-04-26T11:26:25.376118+0000","last_fullsized":"2024-04-26T11:26:25.376118+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":427,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-26T11:26:28.498990+0000","last_change":"2024-04-26T11:26:29.177633+0000","last_active":"2024-04-26T11:26:29.177633+0000","last_peered":"2024-04-26T11:26:28.498990+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.722568+0000","last_became_peered":"2024-04-26T11:26:12.722568+0000","last_unstale":"2024-04-26T11:26:28.498990+0000","last_undegraded":"2024-04-26T11:26:28.498990+0000","last_fullsized":"2024-04-26T11:26:12.579570+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":337,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375889+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:25.375889+0000","last_peered":"2024-04-26T11:26:25.375889+0000","last_clean":"2024-04-26T11:26:25.375889+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:25.375889+0000","last_undegraded":"2024-04-26T11:26:25.375889+0000","last_fullsized":"2024-04-26T11:26:25.375889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":538,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T11:26:26.383590+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:26.383590+0000","last_peered":"2024-04-26T11:26:26.383590+0000","last_clean":"2024-04-26T11:26:26.383590+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:26.383590+0000","last_undegraded":"2024-04-26T11:26:26.383590+0000","last_fullsized":"2024-04-26T11:26:26.383590+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":235,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.890718+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:27.890718+0000","last_peered":"2024-04-26T11:26:27.890718+0000","last_clean":"2024-04-26T11:26:27.890718+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:27.890718+0000","last_undegraded":"2024-04-26T11:26:27.890718+0000","last_fullsized":"2024-04-26T11:26:27.890718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891442+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:27.891442+0000","last_peered":"2024-04-26T11:26:27.891442+0000","last_clean":"2024-04-26T11:26:27.891442+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:27.891442+0000","last_undegraded":"2024-04-26T11:26:27.891442+0000","last_fullsized":"2024-04-26T11:26:27.891442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":836,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376081+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:25.376081+0000","last_peered":"2024-04-26T11:26:25.376081+0000","last_clean":"2024-04-26T11:26:25.376081+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:25.376081+0000","last_undegraded":"2024-04-26T11:26:25.376081+0000","last_fullsized":"2024-04-26T11:26:25.376081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":502,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.893635+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:27.893635+0000","last_peered":"2024-04-26T11:26:27.893635+0000","last_clean":"2024-04-26T11:26:27.893635+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:27.893635+0000","last_undegraded":"2024-04-26T11:26:27.893635+0000","last_fullsized":"2024-04-26T11:26:27.893635+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892051+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:27.892051+0000","last_peered":"2024-04-26T11:26:27.892051+0000","last_clean":"2024-04-26T11:26:27.892051+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:27.892051+0000","last_undegraded":"2024-04-26T11:26:27.892051+0000","last_fullsized":"2024-04-26T11:26:27.892051+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":277,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374085+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:25.374085+0000","last_peered":"2024-04-26T11:26:25.374085+0000","last_clean":"2024-04-26T11:26:25.374085+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:25.374085+0000","last_undegraded":"2024-04-26T11:26:25.374085+0000","last_fullsized":"2024-04-26T11:26:25.374085+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":547,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377687+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:25.377687+0000","last_peered":"2024-04-26T11:26:25.377687+0000","last_clean":"2024-04-26T11:26:25.377687+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:25.377687+0000","last_undegraded":"2024-04-26T11:26:25.377687+0000","last_fullsized":"2024-04-26T11:26:25.377687+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":89,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374536+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:25.374536+0000","last_peered":"2024-04-26T11:26:25.374536+0000","last_clean":"2024-04-26T11:26:25.374536+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:25.374536+0000","last_undegraded":"2024-04-26T11:26:25.374536+0000","last_fullsized":"2024-04-26T11:26:25.374536+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":467,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376068+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:25.376068+0000","last_peered":"2024-04-26T11:26:25.376068+0000","last_clean":"2024-04-26T11:26:25.376068+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:25.376068+0000","last_undegraded":"2024-04-26T11:26:25.376068+0000","last_fullsized":"2024-04-26T11:26:25.376068+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":438,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376158+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:25.376158+0000","last_peered":"2024-04-26T11:26:25.376158+0000","last_clean":"2024-04-26T11:26:25.376158+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:25.376158+0000","last_undegraded":"2024-04-26T11:26:25.376158+0000","last_fullsized":"2024-04-26T11:26:25.376158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891375+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:27.891375+0000","last_peered":"2024-04-26T11:26:27.891375+0000","last_clean":"2024-04-26T11:26:27.891375+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:27.891375+0000","last_undegraded":"2024-04-26T11:26:27.891375+0000","last_fullsized":"2024-04-26T11:26:27.891375+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891394+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:27.891394+0000","last_peered":"2024-04-26T11:26:27.891394+0000","last_clean":"2024-04-26T11:26:27.891394+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:27.891394+0000","last_undegraded":"2024-04-26T11:26:27.891394+0000","last_fullsized":"2024-04-26T11:26:27.891394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":547,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375586+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:25.375586+0000","last_peered":"2024-04-26T11:26:25.375586+0000","last_clean":"2024-04-26T11:26:25.375586+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:25.375586+0000","last_undegraded":"2024-04-26T11:26:25.375586+0000","last_fullsized":"2024-04-26T11:26:25.375586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":558,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.893063+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:27.893063+0000","last_peered":"2024-04-26T11:26:27.893063+0000","last_clean":"2024-04-26T11:26:27.893063+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:27.893063+0000","last_undegraded":"2024-04-26T11:26:27.893063+0000","last_fullsized":"2024-04-26T11:26:27.893063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376291+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:25.376291+0000","last_peered":"2024-04-26T11:26:25.376291+0000","last_clean":"2024-04-26T11:26:25.376291+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:25.376291+0000","last_undegraded":"2024-04-26T11:26:25.376291+0000","last_fullsized":"2024-04-26T11:26:25.376291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":453,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.376240+0000","last_change":"2024-04-26T11:26:22.404169+0000","last_active":"2024-04-26T11:26:25.376240+0000","last_peered":"2024-04-26T11:26:25.376240+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.397567+0000","last_became_peered":"2024-04-26T11:26:22.397567+0000","last_unstale":"2024-04-26T11:26:25.376240+0000","last_undegraded":"2024-04-26T11:26:22.370292+0000","last_fullsized":"2024-04-26T11:26:22.365457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:00.871852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375841+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:25.375841+0000","last_peered":"2024-04-26T11:26:25.375841+0000","last_clean":"2024-04-26T11:26:25.375841+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:25.375841+0000","last_undegraded":"2024-04-26T11:26:25.375841+0000","last_fullsized":"2024-04-26T11:26:25.375841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.378188+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:25.378188+0000","last_peered":"2024-04-26T11:26:25.378188+0000","last_clean":"2024-04-26T11:26:25.378188+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:25.378188+0000","last_undegraded":"2024-04-26T11:26:25.378188+0000","last_fullsized":"2024-04-26T11:26:25.378188+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":802,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376190+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:25.376190+0000","last_peered":"2024-04-26T11:26:25.376190+0000","last_clean":"2024-04-26T11:26:25.376190+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:25.376190+0000","last_undegraded":"2024-04-26T11:26:25.376190+0000","last_fullsized":"2024-04-26T11:26:25.376190+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376793+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:25.376793+0000","last_peered":"2024-04-26T11:26:25.376793+0000","last_clean":"2024-04-26T11:26:25.376793+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:25.376793+0000","last_undegraded":"2024-04-26T11:26:25.376793+0000","last_fullsized":"2024-04-26T11:26:25.376793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376543+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:25.376543+0000","last_peered":"2024-04-26T11:26:25.376543+0000","last_clean":"2024-04-26T11:26:25.376543+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:25.376543+0000","last_undegraded":"2024-04-26T11:26:25.376543+0000","last_fullsized":"2024-04-26T11:26:25.376543+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":531,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.375238+0000","last_change":"2024-04-26T11:26:12.748928+0000","last_active":"2024-04-26T11:26:25.375238+0000","last_peered":"2024-04-26T11:26:25.375238+0000","last_clean":"2024-04-26T11:23:20.666513+0000","last_became_active":"2024-04-26T11:26:12.743721+0000","last_became_peered":"2024-04-26T11:26:12.743721+0000","last_unstale":"2024-04-26T11:26:25.375238+0000","last_undegraded":"2024-04-26T11:26:12.621233+0000","last_fullsized":"2024-04-26T11:26:12.616597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:38.029361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":175,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376515+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:25.376515+0000","last_peered":"2024-04-26T11:26:25.376515+0000","last_clean":"2024-04-26T11:26:25.376515+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:25.376515+0000","last_undegraded":"2024-04-26T11:26:25.376515+0000","last_fullsized":"2024-04-26T11:26:25.376515+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.894123+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:27.894123+0000","last_peered":"2024-04-26T11:26:27.894123+0000","last_clean":"2024-04-26T11:26:27.894123+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:27.894123+0000","last_undegraded":"2024-04-26T11:26:27.894123+0000","last_fullsized":"2024-04-26T11:26:27.894123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":915,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375947+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:25.375947+0000","last_peered":"2024-04-26T11:26:25.375947+0000","last_clean":"2024-04-26T11:26:25.375947+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:25.375947+0000","last_undegraded":"2024-04-26T11:26:25.375947+0000","last_fullsized":"2024-04-26T11:26:25.375947+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":500,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892338+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:27.892338+0000","last_peered":"2024-04-26T11:26:27.892338+0000","last_clean":"2024-04-26T11:26:27.892338+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:27.892338+0000","last_undegraded":"2024-04-26T11:26:27.892338+0000","last_fullsized":"2024-04-26T11:26:27.892338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":479,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892508+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:27.892508+0000","last_peered":"2024-04-26T11:26:27.892508+0000","last_clean":"2024-04-26T11:26:27.892508+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:27.892508+0000","last_undegraded":"2024-04-26T11:26:27.892508+0000","last_fullsized":"2024-04-26T11:26:27.892508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":540,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.373630+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:25.373630+0000","last_peered":"2024-04-26T11:26:25.373630+0000","last_clean":"2024-04-26T11:26:25.373630+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:25.373630+0000","last_undegraded":"2024-04-26T11:26:25.373630+0000","last_fullsized":"2024-04-26T11:26:25.373630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377832+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:25.377832+0000","last_peered":"2024-04-26T11:26:25.377832+0000","last_clean":"2024-04-26T11:26:25.377832+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:25.377832+0000","last_undegraded":"2024-04-26T11:26:25.377832+0000","last_fullsized":"2024-04-26T11:26:25.377832+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":404,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.894836+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:27.894836+0000","last_peered":"2024-04-26T11:26:27.894836+0000","last_clean":"2024-04-26T11:26:27.894836+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:27.894836+0000","last_undegraded":"2024-04-26T11:26:27.894836+0000","last_fullsized":"2024-04-26T11:26:27.894836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":597,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374755+0000","last_change":"2024-04-26T11:26:12.748851+0000","last_active":"2024-04-26T11:26:25.374755+0000","last_peered":"2024-04-26T11:26:25.374755+0000","last_clean":"2024-04-26T11:23:20.666469+0000","last_became_active":"2024-04-26T11:26:12.743007+0000","last_became_peered":"2024-04-26T11:26:12.743007+0000","last_unstale":"2024-04-26T11:26:25.374755+0000","last_undegraded":"2024-04-26T11:26:12.606150+0000","last_fullsized":"2024-04-26T11:26:12.595590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:06.439297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376667+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:25.376667+0000","last_peered":"2024-04-26T11:26:25.376667+0000","last_clean":"2024-04-26T11:26:25.376667+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:25.376667+0000","last_undegraded":"2024-04-26T11:26:25.376667+0000","last_fullsized":"2024-04-26T11:26:25.376667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":554,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.374779+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:25.374779+0000","last_peered":"2024-04-26T11:26:25.374779+0000","last_clean":"2024-04-26T11:26:25.374779+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:25.374779+0000","last_undegraded":"2024-04-26T11:26:25.374779+0000","last_fullsized":"2024-04-26T11:26:25.374779+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":459,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.378645+0000","last_change":"2024-04-26T11:26:22.400653+0000","last_active":"2024-04-26T11:26:25.378645+0000","last_peered":"2024-04-26T11:26:25.378645+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.389958+0000","last_became_peered":"2024-04-26T11:26:22.389958+0000","last_unstale":"2024-04-26T11:26:25.378645+0000","last_undegraded":"2024-04-26T11:26:22.368768+0000","last_fullsized":"2024-04-26T11:26:22.368227+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:02.099186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":154,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":672,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375353+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:25.375353+0000","last_peered":"2024-04-26T11:26:25.375353+0000","last_clean":"2024-04-26T11:26:25.375353+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:25.375353+0000","last_undegraded":"2024-04-26T11:26:25.375353+0000","last_fullsized":"2024-04-26T11:26:25.375353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":907,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.375984+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:25.375984+0000","last_peered":"2024-04-26T11:26:25.375984+0000","last_clean":"2024-04-26T11:26:25.375984+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:25.375984+0000","last_undegraded":"2024-04-26T11:26:25.375984+0000","last_fullsized":"2024-04-26T11:26:25.375984+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":379,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.373831+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:25.373831+0000","last_peered":"2024-04-26T11:26:25.373831+0000","last_clean":"2024-04-26T11:26:25.373831+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:25.373831+0000","last_undegraded":"2024-04-26T11:26:25.373831+0000","last_fullsized":"2024-04-26T11:26:25.373831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":659,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.377340+0000","last_change":"2024-04-26T11:26:22.404414+0000","last_active":"2024-04-26T11:26:25.377340+0000","last_peered":"2024-04-26T11:26:25.377340+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.387346+0000","last_became_peered":"2024-04-26T11:26:22.387346+0000","last_unstale":"2024-04-26T11:26:25.377340+0000","last_undegraded":"2024-04-26T11:26:22.368665+0000","last_fullsized":"2024-04-26T11:26:22.368295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:13.764286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":416,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376653+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:25.376653+0000","last_peered":"2024-04-26T11:26:25.376653+0000","last_clean":"2024-04-26T11:26:25.376653+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:25.376653+0000","last_undegraded":"2024-04-26T11:26:25.376653+0000","last_fullsized":"2024-04-26T11:26:25.376653+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":484,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376834+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:25.376834+0000","last_peered":"2024-04-26T11:26:25.376834+0000","last_clean":"2024-04-26T11:26:25.376834+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:25.376834+0000","last_undegraded":"2024-04-26T11:26:25.376834+0000","last_fullsized":"2024-04-26T11:26:25.376834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":137,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376367+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:25.376367+0000","last_peered":"2024-04-26T11:26:25.376367+0000","last_clean":"2024-04-26T11:26:25.376367+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:25.376367+0000","last_undegraded":"2024-04-26T11:26:25.376367+0000","last_fullsized":"2024-04-26T11:26:25.376367+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":463,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892132+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:27.892132+0000","last_peered":"2024-04-26T11:26:27.892132+0000","last_clean":"2024-04-26T11:26:27.892132+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:27.892132+0000","last_undegraded":"2024-04-26T11:26:27.892132+0000","last_fullsized":"2024-04-26T11:26:27.892132+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":392,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892720+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:27.892720+0000","last_peered":"2024-04-26T11:26:27.892720+0000","last_clean":"2024-04-26T11:26:27.892720+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:27.892720+0000","last_undegraded":"2024-04-26T11:26:27.892720+0000","last_fullsized":"2024-04-26T11:26:27.892720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":490,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374080+0000","last_change":"2024-04-26T11:26:12.744889+0000","last_active":"2024-04-26T11:26:25.374080+0000","last_peered":"2024-04-26T11:26:25.374080+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.737082+0000","last_became_peered":"2024-04-26T11:26:12.737082+0000","last_unstale":"2024-04-26T11:26:25.374080+0000","last_undegraded":"2024-04-26T11:26:12.611355+0000","last_fullsized":"2024-04-26T11:26:12.595288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:20.864858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":482,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.377665+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:25.377665+0000","last_peered":"2024-04-26T11:26:25.377665+0000","last_clean":"2024-04-26T11:26:25.377665+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:25.377665+0000","last_undegraded":"2024-04-26T11:26:25.377665+0000","last_fullsized":"2024-04-26T11:26:25.377665+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":483,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376151+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:25.376151+0000","last_peered":"2024-04-26T11:26:25.376151+0000","last_clean":"2024-04-26T11:26:25.376151+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:25.376151+0000","last_undegraded":"2024-04-26T11:26:25.376151+0000","last_fullsized":"2024-04-26T11:26:25.376151+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":143,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376363+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:25.376363+0000","last_peered":"2024-04-26T11:26:25.376363+0000","last_clean":"2024-04-26T11:26:25.376363+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:25.376363+0000","last_undegraded":"2024-04-26T11:26:25.376363+0000","last_fullsized":"2024-04-26T11:26:25.376363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":543,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.373434+0000","last_change":"2024-04-26T11:26:12.746698+0000","last_active":"2024-04-26T11:26:25.373434+0000","last_peered":"2024-04-26T11:26:25.373434+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.738414+0000","last_became_peered":"2024-04-26T11:26:12.738414+0000","last_unstale":"2024-04-26T11:26:25.373434+0000","last_undegraded":"2024-04-26T11:26:12.613606+0000","last_fullsized":"2024-04-26T11:26:12.600100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:58.547950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":241,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T11:26:25.376415+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:25.376415+0000","last_peered":"2024-04-26T11:26:25.376415+0000","last_clean":"2024-04-26T11:26:25.376415+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:25.376415+0000","last_undegraded":"2024-04-26T11:26:25.376415+0000","last_fullsized":"2024-04-26T11:26:25.376415+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2747,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4563,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":113,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142268,"kb_used_data":30828,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229572,"statfs":{"total":96636764160,"available":96491081728,"internally_reserved":0,"allocated":31567872,"data_stored":81541315,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124188,"kb_used_data":30792,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247652,"statfs":{"total":96636764160,"available":96509595648,"internally_reserved":0,"allocated":31531008,"data_stored":86045435,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.77800000000000002}]}]},{"osd":0,"up_from":75,"seq":322122547206,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49564,"kb_used_data":17932,"kb_used_omap":7,"kb_used_meta":31608,"kb_avail":94322276,"statfs":{"total":96636764160,"available":96586010624,"internally_reserved":0,"allocated":18362368,"data_stored":91723890,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":32367607},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:33.692 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:34.012 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:34.013 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:34.032 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-04-26T11:26:33.449763+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2232,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5017,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":197,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":316132,"kb_used_data":79672,"kb_used_omap":10,"kb_used_meta":236405,"kb_avail":282799388,"statfs":{"total":289910292480,"available":289586573312,"internally_reserved":0,"allocated":81584128,"data_stored":259357566,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":242079619},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1211,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001326"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":499,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378577+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:30.378577+0000","last_peered":"2024-04-26T11:26:30.378577+0000","last_clean":"2024-04-26T11:26:30.378577+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:30.378577+0000","last_undegraded":"2024-04-26T11:26:30.378577+0000","last_fullsized":"2024-04-26T11:26:30.378577+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":555,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377489+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:30.377489+0000","last_peered":"2024-04-26T11:26:30.377489+0000","last_clean":"2024-04-26T11:26:30.377489+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:30.377489+0000","last_undegraded":"2024-04-26T11:26:30.377489+0000","last_fullsized":"2024-04-26T11:26:30.377489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":428,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.894635+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:27.894635+0000","last_peered":"2024-04-26T11:26:27.894635+0000","last_clean":"2024-04-26T11:26:27.894635+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:27.894635+0000","last_undegraded":"2024-04-26T11:26:27.894635+0000","last_fullsized":"2024-04-26T11:26:27.894635+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":477,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.899215+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:28.899215+0000","last_peered":"2024-04-26T11:26:28.899215+0000","last_clean":"2024-04-26T11:26:28.899215+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:28.899215+0000","last_undegraded":"2024-04-26T11:26:28.899215+0000","last_fullsized":"2024-04-26T11:26:28.899215+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":530,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378139+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:30.378139+0000","last_peered":"2024-04-26T11:26:30.378139+0000","last_clean":"2024-04-26T11:26:30.378139+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:30.378139+0000","last_undegraded":"2024-04-26T11:26:30.378139+0000","last_fullsized":"2024-04-26T11:26:30.378139+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":481,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.911800+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:28.911800+0000","last_peered":"2024-04-26T11:26:28.911800+0000","last_clean":"2024-04-26T11:26:28.911800+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:28.911800+0000","last_undegraded":"2024-04-26T11:26:28.911800+0000","last_fullsized":"2024-04-26T11:26:28.911800+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":582,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892245+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:27.892245+0000","last_peered":"2024-04-26T11:26:27.892245+0000","last_clean":"2024-04-26T11:26:27.892245+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:27.892245+0000","last_undegraded":"2024-04-26T11:26:27.892245+0000","last_fullsized":"2024-04-26T11:26:27.892245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":450,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892095+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:27.892095+0000","last_peered":"2024-04-26T11:26:27.892095+0000","last_clean":"2024-04-26T11:26:27.892095+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:27.892095+0000","last_undegraded":"2024-04-26T11:26:27.892095+0000","last_fullsized":"2024-04-26T11:26:27.892095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":586,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379536+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:30.379536+0000","last_peered":"2024-04-26T11:26:30.379536+0000","last_clean":"2024-04-26T11:26:30.379536+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:30.379536+0000","last_undegraded":"2024-04-26T11:26:30.379536+0000","last_fullsized":"2024-04-26T11:26:30.379536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":496,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378089+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:30.378089+0000","last_peered":"2024-04-26T11:26:30.378089+0000","last_clean":"2024-04-26T11:26:30.378089+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:30.378089+0000","last_undegraded":"2024-04-26T11:26:30.378089+0000","last_fullsized":"2024-04-26T11:26:30.378089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":650,"reported_epoch":96,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T11:26:31.493649+0000","last_change":"2024-04-26T11:26:31.189372+0000","last_active":"2024-04-26T11:26:31.493649+0000","last_peered":"2024-04-26T11:26:31.493649+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.741978+0000","last_became_peered":"2024-04-26T11:26:12.741978+0000","last_unstale":"2024-04-26T11:26:31.493649+0000","last_undegraded":"2024-04-26T11:26:31.493649+0000","last_fullsized":"2024-04-26T11:26:12.575641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:33.135319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":772,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377745+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:30.377745+0000","last_peered":"2024-04-26T11:26:30.377745+0000","last_clean":"2024-04-26T11:26:30.377745+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:30.377745+0000","last_undegraded":"2024-04-26T11:26:30.377745+0000","last_fullsized":"2024-04-26T11:26:30.377745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":443,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377713+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:30.377713+0000","last_peered":"2024-04-26T11:26:30.377713+0000","last_clean":"2024-04-26T11:26:30.377713+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:30.377713+0000","last_undegraded":"2024-04-26T11:26:30.377713+0000","last_fullsized":"2024-04-26T11:26:30.377713+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":470,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892626+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:27.892626+0000","last_peered":"2024-04-26T11:26:27.892626+0000","last_clean":"2024-04-26T11:26:27.892626+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:27.892626+0000","last_undegraded":"2024-04-26T11:26:27.892626+0000","last_fullsized":"2024-04-26T11:26:27.892626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":526,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891953+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:27.891953+0000","last_peered":"2024-04-26T11:26:27.891953+0000","last_clean":"2024-04-26T11:26:27.891953+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:27.891953+0000","last_undegraded":"2024-04-26T11:26:27.891953+0000","last_fullsized":"2024-04-26T11:26:27.891953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":591,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892354+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:27.892354+0000","last_peered":"2024-04-26T11:26:27.892354+0000","last_clean":"2024-04-26T11:26:27.892354+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:27.892354+0000","last_undegraded":"2024-04-26T11:26:27.892354+0000","last_fullsized":"2024-04-26T11:26:27.892354+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":566,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380045+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:30.380045+0000","last_peered":"2024-04-26T11:26:30.380045+0000","last_clean":"2024-04-26T11:26:30.380045+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:30.380045+0000","last_undegraded":"2024-04-26T11:26:30.380045+0000","last_fullsized":"2024-04-26T11:26:30.380045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":574,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378574+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:30.378574+0000","last_peered":"2024-04-26T11:26:30.378574+0000","last_clean":"2024-04-26T11:26:30.378574+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:30.378574+0000","last_undegraded":"2024-04-26T11:26:30.378574+0000","last_fullsized":"2024-04-26T11:26:30.378574+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":613,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378874+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:30.378874+0000","last_peered":"2024-04-26T11:26:30.378874+0000","last_clean":"2024-04-26T11:26:30.378874+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:30.378874+0000","last_undegraded":"2024-04-26T11:26:30.378874+0000","last_fullsized":"2024-04-26T11:26:30.378874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":592,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-26T11:26:29.261045+0000","last_change":"2024-04-26T11:26:29.177466+0000","last_active":"2024-04-26T11:26:29.177466+0000","last_peered":"2024-04-26T11:26:29.261045+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.735943+0000","last_became_peered":"2024-04-26T11:26:12.735943+0000","last_unstale":"2024-04-26T11:26:29.261045+0000","last_undegraded":"2024-04-26T11:26:29.261045+0000","last_fullsized":"2024-04-26T11:26:12.575709+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":558,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.378777+0000","last_change":"2024-04-26T11:26:12.748380+0000","last_active":"2024-04-26T11:26:30.378777+0000","last_peered":"2024-04-26T11:26:30.378777+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743161+0000","last_became_peered":"2024-04-26T11:26:12.743161+0000","last_unstale":"2024-04-26T11:26:30.378777+0000","last_undegraded":"2024-04-26T11:26:12.608799+0000","last_fullsized":"2024-04-26T11:26:12.600138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:44.695371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":580,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.377445+0000","last_change":"2024-04-26T11:26:22.400914+0000","last_active":"2024-04-26T11:26:30.377445+0000","last_peered":"2024-04-26T11:26:30.377445+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.377454+0000","last_became_peered":"2024-04-26T11:26:22.377454+0000","last_unstale":"2024-04-26T11:26:30.377445+0000","last_undegraded":"2024-04-26T11:26:22.364727+0000","last_fullsized":"2024-04-26T11:26:22.364125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:07.478987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":922,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376373+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:30.376373+0000","last_peered":"2024-04-26T11:26:30.376373+0000","last_clean":"2024-04-26T11:26:30.376373+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:30.376373+0000","last_undegraded":"2024-04-26T11:26:30.376373+0000","last_fullsized":"2024-04-26T11:26:30.376373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":505,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376937+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:30.376937+0000","last_peered":"2024-04-26T11:26:30.376937+0000","last_clean":"2024-04-26T11:26:30.376937+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:30.376937+0000","last_undegraded":"2024-04-26T11:26:30.376937+0000","last_fullsized":"2024-04-26T11:26:30.376937+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":938,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-26T11:26:31.395767+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:31.395767+0000","last_peered":"2024-04-26T11:26:31.395767+0000","last_clean":"2024-04-26T11:26:31.395767+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:31.395767+0000","last_undegraded":"2024-04-26T11:26:31.395767+0000","last_fullsized":"2024-04-26T11:26:31.395767+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:04.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1044,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378942+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:30.378942+0000","last_peered":"2024-04-26T11:26:30.378942+0000","last_clean":"2024-04-26T11:26:30.378942+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:30.378942+0000","last_undegraded":"2024-04-26T11:26:30.378942+0000","last_fullsized":"2024-04-26T11:26:30.378942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":546,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.900747+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:28.900747+0000","last_peered":"2024-04-26T11:26:28.900747+0000","last_clean":"2024-04-26T11:26:28.900747+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:28.900747+0000","last_undegraded":"2024-04-26T11:26:28.900747+0000","last_fullsized":"2024-04-26T11:26:28.900747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":941,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378437+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:30.378437+0000","last_peered":"2024-04-26T11:26:30.378437+0000","last_clean":"2024-04-26T11:26:30.378437+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:30.378437+0000","last_undegraded":"2024-04-26T11:26:30.378437+0000","last_fullsized":"2024-04-26T11:26:30.378437+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":498,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378088+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:30.378088+0000","last_peered":"2024-04-26T11:26:30.378088+0000","last_clean":"2024-04-26T11:26:30.378088+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:30.378088+0000","last_undegraded":"2024-04-26T11:26:30.378088+0000","last_fullsized":"2024-04-26T11:26:30.378088+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":610,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.378620+0000","last_change":"2024-04-26T11:26:22.407504+0000","last_active":"2024-04-26T11:26:30.378620+0000","last_peered":"2024-04-26T11:26:30.378620+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.402212+0000","last_became_peered":"2024-04-26T11:26:22.402212+0000","last_unstale":"2024-04-26T11:26:30.378620+0000","last_undegraded":"2024-04-26T11:26:22.372226+0000","last_fullsized":"2024-04-26T11:26:22.371421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:02.822376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":618,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376575+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:30.376575+0000","last_peered":"2024-04-26T11:26:30.376575+0000","last_clean":"2024-04-26T11:26:30.376575+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:30.376575+0000","last_undegraded":"2024-04-26T11:26:30.376575+0000","last_fullsized":"2024-04-26T11:26:30.376575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":512,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.376542+0000","last_change":"2024-04-26T11:26:12.752759+0000","last_active":"2024-04-26T11:26:30.376542+0000","last_peered":"2024-04-26T11:26:30.376542+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749360+0000","last_became_peered":"2024-04-26T11:26:12.749360+0000","last_unstale":"2024-04-26T11:26:30.376542+0000","last_undegraded":"2024-04-26T11:26:12.617888+0000","last_fullsized":"2024-04-26T11:26:12.605870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.669370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":475,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378216+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:30.378216+0000","last_peered":"2024-04-26T11:26:30.378216+0000","last_clean":"2024-04-26T11:26:30.378216+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:30.378216+0000","last_undegraded":"2024-04-26T11:26:30.378216+0000","last_fullsized":"2024-04-26T11:26:30.378216+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":538,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891639+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:27.891639+0000","last_peered":"2024-04-26T11:26:27.891639+0000","last_clean":"2024-04-26T11:26:27.891639+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:27.891639+0000","last_undegraded":"2024-04-26T11:26:27.891639+0000","last_fullsized":"2024-04-26T11:26:27.891639+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":495,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379741+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:30.379741+0000","last_peered":"2024-04-26T11:26:30.379741+0000","last_clean":"2024-04-26T11:26:30.379741+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:30.379741+0000","last_undegraded":"2024-04-26T11:26:30.379741+0000","last_fullsized":"2024-04-26T11:26:30.379741+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377048+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:30.377048+0000","last_peered":"2024-04-26T11:26:30.377048+0000","last_clean":"2024-04-26T11:26:30.377048+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:30.377048+0000","last_undegraded":"2024-04-26T11:26:30.377048+0000","last_fullsized":"2024-04-26T11:26:30.377048+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":987,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379329+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:30.379329+0000","last_peered":"2024-04-26T11:26:30.379329+0000","last_clean":"2024-04-26T11:26:30.379329+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:30.379329+0000","last_undegraded":"2024-04-26T11:26:30.379329+0000","last_fullsized":"2024-04-26T11:26:30.379329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378767+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:30.378767+0000","last_peered":"2024-04-26T11:26:30.378767+0000","last_clean":"2024-04-26T11:26:30.378767+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:30.378767+0000","last_undegraded":"2024-04-26T11:26:30.378767+0000","last_fullsized":"2024-04-26T11:26:30.378767+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":927,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379538+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:30.379538+0000","last_peered":"2024-04-26T11:26:30.379538+0000","last_clean":"2024-04-26T11:26:30.379538+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:30.379538+0000","last_undegraded":"2024-04-26T11:26:30.379538+0000","last_fullsized":"2024-04-26T11:26:30.379538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.890960+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:27.890960+0000","last_peered":"2024-04-26T11:26:27.890960+0000","last_clean":"2024-04-26T11:26:27.890960+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:27.890960+0000","last_undegraded":"2024-04-26T11:26:27.890960+0000","last_fullsized":"2024-04-26T11:26:27.890960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":230,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.895043+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:27.895043+0000","last_peered":"2024-04-26T11:26:27.895043+0000","last_clean":"2024-04-26T11:26:27.895043+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:27.895043+0000","last_undegraded":"2024-04-26T11:26:27.895043+0000","last_fullsized":"2024-04-26T11:26:27.895043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":866,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376990+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:30.376990+0000","last_peered":"2024-04-26T11:26:30.376990+0000","last_clean":"2024-04-26T11:26:30.376990+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:30.376990+0000","last_undegraded":"2024-04-26T11:26:30.376990+0000","last_fullsized":"2024-04-26T11:26:30.376990+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":391,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379086+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:30.379086+0000","last_peered":"2024-04-26T11:26:30.379086+0000","last_clean":"2024-04-26T11:26:30.379086+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:30.379086+0000","last_undegraded":"2024-04-26T11:26:30.379086+0000","last_fullsized":"2024-04-26T11:26:30.379086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":570,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377078+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:30.377078+0000","last_peered":"2024-04-26T11:26:30.377078+0000","last_clean":"2024-04-26T11:26:30.377078+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:30.377078+0000","last_undegraded":"2024-04-26T11:26:30.377078+0000","last_fullsized":"2024-04-26T11:26:30.377078+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":633,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.893510+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:27.893510+0000","last_peered":"2024-04-26T11:26:27.893510+0000","last_clean":"2024-04-26T11:26:27.893510+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:27.893510+0000","last_undegraded":"2024-04-26T11:26:27.893510+0000","last_fullsized":"2024-04-26T11:26:27.893510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":542,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.377373+0000","last_change":"2024-04-26T11:26:12.752679+0000","last_active":"2024-04-26T11:26:30.377373+0000","last_peered":"2024-04-26T11:26:30.377373+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749414+0000","last_became_peered":"2024-04-26T11:26:12.749414+0000","last_unstale":"2024-04-26T11:26:30.377373+0000","last_undegraded":"2024-04-26T11:26:12.616453+0000","last_fullsized":"2024-04-26T11:26:12.605189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:29.120239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892832+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:27.892832+0000","last_peered":"2024-04-26T11:26:27.892832+0000","last_clean":"2024-04-26T11:26:27.892832+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:27.892832+0000","last_undegraded":"2024-04-26T11:26:27.892832+0000","last_fullsized":"2024-04-26T11:26:27.892832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":948,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378630+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:30.378630+0000","last_peered":"2024-04-26T11:26:30.378630+0000","last_clean":"2024-04-26T11:26:30.378630+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:30.378630+0000","last_undegraded":"2024-04-26T11:26:30.378630+0000","last_fullsized":"2024-04-26T11:26:30.378630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":300,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378896+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:30.378896+0000","last_peered":"2024-04-26T11:26:30.378896+0000","last_clean":"2024-04-26T11:26:30.378896+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:30.378896+0000","last_undegraded":"2024-04-26T11:26:30.378896+0000","last_fullsized":"2024-04-26T11:26:30.378896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":535,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.378751+0000","last_change":"2024-04-26T11:26:12.748367+0000","last_active":"2024-04-26T11:26:30.378751+0000","last_peered":"2024-04-26T11:26:30.378751+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743318+0000","last_became_peered":"2024-04-26T11:26:12.743318+0000","last_unstale":"2024-04-26T11:26:30.378751+0000","last_undegraded":"2024-04-26T11:26:12.617383+0000","last_fullsized":"2024-04-26T11:26:12.604987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:55.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":283,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891881+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:27.891881+0000","last_peered":"2024-04-26T11:26:27.891881+0000","last_clean":"2024-04-26T11:26:27.891881+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:27.891881+0000","last_undegraded":"2024-04-26T11:26:27.891881+0000","last_fullsized":"2024-04-26T11:26:27.891881+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":459,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.900076+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:28.900076+0000","last_peered":"2024-04-26T11:26:28.900076+0000","last_clean":"2024-04-26T11:26:28.900076+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:28.900076+0000","last_undegraded":"2024-04-26T11:26:28.900076+0000","last_fullsized":"2024-04-26T11:26:28.900076+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377380+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:30.377380+0000","last_peered":"2024-04-26T11:26:30.377380+0000","last_clean":"2024-04-26T11:26:30.377380+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:30.377380+0000","last_undegraded":"2024-04-26T11:26:30.377380+0000","last_fullsized":"2024-04-26T11:26:30.377380+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":427,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-26T11:26:28.498990+0000","last_change":"2024-04-26T11:26:29.177633+0000","last_active":"2024-04-26T11:26:29.177633+0000","last_peered":"2024-04-26T11:26:28.498990+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.722568+0000","last_became_peered":"2024-04-26T11:26:12.722568+0000","last_unstale":"2024-04-26T11:26:28.498990+0000","last_undegraded":"2024-04-26T11:26:28.498990+0000","last_fullsized":"2024-04-26T11:26:12.579570+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":342,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377973+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:30.377973+0000","last_peered":"2024-04-26T11:26:30.377973+0000","last_clean":"2024-04-26T11:26:30.377973+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:30.377973+0000","last_undegraded":"2024-04-26T11:26:30.377973+0000","last_fullsized":"2024-04-26T11:26:30.377973+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":543,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379713+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:30.379713+0000","last_peered":"2024-04-26T11:26:30.379713+0000","last_clean":"2024-04-26T11:26:30.379713+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:30.379713+0000","last_undegraded":"2024-04-26T11:26:30.379713+0000","last_fullsized":"2024-04-26T11:26:30.379713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":235,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.890718+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:27.890718+0000","last_peered":"2024-04-26T11:26:27.890718+0000","last_clean":"2024-04-26T11:26:27.890718+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:27.890718+0000","last_undegraded":"2024-04-26T11:26:27.890718+0000","last_fullsized":"2024-04-26T11:26:27.890718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891442+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:27.891442+0000","last_peered":"2024-04-26T11:26:27.891442+0000","last_clean":"2024-04-26T11:26:27.891442+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:27.891442+0000","last_undegraded":"2024-04-26T11:26:27.891442+0000","last_fullsized":"2024-04-26T11:26:27.891442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":841,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377415+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:30.377415+0000","last_peered":"2024-04-26T11:26:30.377415+0000","last_clean":"2024-04-26T11:26:30.377415+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:30.377415+0000","last_undegraded":"2024-04-26T11:26:30.377415+0000","last_fullsized":"2024-04-26T11:26:30.377415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":502,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.893635+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:27.893635+0000","last_peered":"2024-04-26T11:26:27.893635+0000","last_clean":"2024-04-26T11:26:27.893635+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:27.893635+0000","last_undegraded":"2024-04-26T11:26:27.893635+0000","last_fullsized":"2024-04-26T11:26:27.893635+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892051+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:27.892051+0000","last_peered":"2024-04-26T11:26:27.892051+0000","last_clean":"2024-04-26T11:26:27.892051+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:27.892051+0000","last_undegraded":"2024-04-26T11:26:27.892051+0000","last_fullsized":"2024-04-26T11:26:27.892051+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":282,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377125+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:30.377125+0000","last_peered":"2024-04-26T11:26:30.377125+0000","last_clean":"2024-04-26T11:26:30.377125+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:30.377125+0000","last_undegraded":"2024-04-26T11:26:30.377125+0000","last_fullsized":"2024-04-26T11:26:30.377125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":552,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378325+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:30.378325+0000","last_peered":"2024-04-26T11:26:30.378325+0000","last_clean":"2024-04-26T11:26:30.378325+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:30.378325+0000","last_undegraded":"2024-04-26T11:26:30.378325+0000","last_fullsized":"2024-04-26T11:26:30.378325+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377402+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:30.377402+0000","last_peered":"2024-04-26T11:26:30.377402+0000","last_clean":"2024-04-26T11:26:30.377402+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:30.377402+0000","last_undegraded":"2024-04-26T11:26:30.377402+0000","last_fullsized":"2024-04-26T11:26:30.377402+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":472,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377271+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:30.377271+0000","last_peered":"2024-04-26T11:26:30.377271+0000","last_clean":"2024-04-26T11:26:30.377271+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:30.377271+0000","last_undegraded":"2024-04-26T11:26:30.377271+0000","last_fullsized":"2024-04-26T11:26:30.377271+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":443,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379850+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:30.379850+0000","last_peered":"2024-04-26T11:26:30.379850+0000","last_clean":"2024-04-26T11:26:30.379850+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:30.379850+0000","last_undegraded":"2024-04-26T11:26:30.379850+0000","last_fullsized":"2024-04-26T11:26:30.379850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891375+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:27.891375+0000","last_peered":"2024-04-26T11:26:27.891375+0000","last_clean":"2024-04-26T11:26:27.891375+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:27.891375+0000","last_undegraded":"2024-04-26T11:26:27.891375+0000","last_fullsized":"2024-04-26T11:26:27.891375+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891394+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:27.891394+0000","last_peered":"2024-04-26T11:26:27.891394+0000","last_clean":"2024-04-26T11:26:27.891394+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:27.891394+0000","last_undegraded":"2024-04-26T11:26:27.891394+0000","last_fullsized":"2024-04-26T11:26:27.891394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":552,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379356+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:30.379356+0000","last_peered":"2024-04-26T11:26:30.379356+0000","last_clean":"2024-04-26T11:26:30.379356+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:30.379356+0000","last_undegraded":"2024-04-26T11:26:30.379356+0000","last_fullsized":"2024-04-26T11:26:30.379356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":558,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.893063+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:27.893063+0000","last_peered":"2024-04-26T11:26:27.893063+0000","last_clean":"2024-04-26T11:26:27.893063+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:27.893063+0000","last_undegraded":"2024-04-26T11:26:27.893063+0000","last_fullsized":"2024-04-26T11:26:27.893063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379534+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:30.379534+0000","last_peered":"2024-04-26T11:26:30.379534+0000","last_clean":"2024-04-26T11:26:30.379534+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:30.379534+0000","last_undegraded":"2024-04-26T11:26:30.379534+0000","last_fullsized":"2024-04-26T11:26:30.379534+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":458,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.377954+0000","last_change":"2024-04-26T11:26:22.404169+0000","last_active":"2024-04-26T11:26:30.377954+0000","last_peered":"2024-04-26T11:26:30.377954+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.397567+0000","last_became_peered":"2024-04-26T11:26:22.397567+0000","last_unstale":"2024-04-26T11:26:30.377954+0000","last_undegraded":"2024-04-26T11:26:22.370292+0000","last_fullsized":"2024-04-26T11:26:22.365457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:00.871852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379312+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:30.379312+0000","last_peered":"2024-04-26T11:26:30.379312+0000","last_clean":"2024-04-26T11:26:30.379312+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:30.379312+0000","last_undegraded":"2024-04-26T11:26:30.379312+0000","last_fullsized":"2024-04-26T11:26:30.379312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380388+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:30.380388+0000","last_peered":"2024-04-26T11:26:30.380388+0000","last_clean":"2024-04-26T11:26:30.380388+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:30.380388+0000","last_undegraded":"2024-04-26T11:26:30.380388+0000","last_fullsized":"2024-04-26T11:26:30.380388+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":807,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377937+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:30.377937+0000","last_peered":"2024-04-26T11:26:30.377937+0000","last_clean":"2024-04-26T11:26:30.377937+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:30.377937+0000","last_undegraded":"2024-04-26T11:26:30.377937+0000","last_fullsized":"2024-04-26T11:26:30.377937+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380163+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:30.380163+0000","last_peered":"2024-04-26T11:26:30.380163+0000","last_clean":"2024-04-26T11:26:30.380163+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:30.380163+0000","last_undegraded":"2024-04-26T11:26:30.380163+0000","last_fullsized":"2024-04-26T11:26:30.380163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379646+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:30.379646+0000","last_peered":"2024-04-26T11:26:30.379646+0000","last_clean":"2024-04-26T11:26:30.379646+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:30.379646+0000","last_undegraded":"2024-04-26T11:26:30.379646+0000","last_fullsized":"2024-04-26T11:26:30.379646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":536,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.376987+0000","last_change":"2024-04-26T11:26:12.748928+0000","last_active":"2024-04-26T11:26:30.376987+0000","last_peered":"2024-04-26T11:26:30.376987+0000","last_clean":"2024-04-26T11:23:20.666513+0000","last_became_active":"2024-04-26T11:26:12.743721+0000","last_became_peered":"2024-04-26T11:26:12.743721+0000","last_unstale":"2024-04-26T11:26:30.376987+0000","last_undegraded":"2024-04-26T11:26:12.621233+0000","last_fullsized":"2024-04-26T11:26:12.616597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:38.029361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379840+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:30.379840+0000","last_peered":"2024-04-26T11:26:30.379840+0000","last_clean":"2024-04-26T11:26:30.379840+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:30.379840+0000","last_undegraded":"2024-04-26T11:26:30.379840+0000","last_fullsized":"2024-04-26T11:26:30.379840+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.894123+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:27.894123+0000","last_peered":"2024-04-26T11:26:27.894123+0000","last_clean":"2024-04-26T11:26:27.894123+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:27.894123+0000","last_undegraded":"2024-04-26T11:26:27.894123+0000","last_fullsized":"2024-04-26T11:26:27.894123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":920,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377094+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:30.377094+0000","last_peered":"2024-04-26T11:26:30.377094+0000","last_clean":"2024-04-26T11:26:30.377094+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:30.377094+0000","last_undegraded":"2024-04-26T11:26:30.377094+0000","last_fullsized":"2024-04-26T11:26:30.377094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":500,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892338+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:27.892338+0000","last_peered":"2024-04-26T11:26:27.892338+0000","last_clean":"2024-04-26T11:26:27.892338+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:27.892338+0000","last_undegraded":"2024-04-26T11:26:27.892338+0000","last_fullsized":"2024-04-26T11:26:27.892338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":479,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892508+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:27.892508+0000","last_peered":"2024-04-26T11:26:27.892508+0000","last_clean":"2024-04-26T11:26:27.892508+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:27.892508+0000","last_undegraded":"2024-04-26T11:26:27.892508+0000","last_fullsized":"2024-04-26T11:26:27.892508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":545,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376735+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:30.376735+0000","last_peered":"2024-04-26T11:26:30.376735+0000","last_clean":"2024-04-26T11:26:30.376735+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:30.376735+0000","last_undegraded":"2024-04-26T11:26:30.376735+0000","last_fullsized":"2024-04-26T11:26:30.376735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380303+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:30.380303+0000","last_peered":"2024-04-26T11:26:30.380303+0000","last_clean":"2024-04-26T11:26:30.380303+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:30.380303+0000","last_undegraded":"2024-04-26T11:26:30.380303+0000","last_fullsized":"2024-04-26T11:26:30.380303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":404,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.894836+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:27.894836+0000","last_peered":"2024-04-26T11:26:27.894836+0000","last_clean":"2024-04-26T11:26:27.894836+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:27.894836+0000","last_undegraded":"2024-04-26T11:26:27.894836+0000","last_fullsized":"2024-04-26T11:26:27.894836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":602,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.376728+0000","last_change":"2024-04-26T11:26:12.748851+0000","last_active":"2024-04-26T11:26:30.376728+0000","last_peered":"2024-04-26T11:26:30.376728+0000","last_clean":"2024-04-26T11:23:20.666469+0000","last_became_active":"2024-04-26T11:26:12.743007+0000","last_became_peered":"2024-04-26T11:26:12.743007+0000","last_unstale":"2024-04-26T11:26:30.376728+0000","last_undegraded":"2024-04-26T11:26:12.606150+0000","last_fullsized":"2024-04-26T11:26:12.595590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:06.439297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380125+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:30.380125+0000","last_peered":"2024-04-26T11:26:30.380125+0000","last_clean":"2024-04-26T11:26:30.380125+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:30.380125+0000","last_undegraded":"2024-04-26T11:26:30.380125+0000","last_fullsized":"2024-04-26T11:26:30.380125+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":559,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376866+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:30.376866+0000","last_peered":"2024-04-26T11:26:30.376866+0000","last_clean":"2024-04-26T11:26:30.376866+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:30.376866+0000","last_undegraded":"2024-04-26T11:26:30.376866+0000","last_fullsized":"2024-04-26T11:26:30.376866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":775,"reported_epoch":96,"state":"peering","last_fresh":"2024-04-26T11:26:31.382407+0000","last_change":"2024-04-26T11:26:31.382811+0000","last_active":"2024-04-26T11:26:31.382407+0000","last_peered":"2024-04-26T11:26:31.185264+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.389958+0000","last_became_peered":"2024-04-26T11:26:22.389958+0000","last_unstale":"2024-04-26T11:26:31.382407+0000","last_undegraded":"2024-04-26T11:26:31.382407+0000","last_fullsized":"2024-04-26T11:26:31.382407+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:06.737937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":677,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377311+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:30.377311+0000","last_peered":"2024-04-26T11:26:30.377311+0000","last_clean":"2024-04-26T11:26:30.377311+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:30.377311+0000","last_undegraded":"2024-04-26T11:26:30.377311+0000","last_fullsized":"2024-04-26T11:26:30.377311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":912,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378875+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:30.378875+0000","last_peered":"2024-04-26T11:26:30.378875+0000","last_clean":"2024-04-26T11:26:30.378875+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:30.378875+0000","last_undegraded":"2024-04-26T11:26:30.378875+0000","last_fullsized":"2024-04-26T11:26:30.378875+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":384,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377041+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:30.377041+0000","last_peered":"2024-04-26T11:26:30.377041+0000","last_clean":"2024-04-26T11:26:30.377041+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:30.377041+0000","last_undegraded":"2024-04-26T11:26:30.377041+0000","last_fullsized":"2024-04-26T11:26:30.377041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":664,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.379743+0000","last_change":"2024-04-26T11:26:22.404414+0000","last_active":"2024-04-26T11:26:30.379743+0000","last_peered":"2024-04-26T11:26:30.379743+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.387346+0000","last_became_peered":"2024-04-26T11:26:22.387346+0000","last_unstale":"2024-04-26T11:26:30.379743+0000","last_undegraded":"2024-04-26T11:26:22.368665+0000","last_fullsized":"2024-04-26T11:26:22.368295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:13.764286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":421,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378706+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:30.378706+0000","last_peered":"2024-04-26T11:26:30.378706+0000","last_clean":"2024-04-26T11:26:30.378706+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:30.378706+0000","last_undegraded":"2024-04-26T11:26:30.378706+0000","last_fullsized":"2024-04-26T11:26:30.378706+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":489,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377980+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:30.377980+0000","last_peered":"2024-04-26T11:26:30.377980+0000","last_clean":"2024-04-26T11:26:30.377980+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:30.377980+0000","last_undegraded":"2024-04-26T11:26:30.377980+0000","last_fullsized":"2024-04-26T11:26:30.377980+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378282+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:30.378282+0000","last_peered":"2024-04-26T11:26:30.378282+0000","last_clean":"2024-04-26T11:26:30.378282+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:30.378282+0000","last_undegraded":"2024-04-26T11:26:30.378282+0000","last_fullsized":"2024-04-26T11:26:30.378282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":463,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892132+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:27.892132+0000","last_peered":"2024-04-26T11:26:27.892132+0000","last_clean":"2024-04-26T11:26:27.892132+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:27.892132+0000","last_undegraded":"2024-04-26T11:26:27.892132+0000","last_fullsized":"2024-04-26T11:26:27.892132+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":392,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892720+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:27.892720+0000","last_peered":"2024-04-26T11:26:27.892720+0000","last_clean":"2024-04-26T11:26:27.892720+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:27.892720+0000","last_undegraded":"2024-04-26T11:26:27.892720+0000","last_fullsized":"2024-04-26T11:26:27.892720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":490,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374080+0000","last_change":"2024-04-26T11:26:12.744889+0000","last_active":"2024-04-26T11:26:25.374080+0000","last_peered":"2024-04-26T11:26:25.374080+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.737082+0000","last_became_peered":"2024-04-26T11:26:12.737082+0000","last_unstale":"2024-04-26T11:26:25.374080+0000","last_undegraded":"2024-04-26T11:26:12.611355+0000","last_fullsized":"2024-04-26T11:26:12.595288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:20.864858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":487,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380014+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:30.380014+0000","last_peered":"2024-04-26T11:26:30.380014+0000","last_clean":"2024-04-26T11:26:30.380014+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:30.380014+0000","last_undegraded":"2024-04-26T11:26:30.380014+0000","last_fullsized":"2024-04-26T11:26:30.380014+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":488,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377646+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:30.377646+0000","last_peered":"2024-04-26T11:26:30.377646+0000","last_clean":"2024-04-26T11:26:30.377646+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:30.377646+0000","last_undegraded":"2024-04-26T11:26:30.377646+0000","last_fullsized":"2024-04-26T11:26:30.377646+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379359+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:30.379359+0000","last_peered":"2024-04-26T11:26:30.379359+0000","last_clean":"2024-04-26T11:26:30.379359+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:30.379359+0000","last_undegraded":"2024-04-26T11:26:30.379359+0000","last_fullsized":"2024-04-26T11:26:30.379359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":548,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.376304+0000","last_change":"2024-04-26T11:26:12.746698+0000","last_active":"2024-04-26T11:26:30.376304+0000","last_peered":"2024-04-26T11:26:30.376304+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.738414+0000","last_became_peered":"2024-04-26T11:26:12.738414+0000","last_unstale":"2024-04-26T11:26:30.376304+0000","last_undegraded":"2024-04-26T11:26:12.613606+0000","last_fullsized":"2024-04-26T11:26:12.600100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:58.547950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379843+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:30.379843+0000","last_peered":"2024-04-26T11:26:30.379843+0000","last_clean":"2024-04-26T11:26:30.379843+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:30.379843+0000","last_undegraded":"2024-04-26T11:26:30.379843+0000","last_fullsized":"2024-04-26T11:26:30.379843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2232,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4993,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":115,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142324,"kb_used_data":30888,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229516,"statfs":{"total":96636764160,"available":96491024384,"internally_reserved":0,"allocated":31629312,"data_stored":81564778,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124244,"kb_used_data":30852,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247596,"statfs":{"total":96636764160,"available":96509538304,"internally_reserved":0,"allocated":31592448,"data_stored":86068898,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.72599999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547206,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49564,"kb_used_data":17932,"kb_used_omap":7,"kb_used_meta":31608,"kb_avail":94322276,"statfs":{"total":96636764160,"available":96586010624,"internally_reserved":0,"allocated":18362368,"data_stored":91723890,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":32367607},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:34.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:26:34.428 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:34.428 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 2232/110 objects degraded (2029.091%), 12 pgs degraded","count":12},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":301,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":99,"num_osds":3,"num_up_osds":3,"osd_up_since":1714130770,"num_in_osds":3,"osd_in_since":1714130493,"num_remapped_pgs":8},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":89},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":12},{"state_name":"peering","count":3},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129078864,"bytes_used":323719168,"bytes_avail":289586573312,"bytes_total":289910292480,"inactive_pgs_ratio":0.02857142873108387,"degraded_objects":2232,"degraded_total":110,"degraded_ratio":20.290909090909089,"recovering_objects_per_sec":295,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1181,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4207}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-26T11:23:01.341628+0000","services":{}},"progress_events":{}} 2024-04-26T11:26:34.445 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:26:34.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:34.752 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:34.754 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:34.771 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-04-26T11:26:34.371319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2232,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5017,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":197,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":316132,"kb_used_data":79672,"kb_used_omap":10,"kb_used_meta":236405,"kb_avail":282799388,"statfs":{"total":289910292480,"available":289586573312,"internally_reserved":0,"allocated":81584128,"data_stored":259357566,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":242079619},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-515,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":430,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.997932"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":499,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378577+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:30.378577+0000","last_peered":"2024-04-26T11:26:30.378577+0000","last_clean":"2024-04-26T11:26:30.378577+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:30.378577+0000","last_undegraded":"2024-04-26T11:26:30.378577+0000","last_fullsized":"2024-04-26T11:26:30.378577+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":555,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377489+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:30.377489+0000","last_peered":"2024-04-26T11:26:30.377489+0000","last_clean":"2024-04-26T11:26:30.377489+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:30.377489+0000","last_undegraded":"2024-04-26T11:26:30.377489+0000","last_fullsized":"2024-04-26T11:26:30.377489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":428,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.894635+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:27.894635+0000","last_peered":"2024-04-26T11:26:27.894635+0000","last_clean":"2024-04-26T11:26:27.894635+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:27.894635+0000","last_undegraded":"2024-04-26T11:26:27.894635+0000","last_fullsized":"2024-04-26T11:26:27.894635+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":477,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.899215+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:28.899215+0000","last_peered":"2024-04-26T11:26:28.899215+0000","last_clean":"2024-04-26T11:26:28.899215+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:28.899215+0000","last_undegraded":"2024-04-26T11:26:28.899215+0000","last_fullsized":"2024-04-26T11:26:28.899215+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":530,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378139+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:30.378139+0000","last_peered":"2024-04-26T11:26:30.378139+0000","last_clean":"2024-04-26T11:26:30.378139+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:30.378139+0000","last_undegraded":"2024-04-26T11:26:30.378139+0000","last_fullsized":"2024-04-26T11:26:30.378139+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":481,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.911800+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:28.911800+0000","last_peered":"2024-04-26T11:26:28.911800+0000","last_clean":"2024-04-26T11:26:28.911800+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:28.911800+0000","last_undegraded":"2024-04-26T11:26:28.911800+0000","last_fullsized":"2024-04-26T11:26:28.911800+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":582,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892245+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:27.892245+0000","last_peered":"2024-04-26T11:26:27.892245+0000","last_clean":"2024-04-26T11:26:27.892245+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:27.892245+0000","last_undegraded":"2024-04-26T11:26:27.892245+0000","last_fullsized":"2024-04-26T11:26:27.892245+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":450,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892095+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:27.892095+0000","last_peered":"2024-04-26T11:26:27.892095+0000","last_clean":"2024-04-26T11:26:27.892095+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:27.892095+0000","last_undegraded":"2024-04-26T11:26:27.892095+0000","last_fullsized":"2024-04-26T11:26:27.892095+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":586,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379536+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:30.379536+0000","last_peered":"2024-04-26T11:26:30.379536+0000","last_clean":"2024-04-26T11:26:30.379536+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:30.379536+0000","last_undegraded":"2024-04-26T11:26:30.379536+0000","last_fullsized":"2024-04-26T11:26:30.379536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":496,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378089+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:30.378089+0000","last_peered":"2024-04-26T11:26:30.378089+0000","last_clean":"2024-04-26T11:26:30.378089+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:30.378089+0000","last_undegraded":"2024-04-26T11:26:30.378089+0000","last_fullsized":"2024-04-26T11:26:30.378089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":650,"reported_epoch":96,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T11:26:31.493649+0000","last_change":"2024-04-26T11:26:31.189372+0000","last_active":"2024-04-26T11:26:31.493649+0000","last_peered":"2024-04-26T11:26:31.493649+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.741978+0000","last_became_peered":"2024-04-26T11:26:12.741978+0000","last_unstale":"2024-04-26T11:26:31.493649+0000","last_undegraded":"2024-04-26T11:26:31.493649+0000","last_fullsized":"2024-04-26T11:26:12.575641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:33.135319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":772,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377745+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:30.377745+0000","last_peered":"2024-04-26T11:26:30.377745+0000","last_clean":"2024-04-26T11:26:30.377745+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:30.377745+0000","last_undegraded":"2024-04-26T11:26:30.377745+0000","last_fullsized":"2024-04-26T11:26:30.377745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":443,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377713+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:30.377713+0000","last_peered":"2024-04-26T11:26:30.377713+0000","last_clean":"2024-04-26T11:26:30.377713+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:30.377713+0000","last_undegraded":"2024-04-26T11:26:30.377713+0000","last_fullsized":"2024-04-26T11:26:30.377713+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":470,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892626+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:27.892626+0000","last_peered":"2024-04-26T11:26:27.892626+0000","last_clean":"2024-04-26T11:26:27.892626+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:27.892626+0000","last_undegraded":"2024-04-26T11:26:27.892626+0000","last_fullsized":"2024-04-26T11:26:27.892626+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":526,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891953+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:27.891953+0000","last_peered":"2024-04-26T11:26:27.891953+0000","last_clean":"2024-04-26T11:26:27.891953+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:27.891953+0000","last_undegraded":"2024-04-26T11:26:27.891953+0000","last_fullsized":"2024-04-26T11:26:27.891953+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":591,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892354+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:27.892354+0000","last_peered":"2024-04-26T11:26:27.892354+0000","last_clean":"2024-04-26T11:26:27.892354+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:27.892354+0000","last_undegraded":"2024-04-26T11:26:27.892354+0000","last_fullsized":"2024-04-26T11:26:27.892354+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":566,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380045+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:30.380045+0000","last_peered":"2024-04-26T11:26:30.380045+0000","last_clean":"2024-04-26T11:26:30.380045+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:30.380045+0000","last_undegraded":"2024-04-26T11:26:30.380045+0000","last_fullsized":"2024-04-26T11:26:30.380045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":574,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378574+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:30.378574+0000","last_peered":"2024-04-26T11:26:30.378574+0000","last_clean":"2024-04-26T11:26:30.378574+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:30.378574+0000","last_undegraded":"2024-04-26T11:26:30.378574+0000","last_fullsized":"2024-04-26T11:26:30.378574+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":613,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378874+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:30.378874+0000","last_peered":"2024-04-26T11:26:30.378874+0000","last_clean":"2024-04-26T11:26:30.378874+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:30.378874+0000","last_undegraded":"2024-04-26T11:26:30.378874+0000","last_fullsized":"2024-04-26T11:26:30.378874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":592,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-26T11:26:29.261045+0000","last_change":"2024-04-26T11:26:29.177466+0000","last_active":"2024-04-26T11:26:29.177466+0000","last_peered":"2024-04-26T11:26:29.261045+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.735943+0000","last_became_peered":"2024-04-26T11:26:12.735943+0000","last_unstale":"2024-04-26T11:26:29.261045+0000","last_undegraded":"2024-04-26T11:26:29.261045+0000","last_fullsized":"2024-04-26T11:26:12.575709+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":558,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.378777+0000","last_change":"2024-04-26T11:26:12.748380+0000","last_active":"2024-04-26T11:26:30.378777+0000","last_peered":"2024-04-26T11:26:30.378777+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743161+0000","last_became_peered":"2024-04-26T11:26:12.743161+0000","last_unstale":"2024-04-26T11:26:30.378777+0000","last_undegraded":"2024-04-26T11:26:12.608799+0000","last_fullsized":"2024-04-26T11:26:12.600138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:44.695371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":580,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.377445+0000","last_change":"2024-04-26T11:26:22.400914+0000","last_active":"2024-04-26T11:26:30.377445+0000","last_peered":"2024-04-26T11:26:30.377445+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.377454+0000","last_became_peered":"2024-04-26T11:26:22.377454+0000","last_unstale":"2024-04-26T11:26:30.377445+0000","last_undegraded":"2024-04-26T11:26:22.364727+0000","last_fullsized":"2024-04-26T11:26:22.364125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:01:07.478987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":189,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":922,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376373+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:30.376373+0000","last_peered":"2024-04-26T11:26:30.376373+0000","last_clean":"2024-04-26T11:26:30.376373+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:30.376373+0000","last_undegraded":"2024-04-26T11:26:30.376373+0000","last_fullsized":"2024-04-26T11:26:30.376373+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":505,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376937+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:30.376937+0000","last_peered":"2024-04-26T11:26:30.376937+0000","last_clean":"2024-04-26T11:26:30.376937+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:30.376937+0000","last_undegraded":"2024-04-26T11:26:30.376937+0000","last_fullsized":"2024-04-26T11:26:30.376937+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":938,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-04-26T11:26:31.395767+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:31.395767+0000","last_peered":"2024-04-26T11:26:31.395767+0000","last_clean":"2024-04-26T11:26:31.395767+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:31.395767+0000","last_undegraded":"2024-04-26T11:26:31.395767+0000","last_fullsized":"2024-04-26T11:26:31.395767+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:04.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1044,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378942+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:30.378942+0000","last_peered":"2024-04-26T11:26:30.378942+0000","last_clean":"2024-04-26T11:26:30.378942+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:30.378942+0000","last_undegraded":"2024-04-26T11:26:30.378942+0000","last_fullsized":"2024-04-26T11:26:30.378942+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":546,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.900747+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:28.900747+0000","last_peered":"2024-04-26T11:26:28.900747+0000","last_clean":"2024-04-26T11:26:28.900747+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:28.900747+0000","last_undegraded":"2024-04-26T11:26:28.900747+0000","last_fullsized":"2024-04-26T11:26:28.900747+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":941,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378437+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:30.378437+0000","last_peered":"2024-04-26T11:26:30.378437+0000","last_clean":"2024-04-26T11:26:30.378437+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:30.378437+0000","last_undegraded":"2024-04-26T11:26:30.378437+0000","last_fullsized":"2024-04-26T11:26:30.378437+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":498,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378088+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:30.378088+0000","last_peered":"2024-04-26T11:26:30.378088+0000","last_clean":"2024-04-26T11:26:30.378088+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:30.378088+0000","last_undegraded":"2024-04-26T11:26:30.378088+0000","last_fullsized":"2024-04-26T11:26:30.378088+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":610,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.378620+0000","last_change":"2024-04-26T11:26:22.407504+0000","last_active":"2024-04-26T11:26:30.378620+0000","last_peered":"2024-04-26T11:26:30.378620+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.402212+0000","last_became_peered":"2024-04-26T11:26:22.402212+0000","last_unstale":"2024-04-26T11:26:30.378620+0000","last_undegraded":"2024-04-26T11:26:22.372226+0000","last_fullsized":"2024-04-26T11:26:22.371421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:02.822376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":199,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":618,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376575+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:30.376575+0000","last_peered":"2024-04-26T11:26:30.376575+0000","last_clean":"2024-04-26T11:26:30.376575+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:30.376575+0000","last_undegraded":"2024-04-26T11:26:30.376575+0000","last_fullsized":"2024-04-26T11:26:30.376575+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":512,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.376542+0000","last_change":"2024-04-26T11:26:12.752759+0000","last_active":"2024-04-26T11:26:30.376542+0000","last_peered":"2024-04-26T11:26:30.376542+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749360+0000","last_became_peered":"2024-04-26T11:26:12.749360+0000","last_unstale":"2024-04-26T11:26:30.376542+0000","last_undegraded":"2024-04-26T11:26:12.617888+0000","last_fullsized":"2024-04-26T11:26:12.605870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.669370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":475,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378216+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:30.378216+0000","last_peered":"2024-04-26T11:26:30.378216+0000","last_clean":"2024-04-26T11:26:30.378216+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:30.378216+0000","last_undegraded":"2024-04-26T11:26:30.378216+0000","last_fullsized":"2024-04-26T11:26:30.378216+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":538,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891639+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:27.891639+0000","last_peered":"2024-04-26T11:26:27.891639+0000","last_clean":"2024-04-26T11:26:27.891639+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:27.891639+0000","last_undegraded":"2024-04-26T11:26:27.891639+0000","last_fullsized":"2024-04-26T11:26:27.891639+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":495,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379741+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:30.379741+0000","last_peered":"2024-04-26T11:26:30.379741+0000","last_clean":"2024-04-26T11:26:30.379741+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:30.379741+0000","last_undegraded":"2024-04-26T11:26:30.379741+0000","last_fullsized":"2024-04-26T11:26:30.379741+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377048+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:30.377048+0000","last_peered":"2024-04-26T11:26:30.377048+0000","last_clean":"2024-04-26T11:26:30.377048+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:30.377048+0000","last_undegraded":"2024-04-26T11:26:30.377048+0000","last_fullsized":"2024-04-26T11:26:30.377048+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":987,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379329+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:30.379329+0000","last_peered":"2024-04-26T11:26:30.379329+0000","last_clean":"2024-04-26T11:26:30.379329+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:30.379329+0000","last_undegraded":"2024-04-26T11:26:30.379329+0000","last_fullsized":"2024-04-26T11:26:30.379329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378767+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:30.378767+0000","last_peered":"2024-04-26T11:26:30.378767+0000","last_clean":"2024-04-26T11:26:30.378767+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:30.378767+0000","last_undegraded":"2024-04-26T11:26:30.378767+0000","last_fullsized":"2024-04-26T11:26:30.378767+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":927,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379538+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:30.379538+0000","last_peered":"2024-04-26T11:26:30.379538+0000","last_clean":"2024-04-26T11:26:30.379538+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:30.379538+0000","last_undegraded":"2024-04-26T11:26:30.379538+0000","last_fullsized":"2024-04-26T11:26:30.379538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":40,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.890960+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:27.890960+0000","last_peered":"2024-04-26T11:26:27.890960+0000","last_clean":"2024-04-26T11:26:27.890960+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:27.890960+0000","last_undegraded":"2024-04-26T11:26:27.890960+0000","last_fullsized":"2024-04-26T11:26:27.890960+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":230,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.895043+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:27.895043+0000","last_peered":"2024-04-26T11:26:27.895043+0000","last_clean":"2024-04-26T11:26:27.895043+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:27.895043+0000","last_undegraded":"2024-04-26T11:26:27.895043+0000","last_fullsized":"2024-04-26T11:26:27.895043+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":866,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376990+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:30.376990+0000","last_peered":"2024-04-26T11:26:30.376990+0000","last_clean":"2024-04-26T11:26:30.376990+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:30.376990+0000","last_undegraded":"2024-04-26T11:26:30.376990+0000","last_fullsized":"2024-04-26T11:26:30.376990+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":391,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379086+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:30.379086+0000","last_peered":"2024-04-26T11:26:30.379086+0000","last_clean":"2024-04-26T11:26:30.379086+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:30.379086+0000","last_undegraded":"2024-04-26T11:26:30.379086+0000","last_fullsized":"2024-04-26T11:26:30.379086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":570,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377078+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:30.377078+0000","last_peered":"2024-04-26T11:26:30.377078+0000","last_clean":"2024-04-26T11:26:30.377078+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:30.377078+0000","last_undegraded":"2024-04-26T11:26:30.377078+0000","last_fullsized":"2024-04-26T11:26:30.377078+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":633,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.893510+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:27.893510+0000","last_peered":"2024-04-26T11:26:27.893510+0000","last_clean":"2024-04-26T11:26:27.893510+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:27.893510+0000","last_undegraded":"2024-04-26T11:26:27.893510+0000","last_fullsized":"2024-04-26T11:26:27.893510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":542,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.377373+0000","last_change":"2024-04-26T11:26:12.752679+0000","last_active":"2024-04-26T11:26:30.377373+0000","last_peered":"2024-04-26T11:26:30.377373+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749414+0000","last_became_peered":"2024-04-26T11:26:12.749414+0000","last_unstale":"2024-04-26T11:26:30.377373+0000","last_undegraded":"2024-04-26T11:26:12.616453+0000","last_fullsized":"2024-04-26T11:26:12.605189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:29.120239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892832+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:27.892832+0000","last_peered":"2024-04-26T11:26:27.892832+0000","last_clean":"2024-04-26T11:26:27.892832+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:27.892832+0000","last_undegraded":"2024-04-26T11:26:27.892832+0000","last_fullsized":"2024-04-26T11:26:27.892832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":948,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378630+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:30.378630+0000","last_peered":"2024-04-26T11:26:30.378630+0000","last_clean":"2024-04-26T11:26:30.378630+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:30.378630+0000","last_undegraded":"2024-04-26T11:26:30.378630+0000","last_fullsized":"2024-04-26T11:26:30.378630+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":300,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378896+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:30.378896+0000","last_peered":"2024-04-26T11:26:30.378896+0000","last_clean":"2024-04-26T11:26:30.378896+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:30.378896+0000","last_undegraded":"2024-04-26T11:26:30.378896+0000","last_fullsized":"2024-04-26T11:26:30.378896+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":535,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.378751+0000","last_change":"2024-04-26T11:26:12.748367+0000","last_active":"2024-04-26T11:26:30.378751+0000","last_peered":"2024-04-26T11:26:30.378751+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743318+0000","last_became_peered":"2024-04-26T11:26:12.743318+0000","last_unstale":"2024-04-26T11:26:30.378751+0000","last_undegraded":"2024-04-26T11:26:12.617383+0000","last_fullsized":"2024-04-26T11:26:12.604987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:55.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":283,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891881+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:27.891881+0000","last_peered":"2024-04-26T11:26:27.891881+0000","last_clean":"2024-04-26T11:26:27.891881+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:27.891881+0000","last_undegraded":"2024-04-26T11:26:27.891881+0000","last_fullsized":"2024-04-26T11:26:27.891881+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":459,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-04-26T11:26:28.900076+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:28.900076+0000","last_peered":"2024-04-26T11:26:28.900076+0000","last_clean":"2024-04-26T11:26:28.900076+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:28.900076+0000","last_undegraded":"2024-04-26T11:26:28.900076+0000","last_fullsized":"2024-04-26T11:26:28.900076+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377380+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:30.377380+0000","last_peered":"2024-04-26T11:26:30.377380+0000","last_clean":"2024-04-26T11:26:30.377380+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:30.377380+0000","last_undegraded":"2024-04-26T11:26:30.377380+0000","last_fullsized":"2024-04-26T11:26:30.377380+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":427,"reported_epoch":94,"state":"peering","last_fresh":"2024-04-26T11:26:28.498990+0000","last_change":"2024-04-26T11:26:29.177633+0000","last_active":"2024-04-26T11:26:29.177633+0000","last_peered":"2024-04-26T11:26:28.498990+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.722568+0000","last_became_peered":"2024-04-26T11:26:12.722568+0000","last_unstale":"2024-04-26T11:26:28.498990+0000","last_undegraded":"2024-04-26T11:26:28.498990+0000","last_fullsized":"2024-04-26T11:26:12.579570+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":342,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377973+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:30.377973+0000","last_peered":"2024-04-26T11:26:30.377973+0000","last_clean":"2024-04-26T11:26:30.377973+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:30.377973+0000","last_undegraded":"2024-04-26T11:26:30.377973+0000","last_fullsized":"2024-04-26T11:26:30.377973+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":543,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379713+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:30.379713+0000","last_peered":"2024-04-26T11:26:30.379713+0000","last_clean":"2024-04-26T11:26:30.379713+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:30.379713+0000","last_undegraded":"2024-04-26T11:26:30.379713+0000","last_fullsized":"2024-04-26T11:26:30.379713+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":235,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.890718+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:27.890718+0000","last_peered":"2024-04-26T11:26:27.890718+0000","last_clean":"2024-04-26T11:26:27.890718+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:27.890718+0000","last_undegraded":"2024-04-26T11:26:27.890718+0000","last_fullsized":"2024-04-26T11:26:27.890718+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891442+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:27.891442+0000","last_peered":"2024-04-26T11:26:27.891442+0000","last_clean":"2024-04-26T11:26:27.891442+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:27.891442+0000","last_undegraded":"2024-04-26T11:26:27.891442+0000","last_fullsized":"2024-04-26T11:26:27.891442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":841,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377415+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:30.377415+0000","last_peered":"2024-04-26T11:26:30.377415+0000","last_clean":"2024-04-26T11:26:30.377415+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:30.377415+0000","last_undegraded":"2024-04-26T11:26:30.377415+0000","last_fullsized":"2024-04-26T11:26:30.377415+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":502,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.893635+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:27.893635+0000","last_peered":"2024-04-26T11:26:27.893635+0000","last_clean":"2024-04-26T11:26:27.893635+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:27.893635+0000","last_undegraded":"2024-04-26T11:26:27.893635+0000","last_fullsized":"2024-04-26T11:26:27.893635+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892051+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:27.892051+0000","last_peered":"2024-04-26T11:26:27.892051+0000","last_clean":"2024-04-26T11:26:27.892051+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:27.892051+0000","last_undegraded":"2024-04-26T11:26:27.892051+0000","last_fullsized":"2024-04-26T11:26:27.892051+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":282,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377125+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:30.377125+0000","last_peered":"2024-04-26T11:26:30.377125+0000","last_clean":"2024-04-26T11:26:30.377125+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:30.377125+0000","last_undegraded":"2024-04-26T11:26:30.377125+0000","last_fullsized":"2024-04-26T11:26:30.377125+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":552,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378325+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:30.378325+0000","last_peered":"2024-04-26T11:26:30.378325+0000","last_clean":"2024-04-26T11:26:30.378325+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:30.378325+0000","last_undegraded":"2024-04-26T11:26:30.378325+0000","last_fullsized":"2024-04-26T11:26:30.378325+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377402+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:30.377402+0000","last_peered":"2024-04-26T11:26:30.377402+0000","last_clean":"2024-04-26T11:26:30.377402+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:30.377402+0000","last_undegraded":"2024-04-26T11:26:30.377402+0000","last_fullsized":"2024-04-26T11:26:30.377402+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":472,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377271+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:30.377271+0000","last_peered":"2024-04-26T11:26:30.377271+0000","last_clean":"2024-04-26T11:26:30.377271+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:30.377271+0000","last_undegraded":"2024-04-26T11:26:30.377271+0000","last_fullsized":"2024-04-26T11:26:30.377271+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":443,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379850+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:30.379850+0000","last_peered":"2024-04-26T11:26:30.379850+0000","last_clean":"2024-04-26T11:26:30.379850+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:30.379850+0000","last_undegraded":"2024-04-26T11:26:30.379850+0000","last_fullsized":"2024-04-26T11:26:30.379850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891375+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:27.891375+0000","last_peered":"2024-04-26T11:26:27.891375+0000","last_clean":"2024-04-26T11:26:27.891375+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:27.891375+0000","last_undegraded":"2024-04-26T11:26:27.891375+0000","last_fullsized":"2024-04-26T11:26:27.891375+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.891394+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:27.891394+0000","last_peered":"2024-04-26T11:26:27.891394+0000","last_clean":"2024-04-26T11:26:27.891394+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:27.891394+0000","last_undegraded":"2024-04-26T11:26:27.891394+0000","last_fullsized":"2024-04-26T11:26:27.891394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":552,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379356+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:30.379356+0000","last_peered":"2024-04-26T11:26:30.379356+0000","last_clean":"2024-04-26T11:26:30.379356+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:30.379356+0000","last_undegraded":"2024-04-26T11:26:30.379356+0000","last_fullsized":"2024-04-26T11:26:30.379356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":558,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.893063+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:27.893063+0000","last_peered":"2024-04-26T11:26:27.893063+0000","last_clean":"2024-04-26T11:26:27.893063+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:27.893063+0000","last_undegraded":"2024-04-26T11:26:27.893063+0000","last_fullsized":"2024-04-26T11:26:27.893063+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379534+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:30.379534+0000","last_peered":"2024-04-26T11:26:30.379534+0000","last_clean":"2024-04-26T11:26:30.379534+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:30.379534+0000","last_undegraded":"2024-04-26T11:26:30.379534+0000","last_fullsized":"2024-04-26T11:26:30.379534+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":458,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.377954+0000","last_change":"2024-04-26T11:26:22.404169+0000","last_active":"2024-04-26T11:26:30.377954+0000","last_peered":"2024-04-26T11:26:30.377954+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.397567+0000","last_became_peered":"2024-04-26T11:26:22.397567+0000","last_unstale":"2024-04-26T11:26:30.377954+0000","last_undegraded":"2024-04-26T11:26:22.370292+0000","last_fullsized":"2024-04-26T11:26:22.365457+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:00.871852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":157,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379312+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:30.379312+0000","last_peered":"2024-04-26T11:26:30.379312+0000","last_clean":"2024-04-26T11:26:30.379312+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:30.379312+0000","last_undegraded":"2024-04-26T11:26:30.379312+0000","last_fullsized":"2024-04-26T11:26:30.379312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380388+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:30.380388+0000","last_peered":"2024-04-26T11:26:30.380388+0000","last_clean":"2024-04-26T11:26:30.380388+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:30.380388+0000","last_undegraded":"2024-04-26T11:26:30.380388+0000","last_fullsized":"2024-04-26T11:26:30.380388+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":807,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377937+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:30.377937+0000","last_peered":"2024-04-26T11:26:30.377937+0000","last_clean":"2024-04-26T11:26:30.377937+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:30.377937+0000","last_undegraded":"2024-04-26T11:26:30.377937+0000","last_fullsized":"2024-04-26T11:26:30.377937+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380163+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:30.380163+0000","last_peered":"2024-04-26T11:26:30.380163+0000","last_clean":"2024-04-26T11:26:30.380163+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:30.380163+0000","last_undegraded":"2024-04-26T11:26:30.380163+0000","last_fullsized":"2024-04-26T11:26:30.380163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379646+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:30.379646+0000","last_peered":"2024-04-26T11:26:30.379646+0000","last_clean":"2024-04-26T11:26:30.379646+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:30.379646+0000","last_undegraded":"2024-04-26T11:26:30.379646+0000","last_fullsized":"2024-04-26T11:26:30.379646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":536,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.376987+0000","last_change":"2024-04-26T11:26:12.748928+0000","last_active":"2024-04-26T11:26:30.376987+0000","last_peered":"2024-04-26T11:26:30.376987+0000","last_clean":"2024-04-26T11:23:20.666513+0000","last_became_active":"2024-04-26T11:26:12.743721+0000","last_became_peered":"2024-04-26T11:26:12.743721+0000","last_unstale":"2024-04-26T11:26:30.376987+0000","last_undegraded":"2024-04-26T11:26:12.621233+0000","last_fullsized":"2024-04-26T11:26:12.616597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:38.029361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379840+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:30.379840+0000","last_peered":"2024-04-26T11:26:30.379840+0000","last_clean":"2024-04-26T11:26:30.379840+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:30.379840+0000","last_undegraded":"2024-04-26T11:26:30.379840+0000","last_fullsized":"2024-04-26T11:26:30.379840+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.894123+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:27.894123+0000","last_peered":"2024-04-26T11:26:27.894123+0000","last_clean":"2024-04-26T11:26:27.894123+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:27.894123+0000","last_undegraded":"2024-04-26T11:26:27.894123+0000","last_fullsized":"2024-04-26T11:26:27.894123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":920,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377094+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:30.377094+0000","last_peered":"2024-04-26T11:26:30.377094+0000","last_clean":"2024-04-26T11:26:30.377094+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:30.377094+0000","last_undegraded":"2024-04-26T11:26:30.377094+0000","last_fullsized":"2024-04-26T11:26:30.377094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":500,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892338+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:27.892338+0000","last_peered":"2024-04-26T11:26:27.892338+0000","last_clean":"2024-04-26T11:26:27.892338+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:27.892338+0000","last_undegraded":"2024-04-26T11:26:27.892338+0000","last_fullsized":"2024-04-26T11:26:27.892338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":479,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892508+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:27.892508+0000","last_peered":"2024-04-26T11:26:27.892508+0000","last_clean":"2024-04-26T11:26:27.892508+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:27.892508+0000","last_undegraded":"2024-04-26T11:26:27.892508+0000","last_fullsized":"2024-04-26T11:26:27.892508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":545,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376735+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:30.376735+0000","last_peered":"2024-04-26T11:26:30.376735+0000","last_clean":"2024-04-26T11:26:30.376735+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:30.376735+0000","last_undegraded":"2024-04-26T11:26:30.376735+0000","last_fullsized":"2024-04-26T11:26:30.376735+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380303+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:30.380303+0000","last_peered":"2024-04-26T11:26:30.380303+0000","last_clean":"2024-04-26T11:26:30.380303+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:30.380303+0000","last_undegraded":"2024-04-26T11:26:30.380303+0000","last_fullsized":"2024-04-26T11:26:30.380303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":404,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.894836+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:27.894836+0000","last_peered":"2024-04-26T11:26:27.894836+0000","last_clean":"2024-04-26T11:26:27.894836+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:27.894836+0000","last_undegraded":"2024-04-26T11:26:27.894836+0000","last_fullsized":"2024-04-26T11:26:27.894836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":602,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.376728+0000","last_change":"2024-04-26T11:26:12.748851+0000","last_active":"2024-04-26T11:26:30.376728+0000","last_peered":"2024-04-26T11:26:30.376728+0000","last_clean":"2024-04-26T11:23:20.666469+0000","last_became_active":"2024-04-26T11:26:12.743007+0000","last_became_peered":"2024-04-26T11:26:12.743007+0000","last_unstale":"2024-04-26T11:26:30.376728+0000","last_undegraded":"2024-04-26T11:26:12.606150+0000","last_fullsized":"2024-04-26T11:26:12.595590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:06.439297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380125+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:30.380125+0000","last_peered":"2024-04-26T11:26:30.380125+0000","last_clean":"2024-04-26T11:26:30.380125+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:30.380125+0000","last_undegraded":"2024-04-26T11:26:30.380125+0000","last_fullsized":"2024-04-26T11:26:30.380125+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":559,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.376866+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:30.376866+0000","last_peered":"2024-04-26T11:26:30.376866+0000","last_clean":"2024-04-26T11:26:30.376866+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:30.376866+0000","last_undegraded":"2024-04-26T11:26:30.376866+0000","last_fullsized":"2024-04-26T11:26:30.376866+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":775,"reported_epoch":96,"state":"peering","last_fresh":"2024-04-26T11:26:31.382407+0000","last_change":"2024-04-26T11:26:31.382811+0000","last_active":"2024-04-26T11:26:31.382407+0000","last_peered":"2024-04-26T11:26:31.185264+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.389958+0000","last_became_peered":"2024-04-26T11:26:22.389958+0000","last_unstale":"2024-04-26T11:26:31.382407+0000","last_undegraded":"2024-04-26T11:26:31.382407+0000","last_fullsized":"2024-04-26T11:26:31.382407+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:06.737937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":677,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377311+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:30.377311+0000","last_peered":"2024-04-26T11:26:30.377311+0000","last_clean":"2024-04-26T11:26:30.377311+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:30.377311+0000","last_undegraded":"2024-04-26T11:26:30.377311+0000","last_fullsized":"2024-04-26T11:26:30.377311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":912,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378875+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:30.378875+0000","last_peered":"2024-04-26T11:26:30.378875+0000","last_clean":"2024-04-26T11:26:30.378875+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:30.378875+0000","last_undegraded":"2024-04-26T11:26:30.378875+0000","last_fullsized":"2024-04-26T11:26:30.378875+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":384,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377041+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:30.377041+0000","last_peered":"2024-04-26T11:26:30.377041+0000","last_clean":"2024-04-26T11:26:30.377041+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:30.377041+0000","last_undegraded":"2024-04-26T11:26:30.377041+0000","last_fullsized":"2024-04-26T11:26:30.377041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":664,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.379743+0000","last_change":"2024-04-26T11:26:22.404414+0000","last_active":"2024-04-26T11:26:30.379743+0000","last_peered":"2024-04-26T11:26:30.379743+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.387346+0000","last_became_peered":"2024-04-26T11:26:22.387346+0000","last_unstale":"2024-04-26T11:26:30.379743+0000","last_undegraded":"2024-04-26T11:26:22.368665+0000","last_fullsized":"2024-04-26T11:26:22.368295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:13.764286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":166,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":421,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378706+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:30.378706+0000","last_peered":"2024-04-26T11:26:30.378706+0000","last_clean":"2024-04-26T11:26:30.378706+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:30.378706+0000","last_undegraded":"2024-04-26T11:26:30.378706+0000","last_fullsized":"2024-04-26T11:26:30.378706+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":489,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377980+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:30.377980+0000","last_peered":"2024-04-26T11:26:30.377980+0000","last_clean":"2024-04-26T11:26:30.377980+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:30.377980+0000","last_undegraded":"2024-04-26T11:26:30.377980+0000","last_fullsized":"2024-04-26T11:26:30.377980+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.378282+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:30.378282+0000","last_peered":"2024-04-26T11:26:30.378282+0000","last_clean":"2024-04-26T11:26:30.378282+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:30.378282+0000","last_undegraded":"2024-04-26T11:26:30.378282+0000","last_fullsized":"2024-04-26T11:26:30.378282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":463,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892132+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:27.892132+0000","last_peered":"2024-04-26T11:26:27.892132+0000","last_clean":"2024-04-26T11:26:27.892132+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:27.892132+0000","last_undegraded":"2024-04-26T11:26:27.892132+0000","last_fullsized":"2024-04-26T11:26:27.892132+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":392,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-26T11:26:27.892720+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:27.892720+0000","last_peered":"2024-04-26T11:26:27.892720+0000","last_clean":"2024-04-26T11:26:27.892720+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:27.892720+0000","last_undegraded":"2024-04-26T11:26:27.892720+0000","last_fullsized":"2024-04-26T11:26:27.892720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":490,"reported_epoch":90,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:25.374080+0000","last_change":"2024-04-26T11:26:12.744889+0000","last_active":"2024-04-26T11:26:25.374080+0000","last_peered":"2024-04-26T11:26:25.374080+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.737082+0000","last_became_peered":"2024-04-26T11:26:12.737082+0000","last_unstale":"2024-04-26T11:26:25.374080+0000","last_undegraded":"2024-04-26T11:26:12.611355+0000","last_fullsized":"2024-04-26T11:26:12.595288+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:20.864858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":180,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":487,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.380014+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:30.380014+0000","last_peered":"2024-04-26T11:26:30.380014+0000","last_clean":"2024-04-26T11:26:30.380014+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:30.380014+0000","last_undegraded":"2024-04-26T11:26:30.380014+0000","last_fullsized":"2024-04-26T11:26:30.380014+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":488,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.377646+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:30.377646+0000","last_peered":"2024-04-26T11:26:30.377646+0000","last_clean":"2024-04-26T11:26:30.377646+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:30.377646+0000","last_undegraded":"2024-04-26T11:26:30.377646+0000","last_fullsized":"2024-04-26T11:26:30.377646+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379359+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:30.379359+0000","last_peered":"2024-04-26T11:26:30.379359+0000","last_clean":"2024-04-26T11:26:30.379359+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:30.379359+0000","last_undegraded":"2024-04-26T11:26:30.379359+0000","last_fullsized":"2024-04-26T11:26:30.379359+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":548,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.376304+0000","last_change":"2024-04-26T11:26:12.746698+0000","last_active":"2024-04-26T11:26:30.376304+0000","last_peered":"2024-04-26T11:26:30.376304+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.738414+0000","last_became_peered":"2024-04-26T11:26:12.738414+0000","last_unstale":"2024-04-26T11:26:30.376304+0000","last_undegraded":"2024-04-26T11:26:12.613606+0000","last_fullsized":"2024-04-26T11:26:12.600100+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:58.547950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":198,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-04-26T11:26:30.379843+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:30.379843+0000","last_peered":"2024-04-26T11:26:30.379843+0000","last_clean":"2024-04-26T11:26:30.379843+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:30.379843+0000","last_undegraded":"2024-04-26T11:26:30.379843+0000","last_fullsized":"2024-04-26T11:26:30.379843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2232,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4993,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":115,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738431,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142324,"kb_used_data":30888,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229516,"statfs":{"total":96636764160,"available":96491024384,"internally_reserved":0,"allocated":31629312,"data_stored":81564778,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738431,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124244,"kb_used_data":30852,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247596,"statfs":{"total":96636764160,"available":96509538304,"internally_reserved":0,"allocated":31592448,"data_stored":86068898,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.72599999999999998}]}]},{"osd":0,"up_from":75,"seq":322122547206,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49564,"kb_used_data":17932,"kb_used_omap":7,"kb_used_meta":31608,"kb_avail":94322276,"statfs":{"total":96636764160,"available":96586010624,"internally_reserved":0,"allocated":18362368,"data_stored":91723890,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":32367607},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:37.777 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:38.092 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:38.094 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:38.110 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2024-04-26T11:26:37.451164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1143,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6153,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":203,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":328600,"kb_used_data":79852,"kb_used_omap":10,"kb_used_meta":248693,"kb_avail":282786920,"statfs":{"total":289910292480,"available":289573806080,"internally_reserved":0,"allocated":81768448,"data_stored":259425551,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":254662531},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1089,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1136,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001400"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":504,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383205+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:35.383205+0000","last_peered":"2024-04-26T11:26:35.383205+0000","last_clean":"2024-04-26T11:26:35.383205+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:35.383205+0000","last_undegraded":"2024-04-26T11:26:35.383205+0000","last_fullsized":"2024-04-26T11:26:35.383205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":560,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382490+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:35.382490+0000","last_peered":"2024-04-26T11:26:35.382490+0000","last_clean":"2024-04-26T11:26:35.382490+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:35.382490+0000","last_undegraded":"2024-04-26T11:26:35.382490+0000","last_fullsized":"2024-04-26T11:26:35.382490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":433,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.895001+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:32.895001+0000","last_peered":"2024-04-26T11:26:32.895001+0000","last_clean":"2024-04-26T11:26:32.895001+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:32.895001+0000","last_undegraded":"2024-04-26T11:26:32.895001+0000","last_fullsized":"2024-04-26T11:26:32.895001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":482,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886984+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:32.886984+0000","last_peered":"2024-04-26T11:26:32.886984+0000","last_clean":"2024-04-26T11:26:32.886984+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:32.886984+0000","last_undegraded":"2024-04-26T11:26:32.886984+0000","last_fullsized":"2024-04-26T11:26:32.886984+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":535,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381918+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:35.381918+0000","last_peered":"2024-04-26T11:26:35.381918+0000","last_clean":"2024-04-26T11:26:35.381918+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:35.381918+0000","last_undegraded":"2024-04-26T11:26:35.381918+0000","last_fullsized":"2024-04-26T11:26:35.381918+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":486,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887299+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:32.887299+0000","last_peered":"2024-04-26T11:26:32.887299+0000","last_clean":"2024-04-26T11:26:32.887299+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:32.887299+0000","last_undegraded":"2024-04-26T11:26:32.887299+0000","last_fullsized":"2024-04-26T11:26:32.887299+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":587,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886853+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:32.886853+0000","last_peered":"2024-04-26T11:26:32.886853+0000","last_clean":"2024-04-26T11:26:32.886853+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:32.886853+0000","last_undegraded":"2024-04-26T11:26:32.886853+0000","last_fullsized":"2024-04-26T11:26:32.886853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":455,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886266+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:32.886266+0000","last_peered":"2024-04-26T11:26:32.886266+0000","last_clean":"2024-04-26T11:26:32.886266+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:32.886266+0000","last_undegraded":"2024-04-26T11:26:32.886266+0000","last_fullsized":"2024-04-26T11:26:32.886266+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":591,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379537+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:35.379537+0000","last_peered":"2024-04-26T11:26:35.379537+0000","last_clean":"2024-04-26T11:26:35.379537+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:35.379537+0000","last_undegraded":"2024-04-26T11:26:35.379537+0000","last_fullsized":"2024-04-26T11:26:35.379537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":501,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382628+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:35.382628+0000","last_peered":"2024-04-26T11:26:35.382628+0000","last_clean":"2024-04-26T11:26:35.382628+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:35.382628+0000","last_undegraded":"2024-04-26T11:26:35.382628+0000","last_fullsized":"2024-04-26T11:26:35.382628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":473,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:26:33.898211+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:33.898211+0000","last_peered":"2024-04-26T11:26:33.898211+0000","last_clean":"2024-04-26T11:26:33.898211+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:33.898211+0000","last_undegraded":"2024-04-26T11:26:33.898211+0000","last_fullsized":"2024-04-26T11:26:33.898211+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:07.200544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":777,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381815+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:35.381815+0000","last_peered":"2024-04-26T11:26:35.381815+0000","last_clean":"2024-04-26T11:26:35.381815+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:35.381815+0000","last_undegraded":"2024-04-26T11:26:35.381815+0000","last_fullsized":"2024-04-26T11:26:35.381815+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":448,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381793+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:35.381793+0000","last_peered":"2024-04-26T11:26:35.381793+0000","last_clean":"2024-04-26T11:26:35.381793+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:35.381793+0000","last_undegraded":"2024-04-26T11:26:35.381793+0000","last_fullsized":"2024-04-26T11:26:35.381793+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":475,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887097+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:32.887097+0000","last_peered":"2024-04-26T11:26:32.887097+0000","last_clean":"2024-04-26T11:26:32.887097+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:32.887097+0000","last_undegraded":"2024-04-26T11:26:32.887097+0000","last_fullsized":"2024-04-26T11:26:32.887097+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":531,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886760+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:32.886760+0000","last_peered":"2024-04-26T11:26:32.886760+0000","last_clean":"2024-04-26T11:26:32.886760+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:32.886760+0000","last_undegraded":"2024-04-26T11:26:32.886760+0000","last_fullsized":"2024-04-26T11:26:32.886760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":596,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886586+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:32.886586+0000","last_peered":"2024-04-26T11:26:32.886586+0000","last_clean":"2024-04-26T11:26:32.886586+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:32.886586+0000","last_undegraded":"2024-04-26T11:26:32.886586+0000","last_fullsized":"2024-04-26T11:26:32.886586+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":572,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.400877+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:36.400877+0000","last_peered":"2024-04-26T11:26:36.400877+0000","last_clean":"2024-04-26T11:26:36.400877+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:36.400877+0000","last_undegraded":"2024-04-26T11:26:36.400877+0000","last_fullsized":"2024-04-26T11:26:36.400877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":579,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382887+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:35.382887+0000","last_peered":"2024-04-26T11:26:35.382887+0000","last_clean":"2024-04-26T11:26:35.382887+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:35.382887+0000","last_undegraded":"2024-04-26T11:26:35.382887+0000","last_fullsized":"2024-04-26T11:26:35.382887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":618,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379941+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:35.379941+0000","last_peered":"2024-04-26T11:26:35.379941+0000","last_clean":"2024-04-26T11:26:35.379941+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:35.379941+0000","last_undegraded":"2024-04-26T11:26:35.379941+0000","last_fullsized":"2024-04-26T11:26:35.379941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":604,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887750+0000","last_change":"2024-04-26T11:26:29.907661+0000","last_active":"2024-04-26T11:26:32.887750+0000","last_peered":"2024-04-26T11:26:32.887750+0000","last_clean":"2024-04-26T11:26:32.887750+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:26:32.887750+0000","last_undegraded":"2024-04-26T11:26:32.887750+0000","last_fullsized":"2024-04-26T11:26:32.887750+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":558,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.378777+0000","last_change":"2024-04-26T11:26:12.748380+0000","last_active":"2024-04-26T11:26:30.378777+0000","last_peered":"2024-04-26T11:26:30.378777+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743161+0000","last_became_peered":"2024-04-26T11:26:12.743161+0000","last_unstale":"2024-04-26T11:26:30.378777+0000","last_undegraded":"2024-04-26T11:26:12.608799+0000","last_fullsized":"2024-04-26T11:26:12.600138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:44.695371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":973,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381275+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:35.381275+0000","last_peered":"2024-04-26T11:26:35.381275+0000","last_clean":"2024-04-26T11:26:35.381275+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:35.381275+0000","last_undegraded":"2024-04-26T11:26:35.381275+0000","last_fullsized":"2024-04-26T11:26:35.381275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:06.847831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":927,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378023+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:35.378023+0000","last_peered":"2024-04-26T11:26:35.378023+0000","last_clean":"2024-04-26T11:26:35.378023+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:35.378023+0000","last_undegraded":"2024-04-26T11:26:35.378023+0000","last_fullsized":"2024-04-26T11:26:35.378023+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":510,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380664+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:35.380664+0000","last_peered":"2024-04-26T11:26:35.380664+0000","last_clean":"2024-04-26T11:26:35.380664+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:35.380664+0000","last_undegraded":"2024-04-26T11:26:35.380664+0000","last_fullsized":"2024-04-26T11:26:35.380664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":943,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383462+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:35.383462+0000","last_peered":"2024-04-26T11:26:35.383462+0000","last_clean":"2024-04-26T11:26:35.383462+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:35.383462+0000","last_undegraded":"2024-04-26T11:26:35.383462+0000","last_fullsized":"2024-04-26T11:26:35.383462+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:04.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1049,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380062+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:35.380062+0000","last_peered":"2024-04-26T11:26:35.380062+0000","last_clean":"2024-04-26T11:26:35.380062+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:35.380062+0000","last_undegraded":"2024-04-26T11:26:35.380062+0000","last_fullsized":"2024-04-26T11:26:35.380062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":551,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.890324+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:32.890324+0000","last_peered":"2024-04-26T11:26:32.890324+0000","last_clean":"2024-04-26T11:26:32.890324+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:32.890324+0000","last_undegraded":"2024-04-26T11:26:32.890324+0000","last_fullsized":"2024-04-26T11:26:32.890324+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":946,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382315+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:35.382315+0000","last_peered":"2024-04-26T11:26:35.382315+0000","last_clean":"2024-04-26T11:26:35.382315+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:35.382315+0000","last_undegraded":"2024-04-26T11:26:35.382315+0000","last_fullsized":"2024-04-26T11:26:35.382315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":503,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381112+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:35.381112+0000","last_peered":"2024-04-26T11:26:35.381112+0000","last_clean":"2024-04-26T11:26:35.381112+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:35.381112+0000","last_undegraded":"2024-04-26T11:26:35.381112+0000","last_fullsized":"2024-04-26T11:26:35.381112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":938,"reported_epoch":101,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T11:26:36.472040+0000","last_change":"2024-04-26T11:26:35.803664+0000","last_active":"2024-04-26T11:26:36.472040+0000","last_peered":"2024-04-26T11:26:36.472040+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.402212+0000","last_became_peered":"2024-04-26T11:26:22.402212+0000","last_unstale":"2024-04-26T11:26:36.472040+0000","last_undegraded":"2024-04-26T11:26:36.472040+0000","last_fullsized":"2024-04-26T11:26:22.371421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:02.822376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":623,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378172+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:35.378172+0000","last_peered":"2024-04-26T11:26:35.378172+0000","last_clean":"2024-04-26T11:26:35.378172+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:35.378172+0000","last_undegraded":"2024-04-26T11:26:35.378172+0000","last_fullsized":"2024-04-26T11:26:35.378172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":517,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:35.378107+0000","last_change":"2024-04-26T11:26:12.752759+0000","last_active":"2024-04-26T11:26:35.378107+0000","last_peered":"2024-04-26T11:26:35.378107+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749360+0000","last_became_peered":"2024-04-26T11:26:12.749360+0000","last_unstale":"2024-04-26T11:26:35.378107+0000","last_undegraded":"2024-04-26T11:26:12.617888+0000","last_fullsized":"2024-04-26T11:26:12.605870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.669370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":480,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382046+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:35.382046+0000","last_peered":"2024-04-26T11:26:35.382046+0000","last_clean":"2024-04-26T11:26:35.382046+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:35.382046+0000","last_undegraded":"2024-04-26T11:26:35.382046+0000","last_fullsized":"2024-04-26T11:26:35.382046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":543,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889152+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:32.889152+0000","last_peered":"2024-04-26T11:26:32.889152+0000","last_clean":"2024-04-26T11:26:32.889152+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:32.889152+0000","last_undegraded":"2024-04-26T11:26:32.889152+0000","last_fullsized":"2024-04-26T11:26:32.889152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":500,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383361+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:35.383361+0000","last_peered":"2024-04-26T11:26:35.383361+0000","last_clean":"2024-04-26T11:26:35.383361+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:35.383361+0000","last_undegraded":"2024-04-26T11:26:35.383361+0000","last_fullsized":"2024-04-26T11:26:35.383361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":171,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398505+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:36.398505+0000","last_peered":"2024-04-26T11:26:36.398505+0000","last_clean":"2024-04-26T11:26:36.398505+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:36.398505+0000","last_undegraded":"2024-04-26T11:26:36.398505+0000","last_fullsized":"2024-04-26T11:26:36.398505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":992,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380469+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:35.380469+0000","last_peered":"2024-04-26T11:26:35.380469+0000","last_clean":"2024-04-26T11:26:35.380469+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:35.380469+0000","last_undegraded":"2024-04-26T11:26:35.380469+0000","last_fullsized":"2024-04-26T11:26:35.380469+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":159,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.399284+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:36.399284+0000","last_peered":"2024-04-26T11:26:36.399284+0000","last_clean":"2024-04-26T11:26:36.399284+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:36.399284+0000","last_undegraded":"2024-04-26T11:26:36.399284+0000","last_fullsized":"2024-04-26T11:26:36.399284+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":932,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379697+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:35.379697+0000","last_peered":"2024-04-26T11:26:35.379697+0000","last_clean":"2024-04-26T11:26:35.379697+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:35.379697+0000","last_undegraded":"2024-04-26T11:26:35.379697+0000","last_fullsized":"2024-04-26T11:26:35.379697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":45,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.885833+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:32.885833+0000","last_peered":"2024-04-26T11:26:32.885833+0000","last_clean":"2024-04-26T11:26:32.885833+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:32.885833+0000","last_undegraded":"2024-04-26T11:26:32.885833+0000","last_fullsized":"2024-04-26T11:26:32.885833+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":235,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.890716+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:32.890716+0000","last_peered":"2024-04-26T11:26:32.890716+0000","last_clean":"2024-04-26T11:26:32.890716+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:32.890716+0000","last_undegraded":"2024-04-26T11:26:32.890716+0000","last_fullsized":"2024-04-26T11:26:32.890716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":871,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380782+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:35.380782+0000","last_peered":"2024-04-26T11:26:35.380782+0000","last_clean":"2024-04-26T11:26:35.380782+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:35.380782+0000","last_undegraded":"2024-04-26T11:26:35.380782+0000","last_fullsized":"2024-04-26T11:26:35.380782+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":396,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383151+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:35.383151+0000","last_peered":"2024-04-26T11:26:35.383151+0000","last_clean":"2024-04-26T11:26:35.383151+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:35.383151+0000","last_undegraded":"2024-04-26T11:26:35.383151+0000","last_fullsized":"2024-04-26T11:26:35.383151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":575,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380939+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:35.380939+0000","last_peered":"2024-04-26T11:26:35.380939+0000","last_clean":"2024-04-26T11:26:35.380939+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:35.380939+0000","last_undegraded":"2024-04-26T11:26:35.380939+0000","last_fullsized":"2024-04-26T11:26:35.380939+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":638,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889867+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:32.889867+0000","last_peered":"2024-04-26T11:26:32.889867+0000","last_clean":"2024-04-26T11:26:32.889867+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:32.889867+0000","last_undegraded":"2024-04-26T11:26:32.889867+0000","last_fullsized":"2024-04-26T11:26:32.889867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":547,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:35.379035+0000","last_change":"2024-04-26T11:26:12.752679+0000","last_active":"2024-04-26T11:26:35.379035+0000","last_peered":"2024-04-26T11:26:35.379035+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749414+0000","last_became_peered":"2024-04-26T11:26:12.749414+0000","last_unstale":"2024-04-26T11:26:35.379035+0000","last_undegraded":"2024-04-26T11:26:12.616453+0000","last_fullsized":"2024-04-26T11:26:12.605189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:29.120239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887264+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:32.887264+0000","last_peered":"2024-04-26T11:26:32.887264+0000","last_clean":"2024-04-26T11:26:32.887264+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:32.887264+0000","last_undegraded":"2024-04-26T11:26:32.887264+0000","last_fullsized":"2024-04-26T11:26:32.887264+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":953,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381229+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:35.381229+0000","last_peered":"2024-04-26T11:26:35.381229+0000","last_clean":"2024-04-26T11:26:35.381229+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:35.381229+0000","last_undegraded":"2024-04-26T11:26:35.381229+0000","last_fullsized":"2024-04-26T11:26:35.381229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":305,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381449+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:35.381449+0000","last_peered":"2024-04-26T11:26:35.381449+0000","last_clean":"2024-04-26T11:26:35.381449+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:35.381449+0000","last_undegraded":"2024-04-26T11:26:35.381449+0000","last_fullsized":"2024-04-26T11:26:35.381449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":535,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.378751+0000","last_change":"2024-04-26T11:26:12.748367+0000","last_active":"2024-04-26T11:26:30.378751+0000","last_peered":"2024-04-26T11:26:30.378751+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743318+0000","last_became_peered":"2024-04-26T11:26:12.743318+0000","last_unstale":"2024-04-26T11:26:30.378751+0000","last_undegraded":"2024-04-26T11:26:12.617383+0000","last_fullsized":"2024-04-26T11:26:12.604987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:55.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":288,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886677+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:32.886677+0000","last_peered":"2024-04-26T11:26:32.886677+0000","last_clean":"2024-04-26T11:26:32.886677+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:32.886677+0000","last_undegraded":"2024-04-26T11:26:32.886677+0000","last_fullsized":"2024-04-26T11:26:32.886677+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":464,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889788+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:32.889788+0000","last_peered":"2024-04-26T11:26:32.889788+0000","last_clean":"2024-04-26T11:26:32.889788+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:32.889788+0000","last_undegraded":"2024-04-26T11:26:32.889788+0000","last_fullsized":"2024-04-26T11:26:32.889788+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":146,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381273+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:35.381273+0000","last_peered":"2024-04-26T11:26:35.381273+0000","last_clean":"2024-04-26T11:26:35.381273+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:35.381273+0000","last_undegraded":"2024-04-26T11:26:35.381273+0000","last_fullsized":"2024-04-26T11:26:35.381273+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":439,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.890673+0000","last_change":"2024-04-26T11:26:29.914048+0000","last_active":"2024-04-26T11:26:32.890673+0000","last_peered":"2024-04-26T11:26:32.890673+0000","last_clean":"2024-04-26T11:26:32.890673+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:26:32.890673+0000","last_undegraded":"2024-04-26T11:26:32.890673+0000","last_fullsized":"2024-04-26T11:26:32.890673+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":347,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380904+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:35.380904+0000","last_peered":"2024-04-26T11:26:35.380904+0000","last_clean":"2024-04-26T11:26:35.380904+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:35.380904+0000","last_undegraded":"2024-04-26T11:26:35.380904+0000","last_fullsized":"2024-04-26T11:26:35.380904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":548,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379783+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:35.379783+0000","last_peered":"2024-04-26T11:26:35.379783+0000","last_clean":"2024-04-26T11:26:35.379783+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:35.379783+0000","last_undegraded":"2024-04-26T11:26:35.379783+0000","last_fullsized":"2024-04-26T11:26:35.379783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":240,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.885752+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:32.885752+0000","last_peered":"2024-04-26T11:26:32.885752+0000","last_clean":"2024-04-26T11:26:32.885752+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:32.885752+0000","last_undegraded":"2024-04-26T11:26:32.885752+0000","last_fullsized":"2024-04-26T11:26:32.885752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887349+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:32.887349+0000","last_peered":"2024-04-26T11:26:32.887349+0000","last_clean":"2024-04-26T11:26:32.887349+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:32.887349+0000","last_undegraded":"2024-04-26T11:26:32.887349+0000","last_fullsized":"2024-04-26T11:26:32.887349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":846,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379142+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:35.379142+0000","last_peered":"2024-04-26T11:26:35.379142+0000","last_clean":"2024-04-26T11:26:35.379142+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:35.379142+0000","last_undegraded":"2024-04-26T11:26:35.379142+0000","last_fullsized":"2024-04-26T11:26:35.379142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":507,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.890104+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:32.890104+0000","last_peered":"2024-04-26T11:26:32.890104+0000","last_clean":"2024-04-26T11:26:32.890104+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:32.890104+0000","last_undegraded":"2024-04-26T11:26:32.890104+0000","last_fullsized":"2024-04-26T11:26:32.890104+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886295+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:32.886295+0000","last_peered":"2024-04-26T11:26:32.886295+0000","last_clean":"2024-04-26T11:26:32.886295+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:32.886295+0000","last_undegraded":"2024-04-26T11:26:32.886295+0000","last_fullsized":"2024-04-26T11:26:32.886295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":287,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378949+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:35.378949+0000","last_peered":"2024-04-26T11:26:35.378949+0000","last_clean":"2024-04-26T11:26:35.378949+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:35.378949+0000","last_undegraded":"2024-04-26T11:26:35.378949+0000","last_fullsized":"2024-04-26T11:26:35.378949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":557,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382763+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:35.382763+0000","last_peered":"2024-04-26T11:26:35.382763+0000","last_clean":"2024-04-26T11:26:35.382763+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:35.382763+0000","last_undegraded":"2024-04-26T11:26:35.382763+0000","last_fullsized":"2024-04-26T11:26:35.382763+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379241+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:35.379241+0000","last_peered":"2024-04-26T11:26:35.379241+0000","last_clean":"2024-04-26T11:26:35.379241+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:35.379241+0000","last_undegraded":"2024-04-26T11:26:35.379241+0000","last_fullsized":"2024-04-26T11:26:35.379241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":477,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381040+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:35.381040+0000","last_peered":"2024-04-26T11:26:35.381040+0000","last_clean":"2024-04-26T11:26:35.381040+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:35.381040+0000","last_undegraded":"2024-04-26T11:26:35.381040+0000","last_fullsized":"2024-04-26T11:26:35.381040+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":448,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379961+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:35.379961+0000","last_peered":"2024-04-26T11:26:35.379961+0000","last_clean":"2024-04-26T11:26:35.379961+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:35.379961+0000","last_undegraded":"2024-04-26T11:26:35.379961+0000","last_fullsized":"2024-04-26T11:26:35.379961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886170+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:32.886170+0000","last_peered":"2024-04-26T11:26:32.886170+0000","last_clean":"2024-04-26T11:26:32.886170+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:32.886170+0000","last_undegraded":"2024-04-26T11:26:32.886170+0000","last_fullsized":"2024-04-26T11:26:32.886170+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887594+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:32.887594+0000","last_peered":"2024-04-26T11:26:32.887594+0000","last_clean":"2024-04-26T11:26:32.887594+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:32.887594+0000","last_undegraded":"2024-04-26T11:26:32.887594+0000","last_fullsized":"2024-04-26T11:26:32.887594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":557,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380978+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:35.380978+0000","last_peered":"2024-04-26T11:26:35.380978+0000","last_clean":"2024-04-26T11:26:35.380978+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:35.380978+0000","last_undegraded":"2024-04-26T11:26:35.380978+0000","last_fullsized":"2024-04-26T11:26:35.380978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":563,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889465+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:32.889465+0000","last_peered":"2024-04-26T11:26:32.889465+0000","last_clean":"2024-04-26T11:26:32.889465+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:32.889465+0000","last_undegraded":"2024-04-26T11:26:32.889465+0000","last_fullsized":"2024-04-26T11:26:32.889465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381195+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:35.381195+0000","last_peered":"2024-04-26T11:26:35.381195+0000","last_clean":"2024-04-26T11:26:35.381195+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:35.381195+0000","last_undegraded":"2024-04-26T11:26:35.381195+0000","last_fullsized":"2024-04-26T11:26:35.381195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":787,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.390862+0000","last_change":"2024-04-26T11:26:35.389500+0000","last_active":"2024-04-26T11:26:35.390862+0000","last_peered":"2024-04-26T11:26:35.390862+0000","last_clean":"2024-04-26T11:26:35.390862+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:26:35.390862+0000","last_undegraded":"2024-04-26T11:26:35.390862+0000","last_fullsized":"2024-04-26T11:26:35.390862+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:56.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":153,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381100+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:35.381100+0000","last_peered":"2024-04-26T11:26:35.381100+0000","last_clean":"2024-04-26T11:26:35.381100+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:35.381100+0000","last_undegraded":"2024-04-26T11:26:35.381100+0000","last_fullsized":"2024-04-26T11:26:35.381100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.384064+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:35.384064+0000","last_peered":"2024-04-26T11:26:35.384064+0000","last_clean":"2024-04-26T11:26:35.384064+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:35.384064+0000","last_undegraded":"2024-04-26T11:26:35.384064+0000","last_fullsized":"2024-04-26T11:26:35.384064+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":812,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381881+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:35.381881+0000","last_peered":"2024-04-26T11:26:35.381881+0000","last_clean":"2024-04-26T11:26:35.381881+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:35.381881+0000","last_undegraded":"2024-04-26T11:26:35.381881+0000","last_fullsized":"2024-04-26T11:26:35.381881+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":156,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380574+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:35.380574+0000","last_peered":"2024-04-26T11:26:35.380574+0000","last_clean":"2024-04-26T11:26:35.380574+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:35.380574+0000","last_undegraded":"2024-04-26T11:26:35.380574+0000","last_fullsized":"2024-04-26T11:26:35.380574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380675+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:35.380675+0000","last_peered":"2024-04-26T11:26:35.380675+0000","last_clean":"2024-04-26T11:26:35.380675+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:35.380675+0000","last_undegraded":"2024-04-26T11:26:35.380675+0000","last_fullsized":"2024-04-26T11:26:35.380675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":541,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:35.378664+0000","last_change":"2024-04-26T11:26:12.748928+0000","last_active":"2024-04-26T11:26:35.378664+0000","last_peered":"2024-04-26T11:26:35.378664+0000","last_clean":"2024-04-26T11:23:20.666513+0000","last_became_active":"2024-04-26T11:26:12.743721+0000","last_became_peered":"2024-04-26T11:26:12.743721+0000","last_unstale":"2024-04-26T11:26:35.378664+0000","last_undegraded":"2024-04-26T11:26:12.621233+0000","last_fullsized":"2024-04-26T11:26:12.616597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:38.029361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":185,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380626+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:35.380626+0000","last_peered":"2024-04-26T11:26:35.380626+0000","last_clean":"2024-04-26T11:26:35.380626+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:35.380626+0000","last_undegraded":"2024-04-26T11:26:35.380626+0000","last_fullsized":"2024-04-26T11:26:35.380626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889850+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:32.889850+0000","last_peered":"2024-04-26T11:26:32.889850+0000","last_clean":"2024-04-26T11:26:32.889850+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:32.889850+0000","last_undegraded":"2024-04-26T11:26:32.889850+0000","last_fullsized":"2024-04-26T11:26:32.889850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":925,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381024+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:35.381024+0000","last_peered":"2024-04-26T11:26:35.381024+0000","last_clean":"2024-04-26T11:26:35.381024+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:35.381024+0000","last_undegraded":"2024-04-26T11:26:35.381024+0000","last_fullsized":"2024-04-26T11:26:35.381024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":505,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.888414+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:32.888414+0000","last_peered":"2024-04-26T11:26:32.888414+0000","last_clean":"2024-04-26T11:26:32.888414+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:32.888414+0000","last_undegraded":"2024-04-26T11:26:32.888414+0000","last_fullsized":"2024-04-26T11:26:32.888414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":484,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889097+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:32.889097+0000","last_peered":"2024-04-26T11:26:32.889097+0000","last_clean":"2024-04-26T11:26:32.889097+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:32.889097+0000","last_undegraded":"2024-04-26T11:26:32.889097+0000","last_fullsized":"2024-04-26T11:26:32.889097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":551,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398225+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:36.398225+0000","last_peered":"2024-04-26T11:26:36.398225+0000","last_clean":"2024-04-26T11:26:36.398225+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:36.398225+0000","last_undegraded":"2024-04-26T11:26:36.398225+0000","last_fullsized":"2024-04-26T11:26:36.398225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":176,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383851+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:35.383851+0000","last_peered":"2024-04-26T11:26:35.383851+0000","last_clean":"2024-04-26T11:26:35.383851+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:35.383851+0000","last_undegraded":"2024-04-26T11:26:35.383851+0000","last_fullsized":"2024-04-26T11:26:35.383851+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":409,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.890229+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:32.890229+0000","last_peered":"2024-04-26T11:26:32.890229+0000","last_clean":"2024-04-26T11:26:32.890229+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:32.890229+0000","last_undegraded":"2024-04-26T11:26:32.890229+0000","last_fullsized":"2024-04-26T11:26:32.890229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":608,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:36.398158+0000","last_change":"2024-04-26T11:26:12.748851+0000","last_active":"2024-04-26T11:26:36.398158+0000","last_peered":"2024-04-26T11:26:36.398158+0000","last_clean":"2024-04-26T11:23:20.666469+0000","last_became_active":"2024-04-26T11:26:12.743007+0000","last_became_peered":"2024-04-26T11:26:12.743007+0000","last_unstale":"2024-04-26T11:26:36.398158+0000","last_undegraded":"2024-04-26T11:26:12.606150+0000","last_fullsized":"2024-04-26T11:26:12.595590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:06.439297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":160,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380328+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:35.380328+0000","last_peered":"2024-04-26T11:26:35.380328+0000","last_clean":"2024-04-26T11:26:35.380328+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:35.380328+0000","last_undegraded":"2024-04-26T11:26:35.380328+0000","last_fullsized":"2024-04-26T11:26:35.380328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":565,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398211+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:36.398211+0000","last_peered":"2024-04-26T11:26:36.398211+0000","last_clean":"2024-04-26T11:26:36.398211+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:36.398211+0000","last_undegraded":"2024-04-26T11:26:36.398211+0000","last_fullsized":"2024-04-26T11:26:36.398211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":787,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383462+0000","last_change":"2024-04-26T11:26:32.372817+0000","last_active":"2024-04-26T11:26:35.383462+0000","last_peered":"2024-04-26T11:26:35.383462+0000","last_clean":"2024-04-26T11:26:35.383462+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:26:35.383462+0000","last_undegraded":"2024-04-26T11:26:35.383462+0000","last_fullsized":"2024-04-26T11:26:35.383462+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:32.214458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":682,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379122+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:35.379122+0000","last_peered":"2024-04-26T11:26:35.379122+0000","last_clean":"2024-04-26T11:26:35.379122+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:35.379122+0000","last_undegraded":"2024-04-26T11:26:35.379122+0000","last_fullsized":"2024-04-26T11:26:35.379122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":917,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380154+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:35.380154+0000","last_peered":"2024-04-26T11:26:35.380154+0000","last_clean":"2024-04-26T11:26:35.380154+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:35.380154+0000","last_undegraded":"2024-04-26T11:26:35.380154+0000","last_fullsized":"2024-04-26T11:26:35.380154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":389,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378742+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:35.378742+0000","last_peered":"2024-04-26T11:26:35.378742+0000","last_clean":"2024-04-26T11:26:35.378742+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:35.378742+0000","last_undegraded":"2024-04-26T11:26:35.378742+0000","last_fullsized":"2024-04-26T11:26:35.378742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1011,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.406522+0000","last_change":"2024-04-26T11:26:36.406522+0000","last_active":"2024-04-26T11:26:36.406522+0000","last_peered":"2024-04-26T11:26:36.406522+0000","last_clean":"2024-04-26T11:26:36.406522+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:26:36.406522+0000","last_undegraded":"2024-04-26T11:26:36.406522+0000","last_fullsized":"2024-04-26T11:26:36.406522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:05.312742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":426,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382724+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:35.382724+0000","last_peered":"2024-04-26T11:26:35.382724+0000","last_clean":"2024-04-26T11:26:35.382724+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:35.382724+0000","last_undegraded":"2024-04-26T11:26:35.382724+0000","last_fullsized":"2024-04-26T11:26:35.382724+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":494,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381867+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:35.381867+0000","last_peered":"2024-04-26T11:26:35.381867+0000","last_clean":"2024-04-26T11:26:35.381867+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:35.381867+0000","last_undegraded":"2024-04-26T11:26:35.381867+0000","last_fullsized":"2024-04-26T11:26:35.381867+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":147,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382238+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:35.382238+0000","last_peered":"2024-04-26T11:26:35.382238+0000","last_clean":"2024-04-26T11:26:35.382238+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:35.382238+0000","last_undegraded":"2024-04-26T11:26:35.382238+0000","last_fullsized":"2024-04-26T11:26:35.382238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":468,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.888180+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:32.888180+0000","last_peered":"2024-04-26T11:26:32.888180+0000","last_clean":"2024-04-26T11:26:32.888180+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:32.888180+0000","last_undegraded":"2024-04-26T11:26:32.888180+0000","last_fullsized":"2024-04-26T11:26:32.888180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":397,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886737+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:32.886737+0000","last_peered":"2024-04-26T11:26:32.886737+0000","last_clean":"2024-04-26T11:26:32.886737+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:32.886737+0000","last_undegraded":"2024-04-26T11:26:32.886737+0000","last_fullsized":"2024-04-26T11:26:32.886737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":484,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:26:33.897091+0000","last_change":"2024-04-26T11:26:31.896245+0000","last_active":"2024-04-26T11:26:33.897091+0000","last_peered":"2024-04-26T11:26:33.897091+0000","last_clean":"2024-04-26T11:26:33.897091+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:26:33.897091+0000","last_undegraded":"2024-04-26T11:26:33.897091+0000","last_fullsized":"2024-04-26T11:26:33.897091+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:59.173436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":492,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383508+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:35.383508+0000","last_peered":"2024-04-26T11:26:35.383508+0000","last_clean":"2024-04-26T11:26:35.383508+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:35.383508+0000","last_undegraded":"2024-04-26T11:26:35.383508+0000","last_fullsized":"2024-04-26T11:26:35.383508+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":493,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381445+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:35.381445+0000","last_peered":"2024-04-26T11:26:35.381445+0000","last_clean":"2024-04-26T11:26:35.381445+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:35.381445+0000","last_undegraded":"2024-04-26T11:26:35.381445+0000","last_fullsized":"2024-04-26T11:26:35.381445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":153,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380382+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:35.380382+0000","last_peered":"2024-04-26T11:26:35.380382+0000","last_clean":"2024-04-26T11:26:35.380382+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:35.380382+0000","last_undegraded":"2024-04-26T11:26:35.380382+0000","last_fullsized":"2024-04-26T11:26:35.380382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":535,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:26:33.906446+0000","last_change":"2024-04-26T11:26:33.905426+0000","last_active":"2024-04-26T11:26:33.906446+0000","last_peered":"2024-04-26T11:26:33.906446+0000","last_clean":"2024-04-26T11:26:33.906446+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:33.906446+0000","last_undegraded":"2024-04-26T11:26:33.906446+0000","last_fullsized":"2024-04-26T11:26:33.906446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:49.659488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":251,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380072+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:35.380072+0000","last_peered":"2024-04-26T11:26:35.380072+0000","last_clean":"2024-04-26T11:26:35.380072+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:35.380072+0000","last_undegraded":"2024-04-26T11:26:35.380072+0000","last_fullsized":"2024-04-26T11:26:35.380072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1143,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6129,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":121,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142392,"kb_used_data":30948,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229448,"statfs":{"total":96636764160,"available":96490954752,"internally_reserved":0,"allocated":31690752,"data_stored":81587312,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.751}]}]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124300,"kb_used_data":30912,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247540,"statfs":{"total":96636764160,"available":96509480960,"internally_reserved":0,"allocated":31653888,"data_stored":86091432,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.623},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66400000000000003}]}]},{"osd":0,"up_from":75,"seq":322122547207,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61908,"kb_used_data":17992,"kb_used_omap":7,"kb_used_meta":43896,"kb_avail":94309932,"statfs":{"total":96636764160,"available":96573370368,"internally_reserved":0,"allocated":18423808,"data_stored":91746807,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":44950519},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:38.115 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:26:38.505 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:38.505 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1143/110 objects degraded (1039.091%), 6 pgs degraded","count":6},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":305,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":103,"num_osds":3,"num_up_osds":3,"osd_up_since":1714130770,"num_in_osds":3,"osd_in_since":1714130493,"num_remapped_pgs":2},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":98},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":6},{"state_name":"active+recovering+undersized+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129078864,"bytes_used":336486400,"bytes_avail":289573806080,"bytes_total":289910292480,"degraded_objects":1143,"degraded_total":110,"degraded_ratio":10.390909090909091,"recovering_objects_per_sec":283,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":1136,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4207}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-26T11:23:01.341628+0000","services":{}},"progress_events":{}} 2024-04-26T11:26:38.522 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:26:38.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:38.815 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:38.817 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:38.832 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-26T11:26:38.366384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1143,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6153,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":203,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":328600,"kb_used_data":79852,"kb_used_omap":10,"kb_used_meta":248693,"kb_avail":282786920,"statfs":{"total":289910292480,"available":289573806080,"internally_reserved":0,"allocated":81768448,"data_stored":259425551,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":254662531},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1089,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1136,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.995064"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":504,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383205+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:35.383205+0000","last_peered":"2024-04-26T11:26:35.383205+0000","last_clean":"2024-04-26T11:26:35.383205+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:35.383205+0000","last_undegraded":"2024-04-26T11:26:35.383205+0000","last_fullsized":"2024-04-26T11:26:35.383205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":560,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382490+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:35.382490+0000","last_peered":"2024-04-26T11:26:35.382490+0000","last_clean":"2024-04-26T11:26:35.382490+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:35.382490+0000","last_undegraded":"2024-04-26T11:26:35.382490+0000","last_fullsized":"2024-04-26T11:26:35.382490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":433,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.895001+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:32.895001+0000","last_peered":"2024-04-26T11:26:32.895001+0000","last_clean":"2024-04-26T11:26:32.895001+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:32.895001+0000","last_undegraded":"2024-04-26T11:26:32.895001+0000","last_fullsized":"2024-04-26T11:26:32.895001+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":482,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886984+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:32.886984+0000","last_peered":"2024-04-26T11:26:32.886984+0000","last_clean":"2024-04-26T11:26:32.886984+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:32.886984+0000","last_undegraded":"2024-04-26T11:26:32.886984+0000","last_fullsized":"2024-04-26T11:26:32.886984+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":535,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381918+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:35.381918+0000","last_peered":"2024-04-26T11:26:35.381918+0000","last_clean":"2024-04-26T11:26:35.381918+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:35.381918+0000","last_undegraded":"2024-04-26T11:26:35.381918+0000","last_fullsized":"2024-04-26T11:26:35.381918+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":486,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887299+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:32.887299+0000","last_peered":"2024-04-26T11:26:32.887299+0000","last_clean":"2024-04-26T11:26:32.887299+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:32.887299+0000","last_undegraded":"2024-04-26T11:26:32.887299+0000","last_fullsized":"2024-04-26T11:26:32.887299+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":587,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886853+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:32.886853+0000","last_peered":"2024-04-26T11:26:32.886853+0000","last_clean":"2024-04-26T11:26:32.886853+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:32.886853+0000","last_undegraded":"2024-04-26T11:26:32.886853+0000","last_fullsized":"2024-04-26T11:26:32.886853+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":455,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886266+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:32.886266+0000","last_peered":"2024-04-26T11:26:32.886266+0000","last_clean":"2024-04-26T11:26:32.886266+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:32.886266+0000","last_undegraded":"2024-04-26T11:26:32.886266+0000","last_fullsized":"2024-04-26T11:26:32.886266+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":591,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379537+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:35.379537+0000","last_peered":"2024-04-26T11:26:35.379537+0000","last_clean":"2024-04-26T11:26:35.379537+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:35.379537+0000","last_undegraded":"2024-04-26T11:26:35.379537+0000","last_fullsized":"2024-04-26T11:26:35.379537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":501,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382628+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:35.382628+0000","last_peered":"2024-04-26T11:26:35.382628+0000","last_clean":"2024-04-26T11:26:35.382628+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:35.382628+0000","last_undegraded":"2024-04-26T11:26:35.382628+0000","last_fullsized":"2024-04-26T11:26:35.382628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":473,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:26:33.898211+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:33.898211+0000","last_peered":"2024-04-26T11:26:33.898211+0000","last_clean":"2024-04-26T11:26:33.898211+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:33.898211+0000","last_undegraded":"2024-04-26T11:26:33.898211+0000","last_fullsized":"2024-04-26T11:26:33.898211+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:07.200544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":777,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381815+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:35.381815+0000","last_peered":"2024-04-26T11:26:35.381815+0000","last_clean":"2024-04-26T11:26:35.381815+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:35.381815+0000","last_undegraded":"2024-04-26T11:26:35.381815+0000","last_fullsized":"2024-04-26T11:26:35.381815+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":448,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381793+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:35.381793+0000","last_peered":"2024-04-26T11:26:35.381793+0000","last_clean":"2024-04-26T11:26:35.381793+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:35.381793+0000","last_undegraded":"2024-04-26T11:26:35.381793+0000","last_fullsized":"2024-04-26T11:26:35.381793+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":475,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887097+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:32.887097+0000","last_peered":"2024-04-26T11:26:32.887097+0000","last_clean":"2024-04-26T11:26:32.887097+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:32.887097+0000","last_undegraded":"2024-04-26T11:26:32.887097+0000","last_fullsized":"2024-04-26T11:26:32.887097+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":531,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886760+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:32.886760+0000","last_peered":"2024-04-26T11:26:32.886760+0000","last_clean":"2024-04-26T11:26:32.886760+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:32.886760+0000","last_undegraded":"2024-04-26T11:26:32.886760+0000","last_fullsized":"2024-04-26T11:26:32.886760+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":596,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886586+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:32.886586+0000","last_peered":"2024-04-26T11:26:32.886586+0000","last_clean":"2024-04-26T11:26:32.886586+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:32.886586+0000","last_undegraded":"2024-04-26T11:26:32.886586+0000","last_fullsized":"2024-04-26T11:26:32.886586+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":572,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.400877+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:36.400877+0000","last_peered":"2024-04-26T11:26:36.400877+0000","last_clean":"2024-04-26T11:26:36.400877+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:36.400877+0000","last_undegraded":"2024-04-26T11:26:36.400877+0000","last_fullsized":"2024-04-26T11:26:36.400877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":579,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382887+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:35.382887+0000","last_peered":"2024-04-26T11:26:35.382887+0000","last_clean":"2024-04-26T11:26:35.382887+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:35.382887+0000","last_undegraded":"2024-04-26T11:26:35.382887+0000","last_fullsized":"2024-04-26T11:26:35.382887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":618,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379941+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:35.379941+0000","last_peered":"2024-04-26T11:26:35.379941+0000","last_clean":"2024-04-26T11:26:35.379941+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:35.379941+0000","last_undegraded":"2024-04-26T11:26:35.379941+0000","last_fullsized":"2024-04-26T11:26:35.379941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":604,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887750+0000","last_change":"2024-04-26T11:26:29.907661+0000","last_active":"2024-04-26T11:26:32.887750+0000","last_peered":"2024-04-26T11:26:32.887750+0000","last_clean":"2024-04-26T11:26:32.887750+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:26:32.887750+0000","last_undegraded":"2024-04-26T11:26:32.887750+0000","last_fullsized":"2024-04-26T11:26:32.887750+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":558,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.378777+0000","last_change":"2024-04-26T11:26:12.748380+0000","last_active":"2024-04-26T11:26:30.378777+0000","last_peered":"2024-04-26T11:26:30.378777+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743161+0000","last_became_peered":"2024-04-26T11:26:12.743161+0000","last_unstale":"2024-04-26T11:26:30.378777+0000","last_undegraded":"2024-04-26T11:26:12.608799+0000","last_fullsized":"2024-04-26T11:26:12.600138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:44.695371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":973,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381275+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:35.381275+0000","last_peered":"2024-04-26T11:26:35.381275+0000","last_clean":"2024-04-26T11:26:35.381275+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:35.381275+0000","last_undegraded":"2024-04-26T11:26:35.381275+0000","last_fullsized":"2024-04-26T11:26:35.381275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:06.847831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":927,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378023+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:35.378023+0000","last_peered":"2024-04-26T11:26:35.378023+0000","last_clean":"2024-04-26T11:26:35.378023+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:35.378023+0000","last_undegraded":"2024-04-26T11:26:35.378023+0000","last_fullsized":"2024-04-26T11:26:35.378023+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":510,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380664+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:35.380664+0000","last_peered":"2024-04-26T11:26:35.380664+0000","last_clean":"2024-04-26T11:26:35.380664+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:35.380664+0000","last_undegraded":"2024-04-26T11:26:35.380664+0000","last_fullsized":"2024-04-26T11:26:35.380664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":943,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383462+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:35.383462+0000","last_peered":"2024-04-26T11:26:35.383462+0000","last_clean":"2024-04-26T11:26:35.383462+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:35.383462+0000","last_undegraded":"2024-04-26T11:26:35.383462+0000","last_fullsized":"2024-04-26T11:26:35.383462+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:04.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1049,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380062+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:35.380062+0000","last_peered":"2024-04-26T11:26:35.380062+0000","last_clean":"2024-04-26T11:26:35.380062+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:35.380062+0000","last_undegraded":"2024-04-26T11:26:35.380062+0000","last_fullsized":"2024-04-26T11:26:35.380062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":551,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.890324+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:32.890324+0000","last_peered":"2024-04-26T11:26:32.890324+0000","last_clean":"2024-04-26T11:26:32.890324+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:32.890324+0000","last_undegraded":"2024-04-26T11:26:32.890324+0000","last_fullsized":"2024-04-26T11:26:32.890324+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":946,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382315+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:35.382315+0000","last_peered":"2024-04-26T11:26:35.382315+0000","last_clean":"2024-04-26T11:26:35.382315+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:35.382315+0000","last_undegraded":"2024-04-26T11:26:35.382315+0000","last_fullsized":"2024-04-26T11:26:35.382315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":503,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381112+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:35.381112+0000","last_peered":"2024-04-26T11:26:35.381112+0000","last_clean":"2024-04-26T11:26:35.381112+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:35.381112+0000","last_undegraded":"2024-04-26T11:26:35.381112+0000","last_fullsized":"2024-04-26T11:26:35.381112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":938,"reported_epoch":101,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T11:26:36.472040+0000","last_change":"2024-04-26T11:26:35.803664+0000","last_active":"2024-04-26T11:26:36.472040+0000","last_peered":"2024-04-26T11:26:36.472040+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.402212+0000","last_became_peered":"2024-04-26T11:26:22.402212+0000","last_unstale":"2024-04-26T11:26:36.472040+0000","last_undegraded":"2024-04-26T11:26:36.472040+0000","last_fullsized":"2024-04-26T11:26:22.371421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:02.822376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":623,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378172+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:35.378172+0000","last_peered":"2024-04-26T11:26:35.378172+0000","last_clean":"2024-04-26T11:26:35.378172+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:35.378172+0000","last_undegraded":"2024-04-26T11:26:35.378172+0000","last_fullsized":"2024-04-26T11:26:35.378172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":517,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:35.378107+0000","last_change":"2024-04-26T11:26:12.752759+0000","last_active":"2024-04-26T11:26:35.378107+0000","last_peered":"2024-04-26T11:26:35.378107+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749360+0000","last_became_peered":"2024-04-26T11:26:12.749360+0000","last_unstale":"2024-04-26T11:26:35.378107+0000","last_undegraded":"2024-04-26T11:26:12.617888+0000","last_fullsized":"2024-04-26T11:26:12.605870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.669370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":480,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382046+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:35.382046+0000","last_peered":"2024-04-26T11:26:35.382046+0000","last_clean":"2024-04-26T11:26:35.382046+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:35.382046+0000","last_undegraded":"2024-04-26T11:26:35.382046+0000","last_fullsized":"2024-04-26T11:26:35.382046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":543,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889152+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:32.889152+0000","last_peered":"2024-04-26T11:26:32.889152+0000","last_clean":"2024-04-26T11:26:32.889152+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:32.889152+0000","last_undegraded":"2024-04-26T11:26:32.889152+0000","last_fullsized":"2024-04-26T11:26:32.889152+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":500,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383361+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:35.383361+0000","last_peered":"2024-04-26T11:26:35.383361+0000","last_clean":"2024-04-26T11:26:35.383361+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:35.383361+0000","last_undegraded":"2024-04-26T11:26:35.383361+0000","last_fullsized":"2024-04-26T11:26:35.383361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":171,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398505+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:36.398505+0000","last_peered":"2024-04-26T11:26:36.398505+0000","last_clean":"2024-04-26T11:26:36.398505+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:36.398505+0000","last_undegraded":"2024-04-26T11:26:36.398505+0000","last_fullsized":"2024-04-26T11:26:36.398505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":992,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380469+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:35.380469+0000","last_peered":"2024-04-26T11:26:35.380469+0000","last_clean":"2024-04-26T11:26:35.380469+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:35.380469+0000","last_undegraded":"2024-04-26T11:26:35.380469+0000","last_fullsized":"2024-04-26T11:26:35.380469+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":159,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.399284+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:36.399284+0000","last_peered":"2024-04-26T11:26:36.399284+0000","last_clean":"2024-04-26T11:26:36.399284+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:36.399284+0000","last_undegraded":"2024-04-26T11:26:36.399284+0000","last_fullsized":"2024-04-26T11:26:36.399284+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":932,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379697+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:35.379697+0000","last_peered":"2024-04-26T11:26:35.379697+0000","last_clean":"2024-04-26T11:26:35.379697+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:35.379697+0000","last_undegraded":"2024-04-26T11:26:35.379697+0000","last_fullsized":"2024-04-26T11:26:35.379697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":45,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.885833+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:32.885833+0000","last_peered":"2024-04-26T11:26:32.885833+0000","last_clean":"2024-04-26T11:26:32.885833+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:32.885833+0000","last_undegraded":"2024-04-26T11:26:32.885833+0000","last_fullsized":"2024-04-26T11:26:32.885833+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":235,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.890716+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:32.890716+0000","last_peered":"2024-04-26T11:26:32.890716+0000","last_clean":"2024-04-26T11:26:32.890716+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:32.890716+0000","last_undegraded":"2024-04-26T11:26:32.890716+0000","last_fullsized":"2024-04-26T11:26:32.890716+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":871,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380782+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:35.380782+0000","last_peered":"2024-04-26T11:26:35.380782+0000","last_clean":"2024-04-26T11:26:35.380782+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:35.380782+0000","last_undegraded":"2024-04-26T11:26:35.380782+0000","last_fullsized":"2024-04-26T11:26:35.380782+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":396,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383151+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:35.383151+0000","last_peered":"2024-04-26T11:26:35.383151+0000","last_clean":"2024-04-26T11:26:35.383151+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:35.383151+0000","last_undegraded":"2024-04-26T11:26:35.383151+0000","last_fullsized":"2024-04-26T11:26:35.383151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":575,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380939+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:35.380939+0000","last_peered":"2024-04-26T11:26:35.380939+0000","last_clean":"2024-04-26T11:26:35.380939+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:35.380939+0000","last_undegraded":"2024-04-26T11:26:35.380939+0000","last_fullsized":"2024-04-26T11:26:35.380939+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":638,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889867+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:32.889867+0000","last_peered":"2024-04-26T11:26:32.889867+0000","last_clean":"2024-04-26T11:26:32.889867+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:32.889867+0000","last_undegraded":"2024-04-26T11:26:32.889867+0000","last_fullsized":"2024-04-26T11:26:32.889867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":547,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:35.379035+0000","last_change":"2024-04-26T11:26:12.752679+0000","last_active":"2024-04-26T11:26:35.379035+0000","last_peered":"2024-04-26T11:26:35.379035+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749414+0000","last_became_peered":"2024-04-26T11:26:12.749414+0000","last_unstale":"2024-04-26T11:26:35.379035+0000","last_undegraded":"2024-04-26T11:26:12.616453+0000","last_fullsized":"2024-04-26T11:26:12.605189+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:29.120239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887264+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:32.887264+0000","last_peered":"2024-04-26T11:26:32.887264+0000","last_clean":"2024-04-26T11:26:32.887264+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:32.887264+0000","last_undegraded":"2024-04-26T11:26:32.887264+0000","last_fullsized":"2024-04-26T11:26:32.887264+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":953,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381229+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:35.381229+0000","last_peered":"2024-04-26T11:26:35.381229+0000","last_clean":"2024-04-26T11:26:35.381229+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:35.381229+0000","last_undegraded":"2024-04-26T11:26:35.381229+0000","last_fullsized":"2024-04-26T11:26:35.381229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":305,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381449+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:35.381449+0000","last_peered":"2024-04-26T11:26:35.381449+0000","last_clean":"2024-04-26T11:26:35.381449+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:35.381449+0000","last_undegraded":"2024-04-26T11:26:35.381449+0000","last_fullsized":"2024-04-26T11:26:35.381449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":535,"reported_epoch":95,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:30.378751+0000","last_change":"2024-04-26T11:26:12.748367+0000","last_active":"2024-04-26T11:26:30.378751+0000","last_peered":"2024-04-26T11:26:30.378751+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.743318+0000","last_became_peered":"2024-04-26T11:26:12.743318+0000","last_unstale":"2024-04-26T11:26:30.378751+0000","last_undegraded":"2024-04-26T11:26:12.617383+0000","last_fullsized":"2024-04-26T11:26:12.604987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:55.161415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":288,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886677+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:32.886677+0000","last_peered":"2024-04-26T11:26:32.886677+0000","last_clean":"2024-04-26T11:26:32.886677+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:32.886677+0000","last_undegraded":"2024-04-26T11:26:32.886677+0000","last_fullsized":"2024-04-26T11:26:32.886677+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":464,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889788+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:32.889788+0000","last_peered":"2024-04-26T11:26:32.889788+0000","last_clean":"2024-04-26T11:26:32.889788+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:32.889788+0000","last_undegraded":"2024-04-26T11:26:32.889788+0000","last_fullsized":"2024-04-26T11:26:32.889788+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":146,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381273+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:35.381273+0000","last_peered":"2024-04-26T11:26:35.381273+0000","last_clean":"2024-04-26T11:26:35.381273+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:35.381273+0000","last_undegraded":"2024-04-26T11:26:35.381273+0000","last_fullsized":"2024-04-26T11:26:35.381273+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":439,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.890673+0000","last_change":"2024-04-26T11:26:29.914048+0000","last_active":"2024-04-26T11:26:32.890673+0000","last_peered":"2024-04-26T11:26:32.890673+0000","last_clean":"2024-04-26T11:26:32.890673+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:26:32.890673+0000","last_undegraded":"2024-04-26T11:26:32.890673+0000","last_fullsized":"2024-04-26T11:26:32.890673+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":347,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380904+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:35.380904+0000","last_peered":"2024-04-26T11:26:35.380904+0000","last_clean":"2024-04-26T11:26:35.380904+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:35.380904+0000","last_undegraded":"2024-04-26T11:26:35.380904+0000","last_fullsized":"2024-04-26T11:26:35.380904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":548,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379783+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:35.379783+0000","last_peered":"2024-04-26T11:26:35.379783+0000","last_clean":"2024-04-26T11:26:35.379783+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:35.379783+0000","last_undegraded":"2024-04-26T11:26:35.379783+0000","last_fullsized":"2024-04-26T11:26:35.379783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":240,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.885752+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:32.885752+0000","last_peered":"2024-04-26T11:26:32.885752+0000","last_clean":"2024-04-26T11:26:32.885752+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:32.885752+0000","last_undegraded":"2024-04-26T11:26:32.885752+0000","last_fullsized":"2024-04-26T11:26:32.885752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887349+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:32.887349+0000","last_peered":"2024-04-26T11:26:32.887349+0000","last_clean":"2024-04-26T11:26:32.887349+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:32.887349+0000","last_undegraded":"2024-04-26T11:26:32.887349+0000","last_fullsized":"2024-04-26T11:26:32.887349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":846,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379142+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:35.379142+0000","last_peered":"2024-04-26T11:26:35.379142+0000","last_clean":"2024-04-26T11:26:35.379142+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:35.379142+0000","last_undegraded":"2024-04-26T11:26:35.379142+0000","last_fullsized":"2024-04-26T11:26:35.379142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":507,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.890104+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:32.890104+0000","last_peered":"2024-04-26T11:26:32.890104+0000","last_clean":"2024-04-26T11:26:32.890104+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:32.890104+0000","last_undegraded":"2024-04-26T11:26:32.890104+0000","last_fullsized":"2024-04-26T11:26:32.890104+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886295+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:32.886295+0000","last_peered":"2024-04-26T11:26:32.886295+0000","last_clean":"2024-04-26T11:26:32.886295+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:32.886295+0000","last_undegraded":"2024-04-26T11:26:32.886295+0000","last_fullsized":"2024-04-26T11:26:32.886295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":287,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378949+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:35.378949+0000","last_peered":"2024-04-26T11:26:35.378949+0000","last_clean":"2024-04-26T11:26:35.378949+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:35.378949+0000","last_undegraded":"2024-04-26T11:26:35.378949+0000","last_fullsized":"2024-04-26T11:26:35.378949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":557,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382763+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:35.382763+0000","last_peered":"2024-04-26T11:26:35.382763+0000","last_clean":"2024-04-26T11:26:35.382763+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:35.382763+0000","last_undegraded":"2024-04-26T11:26:35.382763+0000","last_fullsized":"2024-04-26T11:26:35.382763+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379241+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:35.379241+0000","last_peered":"2024-04-26T11:26:35.379241+0000","last_clean":"2024-04-26T11:26:35.379241+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:35.379241+0000","last_undegraded":"2024-04-26T11:26:35.379241+0000","last_fullsized":"2024-04-26T11:26:35.379241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":477,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381040+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:35.381040+0000","last_peered":"2024-04-26T11:26:35.381040+0000","last_clean":"2024-04-26T11:26:35.381040+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:35.381040+0000","last_undegraded":"2024-04-26T11:26:35.381040+0000","last_fullsized":"2024-04-26T11:26:35.381040+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":448,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379961+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:35.379961+0000","last_peered":"2024-04-26T11:26:35.379961+0000","last_clean":"2024-04-26T11:26:35.379961+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:35.379961+0000","last_undegraded":"2024-04-26T11:26:35.379961+0000","last_fullsized":"2024-04-26T11:26:35.379961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886170+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:32.886170+0000","last_peered":"2024-04-26T11:26:32.886170+0000","last_clean":"2024-04-26T11:26:32.886170+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:32.886170+0000","last_undegraded":"2024-04-26T11:26:32.886170+0000","last_fullsized":"2024-04-26T11:26:32.886170+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.887594+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:32.887594+0000","last_peered":"2024-04-26T11:26:32.887594+0000","last_clean":"2024-04-26T11:26:32.887594+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:32.887594+0000","last_undegraded":"2024-04-26T11:26:32.887594+0000","last_fullsized":"2024-04-26T11:26:32.887594+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":557,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380978+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:35.380978+0000","last_peered":"2024-04-26T11:26:35.380978+0000","last_clean":"2024-04-26T11:26:35.380978+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:35.380978+0000","last_undegraded":"2024-04-26T11:26:35.380978+0000","last_fullsized":"2024-04-26T11:26:35.380978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":563,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889465+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:32.889465+0000","last_peered":"2024-04-26T11:26:32.889465+0000","last_clean":"2024-04-26T11:26:32.889465+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:32.889465+0000","last_undegraded":"2024-04-26T11:26:32.889465+0000","last_fullsized":"2024-04-26T11:26:32.889465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381195+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:35.381195+0000","last_peered":"2024-04-26T11:26:35.381195+0000","last_clean":"2024-04-26T11:26:35.381195+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:35.381195+0000","last_undegraded":"2024-04-26T11:26:35.381195+0000","last_fullsized":"2024-04-26T11:26:35.381195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":787,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.390862+0000","last_change":"2024-04-26T11:26:35.389500+0000","last_active":"2024-04-26T11:26:35.390862+0000","last_peered":"2024-04-26T11:26:35.390862+0000","last_clean":"2024-04-26T11:26:35.390862+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:26:35.390862+0000","last_undegraded":"2024-04-26T11:26:35.390862+0000","last_fullsized":"2024-04-26T11:26:35.390862+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:56.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":153,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381100+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:35.381100+0000","last_peered":"2024-04-26T11:26:35.381100+0000","last_clean":"2024-04-26T11:26:35.381100+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:35.381100+0000","last_undegraded":"2024-04-26T11:26:35.381100+0000","last_fullsized":"2024-04-26T11:26:35.381100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.384064+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:35.384064+0000","last_peered":"2024-04-26T11:26:35.384064+0000","last_clean":"2024-04-26T11:26:35.384064+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:35.384064+0000","last_undegraded":"2024-04-26T11:26:35.384064+0000","last_fullsized":"2024-04-26T11:26:35.384064+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":812,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381881+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:35.381881+0000","last_peered":"2024-04-26T11:26:35.381881+0000","last_clean":"2024-04-26T11:26:35.381881+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:35.381881+0000","last_undegraded":"2024-04-26T11:26:35.381881+0000","last_fullsized":"2024-04-26T11:26:35.381881+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":156,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380574+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:35.380574+0000","last_peered":"2024-04-26T11:26:35.380574+0000","last_clean":"2024-04-26T11:26:35.380574+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:35.380574+0000","last_undegraded":"2024-04-26T11:26:35.380574+0000","last_fullsized":"2024-04-26T11:26:35.380574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380675+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:35.380675+0000","last_peered":"2024-04-26T11:26:35.380675+0000","last_clean":"2024-04-26T11:26:35.380675+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:35.380675+0000","last_undegraded":"2024-04-26T11:26:35.380675+0000","last_fullsized":"2024-04-26T11:26:35.380675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":541,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:35.378664+0000","last_change":"2024-04-26T11:26:12.748928+0000","last_active":"2024-04-26T11:26:35.378664+0000","last_peered":"2024-04-26T11:26:35.378664+0000","last_clean":"2024-04-26T11:23:20.666513+0000","last_became_active":"2024-04-26T11:26:12.743721+0000","last_became_peered":"2024-04-26T11:26:12.743721+0000","last_unstale":"2024-04-26T11:26:35.378664+0000","last_undegraded":"2024-04-26T11:26:12.621233+0000","last_fullsized":"2024-04-26T11:26:12.616597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:38.029361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":185,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380626+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:35.380626+0000","last_peered":"2024-04-26T11:26:35.380626+0000","last_clean":"2024-04-26T11:26:35.380626+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:35.380626+0000","last_undegraded":"2024-04-26T11:26:35.380626+0000","last_fullsized":"2024-04-26T11:26:35.380626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889850+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:32.889850+0000","last_peered":"2024-04-26T11:26:32.889850+0000","last_clean":"2024-04-26T11:26:32.889850+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:32.889850+0000","last_undegraded":"2024-04-26T11:26:32.889850+0000","last_fullsized":"2024-04-26T11:26:32.889850+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":925,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381024+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:35.381024+0000","last_peered":"2024-04-26T11:26:35.381024+0000","last_clean":"2024-04-26T11:26:35.381024+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:35.381024+0000","last_undegraded":"2024-04-26T11:26:35.381024+0000","last_fullsized":"2024-04-26T11:26:35.381024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":505,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.888414+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:32.888414+0000","last_peered":"2024-04-26T11:26:32.888414+0000","last_clean":"2024-04-26T11:26:32.888414+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:32.888414+0000","last_undegraded":"2024-04-26T11:26:32.888414+0000","last_fullsized":"2024-04-26T11:26:32.888414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":484,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.889097+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:32.889097+0000","last_peered":"2024-04-26T11:26:32.889097+0000","last_clean":"2024-04-26T11:26:32.889097+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:32.889097+0000","last_undegraded":"2024-04-26T11:26:32.889097+0000","last_fullsized":"2024-04-26T11:26:32.889097+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":551,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398225+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:36.398225+0000","last_peered":"2024-04-26T11:26:36.398225+0000","last_clean":"2024-04-26T11:26:36.398225+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:36.398225+0000","last_undegraded":"2024-04-26T11:26:36.398225+0000","last_fullsized":"2024-04-26T11:26:36.398225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":176,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383851+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:35.383851+0000","last_peered":"2024-04-26T11:26:35.383851+0000","last_clean":"2024-04-26T11:26:35.383851+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:35.383851+0000","last_undegraded":"2024-04-26T11:26:35.383851+0000","last_fullsized":"2024-04-26T11:26:35.383851+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":409,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.890229+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:32.890229+0000","last_peered":"2024-04-26T11:26:32.890229+0000","last_clean":"2024-04-26T11:26:32.890229+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:32.890229+0000","last_undegraded":"2024-04-26T11:26:32.890229+0000","last_fullsized":"2024-04-26T11:26:32.890229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":608,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:36.398158+0000","last_change":"2024-04-26T11:26:12.748851+0000","last_active":"2024-04-26T11:26:36.398158+0000","last_peered":"2024-04-26T11:26:36.398158+0000","last_clean":"2024-04-26T11:23:20.666469+0000","last_became_active":"2024-04-26T11:26:12.743007+0000","last_became_peered":"2024-04-26T11:26:12.743007+0000","last_unstale":"2024-04-26T11:26:36.398158+0000","last_undegraded":"2024-04-26T11:26:12.606150+0000","last_fullsized":"2024-04-26T11:26:12.595590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:06.439297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":160,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380328+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:35.380328+0000","last_peered":"2024-04-26T11:26:35.380328+0000","last_clean":"2024-04-26T11:26:35.380328+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:35.380328+0000","last_undegraded":"2024-04-26T11:26:35.380328+0000","last_fullsized":"2024-04-26T11:26:35.380328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":565,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398211+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:36.398211+0000","last_peered":"2024-04-26T11:26:36.398211+0000","last_clean":"2024-04-26T11:26:36.398211+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:36.398211+0000","last_undegraded":"2024-04-26T11:26:36.398211+0000","last_fullsized":"2024-04-26T11:26:36.398211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":787,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383462+0000","last_change":"2024-04-26T11:26:32.372817+0000","last_active":"2024-04-26T11:26:35.383462+0000","last_peered":"2024-04-26T11:26:35.383462+0000","last_clean":"2024-04-26T11:26:35.383462+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:26:35.383462+0000","last_undegraded":"2024-04-26T11:26:35.383462+0000","last_fullsized":"2024-04-26T11:26:35.383462+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:32.214458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":682,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379122+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:35.379122+0000","last_peered":"2024-04-26T11:26:35.379122+0000","last_clean":"2024-04-26T11:26:35.379122+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:35.379122+0000","last_undegraded":"2024-04-26T11:26:35.379122+0000","last_fullsized":"2024-04-26T11:26:35.379122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":917,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380154+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:35.380154+0000","last_peered":"2024-04-26T11:26:35.380154+0000","last_clean":"2024-04-26T11:26:35.380154+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:35.380154+0000","last_undegraded":"2024-04-26T11:26:35.380154+0000","last_fullsized":"2024-04-26T11:26:35.380154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":389,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378742+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:35.378742+0000","last_peered":"2024-04-26T11:26:35.378742+0000","last_clean":"2024-04-26T11:26:35.378742+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:35.378742+0000","last_undegraded":"2024-04-26T11:26:35.378742+0000","last_fullsized":"2024-04-26T11:26:35.378742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1011,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.406522+0000","last_change":"2024-04-26T11:26:36.406522+0000","last_active":"2024-04-26T11:26:36.406522+0000","last_peered":"2024-04-26T11:26:36.406522+0000","last_clean":"2024-04-26T11:26:36.406522+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:26:36.406522+0000","last_undegraded":"2024-04-26T11:26:36.406522+0000","last_fullsized":"2024-04-26T11:26:36.406522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:05.312742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":426,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382724+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:35.382724+0000","last_peered":"2024-04-26T11:26:35.382724+0000","last_clean":"2024-04-26T11:26:35.382724+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:35.382724+0000","last_undegraded":"2024-04-26T11:26:35.382724+0000","last_fullsized":"2024-04-26T11:26:35.382724+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":494,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381867+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:35.381867+0000","last_peered":"2024-04-26T11:26:35.381867+0000","last_clean":"2024-04-26T11:26:35.381867+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:35.381867+0000","last_undegraded":"2024-04-26T11:26:35.381867+0000","last_fullsized":"2024-04-26T11:26:35.381867+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":147,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382238+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:35.382238+0000","last_peered":"2024-04-26T11:26:35.382238+0000","last_clean":"2024-04-26T11:26:35.382238+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:35.382238+0000","last_undegraded":"2024-04-26T11:26:35.382238+0000","last_fullsized":"2024-04-26T11:26:35.382238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":468,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.888180+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:32.888180+0000","last_peered":"2024-04-26T11:26:32.888180+0000","last_clean":"2024-04-26T11:26:32.888180+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:32.888180+0000","last_undegraded":"2024-04-26T11:26:32.888180+0000","last_fullsized":"2024-04-26T11:26:32.888180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":397,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-04-26T11:26:32.886737+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:32.886737+0000","last_peered":"2024-04-26T11:26:32.886737+0000","last_clean":"2024-04-26T11:26:32.886737+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:32.886737+0000","last_undegraded":"2024-04-26T11:26:32.886737+0000","last_fullsized":"2024-04-26T11:26:32.886737+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":484,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:26:33.897091+0000","last_change":"2024-04-26T11:26:31.896245+0000","last_active":"2024-04-26T11:26:33.897091+0000","last_peered":"2024-04-26T11:26:33.897091+0000","last_clean":"2024-04-26T11:26:33.897091+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:26:33.897091+0000","last_undegraded":"2024-04-26T11:26:33.897091+0000","last_fullsized":"2024-04-26T11:26:33.897091+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:59.173436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":492,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383508+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:35.383508+0000","last_peered":"2024-04-26T11:26:35.383508+0000","last_clean":"2024-04-26T11:26:35.383508+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:35.383508+0000","last_undegraded":"2024-04-26T11:26:35.383508+0000","last_fullsized":"2024-04-26T11:26:35.383508+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":493,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381445+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:35.381445+0000","last_peered":"2024-04-26T11:26:35.381445+0000","last_clean":"2024-04-26T11:26:35.381445+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:35.381445+0000","last_undegraded":"2024-04-26T11:26:35.381445+0000","last_fullsized":"2024-04-26T11:26:35.381445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":153,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380382+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:35.380382+0000","last_peered":"2024-04-26T11:26:35.380382+0000","last_clean":"2024-04-26T11:26:35.380382+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:35.380382+0000","last_undegraded":"2024-04-26T11:26:35.380382+0000","last_fullsized":"2024-04-26T11:26:35.380382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":535,"reported_epoch":99,"state":"active+clean","last_fresh":"2024-04-26T11:26:33.906446+0000","last_change":"2024-04-26T11:26:33.905426+0000","last_active":"2024-04-26T11:26:33.906446+0000","last_peered":"2024-04-26T11:26:33.906446+0000","last_clean":"2024-04-26T11:26:33.906446+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:33.906446+0000","last_undegraded":"2024-04-26T11:26:33.906446+0000","last_fullsized":"2024-04-26T11:26:33.906446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:49.659488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":251,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380072+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:35.380072+0000","last_peered":"2024-04-26T11:26:35.380072+0000","last_clean":"2024-04-26T11:26:35.380072+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:35.380072+0000","last_undegraded":"2024-04-26T11:26:35.380072+0000","last_fullsized":"2024-04-26T11:26:35.380072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1143,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6129,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":121,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142392,"kb_used_data":30948,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229448,"statfs":{"total":96636764160,"available":96490954752,"internally_reserved":0,"allocated":31690752,"data_stored":81587312,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.751}]}]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124300,"kb_used_data":30912,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247540,"statfs":{"total":96636764160,"available":96509480960,"internally_reserved":0,"allocated":31653888,"data_stored":86091432,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.623},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66400000000000003}]}]},{"osd":0,"up_from":75,"seq":322122547207,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61908,"kb_used_data":17992,"kb_used_omap":7,"kb_used_meta":43896,"kb_avail":94309932,"statfs":{"total":96636764160,"available":96573370368,"internally_reserved":0,"allocated":18423808,"data_stored":91746807,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":44950519},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:41.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:42.155 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:42.157 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:42.174 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-26T11:26:41.452613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":576,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6720,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":206,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":338504,"kb_used_data":79904,"kb_used_omap":10,"kb_used_meta":258549,"kb_avail":282777016,"statfs":{"total":289910292480,"available":289563664384,"internally_reserved":0,"allocated":81821696,"data_stored":259447514,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":264755075},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-567,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":567,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001448"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":504,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383205+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:35.383205+0000","last_peered":"2024-04-26T11:26:35.383205+0000","last_clean":"2024-04-26T11:26:35.383205+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:35.383205+0000","last_undegraded":"2024-04-26T11:26:35.383205+0000","last_fullsized":"2024-04-26T11:26:35.383205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":560,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382490+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:35.382490+0000","last_peered":"2024-04-26T11:26:35.382490+0000","last_clean":"2024-04-26T11:26:35.382490+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:35.382490+0000","last_undegraded":"2024-04-26T11:26:35.382490+0000","last_fullsized":"2024-04-26T11:26:35.382490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":438,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890627+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:37.890627+0000","last_peered":"2024-04-26T11:26:37.890627+0000","last_clean":"2024-04-26T11:26:37.890627+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:37.890627+0000","last_undegraded":"2024-04-26T11:26:37.890627+0000","last_fullsized":"2024-04-26T11:26:37.890627+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":487,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889875+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:37.889875+0000","last_peered":"2024-04-26T11:26:37.889875+0000","last_clean":"2024-04-26T11:26:37.889875+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:37.889875+0000","last_undegraded":"2024-04-26T11:26:37.889875+0000","last_fullsized":"2024-04-26T11:26:37.889875+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":535,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381918+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:35.381918+0000","last_peered":"2024-04-26T11:26:35.381918+0000","last_clean":"2024-04-26T11:26:35.381918+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:35.381918+0000","last_undegraded":"2024-04-26T11:26:35.381918+0000","last_fullsized":"2024-04-26T11:26:35.381918+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":491,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890544+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:37.890544+0000","last_peered":"2024-04-26T11:26:37.890544+0000","last_clean":"2024-04-26T11:26:37.890544+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:37.890544+0000","last_undegraded":"2024-04-26T11:26:37.890544+0000","last_fullsized":"2024-04-26T11:26:37.890544+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":592,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889228+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:37.889228+0000","last_peered":"2024-04-26T11:26:37.889228+0000","last_clean":"2024-04-26T11:26:37.889228+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:37.889228+0000","last_undegraded":"2024-04-26T11:26:37.889228+0000","last_fullsized":"2024-04-26T11:26:37.889228+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":460,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888774+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:37.888774+0000","last_peered":"2024-04-26T11:26:37.888774+0000","last_clean":"2024-04-26T11:26:37.888774+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:37.888774+0000","last_undegraded":"2024-04-26T11:26:37.888774+0000","last_fullsized":"2024-04-26T11:26:37.888774+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":591,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379537+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:35.379537+0000","last_peered":"2024-04-26T11:26:35.379537+0000","last_clean":"2024-04-26T11:26:35.379537+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:35.379537+0000","last_undegraded":"2024-04-26T11:26:35.379537+0000","last_fullsized":"2024-04-26T11:26:35.379537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":501,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382628+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:35.382628+0000","last_peered":"2024-04-26T11:26:35.382628+0000","last_clean":"2024-04-26T11:26:35.382628+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:35.382628+0000","last_undegraded":"2024-04-26T11:26:35.382628+0000","last_fullsized":"2024-04-26T11:26:35.382628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":478,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890430+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:37.890430+0000","last_peered":"2024-04-26T11:26:37.890430+0000","last_clean":"2024-04-26T11:26:37.890430+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:37.890430+0000","last_undegraded":"2024-04-26T11:26:37.890430+0000","last_fullsized":"2024-04-26T11:26:37.890430+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:07.200544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":777,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381815+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:35.381815+0000","last_peered":"2024-04-26T11:26:35.381815+0000","last_clean":"2024-04-26T11:26:35.381815+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:35.381815+0000","last_undegraded":"2024-04-26T11:26:35.381815+0000","last_fullsized":"2024-04-26T11:26:35.381815+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":448,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381793+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:35.381793+0000","last_peered":"2024-04-26T11:26:35.381793+0000","last_clean":"2024-04-26T11:26:35.381793+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:35.381793+0000","last_undegraded":"2024-04-26T11:26:35.381793+0000","last_fullsized":"2024-04-26T11:26:35.381793+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":480,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889976+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:37.889976+0000","last_peered":"2024-04-26T11:26:37.889976+0000","last_clean":"2024-04-26T11:26:37.889976+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:37.889976+0000","last_undegraded":"2024-04-26T11:26:37.889976+0000","last_fullsized":"2024-04-26T11:26:37.889976+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":536,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888992+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:37.888992+0000","last_peered":"2024-04-26T11:26:37.888992+0000","last_clean":"2024-04-26T11:26:37.888992+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:37.888992+0000","last_undegraded":"2024-04-26T11:26:37.888992+0000","last_fullsized":"2024-04-26T11:26:37.888992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":601,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889741+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:37.889741+0000","last_peered":"2024-04-26T11:26:37.889741+0000","last_clean":"2024-04-26T11:26:37.889741+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:37.889741+0000","last_undegraded":"2024-04-26T11:26:37.889741+0000","last_fullsized":"2024-04-26T11:26:37.889741+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":572,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.400877+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:36.400877+0000","last_peered":"2024-04-26T11:26:36.400877+0000","last_clean":"2024-04-26T11:26:36.400877+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:36.400877+0000","last_undegraded":"2024-04-26T11:26:36.400877+0000","last_fullsized":"2024-04-26T11:26:36.400877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":579,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382887+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:35.382887+0000","last_peered":"2024-04-26T11:26:35.382887+0000","last_clean":"2024-04-26T11:26:35.382887+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:35.382887+0000","last_undegraded":"2024-04-26T11:26:35.382887+0000","last_fullsized":"2024-04-26T11:26:35.382887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":618,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379941+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:35.379941+0000","last_peered":"2024-04-26T11:26:35.379941+0000","last_clean":"2024-04-26T11:26:35.379941+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:35.379941+0000","last_undegraded":"2024-04-26T11:26:35.379941+0000","last_fullsized":"2024-04-26T11:26:35.379941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":609,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890832+0000","last_change":"2024-04-26T11:26:29.907661+0000","last_active":"2024-04-26T11:26:37.890832+0000","last_peered":"2024-04-26T11:26:37.890832+0000","last_clean":"2024-04-26T11:26:37.890832+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:26:37.890832+0000","last_undegraded":"2024-04-26T11:26:37.890832+0000","last_fullsized":"2024-04-26T11:26:37.890832+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":547,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:26:38.893504+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:38.893504+0000","last_peered":"2024-04-26T11:26:38.893504+0000","last_clean":"2024-04-26T11:26:38.893504+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:38.893504+0000","last_undegraded":"2024-04-26T11:26:38.893504+0000","last_fullsized":"2024-04-26T11:26:38.893504+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.393282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":973,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381275+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:35.381275+0000","last_peered":"2024-04-26T11:26:35.381275+0000","last_clean":"2024-04-26T11:26:35.381275+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:35.381275+0000","last_undegraded":"2024-04-26T11:26:35.381275+0000","last_fullsized":"2024-04-26T11:26:35.381275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:06.847831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":927,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378023+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:35.378023+0000","last_peered":"2024-04-26T11:26:35.378023+0000","last_clean":"2024-04-26T11:26:35.378023+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:35.378023+0000","last_undegraded":"2024-04-26T11:26:35.378023+0000","last_fullsized":"2024-04-26T11:26:35.378023+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":510,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380664+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:35.380664+0000","last_peered":"2024-04-26T11:26:35.380664+0000","last_clean":"2024-04-26T11:26:35.380664+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:35.380664+0000","last_undegraded":"2024-04-26T11:26:35.380664+0000","last_fullsized":"2024-04-26T11:26:35.380664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":943,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383462+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:35.383462+0000","last_peered":"2024-04-26T11:26:35.383462+0000","last_clean":"2024-04-26T11:26:35.383462+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:35.383462+0000","last_undegraded":"2024-04-26T11:26:35.383462+0000","last_fullsized":"2024-04-26T11:26:35.383462+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:04.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1049,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380062+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:35.380062+0000","last_peered":"2024-04-26T11:26:35.380062+0000","last_clean":"2024-04-26T11:26:35.380062+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:35.380062+0000","last_undegraded":"2024-04-26T11:26:35.380062+0000","last_fullsized":"2024-04-26T11:26:35.380062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":556,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890345+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:37.890345+0000","last_peered":"2024-04-26T11:26:37.890345+0000","last_clean":"2024-04-26T11:26:37.890345+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:37.890345+0000","last_undegraded":"2024-04-26T11:26:37.890345+0000","last_fullsized":"2024-04-26T11:26:37.890345+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":946,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382315+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:35.382315+0000","last_peered":"2024-04-26T11:26:35.382315+0000","last_clean":"2024-04-26T11:26:35.382315+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:35.382315+0000","last_undegraded":"2024-04-26T11:26:35.382315+0000","last_fullsized":"2024-04-26T11:26:35.382315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":503,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381112+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:35.381112+0000","last_peered":"2024-04-26T11:26:35.381112+0000","last_clean":"2024-04-26T11:26:35.381112+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:35.381112+0000","last_undegraded":"2024-04-26T11:26:35.381112+0000","last_fullsized":"2024-04-26T11:26:35.381112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":938,"reported_epoch":101,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T11:26:36.472040+0000","last_change":"2024-04-26T11:26:35.803664+0000","last_active":"2024-04-26T11:26:36.472040+0000","last_peered":"2024-04-26T11:26:36.472040+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.402212+0000","last_became_peered":"2024-04-26T11:26:22.402212+0000","last_unstale":"2024-04-26T11:26:36.472040+0000","last_undegraded":"2024-04-26T11:26:36.472040+0000","last_fullsized":"2024-04-26T11:26:22.371421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:02.822376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":623,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378172+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:35.378172+0000","last_peered":"2024-04-26T11:26:35.378172+0000","last_clean":"2024-04-26T11:26:35.378172+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:35.378172+0000","last_undegraded":"2024-04-26T11:26:35.378172+0000","last_fullsized":"2024-04-26T11:26:35.378172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":517,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:35.378107+0000","last_change":"2024-04-26T11:26:12.752759+0000","last_active":"2024-04-26T11:26:35.378107+0000","last_peered":"2024-04-26T11:26:35.378107+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749360+0000","last_became_peered":"2024-04-26T11:26:12.749360+0000","last_unstale":"2024-04-26T11:26:35.378107+0000","last_undegraded":"2024-04-26T11:26:12.617888+0000","last_fullsized":"2024-04-26T11:26:12.605870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.669370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":480,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382046+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:35.382046+0000","last_peered":"2024-04-26T11:26:35.382046+0000","last_clean":"2024-04-26T11:26:35.382046+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:35.382046+0000","last_undegraded":"2024-04-26T11:26:35.382046+0000","last_fullsized":"2024-04-26T11:26:35.382046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":548,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889251+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:37.889251+0000","last_peered":"2024-04-26T11:26:37.889251+0000","last_clean":"2024-04-26T11:26:37.889251+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:37.889251+0000","last_undegraded":"2024-04-26T11:26:37.889251+0000","last_fullsized":"2024-04-26T11:26:37.889251+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":500,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383361+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:35.383361+0000","last_peered":"2024-04-26T11:26:35.383361+0000","last_clean":"2024-04-26T11:26:35.383361+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:35.383361+0000","last_undegraded":"2024-04-26T11:26:35.383361+0000","last_fullsized":"2024-04-26T11:26:35.383361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":171,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398505+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:36.398505+0000","last_peered":"2024-04-26T11:26:36.398505+0000","last_clean":"2024-04-26T11:26:36.398505+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:36.398505+0000","last_undegraded":"2024-04-26T11:26:36.398505+0000","last_fullsized":"2024-04-26T11:26:36.398505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":992,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380469+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:35.380469+0000","last_peered":"2024-04-26T11:26:35.380469+0000","last_clean":"2024-04-26T11:26:35.380469+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:35.380469+0000","last_undegraded":"2024-04-26T11:26:35.380469+0000","last_fullsized":"2024-04-26T11:26:35.380469+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":159,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.399284+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:36.399284+0000","last_peered":"2024-04-26T11:26:36.399284+0000","last_clean":"2024-04-26T11:26:36.399284+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:36.399284+0000","last_undegraded":"2024-04-26T11:26:36.399284+0000","last_fullsized":"2024-04-26T11:26:36.399284+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":932,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379697+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:35.379697+0000","last_peered":"2024-04-26T11:26:35.379697+0000","last_clean":"2024-04-26T11:26:35.379697+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:35.379697+0000","last_undegraded":"2024-04-26T11:26:35.379697+0000","last_fullsized":"2024-04-26T11:26:35.379697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":50,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888508+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:37.888508+0000","last_peered":"2024-04-26T11:26:37.888508+0000","last_clean":"2024-04-26T11:26:37.888508+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:37.888508+0000","last_undegraded":"2024-04-26T11:26:37.888508+0000","last_fullsized":"2024-04-26T11:26:37.888508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":240,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.891200+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:37.891200+0000","last_peered":"2024-04-26T11:26:37.891200+0000","last_clean":"2024-04-26T11:26:37.891200+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:37.891200+0000","last_undegraded":"2024-04-26T11:26:37.891200+0000","last_fullsized":"2024-04-26T11:26:37.891200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":871,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380782+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:35.380782+0000","last_peered":"2024-04-26T11:26:35.380782+0000","last_clean":"2024-04-26T11:26:35.380782+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:35.380782+0000","last_undegraded":"2024-04-26T11:26:35.380782+0000","last_fullsized":"2024-04-26T11:26:35.380782+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":396,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383151+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:35.383151+0000","last_peered":"2024-04-26T11:26:35.383151+0000","last_clean":"2024-04-26T11:26:35.383151+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:35.383151+0000","last_undegraded":"2024-04-26T11:26:35.383151+0000","last_fullsized":"2024-04-26T11:26:35.383151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":575,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380939+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:35.380939+0000","last_peered":"2024-04-26T11:26:35.380939+0000","last_clean":"2024-04-26T11:26:35.380939+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:35.380939+0000","last_undegraded":"2024-04-26T11:26:35.380939+0000","last_fullsized":"2024-04-26T11:26:35.380939+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890089+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:37.890089+0000","last_peered":"2024-04-26T11:26:37.890089+0000","last_clean":"2024-04-26T11:26:37.890089+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:37.890089+0000","last_undegraded":"2024-04-26T11:26:37.890089+0000","last_fullsized":"2024-04-26T11:26:37.890089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":521,"reported_epoch":104,"state":"peering","last_fresh":"2024-04-26T11:26:38.655813+0000","last_change":"2024-04-26T11:26:39.180440+0000","last_active":"2024-04-26T11:26:39.180440+0000","last_peered":"2024-04-26T11:26:38.655813+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749414+0000","last_became_peered":"2024-04-26T11:26:12.749414+0000","last_unstale":"2024-04-26T11:26:38.655813+0000","last_undegraded":"2024-04-26T11:26:38.655813+0000","last_fullsized":"2024-04-26T11:26:12.605189+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:50.194168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890107+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:37.890107+0000","last_peered":"2024-04-26T11:26:37.890107+0000","last_clean":"2024-04-26T11:26:37.890107+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:37.890107+0000","last_undegraded":"2024-04-26T11:26:37.890107+0000","last_fullsized":"2024-04-26T11:26:37.890107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":953,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381229+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:35.381229+0000","last_peered":"2024-04-26T11:26:35.381229+0000","last_clean":"2024-04-26T11:26:35.381229+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:35.381229+0000","last_undegraded":"2024-04-26T11:26:35.381229+0000","last_fullsized":"2024-04-26T11:26:35.381229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":305,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381449+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:35.381449+0000","last_peered":"2024-04-26T11:26:35.381449+0000","last_clean":"2024-04-26T11:26:35.381449+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:35.381449+0000","last_undegraded":"2024-04-26T11:26:35.381449+0000","last_fullsized":"2024-04-26T11:26:35.381449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":525,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:26:38.893323+0000","last_change":"2024-04-26T11:26:35.931909+0000","last_active":"2024-04-26T11:26:38.893323+0000","last_peered":"2024-04-26T11:26:38.893323+0000","last_clean":"2024-04-26T11:26:38.893323+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:26:38.893323+0000","last_undegraded":"2024-04-26T11:26:38.893323+0000","last_fullsized":"2024-04-26T11:26:38.893323+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:22.946052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":293,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888690+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:37.888690+0000","last_peered":"2024-04-26T11:26:37.888690+0000","last_clean":"2024-04-26T11:26:37.888690+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:37.888690+0000","last_undegraded":"2024-04-26T11:26:37.888690+0000","last_fullsized":"2024-04-26T11:26:37.888690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":469,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889885+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:37.889885+0000","last_peered":"2024-04-26T11:26:37.889885+0000","last_clean":"2024-04-26T11:26:37.889885+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:37.889885+0000","last_undegraded":"2024-04-26T11:26:37.889885+0000","last_fullsized":"2024-04-26T11:26:37.889885+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":146,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381273+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:35.381273+0000","last_peered":"2024-04-26T11:26:35.381273+0000","last_clean":"2024-04-26T11:26:35.381273+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:35.381273+0000","last_undegraded":"2024-04-26T11:26:35.381273+0000","last_fullsized":"2024-04-26T11:26:35.381273+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":444,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.891736+0000","last_change":"2024-04-26T11:26:29.914048+0000","last_active":"2024-04-26T11:26:37.891736+0000","last_peered":"2024-04-26T11:26:37.891736+0000","last_clean":"2024-04-26T11:26:37.891736+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:26:37.891736+0000","last_undegraded":"2024-04-26T11:26:37.891736+0000","last_fullsized":"2024-04-26T11:26:37.891736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":347,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380904+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:35.380904+0000","last_peered":"2024-04-26T11:26:35.380904+0000","last_clean":"2024-04-26T11:26:35.380904+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:35.380904+0000","last_undegraded":"2024-04-26T11:26:35.380904+0000","last_fullsized":"2024-04-26T11:26:35.380904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":548,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379783+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:35.379783+0000","last_peered":"2024-04-26T11:26:35.379783+0000","last_clean":"2024-04-26T11:26:35.379783+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:35.379783+0000","last_undegraded":"2024-04-26T11:26:35.379783+0000","last_fullsized":"2024-04-26T11:26:35.379783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":245,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888199+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:37.888199+0000","last_peered":"2024-04-26T11:26:37.888199+0000","last_clean":"2024-04-26T11:26:37.888199+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:37.888199+0000","last_undegraded":"2024-04-26T11:26:37.888199+0000","last_fullsized":"2024-04-26T11:26:37.888199+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888684+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:37.888684+0000","last_peered":"2024-04-26T11:26:37.888684+0000","last_clean":"2024-04-26T11:26:37.888684+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:37.888684+0000","last_undegraded":"2024-04-26T11:26:37.888684+0000","last_fullsized":"2024-04-26T11:26:37.888684+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":846,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379142+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:35.379142+0000","last_peered":"2024-04-26T11:26:35.379142+0000","last_clean":"2024-04-26T11:26:35.379142+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:35.379142+0000","last_undegraded":"2024-04-26T11:26:35.379142+0000","last_fullsized":"2024-04-26T11:26:35.379142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":512,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890143+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:37.890143+0000","last_peered":"2024-04-26T11:26:37.890143+0000","last_clean":"2024-04-26T11:26:37.890143+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:37.890143+0000","last_undegraded":"2024-04-26T11:26:37.890143+0000","last_fullsized":"2024-04-26T11:26:37.890143+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888974+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:37.888974+0000","last_peered":"2024-04-26T11:26:37.888974+0000","last_clean":"2024-04-26T11:26:37.888974+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:37.888974+0000","last_undegraded":"2024-04-26T11:26:37.888974+0000","last_fullsized":"2024-04-26T11:26:37.888974+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":287,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378949+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:35.378949+0000","last_peered":"2024-04-26T11:26:35.378949+0000","last_clean":"2024-04-26T11:26:35.378949+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:35.378949+0000","last_undegraded":"2024-04-26T11:26:35.378949+0000","last_fullsized":"2024-04-26T11:26:35.378949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":557,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382763+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:35.382763+0000","last_peered":"2024-04-26T11:26:35.382763+0000","last_clean":"2024-04-26T11:26:35.382763+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:35.382763+0000","last_undegraded":"2024-04-26T11:26:35.382763+0000","last_fullsized":"2024-04-26T11:26:35.382763+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379241+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:35.379241+0000","last_peered":"2024-04-26T11:26:35.379241+0000","last_clean":"2024-04-26T11:26:35.379241+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:35.379241+0000","last_undegraded":"2024-04-26T11:26:35.379241+0000","last_fullsized":"2024-04-26T11:26:35.379241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":477,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381040+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:35.381040+0000","last_peered":"2024-04-26T11:26:35.381040+0000","last_clean":"2024-04-26T11:26:35.381040+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:35.381040+0000","last_undegraded":"2024-04-26T11:26:35.381040+0000","last_fullsized":"2024-04-26T11:26:35.381040+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":448,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379961+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:35.379961+0000","last_peered":"2024-04-26T11:26:35.379961+0000","last_clean":"2024-04-26T11:26:35.379961+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:35.379961+0000","last_undegraded":"2024-04-26T11:26:35.379961+0000","last_fullsized":"2024-04-26T11:26:35.379961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888938+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:37.888938+0000","last_peered":"2024-04-26T11:26:37.888938+0000","last_clean":"2024-04-26T11:26:37.888938+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:37.888938+0000","last_undegraded":"2024-04-26T11:26:37.888938+0000","last_fullsized":"2024-04-26T11:26:37.888938+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888969+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:37.888969+0000","last_peered":"2024-04-26T11:26:37.888969+0000","last_clean":"2024-04-26T11:26:37.888969+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:37.888969+0000","last_undegraded":"2024-04-26T11:26:37.888969+0000","last_fullsized":"2024-04-26T11:26:37.888969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":557,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380978+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:35.380978+0000","last_peered":"2024-04-26T11:26:35.380978+0000","last_clean":"2024-04-26T11:26:35.380978+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:35.380978+0000","last_undegraded":"2024-04-26T11:26:35.380978+0000","last_fullsized":"2024-04-26T11:26:35.380978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":568,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889356+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:37.889356+0000","last_peered":"2024-04-26T11:26:37.889356+0000","last_clean":"2024-04-26T11:26:37.889356+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:37.889356+0000","last_undegraded":"2024-04-26T11:26:37.889356+0000","last_fullsized":"2024-04-26T11:26:37.889356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381195+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:35.381195+0000","last_peered":"2024-04-26T11:26:35.381195+0000","last_clean":"2024-04-26T11:26:35.381195+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:35.381195+0000","last_undegraded":"2024-04-26T11:26:35.381195+0000","last_fullsized":"2024-04-26T11:26:35.381195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":787,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.390862+0000","last_change":"2024-04-26T11:26:35.389500+0000","last_active":"2024-04-26T11:26:35.390862+0000","last_peered":"2024-04-26T11:26:35.390862+0000","last_clean":"2024-04-26T11:26:35.390862+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:26:35.390862+0000","last_undegraded":"2024-04-26T11:26:35.390862+0000","last_fullsized":"2024-04-26T11:26:35.390862+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:56.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":153,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381100+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:35.381100+0000","last_peered":"2024-04-26T11:26:35.381100+0000","last_clean":"2024-04-26T11:26:35.381100+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:35.381100+0000","last_undegraded":"2024-04-26T11:26:35.381100+0000","last_fullsized":"2024-04-26T11:26:35.381100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.384064+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:35.384064+0000","last_peered":"2024-04-26T11:26:35.384064+0000","last_clean":"2024-04-26T11:26:35.384064+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:35.384064+0000","last_undegraded":"2024-04-26T11:26:35.384064+0000","last_fullsized":"2024-04-26T11:26:35.384064+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":812,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381881+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:35.381881+0000","last_peered":"2024-04-26T11:26:35.381881+0000","last_clean":"2024-04-26T11:26:35.381881+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:35.381881+0000","last_undegraded":"2024-04-26T11:26:35.381881+0000","last_fullsized":"2024-04-26T11:26:35.381881+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":156,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380574+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:35.380574+0000","last_peered":"2024-04-26T11:26:35.380574+0000","last_clean":"2024-04-26T11:26:35.380574+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:35.380574+0000","last_undegraded":"2024-04-26T11:26:35.380574+0000","last_fullsized":"2024-04-26T11:26:35.380574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380675+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:35.380675+0000","last_peered":"2024-04-26T11:26:35.380675+0000","last_clean":"2024-04-26T11:26:35.380675+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:35.380675+0000","last_undegraded":"2024-04-26T11:26:35.380675+0000","last_fullsized":"2024-04-26T11:26:35.380675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":541,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:35.378664+0000","last_change":"2024-04-26T11:26:12.748928+0000","last_active":"2024-04-26T11:26:35.378664+0000","last_peered":"2024-04-26T11:26:35.378664+0000","last_clean":"2024-04-26T11:23:20.666513+0000","last_became_active":"2024-04-26T11:26:12.743721+0000","last_became_peered":"2024-04-26T11:26:12.743721+0000","last_unstale":"2024-04-26T11:26:35.378664+0000","last_undegraded":"2024-04-26T11:26:12.621233+0000","last_fullsized":"2024-04-26T11:26:12.616597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:38.029361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":185,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380626+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:35.380626+0000","last_peered":"2024-04-26T11:26:35.380626+0000","last_clean":"2024-04-26T11:26:35.380626+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:35.380626+0000","last_undegraded":"2024-04-26T11:26:35.380626+0000","last_fullsized":"2024-04-26T11:26:35.380626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890653+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:37.890653+0000","last_peered":"2024-04-26T11:26:37.890653+0000","last_clean":"2024-04-26T11:26:37.890653+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:37.890653+0000","last_undegraded":"2024-04-26T11:26:37.890653+0000","last_fullsized":"2024-04-26T11:26:37.890653+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":925,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381024+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:35.381024+0000","last_peered":"2024-04-26T11:26:35.381024+0000","last_clean":"2024-04-26T11:26:35.381024+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:35.381024+0000","last_undegraded":"2024-04-26T11:26:35.381024+0000","last_fullsized":"2024-04-26T11:26:35.381024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":510,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.891291+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:37.891291+0000","last_peered":"2024-04-26T11:26:37.891291+0000","last_clean":"2024-04-26T11:26:37.891291+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:37.891291+0000","last_undegraded":"2024-04-26T11:26:37.891291+0000","last_fullsized":"2024-04-26T11:26:37.891291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":489,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889528+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:37.889528+0000","last_peered":"2024-04-26T11:26:37.889528+0000","last_clean":"2024-04-26T11:26:37.889528+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:37.889528+0000","last_undegraded":"2024-04-26T11:26:37.889528+0000","last_fullsized":"2024-04-26T11:26:37.889528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":551,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398225+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:36.398225+0000","last_peered":"2024-04-26T11:26:36.398225+0000","last_clean":"2024-04-26T11:26:36.398225+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:36.398225+0000","last_undegraded":"2024-04-26T11:26:36.398225+0000","last_fullsized":"2024-04-26T11:26:36.398225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":176,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383851+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:35.383851+0000","last_peered":"2024-04-26T11:26:35.383851+0000","last_clean":"2024-04-26T11:26:35.383851+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:35.383851+0000","last_undegraded":"2024-04-26T11:26:35.383851+0000","last_fullsized":"2024-04-26T11:26:35.383851+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":414,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.891468+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:37.891468+0000","last_peered":"2024-04-26T11:26:37.891468+0000","last_clean":"2024-04-26T11:26:37.891468+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:37.891468+0000","last_undegraded":"2024-04-26T11:26:37.891468+0000","last_fullsized":"2024-04-26T11:26:37.891468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":608,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:36.398158+0000","last_change":"2024-04-26T11:26:12.748851+0000","last_active":"2024-04-26T11:26:36.398158+0000","last_peered":"2024-04-26T11:26:36.398158+0000","last_clean":"2024-04-26T11:23:20.666469+0000","last_became_active":"2024-04-26T11:26:12.743007+0000","last_became_peered":"2024-04-26T11:26:12.743007+0000","last_unstale":"2024-04-26T11:26:36.398158+0000","last_undegraded":"2024-04-26T11:26:12.606150+0000","last_fullsized":"2024-04-26T11:26:12.595590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:06.439297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":160,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380328+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:35.380328+0000","last_peered":"2024-04-26T11:26:35.380328+0000","last_clean":"2024-04-26T11:26:35.380328+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:35.380328+0000","last_undegraded":"2024-04-26T11:26:35.380328+0000","last_fullsized":"2024-04-26T11:26:35.380328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":565,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398211+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:36.398211+0000","last_peered":"2024-04-26T11:26:36.398211+0000","last_clean":"2024-04-26T11:26:36.398211+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:36.398211+0000","last_undegraded":"2024-04-26T11:26:36.398211+0000","last_fullsized":"2024-04-26T11:26:36.398211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":787,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383462+0000","last_change":"2024-04-26T11:26:32.372817+0000","last_active":"2024-04-26T11:26:35.383462+0000","last_peered":"2024-04-26T11:26:35.383462+0000","last_clean":"2024-04-26T11:26:35.383462+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:26:35.383462+0000","last_undegraded":"2024-04-26T11:26:35.383462+0000","last_fullsized":"2024-04-26T11:26:35.383462+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:32.214458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":682,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379122+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:35.379122+0000","last_peered":"2024-04-26T11:26:35.379122+0000","last_clean":"2024-04-26T11:26:35.379122+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:35.379122+0000","last_undegraded":"2024-04-26T11:26:35.379122+0000","last_fullsized":"2024-04-26T11:26:35.379122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":917,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380154+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:35.380154+0000","last_peered":"2024-04-26T11:26:35.380154+0000","last_clean":"2024-04-26T11:26:35.380154+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:35.380154+0000","last_undegraded":"2024-04-26T11:26:35.380154+0000","last_fullsized":"2024-04-26T11:26:35.380154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":389,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378742+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:35.378742+0000","last_peered":"2024-04-26T11:26:35.378742+0000","last_clean":"2024-04-26T11:26:35.378742+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:35.378742+0000","last_undegraded":"2024-04-26T11:26:35.378742+0000","last_fullsized":"2024-04-26T11:26:35.378742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1011,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.406522+0000","last_change":"2024-04-26T11:26:36.406522+0000","last_active":"2024-04-26T11:26:36.406522+0000","last_peered":"2024-04-26T11:26:36.406522+0000","last_clean":"2024-04-26T11:26:36.406522+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:26:36.406522+0000","last_undegraded":"2024-04-26T11:26:36.406522+0000","last_fullsized":"2024-04-26T11:26:36.406522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:05.312742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":426,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382724+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:35.382724+0000","last_peered":"2024-04-26T11:26:35.382724+0000","last_clean":"2024-04-26T11:26:35.382724+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:35.382724+0000","last_undegraded":"2024-04-26T11:26:35.382724+0000","last_fullsized":"2024-04-26T11:26:35.382724+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":494,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381867+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:35.381867+0000","last_peered":"2024-04-26T11:26:35.381867+0000","last_clean":"2024-04-26T11:26:35.381867+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:35.381867+0000","last_undegraded":"2024-04-26T11:26:35.381867+0000","last_fullsized":"2024-04-26T11:26:35.381867+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":147,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382238+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:35.382238+0000","last_peered":"2024-04-26T11:26:35.382238+0000","last_clean":"2024-04-26T11:26:35.382238+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:35.382238+0000","last_undegraded":"2024-04-26T11:26:35.382238+0000","last_fullsized":"2024-04-26T11:26:35.382238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":473,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.891024+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:37.891024+0000","last_peered":"2024-04-26T11:26:37.891024+0000","last_clean":"2024-04-26T11:26:37.891024+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:37.891024+0000","last_undegraded":"2024-04-26T11:26:37.891024+0000","last_fullsized":"2024-04-26T11:26:37.891024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":402,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890906+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:37.890906+0000","last_peered":"2024-04-26T11:26:37.890906+0000","last_clean":"2024-04-26T11:26:37.890906+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:37.890906+0000","last_undegraded":"2024-04-26T11:26:37.890906+0000","last_fullsized":"2024-04-26T11:26:37.890906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":489,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889553+0000","last_change":"2024-04-26T11:26:31.896245+0000","last_active":"2024-04-26T11:26:37.889553+0000","last_peered":"2024-04-26T11:26:37.889553+0000","last_clean":"2024-04-26T11:26:37.889553+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:26:37.889553+0000","last_undegraded":"2024-04-26T11:26:37.889553+0000","last_fullsized":"2024-04-26T11:26:37.889553+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:59.173436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":492,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383508+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:35.383508+0000","last_peered":"2024-04-26T11:26:35.383508+0000","last_clean":"2024-04-26T11:26:35.383508+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:35.383508+0000","last_undegraded":"2024-04-26T11:26:35.383508+0000","last_fullsized":"2024-04-26T11:26:35.383508+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":493,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381445+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:35.381445+0000","last_peered":"2024-04-26T11:26:35.381445+0000","last_clean":"2024-04-26T11:26:35.381445+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:35.381445+0000","last_undegraded":"2024-04-26T11:26:35.381445+0000","last_fullsized":"2024-04-26T11:26:35.381445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":153,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380382+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:35.380382+0000","last_peered":"2024-04-26T11:26:35.380382+0000","last_clean":"2024-04-26T11:26:35.380382+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:35.380382+0000","last_undegraded":"2024-04-26T11:26:35.380382+0000","last_fullsized":"2024-04-26T11:26:35.380382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":540,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889211+0000","last_change":"2024-04-26T11:26:33.905426+0000","last_active":"2024-04-26T11:26:37.889211+0000","last_peered":"2024-04-26T11:26:37.889211+0000","last_clean":"2024-04-26T11:26:37.889211+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:37.889211+0000","last_undegraded":"2024-04-26T11:26:37.889211+0000","last_fullsized":"2024-04-26T11:26:37.889211+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:49.659488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":251,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380072+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:35.380072+0000","last_peered":"2024-04-26T11:26:35.380072+0000","last_clean":"2024-04-26T11:26:35.380072+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:35.380072+0000","last_undegraded":"2024-04-26T11:26:35.380072+0000","last_fullsized":"2024-04-26T11:26:35.380072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":576,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6696,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":124,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142392,"kb_used_data":30948,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229448,"statfs":{"total":96636764160,"available":96490954752,"internally_reserved":0,"allocated":31690752,"data_stored":81587312,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.751}]}]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124300,"kb_used_data":30912,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247540,"statfs":{"total":96636764160,"available":96509480960,"internally_reserved":0,"allocated":31653888,"data_stored":86091432,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.623},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66400000000000003}]}]},{"osd":0,"up_from":75,"seq":322122547208,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71812,"kb_used_data":18044,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94300028,"statfs":{"total":96636764160,"available":96563228672,"internally_reserved":0,"allocated":18477056,"data_stored":91768770,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":55043063},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:42.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T11:26:42.565 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:42.566 INFO:teuthology.orchestra.run.smithi073.stdout:{"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 576/110 objects degraded (523.636%), 3 pgs degraded","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":310,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":106,"num_osds":3,"num_up_osds":3,"osd_up_since":1714130770,"num_in_osds":3,"osd_in_since":1714130493,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":100},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":3},{"state_name":"active+recovering+undersized+remapped","count":1},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":55,"data_bytes":129078864,"bytes_used":346628096,"bytes_avail":289563664384,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"degraded_objects":576,"degraded_total":110,"degraded_ratio":5.2363636363636363,"recovering_objects_per_sec":141,"recovering_bytes_per_sec":0,"recovering_keys_per_sec":0,"num_objects_recovered":567,"num_bytes_recovered":0,"num_keys_recovered":0},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4207}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-26T11:23:01.341628+0000","services":{}},"progress_events":{}} 2024-04-26T11:26:42.584 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T11:26:42.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:42.876 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:42.878 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:42.894 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-04-26T11:26:41.452613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":576,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6720,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":206,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":338504,"kb_used_data":79904,"kb_used_omap":10,"kb_used_meta":258549,"kb_avail":282777016,"statfs":{"total":289910292480,"available":289563664384,"internally_reserved":0,"allocated":81821696,"data_stored":259447514,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":264755075},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-567,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":567,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001448"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":504,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383205+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:35.383205+0000","last_peered":"2024-04-26T11:26:35.383205+0000","last_clean":"2024-04-26T11:26:35.383205+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:35.383205+0000","last_undegraded":"2024-04-26T11:26:35.383205+0000","last_fullsized":"2024-04-26T11:26:35.383205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":560,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382490+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:35.382490+0000","last_peered":"2024-04-26T11:26:35.382490+0000","last_clean":"2024-04-26T11:26:35.382490+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:35.382490+0000","last_undegraded":"2024-04-26T11:26:35.382490+0000","last_fullsized":"2024-04-26T11:26:35.382490+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":438,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890627+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:37.890627+0000","last_peered":"2024-04-26T11:26:37.890627+0000","last_clean":"2024-04-26T11:26:37.890627+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:37.890627+0000","last_undegraded":"2024-04-26T11:26:37.890627+0000","last_fullsized":"2024-04-26T11:26:37.890627+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":487,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889875+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:37.889875+0000","last_peered":"2024-04-26T11:26:37.889875+0000","last_clean":"2024-04-26T11:26:37.889875+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:37.889875+0000","last_undegraded":"2024-04-26T11:26:37.889875+0000","last_fullsized":"2024-04-26T11:26:37.889875+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":535,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381918+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:35.381918+0000","last_peered":"2024-04-26T11:26:35.381918+0000","last_clean":"2024-04-26T11:26:35.381918+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:35.381918+0000","last_undegraded":"2024-04-26T11:26:35.381918+0000","last_fullsized":"2024-04-26T11:26:35.381918+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":491,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890544+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:37.890544+0000","last_peered":"2024-04-26T11:26:37.890544+0000","last_clean":"2024-04-26T11:26:37.890544+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:37.890544+0000","last_undegraded":"2024-04-26T11:26:37.890544+0000","last_fullsized":"2024-04-26T11:26:37.890544+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":592,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889228+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:37.889228+0000","last_peered":"2024-04-26T11:26:37.889228+0000","last_clean":"2024-04-26T11:26:37.889228+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:37.889228+0000","last_undegraded":"2024-04-26T11:26:37.889228+0000","last_fullsized":"2024-04-26T11:26:37.889228+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":460,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888774+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:37.888774+0000","last_peered":"2024-04-26T11:26:37.888774+0000","last_clean":"2024-04-26T11:26:37.888774+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:37.888774+0000","last_undegraded":"2024-04-26T11:26:37.888774+0000","last_fullsized":"2024-04-26T11:26:37.888774+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":591,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379537+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:35.379537+0000","last_peered":"2024-04-26T11:26:35.379537+0000","last_clean":"2024-04-26T11:26:35.379537+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:35.379537+0000","last_undegraded":"2024-04-26T11:26:35.379537+0000","last_fullsized":"2024-04-26T11:26:35.379537+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":501,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382628+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:35.382628+0000","last_peered":"2024-04-26T11:26:35.382628+0000","last_clean":"2024-04-26T11:26:35.382628+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:35.382628+0000","last_undegraded":"2024-04-26T11:26:35.382628+0000","last_fullsized":"2024-04-26T11:26:35.382628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":478,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890430+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:37.890430+0000","last_peered":"2024-04-26T11:26:37.890430+0000","last_clean":"2024-04-26T11:26:37.890430+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:37.890430+0000","last_undegraded":"2024-04-26T11:26:37.890430+0000","last_fullsized":"2024-04-26T11:26:37.890430+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:07.200544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":777,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381815+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:35.381815+0000","last_peered":"2024-04-26T11:26:35.381815+0000","last_clean":"2024-04-26T11:26:35.381815+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:35.381815+0000","last_undegraded":"2024-04-26T11:26:35.381815+0000","last_fullsized":"2024-04-26T11:26:35.381815+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":448,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381793+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:35.381793+0000","last_peered":"2024-04-26T11:26:35.381793+0000","last_clean":"2024-04-26T11:26:35.381793+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:35.381793+0000","last_undegraded":"2024-04-26T11:26:35.381793+0000","last_fullsized":"2024-04-26T11:26:35.381793+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":480,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889976+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:37.889976+0000","last_peered":"2024-04-26T11:26:37.889976+0000","last_clean":"2024-04-26T11:26:37.889976+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:37.889976+0000","last_undegraded":"2024-04-26T11:26:37.889976+0000","last_fullsized":"2024-04-26T11:26:37.889976+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":536,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888992+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:37.888992+0000","last_peered":"2024-04-26T11:26:37.888992+0000","last_clean":"2024-04-26T11:26:37.888992+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:37.888992+0000","last_undegraded":"2024-04-26T11:26:37.888992+0000","last_fullsized":"2024-04-26T11:26:37.888992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":601,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889741+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:37.889741+0000","last_peered":"2024-04-26T11:26:37.889741+0000","last_clean":"2024-04-26T11:26:37.889741+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:37.889741+0000","last_undegraded":"2024-04-26T11:26:37.889741+0000","last_fullsized":"2024-04-26T11:26:37.889741+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":572,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.400877+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:36.400877+0000","last_peered":"2024-04-26T11:26:36.400877+0000","last_clean":"2024-04-26T11:26:36.400877+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:36.400877+0000","last_undegraded":"2024-04-26T11:26:36.400877+0000","last_fullsized":"2024-04-26T11:26:36.400877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":579,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382887+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:35.382887+0000","last_peered":"2024-04-26T11:26:35.382887+0000","last_clean":"2024-04-26T11:26:35.382887+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:35.382887+0000","last_undegraded":"2024-04-26T11:26:35.382887+0000","last_fullsized":"2024-04-26T11:26:35.382887+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":618,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379941+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:35.379941+0000","last_peered":"2024-04-26T11:26:35.379941+0000","last_clean":"2024-04-26T11:26:35.379941+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:35.379941+0000","last_undegraded":"2024-04-26T11:26:35.379941+0000","last_fullsized":"2024-04-26T11:26:35.379941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":609,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890832+0000","last_change":"2024-04-26T11:26:29.907661+0000","last_active":"2024-04-26T11:26:37.890832+0000","last_peered":"2024-04-26T11:26:37.890832+0000","last_clean":"2024-04-26T11:26:37.890832+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:26:37.890832+0000","last_undegraded":"2024-04-26T11:26:37.890832+0000","last_fullsized":"2024-04-26T11:26:37.890832+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":547,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:26:38.893504+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:38.893504+0000","last_peered":"2024-04-26T11:26:38.893504+0000","last_clean":"2024-04-26T11:26:38.893504+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:38.893504+0000","last_undegraded":"2024-04-26T11:26:38.893504+0000","last_fullsized":"2024-04-26T11:26:38.893504+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.393282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":973,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381275+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:35.381275+0000","last_peered":"2024-04-26T11:26:35.381275+0000","last_clean":"2024-04-26T11:26:35.381275+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:35.381275+0000","last_undegraded":"2024-04-26T11:26:35.381275+0000","last_fullsized":"2024-04-26T11:26:35.381275+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:06.847831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":927,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378023+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:35.378023+0000","last_peered":"2024-04-26T11:26:35.378023+0000","last_clean":"2024-04-26T11:26:35.378023+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:35.378023+0000","last_undegraded":"2024-04-26T11:26:35.378023+0000","last_fullsized":"2024-04-26T11:26:35.378023+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":510,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380664+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:35.380664+0000","last_peered":"2024-04-26T11:26:35.380664+0000","last_clean":"2024-04-26T11:26:35.380664+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:35.380664+0000","last_undegraded":"2024-04-26T11:26:35.380664+0000","last_fullsized":"2024-04-26T11:26:35.380664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":943,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383462+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:35.383462+0000","last_peered":"2024-04-26T11:26:35.383462+0000","last_clean":"2024-04-26T11:26:35.383462+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:35.383462+0000","last_undegraded":"2024-04-26T11:26:35.383462+0000","last_fullsized":"2024-04-26T11:26:35.383462+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:04.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1049,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380062+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:35.380062+0000","last_peered":"2024-04-26T11:26:35.380062+0000","last_clean":"2024-04-26T11:26:35.380062+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:35.380062+0000","last_undegraded":"2024-04-26T11:26:35.380062+0000","last_fullsized":"2024-04-26T11:26:35.380062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":556,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890345+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:37.890345+0000","last_peered":"2024-04-26T11:26:37.890345+0000","last_clean":"2024-04-26T11:26:37.890345+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:37.890345+0000","last_undegraded":"2024-04-26T11:26:37.890345+0000","last_fullsized":"2024-04-26T11:26:37.890345+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":946,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382315+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:35.382315+0000","last_peered":"2024-04-26T11:26:35.382315+0000","last_clean":"2024-04-26T11:26:35.382315+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:35.382315+0000","last_undegraded":"2024-04-26T11:26:35.382315+0000","last_fullsized":"2024-04-26T11:26:35.382315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":503,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381112+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:35.381112+0000","last_peered":"2024-04-26T11:26:35.381112+0000","last_clean":"2024-04-26T11:26:35.381112+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:35.381112+0000","last_undegraded":"2024-04-26T11:26:35.381112+0000","last_fullsized":"2024-04-26T11:26:35.381112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":938,"reported_epoch":101,"state":"active+recovering+undersized+remapped","last_fresh":"2024-04-26T11:26:36.472040+0000","last_change":"2024-04-26T11:26:35.803664+0000","last_active":"2024-04-26T11:26:36.472040+0000","last_peered":"2024-04-26T11:26:36.472040+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:22.402212+0000","last_became_peered":"2024-04-26T11:26:22.402212+0000","last_unstale":"2024-04-26T11:26:36.472040+0000","last_undegraded":"2024-04-26T11:26:36.472040+0000","last_fullsized":"2024-04-26T11:26:22.371421+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:49:02.822376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":623,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378172+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:35.378172+0000","last_peered":"2024-04-26T11:26:35.378172+0000","last_clean":"2024-04-26T11:26:35.378172+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:35.378172+0000","last_undegraded":"2024-04-26T11:26:35.378172+0000","last_fullsized":"2024-04-26T11:26:35.378172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":517,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:35.378107+0000","last_change":"2024-04-26T11:26:12.752759+0000","last_active":"2024-04-26T11:26:35.378107+0000","last_peered":"2024-04-26T11:26:35.378107+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749360+0000","last_became_peered":"2024-04-26T11:26:12.749360+0000","last_unstale":"2024-04-26T11:26:35.378107+0000","last_undegraded":"2024-04-26T11:26:12.617888+0000","last_fullsized":"2024-04-26T11:26:12.605870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:48.669370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":480,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382046+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:35.382046+0000","last_peered":"2024-04-26T11:26:35.382046+0000","last_clean":"2024-04-26T11:26:35.382046+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:35.382046+0000","last_undegraded":"2024-04-26T11:26:35.382046+0000","last_fullsized":"2024-04-26T11:26:35.382046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":548,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889251+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:37.889251+0000","last_peered":"2024-04-26T11:26:37.889251+0000","last_clean":"2024-04-26T11:26:37.889251+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:37.889251+0000","last_undegraded":"2024-04-26T11:26:37.889251+0000","last_fullsized":"2024-04-26T11:26:37.889251+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":500,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383361+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:35.383361+0000","last_peered":"2024-04-26T11:26:35.383361+0000","last_clean":"2024-04-26T11:26:35.383361+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:35.383361+0000","last_undegraded":"2024-04-26T11:26:35.383361+0000","last_fullsized":"2024-04-26T11:26:35.383361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":171,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398505+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:36.398505+0000","last_peered":"2024-04-26T11:26:36.398505+0000","last_clean":"2024-04-26T11:26:36.398505+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:36.398505+0000","last_undegraded":"2024-04-26T11:26:36.398505+0000","last_fullsized":"2024-04-26T11:26:36.398505+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":992,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380469+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:35.380469+0000","last_peered":"2024-04-26T11:26:35.380469+0000","last_clean":"2024-04-26T11:26:35.380469+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:35.380469+0000","last_undegraded":"2024-04-26T11:26:35.380469+0000","last_fullsized":"2024-04-26T11:26:35.380469+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":159,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.399284+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:36.399284+0000","last_peered":"2024-04-26T11:26:36.399284+0000","last_clean":"2024-04-26T11:26:36.399284+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:36.399284+0000","last_undegraded":"2024-04-26T11:26:36.399284+0000","last_fullsized":"2024-04-26T11:26:36.399284+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":932,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379697+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:35.379697+0000","last_peered":"2024-04-26T11:26:35.379697+0000","last_clean":"2024-04-26T11:26:35.379697+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:35.379697+0000","last_undegraded":"2024-04-26T11:26:35.379697+0000","last_fullsized":"2024-04-26T11:26:35.379697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":50,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888508+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:37.888508+0000","last_peered":"2024-04-26T11:26:37.888508+0000","last_clean":"2024-04-26T11:26:37.888508+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:37.888508+0000","last_undegraded":"2024-04-26T11:26:37.888508+0000","last_fullsized":"2024-04-26T11:26:37.888508+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":240,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.891200+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:37.891200+0000","last_peered":"2024-04-26T11:26:37.891200+0000","last_clean":"2024-04-26T11:26:37.891200+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:37.891200+0000","last_undegraded":"2024-04-26T11:26:37.891200+0000","last_fullsized":"2024-04-26T11:26:37.891200+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":871,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380782+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:35.380782+0000","last_peered":"2024-04-26T11:26:35.380782+0000","last_clean":"2024-04-26T11:26:35.380782+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:35.380782+0000","last_undegraded":"2024-04-26T11:26:35.380782+0000","last_fullsized":"2024-04-26T11:26:35.380782+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":396,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383151+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:35.383151+0000","last_peered":"2024-04-26T11:26:35.383151+0000","last_clean":"2024-04-26T11:26:35.383151+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:35.383151+0000","last_undegraded":"2024-04-26T11:26:35.383151+0000","last_fullsized":"2024-04-26T11:26:35.383151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":575,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380939+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:35.380939+0000","last_peered":"2024-04-26T11:26:35.380939+0000","last_clean":"2024-04-26T11:26:35.380939+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:35.380939+0000","last_undegraded":"2024-04-26T11:26:35.380939+0000","last_fullsized":"2024-04-26T11:26:35.380939+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":643,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890089+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:37.890089+0000","last_peered":"2024-04-26T11:26:37.890089+0000","last_clean":"2024-04-26T11:26:37.890089+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:37.890089+0000","last_undegraded":"2024-04-26T11:26:37.890089+0000","last_fullsized":"2024-04-26T11:26:37.890089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":521,"reported_epoch":104,"state":"peering","last_fresh":"2024-04-26T11:26:38.655813+0000","last_change":"2024-04-26T11:26:39.180440+0000","last_active":"2024-04-26T11:26:39.180440+0000","last_peered":"2024-04-26T11:26:38.655813+0000","last_clean":"2024-04-26T11:21:53.304950+0000","last_became_active":"2024-04-26T11:26:12.749414+0000","last_became_peered":"2024-04-26T11:26:12.749414+0000","last_unstale":"2024-04-26T11:26:38.655813+0000","last_undegraded":"2024-04-26T11:26:38.655813+0000","last_fullsized":"2024-04-26T11:26:12.605189+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:50.194168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890107+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:37.890107+0000","last_peered":"2024-04-26T11:26:37.890107+0000","last_clean":"2024-04-26T11:26:37.890107+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:37.890107+0000","last_undegraded":"2024-04-26T11:26:37.890107+0000","last_fullsized":"2024-04-26T11:26:37.890107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":953,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381229+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:35.381229+0000","last_peered":"2024-04-26T11:26:35.381229+0000","last_clean":"2024-04-26T11:26:35.381229+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:35.381229+0000","last_undegraded":"2024-04-26T11:26:35.381229+0000","last_fullsized":"2024-04-26T11:26:35.381229+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":305,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381449+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:35.381449+0000","last_peered":"2024-04-26T11:26:35.381449+0000","last_clean":"2024-04-26T11:26:35.381449+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:35.381449+0000","last_undegraded":"2024-04-26T11:26:35.381449+0000","last_fullsized":"2024-04-26T11:26:35.381449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":525,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T11:26:38.893323+0000","last_change":"2024-04-26T11:26:35.931909+0000","last_active":"2024-04-26T11:26:38.893323+0000","last_peered":"2024-04-26T11:26:38.893323+0000","last_clean":"2024-04-26T11:26:38.893323+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:26:38.893323+0000","last_undegraded":"2024-04-26T11:26:38.893323+0000","last_fullsized":"2024-04-26T11:26:38.893323+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:22.946052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":293,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888690+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:37.888690+0000","last_peered":"2024-04-26T11:26:37.888690+0000","last_clean":"2024-04-26T11:26:37.888690+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:37.888690+0000","last_undegraded":"2024-04-26T11:26:37.888690+0000","last_fullsized":"2024-04-26T11:26:37.888690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":469,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889885+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:37.889885+0000","last_peered":"2024-04-26T11:26:37.889885+0000","last_clean":"2024-04-26T11:26:37.889885+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:37.889885+0000","last_undegraded":"2024-04-26T11:26:37.889885+0000","last_fullsized":"2024-04-26T11:26:37.889885+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":146,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381273+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:35.381273+0000","last_peered":"2024-04-26T11:26:35.381273+0000","last_clean":"2024-04-26T11:26:35.381273+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:35.381273+0000","last_undegraded":"2024-04-26T11:26:35.381273+0000","last_fullsized":"2024-04-26T11:26:35.381273+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":444,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.891736+0000","last_change":"2024-04-26T11:26:29.914048+0000","last_active":"2024-04-26T11:26:37.891736+0000","last_peered":"2024-04-26T11:26:37.891736+0000","last_clean":"2024-04-26T11:26:37.891736+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:26:37.891736+0000","last_undegraded":"2024-04-26T11:26:37.891736+0000","last_fullsized":"2024-04-26T11:26:37.891736+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":347,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380904+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:35.380904+0000","last_peered":"2024-04-26T11:26:35.380904+0000","last_clean":"2024-04-26T11:26:35.380904+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:35.380904+0000","last_undegraded":"2024-04-26T11:26:35.380904+0000","last_fullsized":"2024-04-26T11:26:35.380904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":548,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379783+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:35.379783+0000","last_peered":"2024-04-26T11:26:35.379783+0000","last_clean":"2024-04-26T11:26:35.379783+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:35.379783+0000","last_undegraded":"2024-04-26T11:26:35.379783+0000","last_fullsized":"2024-04-26T11:26:35.379783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":245,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888199+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:37.888199+0000","last_peered":"2024-04-26T11:26:37.888199+0000","last_clean":"2024-04-26T11:26:37.888199+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:37.888199+0000","last_undegraded":"2024-04-26T11:26:37.888199+0000","last_fullsized":"2024-04-26T11:26:37.888199+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888684+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:37.888684+0000","last_peered":"2024-04-26T11:26:37.888684+0000","last_clean":"2024-04-26T11:26:37.888684+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:37.888684+0000","last_undegraded":"2024-04-26T11:26:37.888684+0000","last_fullsized":"2024-04-26T11:26:37.888684+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":846,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379142+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:35.379142+0000","last_peered":"2024-04-26T11:26:35.379142+0000","last_clean":"2024-04-26T11:26:35.379142+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:35.379142+0000","last_undegraded":"2024-04-26T11:26:35.379142+0000","last_fullsized":"2024-04-26T11:26:35.379142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":512,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890143+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:37.890143+0000","last_peered":"2024-04-26T11:26:37.890143+0000","last_clean":"2024-04-26T11:26:37.890143+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:37.890143+0000","last_undegraded":"2024-04-26T11:26:37.890143+0000","last_fullsized":"2024-04-26T11:26:37.890143+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888974+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:37.888974+0000","last_peered":"2024-04-26T11:26:37.888974+0000","last_clean":"2024-04-26T11:26:37.888974+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:37.888974+0000","last_undegraded":"2024-04-26T11:26:37.888974+0000","last_fullsized":"2024-04-26T11:26:37.888974+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":287,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378949+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:35.378949+0000","last_peered":"2024-04-26T11:26:35.378949+0000","last_clean":"2024-04-26T11:26:35.378949+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:35.378949+0000","last_undegraded":"2024-04-26T11:26:35.378949+0000","last_fullsized":"2024-04-26T11:26:35.378949+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":557,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382763+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:35.382763+0000","last_peered":"2024-04-26T11:26:35.382763+0000","last_clean":"2024-04-26T11:26:35.382763+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:35.382763+0000","last_undegraded":"2024-04-26T11:26:35.382763+0000","last_fullsized":"2024-04-26T11:26:35.382763+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":99,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379241+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:35.379241+0000","last_peered":"2024-04-26T11:26:35.379241+0000","last_clean":"2024-04-26T11:26:35.379241+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:35.379241+0000","last_undegraded":"2024-04-26T11:26:35.379241+0000","last_fullsized":"2024-04-26T11:26:35.379241+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":477,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381040+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:35.381040+0000","last_peered":"2024-04-26T11:26:35.381040+0000","last_clean":"2024-04-26T11:26:35.381040+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:35.381040+0000","last_undegraded":"2024-04-26T11:26:35.381040+0000","last_fullsized":"2024-04-26T11:26:35.381040+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":448,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379961+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:35.379961+0000","last_peered":"2024-04-26T11:26:35.379961+0000","last_clean":"2024-04-26T11:26:35.379961+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:35.379961+0000","last_undegraded":"2024-04-26T11:26:35.379961+0000","last_fullsized":"2024-04-26T11:26:35.379961+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888938+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:37.888938+0000","last_peered":"2024-04-26T11:26:37.888938+0000","last_clean":"2024-04-26T11:26:37.888938+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:37.888938+0000","last_undegraded":"2024-04-26T11:26:37.888938+0000","last_fullsized":"2024-04-26T11:26:37.888938+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.888969+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:37.888969+0000","last_peered":"2024-04-26T11:26:37.888969+0000","last_clean":"2024-04-26T11:26:37.888969+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:37.888969+0000","last_undegraded":"2024-04-26T11:26:37.888969+0000","last_fullsized":"2024-04-26T11:26:37.888969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":557,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380978+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:35.380978+0000","last_peered":"2024-04-26T11:26:35.380978+0000","last_clean":"2024-04-26T11:26:35.380978+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:35.380978+0000","last_undegraded":"2024-04-26T11:26:35.380978+0000","last_fullsized":"2024-04-26T11:26:35.380978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":568,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889356+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:37.889356+0000","last_peered":"2024-04-26T11:26:37.889356+0000","last_clean":"2024-04-26T11:26:37.889356+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:37.889356+0000","last_undegraded":"2024-04-26T11:26:37.889356+0000","last_fullsized":"2024-04-26T11:26:37.889356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381195+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:35.381195+0000","last_peered":"2024-04-26T11:26:35.381195+0000","last_clean":"2024-04-26T11:26:35.381195+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:35.381195+0000","last_undegraded":"2024-04-26T11:26:35.381195+0000","last_fullsized":"2024-04-26T11:26:35.381195+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":787,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.390862+0000","last_change":"2024-04-26T11:26:35.389500+0000","last_active":"2024-04-26T11:26:35.390862+0000","last_peered":"2024-04-26T11:26:35.390862+0000","last_clean":"2024-04-26T11:26:35.390862+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:26:35.390862+0000","last_undegraded":"2024-04-26T11:26:35.390862+0000","last_fullsized":"2024-04-26T11:26:35.390862+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:56.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":153,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381100+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:35.381100+0000","last_peered":"2024-04-26T11:26:35.381100+0000","last_clean":"2024-04-26T11:26:35.381100+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:35.381100+0000","last_undegraded":"2024-04-26T11:26:35.381100+0000","last_fullsized":"2024-04-26T11:26:35.381100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.384064+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:35.384064+0000","last_peered":"2024-04-26T11:26:35.384064+0000","last_clean":"2024-04-26T11:26:35.384064+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:35.384064+0000","last_undegraded":"2024-04-26T11:26:35.384064+0000","last_fullsized":"2024-04-26T11:26:35.384064+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":812,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381881+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:35.381881+0000","last_peered":"2024-04-26T11:26:35.381881+0000","last_clean":"2024-04-26T11:26:35.381881+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:35.381881+0000","last_undegraded":"2024-04-26T11:26:35.381881+0000","last_fullsized":"2024-04-26T11:26:35.381881+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":156,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380574+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:35.380574+0000","last_peered":"2024-04-26T11:26:35.380574+0000","last_clean":"2024-04-26T11:26:35.380574+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:35.380574+0000","last_undegraded":"2024-04-26T11:26:35.380574+0000","last_fullsized":"2024-04-26T11:26:35.380574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380675+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:35.380675+0000","last_peered":"2024-04-26T11:26:35.380675+0000","last_clean":"2024-04-26T11:26:35.380675+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:35.380675+0000","last_undegraded":"2024-04-26T11:26:35.380675+0000","last_fullsized":"2024-04-26T11:26:35.380675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":541,"reported_epoch":100,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:35.378664+0000","last_change":"2024-04-26T11:26:12.748928+0000","last_active":"2024-04-26T11:26:35.378664+0000","last_peered":"2024-04-26T11:26:35.378664+0000","last_clean":"2024-04-26T11:23:20.666513+0000","last_became_active":"2024-04-26T11:26:12.743721+0000","last_became_peered":"2024-04-26T11:26:12.743721+0000","last_unstale":"2024-04-26T11:26:35.378664+0000","last_undegraded":"2024-04-26T11:26:12.621233+0000","last_fullsized":"2024-04-26T11:26:12.616597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:38.029361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":185,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":185,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380626+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:35.380626+0000","last_peered":"2024-04-26T11:26:35.380626+0000","last_clean":"2024-04-26T11:26:35.380626+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:35.380626+0000","last_undegraded":"2024-04-26T11:26:35.380626+0000","last_fullsized":"2024-04-26T11:26:35.380626+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890653+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:37.890653+0000","last_peered":"2024-04-26T11:26:37.890653+0000","last_clean":"2024-04-26T11:26:37.890653+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:37.890653+0000","last_undegraded":"2024-04-26T11:26:37.890653+0000","last_fullsized":"2024-04-26T11:26:37.890653+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":925,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381024+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:35.381024+0000","last_peered":"2024-04-26T11:26:35.381024+0000","last_clean":"2024-04-26T11:26:35.381024+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:35.381024+0000","last_undegraded":"2024-04-26T11:26:35.381024+0000","last_fullsized":"2024-04-26T11:26:35.381024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":510,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.891291+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:37.891291+0000","last_peered":"2024-04-26T11:26:37.891291+0000","last_clean":"2024-04-26T11:26:37.891291+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:37.891291+0000","last_undegraded":"2024-04-26T11:26:37.891291+0000","last_fullsized":"2024-04-26T11:26:37.891291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":489,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889528+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:37.889528+0000","last_peered":"2024-04-26T11:26:37.889528+0000","last_clean":"2024-04-26T11:26:37.889528+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:37.889528+0000","last_undegraded":"2024-04-26T11:26:37.889528+0000","last_fullsized":"2024-04-26T11:26:37.889528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":551,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398225+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:36.398225+0000","last_peered":"2024-04-26T11:26:36.398225+0000","last_clean":"2024-04-26T11:26:36.398225+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:36.398225+0000","last_undegraded":"2024-04-26T11:26:36.398225+0000","last_fullsized":"2024-04-26T11:26:36.398225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":176,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383851+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:35.383851+0000","last_peered":"2024-04-26T11:26:35.383851+0000","last_clean":"2024-04-26T11:26:35.383851+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:35.383851+0000","last_undegraded":"2024-04-26T11:26:35.383851+0000","last_fullsized":"2024-04-26T11:26:35.383851+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":414,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.891468+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:37.891468+0000","last_peered":"2024-04-26T11:26:37.891468+0000","last_clean":"2024-04-26T11:26:37.891468+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:37.891468+0000","last_undegraded":"2024-04-26T11:26:37.891468+0000","last_fullsized":"2024-04-26T11:26:37.891468+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":608,"reported_epoch":101,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-26T11:26:36.398158+0000","last_change":"2024-04-26T11:26:12.748851+0000","last_active":"2024-04-26T11:26:36.398158+0000","last_peered":"2024-04-26T11:26:36.398158+0000","last_clean":"2024-04-26T11:23:20.666469+0000","last_became_active":"2024-04-26T11:26:12.743007+0000","last_became_peered":"2024-04-26T11:26:12.743007+0000","last_unstale":"2024-04-26T11:26:36.398158+0000","last_undegraded":"2024-04-26T11:26:12.606150+0000","last_fullsized":"2024-04-26T11:26:12.595590+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:06.439297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":201,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":160,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380328+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:35.380328+0000","last_peered":"2024-04-26T11:26:35.380328+0000","last_clean":"2024-04-26T11:26:35.380328+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:35.380328+0000","last_undegraded":"2024-04-26T11:26:35.380328+0000","last_fullsized":"2024-04-26T11:26:35.380328+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":565,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.398211+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:36.398211+0000","last_peered":"2024-04-26T11:26:36.398211+0000","last_clean":"2024-04-26T11:26:36.398211+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:36.398211+0000","last_undegraded":"2024-04-26T11:26:36.398211+0000","last_fullsized":"2024-04-26T11:26:36.398211+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":787,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383462+0000","last_change":"2024-04-26T11:26:32.372817+0000","last_active":"2024-04-26T11:26:35.383462+0000","last_peered":"2024-04-26T11:26:35.383462+0000","last_clean":"2024-04-26T11:26:35.383462+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:26:35.383462+0000","last_undegraded":"2024-04-26T11:26:35.383462+0000","last_fullsized":"2024-04-26T11:26:35.383462+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:32.214458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":682,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.379122+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:35.379122+0000","last_peered":"2024-04-26T11:26:35.379122+0000","last_clean":"2024-04-26T11:26:35.379122+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:35.379122+0000","last_undegraded":"2024-04-26T11:26:35.379122+0000","last_fullsized":"2024-04-26T11:26:35.379122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":917,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380154+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:35.380154+0000","last_peered":"2024-04-26T11:26:35.380154+0000","last_clean":"2024-04-26T11:26:35.380154+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:35.380154+0000","last_undegraded":"2024-04-26T11:26:35.380154+0000","last_fullsized":"2024-04-26T11:26:35.380154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":389,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.378742+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:35.378742+0000","last_peered":"2024-04-26T11:26:35.378742+0000","last_clean":"2024-04-26T11:26:35.378742+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:35.378742+0000","last_undegraded":"2024-04-26T11:26:35.378742+0000","last_fullsized":"2024-04-26T11:26:35.378742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1011,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-26T11:26:36.406522+0000","last_change":"2024-04-26T11:26:36.406522+0000","last_active":"2024-04-26T11:26:36.406522+0000","last_peered":"2024-04-26T11:26:36.406522+0000","last_clean":"2024-04-26T11:26:36.406522+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:26:36.406522+0000","last_undegraded":"2024-04-26T11:26:36.406522+0000","last_fullsized":"2024-04-26T11:26:36.406522+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:05.312742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":426,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382724+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:35.382724+0000","last_peered":"2024-04-26T11:26:35.382724+0000","last_clean":"2024-04-26T11:26:35.382724+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:35.382724+0000","last_undegraded":"2024-04-26T11:26:35.382724+0000","last_fullsized":"2024-04-26T11:26:35.382724+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":494,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381867+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:35.381867+0000","last_peered":"2024-04-26T11:26:35.381867+0000","last_clean":"2024-04-26T11:26:35.381867+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:35.381867+0000","last_undegraded":"2024-04-26T11:26:35.381867+0000","last_fullsized":"2024-04-26T11:26:35.381867+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":147,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.382238+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:35.382238+0000","last_peered":"2024-04-26T11:26:35.382238+0000","last_clean":"2024-04-26T11:26:35.382238+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:35.382238+0000","last_undegraded":"2024-04-26T11:26:35.382238+0000","last_fullsized":"2024-04-26T11:26:35.382238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":473,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.891024+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:37.891024+0000","last_peered":"2024-04-26T11:26:37.891024+0000","last_clean":"2024-04-26T11:26:37.891024+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:37.891024+0000","last_undegraded":"2024-04-26T11:26:37.891024+0000","last_fullsized":"2024-04-26T11:26:37.891024+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":402,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.890906+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:37.890906+0000","last_peered":"2024-04-26T11:26:37.890906+0000","last_clean":"2024-04-26T11:26:37.890906+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:37.890906+0000","last_undegraded":"2024-04-26T11:26:37.890906+0000","last_fullsized":"2024-04-26T11:26:37.890906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":489,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889553+0000","last_change":"2024-04-26T11:26:31.896245+0000","last_active":"2024-04-26T11:26:37.889553+0000","last_peered":"2024-04-26T11:26:37.889553+0000","last_clean":"2024-04-26T11:26:37.889553+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:26:37.889553+0000","last_undegraded":"2024-04-26T11:26:37.889553+0000","last_fullsized":"2024-04-26T11:26:37.889553+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:59.173436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":492,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.383508+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:35.383508+0000","last_peered":"2024-04-26T11:26:35.383508+0000","last_clean":"2024-04-26T11:26:35.383508+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:35.383508+0000","last_undegraded":"2024-04-26T11:26:35.383508+0000","last_fullsized":"2024-04-26T11:26:35.383508+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":493,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.381445+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:35.381445+0000","last_peered":"2024-04-26T11:26:35.381445+0000","last_clean":"2024-04-26T11:26:35.381445+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:35.381445+0000","last_undegraded":"2024-04-26T11:26:35.381445+0000","last_fullsized":"2024-04-26T11:26:35.381445+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":153,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380382+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:35.380382+0000","last_peered":"2024-04-26T11:26:35.380382+0000","last_clean":"2024-04-26T11:26:35.380382+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:35.380382+0000","last_undegraded":"2024-04-26T11:26:35.380382+0000","last_fullsized":"2024-04-26T11:26:35.380382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":540,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-04-26T11:26:37.889211+0000","last_change":"2024-04-26T11:26:33.905426+0000","last_active":"2024-04-26T11:26:37.889211+0000","last_peered":"2024-04-26T11:26:37.889211+0000","last_clean":"2024-04-26T11:26:37.889211+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:37.889211+0000","last_undegraded":"2024-04-26T11:26:37.889211+0000","last_fullsized":"2024-04-26T11:26:37.889211+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:49.659488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":251,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-26T11:26:35.380072+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:35.380072+0000","last_peered":"2024-04-26T11:26:35.380072+0000","last_clean":"2024-04-26T11:26:35.380072+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:35.380072+0000","last_undegraded":"2024-04-26T11:26:35.380072+0000","last_fullsized":"2024-04-26T11:26:35.380072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":576,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6696,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":124,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738432,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142392,"kb_used_data":30948,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229448,"statfs":{"total":96636764160,"available":96490954752,"internally_reserved":0,"allocated":31690752,"data_stored":81587312,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.751}]}]},{"osd":1,"up_from":8,"seq":34359738432,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124300,"kb_used_data":30912,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247540,"statfs":{"total":96636764160,"available":96509480960,"internally_reserved":0,"allocated":31653888,"data_stored":86091432,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.623},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.66400000000000003}]}]},{"osd":0,"up_from":75,"seq":322122547208,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71812,"kb_used_data":18044,"kb_used_omap":7,"kb_used_meta":53752,"kb_avail":94300028,"statfs":{"total":96636764160,"available":96563228672,"internally_reserved":0,"allocated":18477056,"data_stored":91768770,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":55043063},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:45.899 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:46.215 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:46.217 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:46.234 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2024-04-26T11:26:45.454132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7334,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":342728,"kb_used_data":80016,"kb_used_omap":10,"kb_used_meta":262645,"kb_avail":282772792,"statfs":{"total":289910292480,"available":289559339008,"internally_reserved":0,"allocated":81936384,"data_stored":259503479,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":268949379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1143,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.086259"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":509,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375889+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:40.375889+0000","last_peered":"2024-04-26T11:26:40.375889+0000","last_clean":"2024-04-26T11:26:40.375889+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:40.375889+0000","last_undegraded":"2024-04-26T11:26:40.375889+0000","last_fullsized":"2024-04-26T11:26:40.375889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":565,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375446+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:40.375446+0000","last_peered":"2024-04-26T11:26:40.375446+0000","last_clean":"2024-04-26T11:26:40.375446+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:40.375446+0000","last_undegraded":"2024-04-26T11:26:40.375446+0000","last_fullsized":"2024-04-26T11:26:40.375446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":440,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898192+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:39.898192+0000","last_peered":"2024-04-26T11:26:39.898192+0000","last_clean":"2024-04-26T11:26:39.898192+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:39.898192+0000","last_undegraded":"2024-04-26T11:26:39.898192+0000","last_fullsized":"2024-04-26T11:26:39.898192+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":489,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896372+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:39.896372+0000","last_peered":"2024-04-26T11:26:39.896372+0000","last_clean":"2024-04-26T11:26:39.896372+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:39.896372+0000","last_undegraded":"2024-04-26T11:26:39.896372+0000","last_fullsized":"2024-04-26T11:26:39.896372+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":540,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375005+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:40.375005+0000","last_peered":"2024-04-26T11:26:40.375005+0000","last_clean":"2024-04-26T11:26:40.375005+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:40.375005+0000","last_undegraded":"2024-04-26T11:26:40.375005+0000","last_fullsized":"2024-04-26T11:26:40.375005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":493,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896914+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:39.896914+0000","last_peered":"2024-04-26T11:26:39.896914+0000","last_clean":"2024-04-26T11:26:39.896914+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:39.896914+0000","last_undegraded":"2024-04-26T11:26:39.896914+0000","last_fullsized":"2024-04-26T11:26:39.896914+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":594,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895848+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:39.895848+0000","last_peered":"2024-04-26T11:26:39.895848+0000","last_clean":"2024-04-26T11:26:39.895848+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:39.895848+0000","last_undegraded":"2024-04-26T11:26:39.895848+0000","last_fullsized":"2024-04-26T11:26:39.895848+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":462,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896813+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:39.896813+0000","last_peered":"2024-04-26T11:26:39.896813+0000","last_clean":"2024-04-26T11:26:39.896813+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:39.896813+0000","last_undegraded":"2024-04-26T11:26:39.896813+0000","last_fullsized":"2024-04-26T11:26:39.896813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":596,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372012+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:40.372012+0000","last_peered":"2024-04-26T11:26:40.372012+0000","last_clean":"2024-04-26T11:26:40.372012+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:40.372012+0000","last_undegraded":"2024-04-26T11:26:40.372012+0000","last_fullsized":"2024-04-26T11:26:40.372012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":506,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375596+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:40.375596+0000","last_peered":"2024-04-26T11:26:40.375596+0000","last_clean":"2024-04-26T11:26:40.375596+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:40.375596+0000","last_undegraded":"2024-04-26T11:26:40.375596+0000","last_fullsized":"2024-04-26T11:26:40.375596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":480,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898025+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:39.898025+0000","last_peered":"2024-04-26T11:26:39.898025+0000","last_clean":"2024-04-26T11:26:39.898025+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:39.898025+0000","last_undegraded":"2024-04-26T11:26:39.898025+0000","last_fullsized":"2024-04-26T11:26:39.898025+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:07.200544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":782,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375001+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:40.375001+0000","last_peered":"2024-04-26T11:26:40.375001+0000","last_clean":"2024-04-26T11:26:40.375001+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:40.375001+0000","last_undegraded":"2024-04-26T11:26:40.375001+0000","last_fullsized":"2024-04-26T11:26:40.375001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":453,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374678+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:40.374678+0000","last_peered":"2024-04-26T11:26:40.374678+0000","last_clean":"2024-04-26T11:26:40.374678+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:40.374678+0000","last_undegraded":"2024-04-26T11:26:40.374678+0000","last_fullsized":"2024-04-26T11:26:40.374678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":482,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896659+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:39.896659+0000","last_peered":"2024-04-26T11:26:39.896659+0000","last_clean":"2024-04-26T11:26:39.896659+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:39.896659+0000","last_undegraded":"2024-04-26T11:26:39.896659+0000","last_fullsized":"2024-04-26T11:26:39.896659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":538,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896114+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:39.896114+0000","last_peered":"2024-04-26T11:26:39.896114+0000","last_clean":"2024-04-26T11:26:39.896114+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:39.896114+0000","last_undegraded":"2024-04-26T11:26:39.896114+0000","last_fullsized":"2024-04-26T11:26:39.896114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":603,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897245+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:39.897245+0000","last_peered":"2024-04-26T11:26:39.897245+0000","last_clean":"2024-04-26T11:26:39.897245+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:39.897245+0000","last_undegraded":"2024-04-26T11:26:39.897245+0000","last_fullsized":"2024-04-26T11:26:39.897245+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":577,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372796+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:40.372796+0000","last_peered":"2024-04-26T11:26:40.372796+0000","last_clean":"2024-04-26T11:26:40.372796+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:40.372796+0000","last_undegraded":"2024-04-26T11:26:40.372796+0000","last_fullsized":"2024-04-26T11:26:40.372796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":584,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375825+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:40.375825+0000","last_peered":"2024-04-26T11:26:40.375825+0000","last_clean":"2024-04-26T11:26:40.375825+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:40.375825+0000","last_undegraded":"2024-04-26T11:26:40.375825+0000","last_fullsized":"2024-04-26T11:26:40.375825+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":623,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371677+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:40.371677+0000","last_peered":"2024-04-26T11:26:40.371677+0000","last_clean":"2024-04-26T11:26:40.371677+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:40.371677+0000","last_undegraded":"2024-04-26T11:26:40.371677+0000","last_fullsized":"2024-04-26T11:26:40.371677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":611,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897131+0000","last_change":"2024-04-26T11:26:29.907661+0000","last_active":"2024-04-26T11:26:39.897131+0000","last_peered":"2024-04-26T11:26:39.897131+0000","last_clean":"2024-04-26T11:26:39.897131+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:26:39.897131+0000","last_undegraded":"2024-04-26T11:26:39.897131+0000","last_fullsized":"2024-04-26T11:26:39.897131+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":549,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896468+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:39.896468+0000","last_peered":"2024-04-26T11:26:39.896468+0000","last_clean":"2024-04-26T11:26:39.896468+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:39.896468+0000","last_undegraded":"2024-04-26T11:26:39.896468+0000","last_fullsized":"2024-04-26T11:26:39.896468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.393282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":978,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374306+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:40.374306+0000","last_peered":"2024-04-26T11:26:40.374306+0000","last_clean":"2024-04-26T11:26:40.374306+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:40.374306+0000","last_undegraded":"2024-04-26T11:26:40.374306+0000","last_fullsized":"2024-04-26T11:26:40.374306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:06.847831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":932,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.369890+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:40.369890+0000","last_peered":"2024-04-26T11:26:40.369890+0000","last_clean":"2024-04-26T11:26:40.369890+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:40.369890+0000","last_undegraded":"2024-04-26T11:26:40.369890+0000","last_fullsized":"2024-04-26T11:26:40.369890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":515,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373716+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:40.373716+0000","last_peered":"2024-04-26T11:26:40.373716+0000","last_clean":"2024-04-26T11:26:40.373716+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:40.373716+0000","last_undegraded":"2024-04-26T11:26:40.373716+0000","last_fullsized":"2024-04-26T11:26:40.373716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":948,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376062+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:40.376062+0000","last_peered":"2024-04-26T11:26:40.376062+0000","last_clean":"2024-04-26T11:26:40.376062+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:40.376062+0000","last_undegraded":"2024-04-26T11:26:40.376062+0000","last_fullsized":"2024-04-26T11:26:40.376062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:04.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1054,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372134+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:40.372134+0000","last_peered":"2024-04-26T11:26:40.372134+0000","last_clean":"2024-04-26T11:26:40.372134+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:40.372134+0000","last_undegraded":"2024-04-26T11:26:40.372134+0000","last_fullsized":"2024-04-26T11:26:40.372134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":558,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897950+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:39.897950+0000","last_peered":"2024-04-26T11:26:39.897950+0000","last_clean":"2024-04-26T11:26:39.897950+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:39.897950+0000","last_undegraded":"2024-04-26T11:26:39.897950+0000","last_fullsized":"2024-04-26T11:26:39.897950+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":951,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375483+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:40.375483+0000","last_peered":"2024-04-26T11:26:40.375483+0000","last_clean":"2024-04-26T11:26:40.375483+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:40.375483+0000","last_undegraded":"2024-04-26T11:26:40.375483+0000","last_fullsized":"2024-04-26T11:26:40.375483+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":508,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371263+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:40.371263+0000","last_peered":"2024-04-26T11:26:40.371263+0000","last_clean":"2024-04-26T11:26:40.371263+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:40.371263+0000","last_undegraded":"2024-04-26T11:26:40.371263+0000","last_fullsized":"2024-04-26T11:26:40.371263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":1028,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374860+0000","last_change":"2024-04-26T11:26:38.377195+0000","last_active":"2024-04-26T11:26:40.374860+0000","last_peered":"2024-04-26T11:26:40.374860+0000","last_clean":"2024-04-26T11:26:40.374860+0000","last_became_active":"2024-04-26T11:26:38.373963+0000","last_became_peered":"2024-04-26T11:26:38.373963+0000","last_unstale":"2024-04-26T11:26:40.374860+0000","last_undegraded":"2024-04-26T11:26:40.374860+0000","last_fullsized":"2024-04-26T11:26:40.374860+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:57.937161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":628,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370077+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:40.370077+0000","last_peered":"2024-04-26T11:26:40.370077+0000","last_clean":"2024-04-26T11:26:40.370077+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:40.370077+0000","last_undegraded":"2024-04-26T11:26:40.370077+0000","last_fullsized":"2024-04-26T11:26:40.370077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":499,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.901431+0000","last_change":"2024-04-26T11:26:40.900605+0000","last_active":"2024-04-26T11:26:40.901431+0000","last_peered":"2024-04-26T11:26:40.901431+0000","last_clean":"2024-04-26T11:26:40.901431+0000","last_became_active":"2024-04-26T11:26:40.895623+0000","last_became_peered":"2024-04-26T11:26:40.895623+0000","last_unstale":"2024-04-26T11:26:40.901431+0000","last_undegraded":"2024-04-26T11:26:40.901431+0000","last_fullsized":"2024-04-26T11:26:40.901431+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:04.320929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":485,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375274+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:40.375274+0000","last_peered":"2024-04-26T11:26:40.375274+0000","last_clean":"2024-04-26T11:26:40.375274+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:40.375274+0000","last_undegraded":"2024-04-26T11:26:40.375274+0000","last_fullsized":"2024-04-26T11:26:40.375274+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":550,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895866+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:39.895866+0000","last_peered":"2024-04-26T11:26:39.895866+0000","last_clean":"2024-04-26T11:26:39.895866+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:39.895866+0000","last_undegraded":"2024-04-26T11:26:39.895866+0000","last_fullsized":"2024-04-26T11:26:39.895866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":505,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375633+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:40.375633+0000","last_peered":"2024-04-26T11:26:40.375633+0000","last_clean":"2024-04-26T11:26:40.375633+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:40.375633+0000","last_undegraded":"2024-04-26T11:26:40.375633+0000","last_fullsized":"2024-04-26T11:26:40.375633+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":176,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370912+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:40.370912+0000","last_peered":"2024-04-26T11:26:40.370912+0000","last_clean":"2024-04-26T11:26:40.370912+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:40.370912+0000","last_undegraded":"2024-04-26T11:26:40.370912+0000","last_fullsized":"2024-04-26T11:26:40.370912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":997,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372764+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:40.372764+0000","last_peered":"2024-04-26T11:26:40.372764+0000","last_clean":"2024-04-26T11:26:40.372764+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:40.372764+0000","last_undegraded":"2024-04-26T11:26:40.372764+0000","last_fullsized":"2024-04-26T11:26:40.372764+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":164,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374326+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:40.374326+0000","last_peered":"2024-04-26T11:26:40.374326+0000","last_clean":"2024-04-26T11:26:40.374326+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:40.374326+0000","last_undegraded":"2024-04-26T11:26:40.374326+0000","last_fullsized":"2024-04-26T11:26:40.374326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":937,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372115+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:40.372115+0000","last_peered":"2024-04-26T11:26:40.372115+0000","last_clean":"2024-04-26T11:26:40.372115+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:40.372115+0000","last_undegraded":"2024-04-26T11:26:40.372115+0000","last_fullsized":"2024-04-26T11:26:40.372115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":52,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895270+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:39.895270+0000","last_peered":"2024-04-26T11:26:39.895270+0000","last_clean":"2024-04-26T11:26:39.895270+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:39.895270+0000","last_undegraded":"2024-04-26T11:26:39.895270+0000","last_fullsized":"2024-04-26T11:26:39.895270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":242,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898259+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:39.898259+0000","last_peered":"2024-04-26T11:26:39.898259+0000","last_clean":"2024-04-26T11:26:39.898259+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:39.898259+0000","last_undegraded":"2024-04-26T11:26:39.898259+0000","last_fullsized":"2024-04-26T11:26:39.898259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":876,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373876+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:40.373876+0000","last_peered":"2024-04-26T11:26:40.373876+0000","last_clean":"2024-04-26T11:26:40.373876+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:40.373876+0000","last_undegraded":"2024-04-26T11:26:40.373876+0000","last_fullsized":"2024-04-26T11:26:40.373876+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":401,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376112+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:40.376112+0000","last_peered":"2024-04-26T11:26:40.376112+0000","last_clean":"2024-04-26T11:26:40.376112+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:40.376112+0000","last_undegraded":"2024-04-26T11:26:40.376112+0000","last_fullsized":"2024-04-26T11:26:40.376112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":580,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374073+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:40.374073+0000","last_peered":"2024-04-26T11:26:40.374073+0000","last_clean":"2024-04-26T11:26:40.374073+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:40.374073+0000","last_undegraded":"2024-04-26T11:26:40.374073+0000","last_fullsized":"2024-04-26T11:26:40.374073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":645,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897731+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:39.897731+0000","last_peered":"2024-04-26T11:26:39.897731+0000","last_clean":"2024-04-26T11:26:39.897731+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:39.897731+0000","last_undegraded":"2024-04-26T11:26:39.897731+0000","last_fullsized":"2024-04-26T11:26:39.897731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":530,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.906286+0000","last_change":"2024-04-26T11:26:39.905388+0000","last_active":"2024-04-26T11:26:39.906286+0000","last_peered":"2024-04-26T11:26:39.906286+0000","last_clean":"2024-04-26T11:26:39.906286+0000","last_became_active":"2024-04-26T11:26:39.900162+0000","last_became_peered":"2024-04-26T11:26:39.900162+0000","last_unstale":"2024-04-26T11:26:39.906286+0000","last_undegraded":"2024-04-26T11:26:39.906286+0000","last_fullsized":"2024-04-26T11:26:39.906286+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:50.194168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897546+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:39.897546+0000","last_peered":"2024-04-26T11:26:39.897546+0000","last_clean":"2024-04-26T11:26:39.897546+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:39.897546+0000","last_undegraded":"2024-04-26T11:26:39.897546+0000","last_fullsized":"2024-04-26T11:26:39.897546+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":958,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370924+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:40.370924+0000","last_peered":"2024-04-26T11:26:40.370924+0000","last_clean":"2024-04-26T11:26:40.370924+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:40.370924+0000","last_undegraded":"2024-04-26T11:26:40.370924+0000","last_fullsized":"2024-04-26T11:26:40.370924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":310,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371534+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:40.371534+0000","last_peered":"2024-04-26T11:26:40.371534+0000","last_clean":"2024-04-26T11:26:40.371534+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:40.371534+0000","last_undegraded":"2024-04-26T11:26:40.371534+0000","last_fullsized":"2024-04-26T11:26:40.371534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":527,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897534+0000","last_change":"2024-04-26T11:26:35.931909+0000","last_active":"2024-04-26T11:26:39.897534+0000","last_peered":"2024-04-26T11:26:39.897534+0000","last_clean":"2024-04-26T11:26:39.897534+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:26:39.897534+0000","last_undegraded":"2024-04-26T11:26:39.897534+0000","last_fullsized":"2024-04-26T11:26:39.897534+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:22.946052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":295,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896059+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:39.896059+0000","last_peered":"2024-04-26T11:26:39.896059+0000","last_clean":"2024-04-26T11:26:39.896059+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:39.896059+0000","last_undegraded":"2024-04-26T11:26:39.896059+0000","last_fullsized":"2024-04-26T11:26:39.896059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":471,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897608+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:39.897608+0000","last_peered":"2024-04-26T11:26:39.897608+0000","last_clean":"2024-04-26T11:26:39.897608+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:39.897608+0000","last_undegraded":"2024-04-26T11:26:39.897608+0000","last_fullsized":"2024-04-26T11:26:39.897608+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":151,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374409+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:40.374409+0000","last_peered":"2024-04-26T11:26:40.374409+0000","last_clean":"2024-04-26T11:26:40.374409+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:40.374409+0000","last_undegraded":"2024-04-26T11:26:40.374409+0000","last_fullsized":"2024-04-26T11:26:40.374409+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":446,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897851+0000","last_change":"2024-04-26T11:26:29.914048+0000","last_active":"2024-04-26T11:26:39.897851+0000","last_peered":"2024-04-26T11:26:39.897851+0000","last_clean":"2024-04-26T11:26:39.897851+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:26:39.897851+0000","last_undegraded":"2024-04-26T11:26:39.897851+0000","last_fullsized":"2024-04-26T11:26:39.897851+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":352,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373885+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:40.373885+0000","last_peered":"2024-04-26T11:26:40.373885+0000","last_clean":"2024-04-26T11:26:40.373885+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:40.373885+0000","last_undegraded":"2024-04-26T11:26:40.373885+0000","last_fullsized":"2024-04-26T11:26:40.373885+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":553,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372264+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:40.372264+0000","last_peered":"2024-04-26T11:26:40.372264+0000","last_clean":"2024-04-26T11:26:40.372264+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:40.372264+0000","last_undegraded":"2024-04-26T11:26:40.372264+0000","last_fullsized":"2024-04-26T11:26:40.372264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":247,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.894834+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:39.894834+0000","last_peered":"2024-04-26T11:26:39.894834+0000","last_clean":"2024-04-26T11:26:39.894834+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:39.894834+0000","last_undegraded":"2024-04-26T11:26:39.894834+0000","last_fullsized":"2024-04-26T11:26:39.894834+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895601+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:39.895601+0000","last_peered":"2024-04-26T11:26:39.895601+0000","last_clean":"2024-04-26T11:26:39.895601+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:39.895601+0000","last_undegraded":"2024-04-26T11:26:39.895601+0000","last_fullsized":"2024-04-26T11:26:39.895601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":851,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371480+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:40.371480+0000","last_peered":"2024-04-26T11:26:40.371480+0000","last_clean":"2024-04-26T11:26:40.371480+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:40.371480+0000","last_undegraded":"2024-04-26T11:26:40.371480+0000","last_fullsized":"2024-04-26T11:26:40.371480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":514,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897848+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:39.897848+0000","last_peered":"2024-04-26T11:26:39.897848+0000","last_clean":"2024-04-26T11:26:39.897848+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:39.897848+0000","last_undegraded":"2024-04-26T11:26:39.897848+0000","last_fullsized":"2024-04-26T11:26:39.897848+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896930+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:39.896930+0000","last_peered":"2024-04-26T11:26:39.896930+0000","last_clean":"2024-04-26T11:26:39.896930+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:39.896930+0000","last_undegraded":"2024-04-26T11:26:39.896930+0000","last_fullsized":"2024-04-26T11:26:39.896930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":292,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370638+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:40.370638+0000","last_peered":"2024-04-26T11:26:40.370638+0000","last_clean":"2024-04-26T11:26:40.370638+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:40.370638+0000","last_undegraded":"2024-04-26T11:26:40.370638+0000","last_fullsized":"2024-04-26T11:26:40.370638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":562,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375681+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:40.375681+0000","last_peered":"2024-04-26T11:26:40.375681+0000","last_clean":"2024-04-26T11:26:40.375681+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:40.375681+0000","last_undegraded":"2024-04-26T11:26:40.375681+0000","last_fullsized":"2024-04-26T11:26:40.375681+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371265+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:40.371265+0000","last_peered":"2024-04-26T11:26:40.371265+0000","last_clean":"2024-04-26T11:26:40.371265+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:40.371265+0000","last_undegraded":"2024-04-26T11:26:40.371265+0000","last_fullsized":"2024-04-26T11:26:40.371265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":482,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374138+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:40.374138+0000","last_peered":"2024-04-26T11:26:40.374138+0000","last_clean":"2024-04-26T11:26:40.374138+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:40.374138+0000","last_undegraded":"2024-04-26T11:26:40.374138+0000","last_fullsized":"2024-04-26T11:26:40.374138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":453,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372369+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:40.372369+0000","last_peered":"2024-04-26T11:26:40.372369+0000","last_clean":"2024-04-26T11:26:40.372369+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:40.372369+0000","last_undegraded":"2024-04-26T11:26:40.372369+0000","last_fullsized":"2024-04-26T11:26:40.372369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895458+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:39.895458+0000","last_peered":"2024-04-26T11:26:39.895458+0000","last_clean":"2024-04-26T11:26:39.895458+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:39.895458+0000","last_undegraded":"2024-04-26T11:26:39.895458+0000","last_fullsized":"2024-04-26T11:26:39.895458+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895632+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:39.895632+0000","last_peered":"2024-04-26T11:26:39.895632+0000","last_clean":"2024-04-26T11:26:39.895632+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:39.895632+0000","last_undegraded":"2024-04-26T11:26:39.895632+0000","last_fullsized":"2024-04-26T11:26:39.895632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":562,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372246+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:40.372246+0000","last_peered":"2024-04-26T11:26:40.372246+0000","last_clean":"2024-04-26T11:26:40.372246+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:40.372246+0000","last_undegraded":"2024-04-26T11:26:40.372246+0000","last_fullsized":"2024-04-26T11:26:40.372246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896978+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:39.896978+0000","last_peered":"2024-04-26T11:26:39.896978+0000","last_clean":"2024-04-26T11:26:39.896978+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:39.896978+0000","last_undegraded":"2024-04-26T11:26:39.896978+0000","last_fullsized":"2024-04-26T11:26:39.896978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372506+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:40.372506+0000","last_peered":"2024-04-26T11:26:40.372506+0000","last_clean":"2024-04-26T11:26:40.372506+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:40.372506+0000","last_undegraded":"2024-04-26T11:26:40.372506+0000","last_fullsized":"2024-04-26T11:26:40.372506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":792,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374549+0000","last_change":"2024-04-26T11:26:35.389500+0000","last_active":"2024-04-26T11:26:40.374549+0000","last_peered":"2024-04-26T11:26:40.374549+0000","last_clean":"2024-04-26T11:26:40.374549+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:26:40.374549+0000","last_undegraded":"2024-04-26T11:26:40.374549+0000","last_fullsized":"2024-04-26T11:26:40.374549+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:56.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":158,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372239+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:40.372239+0000","last_peered":"2024-04-26T11:26:40.372239+0000","last_clean":"2024-04-26T11:26:40.372239+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:40.372239+0000","last_undegraded":"2024-04-26T11:26:40.372239+0000","last_fullsized":"2024-04-26T11:26:40.372239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376205+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:40.376205+0000","last_peered":"2024-04-26T11:26:40.376205+0000","last_clean":"2024-04-26T11:26:40.376205+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:40.376205+0000","last_undegraded":"2024-04-26T11:26:40.376205+0000","last_fullsized":"2024-04-26T11:26:40.376205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":817,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374730+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:40.374730+0000","last_peered":"2024-04-26T11:26:40.374730+0000","last_clean":"2024-04-26T11:26:40.374730+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:40.374730+0000","last_undegraded":"2024-04-26T11:26:40.374730+0000","last_fullsized":"2024-04-26T11:26:40.374730+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":161,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372975+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:40.372975+0000","last_peered":"2024-04-26T11:26:40.372975+0000","last_clean":"2024-04-26T11:26:40.372975+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:40.372975+0000","last_undegraded":"2024-04-26T11:26:40.372975+0000","last_fullsized":"2024-04-26T11:26:40.372975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372900+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:40.372900+0000","last_peered":"2024-04-26T11:26:40.372900+0000","last_clean":"2024-04-26T11:26:40.372900+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:40.372900+0000","last_undegraded":"2024-04-26T11:26:40.372900+0000","last_fullsized":"2024-04-26T11:26:40.372900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":926,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370385+0000","last_change":"2024-04-26T11:26:39.378496+0000","last_active":"2024-04-26T11:26:40.370385+0000","last_peered":"2024-04-26T11:26:40.370385+0000","last_clean":"2024-04-26T11:26:40.370385+0000","last_became_active":"2024-04-26T11:26:39.375075+0000","last_became_peered":"2024-04-26T11:26:39.375075+0000","last_unstale":"2024-04-26T11:26:40.370385+0000","last_undegraded":"2024-04-26T11:26:40.370385+0000","last_fullsized":"2024-04-26T11:26:40.370385+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:37.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":190,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372812+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:40.372812+0000","last_peered":"2024-04-26T11:26:40.372812+0000","last_clean":"2024-04-26T11:26:40.372812+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:40.372812+0000","last_undegraded":"2024-04-26T11:26:40.372812+0000","last_fullsized":"2024-04-26T11:26:40.372812+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897855+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:39.897855+0000","last_peered":"2024-04-26T11:26:39.897855+0000","last_clean":"2024-04-26T11:26:39.897855+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:39.897855+0000","last_undegraded":"2024-04-26T11:26:39.897855+0000","last_fullsized":"2024-04-26T11:26:39.897855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":930,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374136+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:40.374136+0000","last_peered":"2024-04-26T11:26:40.374136+0000","last_clean":"2024-04-26T11:26:40.374136+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:40.374136+0000","last_undegraded":"2024-04-26T11:26:40.374136+0000","last_fullsized":"2024-04-26T11:26:40.374136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":512,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896222+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:39.896222+0000","last_peered":"2024-04-26T11:26:39.896222+0000","last_clean":"2024-04-26T11:26:39.896222+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:39.896222+0000","last_undegraded":"2024-04-26T11:26:39.896222+0000","last_fullsized":"2024-04-26T11:26:39.896222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":491,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896711+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:39.896711+0000","last_peered":"2024-04-26T11:26:39.896711+0000","last_clean":"2024-04-26T11:26:39.896711+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:39.896711+0000","last_undegraded":"2024-04-26T11:26:39.896711+0000","last_fullsized":"2024-04-26T11:26:39.896711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":556,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370468+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:40.370468+0000","last_peered":"2024-04-26T11:26:40.370468+0000","last_clean":"2024-04-26T11:26:40.370468+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:40.370468+0000","last_undegraded":"2024-04-26T11:26:40.370468+0000","last_fullsized":"2024-04-26T11:26:40.370468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":181,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376086+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:40.376086+0000","last_peered":"2024-04-26T11:26:40.376086+0000","last_clean":"2024-04-26T11:26:40.376086+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:40.376086+0000","last_undegraded":"2024-04-26T11:26:40.376086+0000","last_fullsized":"2024-04-26T11:26:40.376086+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":416,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897546+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:39.897546+0000","last_peered":"2024-04-26T11:26:39.897546+0000","last_clean":"2024-04-26T11:26:39.897546+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:39.897546+0000","last_undegraded":"2024-04-26T11:26:39.897546+0000","last_fullsized":"2024-04-26T11:26:39.897546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":1025,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370129+0000","last_change":"2024-04-26T11:26:38.376749+0000","last_active":"2024-04-26T11:26:40.370129+0000","last_peered":"2024-04-26T11:26:40.370129+0000","last_clean":"2024-04-26T11:26:40.370129+0000","last_became_active":"2024-04-26T11:26:38.373800+0000","last_became_peered":"2024-04-26T11:26:38.373800+0000","last_unstale":"2024-04-26T11:26:40.370129+0000","last_undegraded":"2024-04-26T11:26:40.370129+0000","last_fullsized":"2024-04-26T11:26:40.370129+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:23.112909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":165,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372797+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:40.372797+0000","last_peered":"2024-04-26T11:26:40.372797+0000","last_clean":"2024-04-26T11:26:40.372797+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:40.372797+0000","last_undegraded":"2024-04-26T11:26:40.372797+0000","last_fullsized":"2024-04-26T11:26:40.372797+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370124+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:40.370124+0000","last_peered":"2024-04-26T11:26:40.370124+0000","last_clean":"2024-04-26T11:26:40.370124+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:40.370124+0000","last_undegraded":"2024-04-26T11:26:40.370124+0000","last_fullsized":"2024-04-26T11:26:40.370124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":792,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376038+0000","last_change":"2024-04-26T11:26:32.372817+0000","last_active":"2024-04-26T11:26:40.376038+0000","last_peered":"2024-04-26T11:26:40.376038+0000","last_clean":"2024-04-26T11:26:40.376038+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:26:40.376038+0000","last_undegraded":"2024-04-26T11:26:40.376038+0000","last_fullsized":"2024-04-26T11:26:40.376038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:32.214458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":687,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370831+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:40.370831+0000","last_peered":"2024-04-26T11:26:40.370831+0000","last_clean":"2024-04-26T11:26:40.370831+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:40.370831+0000","last_undegraded":"2024-04-26T11:26:40.370831+0000","last_fullsized":"2024-04-26T11:26:40.370831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":922,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372380+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:40.372380+0000","last_peered":"2024-04-26T11:26:40.372380+0000","last_clean":"2024-04-26T11:26:40.372380+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:40.372380+0000","last_undegraded":"2024-04-26T11:26:40.372380+0000","last_fullsized":"2024-04-26T11:26:40.372380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":394,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370389+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:40.370389+0000","last_peered":"2024-04-26T11:26:40.370389+0000","last_clean":"2024-04-26T11:26:40.370389+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:40.370389+0000","last_undegraded":"2024-04-26T11:26:40.370389+0000","last_fullsized":"2024-04-26T11:26:40.370389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1016,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375585+0000","last_change":"2024-04-26T11:26:36.406522+0000","last_active":"2024-04-26T11:26:40.375585+0000","last_peered":"2024-04-26T11:26:40.375585+0000","last_clean":"2024-04-26T11:26:40.375585+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:26:40.375585+0000","last_undegraded":"2024-04-26T11:26:40.375585+0000","last_fullsized":"2024-04-26T11:26:40.375585+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:05.312742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":431,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374748+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:40.374748+0000","last_peered":"2024-04-26T11:26:40.374748+0000","last_clean":"2024-04-26T11:26:40.374748+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:40.374748+0000","last_undegraded":"2024-04-26T11:26:40.374748+0000","last_fullsized":"2024-04-26T11:26:40.374748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":499,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375046+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:40.375046+0000","last_peered":"2024-04-26T11:26:40.375046+0000","last_clean":"2024-04-26T11:26:40.375046+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:40.375046+0000","last_undegraded":"2024-04-26T11:26:40.375046+0000","last_fullsized":"2024-04-26T11:26:40.375046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":152,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375041+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:40.375041+0000","last_peered":"2024-04-26T11:26:40.375041+0000","last_clean":"2024-04-26T11:26:40.375041+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:40.375041+0000","last_undegraded":"2024-04-26T11:26:40.375041+0000","last_fullsized":"2024-04-26T11:26:40.375041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":475,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896112+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:39.896112+0000","last_peered":"2024-04-26T11:26:39.896112+0000","last_clean":"2024-04-26T11:26:39.896112+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:39.896112+0000","last_undegraded":"2024-04-26T11:26:39.896112+0000","last_fullsized":"2024-04-26T11:26:39.896112+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":404,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895905+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:39.895905+0000","last_peered":"2024-04-26T11:26:39.895905+0000","last_clean":"2024-04-26T11:26:39.895905+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:39.895905+0000","last_undegraded":"2024-04-26T11:26:39.895905+0000","last_fullsized":"2024-04-26T11:26:39.895905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":491,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897078+0000","last_change":"2024-04-26T11:26:31.896245+0000","last_active":"2024-04-26T11:26:39.897078+0000","last_peered":"2024-04-26T11:26:39.897078+0000","last_clean":"2024-04-26T11:26:39.897078+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:26:39.897078+0000","last_undegraded":"2024-04-26T11:26:39.897078+0000","last_fullsized":"2024-04-26T11:26:39.897078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:59.173436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":497,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375850+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:40.375850+0000","last_peered":"2024-04-26T11:26:40.375850+0000","last_clean":"2024-04-26T11:26:40.375850+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:40.375850+0000","last_undegraded":"2024-04-26T11:26:40.375850+0000","last_fullsized":"2024-04-26T11:26:40.375850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":498,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374562+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:40.374562+0000","last_peered":"2024-04-26T11:26:40.374562+0000","last_clean":"2024-04-26T11:26:40.374562+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:40.374562+0000","last_undegraded":"2024-04-26T11:26:40.374562+0000","last_fullsized":"2024-04-26T11:26:40.374562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":158,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372672+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:40.372672+0000","last_peered":"2024-04-26T11:26:40.372672+0000","last_clean":"2024-04-26T11:26:40.372672+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:40.372672+0000","last_undegraded":"2024-04-26T11:26:40.372672+0000","last_fullsized":"2024-04-26T11:26:40.372672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":542,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897090+0000","last_change":"2024-04-26T11:26:33.905426+0000","last_active":"2024-04-26T11:26:39.897090+0000","last_peered":"2024-04-26T11:26:39.897090+0000","last_clean":"2024-04-26T11:26:39.897090+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:39.897090+0000","last_undegraded":"2024-04-26T11:26:39.897090+0000","last_fullsized":"2024-04-26T11:26:39.897090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:49.659488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":256,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372499+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:40.372499+0000","last_peered":"2024-04-26T11:26:40.372499+0000","last_clean":"2024-04-26T11:26:40.372499+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:40.372499+0000","last_undegraded":"2024-04-26T11:26:40.372499+0000","last_fullsized":"2024-04-26T11:26:40.372499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142432,"kb_used_data":30992,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229408,"statfs":{"total":96636764160,"available":96490913792,"internally_reserved":0,"allocated":31735808,"data_stored":81608913,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61599999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124352,"kb_used_data":30956,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247488,"statfs":{"total":96636764160,"available":96509427712,"internally_reserved":0,"allocated":31698944,"data_stored":86113033,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56599999999999995}]}]},{"osd":0,"up_from":75,"seq":322122547209,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75944,"kb_used_data":18068,"kb_used_omap":7,"kb_used_meta":57848,"kb_avail":94295896,"statfs":{"total":96636764160,"available":96558997504,"internally_reserved":0,"allocated":18501632,"data_stored":91781533,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":59237367},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:46.238 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T11:26:46.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T11:26:46.588 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T11:26:46.598 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T11:26:46.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:46.884 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:46.886 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:46.901 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2024-04-26T11:26:45.454132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7334,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":342728,"kb_used_data":80016,"kb_used_omap":10,"kb_used_meta":262645,"kb_avail":282772792,"statfs":{"total":289910292480,"available":289559339008,"internally_reserved":0,"allocated":81936384,"data_stored":259503479,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":268949379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1143,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.086259"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":509,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375889+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:40.375889+0000","last_peered":"2024-04-26T11:26:40.375889+0000","last_clean":"2024-04-26T11:26:40.375889+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:40.375889+0000","last_undegraded":"2024-04-26T11:26:40.375889+0000","last_fullsized":"2024-04-26T11:26:40.375889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":565,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375446+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:40.375446+0000","last_peered":"2024-04-26T11:26:40.375446+0000","last_clean":"2024-04-26T11:26:40.375446+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:40.375446+0000","last_undegraded":"2024-04-26T11:26:40.375446+0000","last_fullsized":"2024-04-26T11:26:40.375446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":440,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898192+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:39.898192+0000","last_peered":"2024-04-26T11:26:39.898192+0000","last_clean":"2024-04-26T11:26:39.898192+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:39.898192+0000","last_undegraded":"2024-04-26T11:26:39.898192+0000","last_fullsized":"2024-04-26T11:26:39.898192+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":489,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896372+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:39.896372+0000","last_peered":"2024-04-26T11:26:39.896372+0000","last_clean":"2024-04-26T11:26:39.896372+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:39.896372+0000","last_undegraded":"2024-04-26T11:26:39.896372+0000","last_fullsized":"2024-04-26T11:26:39.896372+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":540,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375005+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:40.375005+0000","last_peered":"2024-04-26T11:26:40.375005+0000","last_clean":"2024-04-26T11:26:40.375005+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:40.375005+0000","last_undegraded":"2024-04-26T11:26:40.375005+0000","last_fullsized":"2024-04-26T11:26:40.375005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":493,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896914+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:39.896914+0000","last_peered":"2024-04-26T11:26:39.896914+0000","last_clean":"2024-04-26T11:26:39.896914+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:39.896914+0000","last_undegraded":"2024-04-26T11:26:39.896914+0000","last_fullsized":"2024-04-26T11:26:39.896914+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":594,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895848+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:39.895848+0000","last_peered":"2024-04-26T11:26:39.895848+0000","last_clean":"2024-04-26T11:26:39.895848+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:39.895848+0000","last_undegraded":"2024-04-26T11:26:39.895848+0000","last_fullsized":"2024-04-26T11:26:39.895848+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":462,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896813+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:39.896813+0000","last_peered":"2024-04-26T11:26:39.896813+0000","last_clean":"2024-04-26T11:26:39.896813+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:39.896813+0000","last_undegraded":"2024-04-26T11:26:39.896813+0000","last_fullsized":"2024-04-26T11:26:39.896813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":596,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372012+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:40.372012+0000","last_peered":"2024-04-26T11:26:40.372012+0000","last_clean":"2024-04-26T11:26:40.372012+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:40.372012+0000","last_undegraded":"2024-04-26T11:26:40.372012+0000","last_fullsized":"2024-04-26T11:26:40.372012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":506,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375596+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:40.375596+0000","last_peered":"2024-04-26T11:26:40.375596+0000","last_clean":"2024-04-26T11:26:40.375596+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:40.375596+0000","last_undegraded":"2024-04-26T11:26:40.375596+0000","last_fullsized":"2024-04-26T11:26:40.375596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":480,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898025+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:39.898025+0000","last_peered":"2024-04-26T11:26:39.898025+0000","last_clean":"2024-04-26T11:26:39.898025+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:39.898025+0000","last_undegraded":"2024-04-26T11:26:39.898025+0000","last_fullsized":"2024-04-26T11:26:39.898025+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:07.200544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":782,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375001+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:40.375001+0000","last_peered":"2024-04-26T11:26:40.375001+0000","last_clean":"2024-04-26T11:26:40.375001+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:40.375001+0000","last_undegraded":"2024-04-26T11:26:40.375001+0000","last_fullsized":"2024-04-26T11:26:40.375001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":453,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374678+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:40.374678+0000","last_peered":"2024-04-26T11:26:40.374678+0000","last_clean":"2024-04-26T11:26:40.374678+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:40.374678+0000","last_undegraded":"2024-04-26T11:26:40.374678+0000","last_fullsized":"2024-04-26T11:26:40.374678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":482,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896659+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:39.896659+0000","last_peered":"2024-04-26T11:26:39.896659+0000","last_clean":"2024-04-26T11:26:39.896659+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:39.896659+0000","last_undegraded":"2024-04-26T11:26:39.896659+0000","last_fullsized":"2024-04-26T11:26:39.896659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":538,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896114+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:39.896114+0000","last_peered":"2024-04-26T11:26:39.896114+0000","last_clean":"2024-04-26T11:26:39.896114+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:39.896114+0000","last_undegraded":"2024-04-26T11:26:39.896114+0000","last_fullsized":"2024-04-26T11:26:39.896114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":603,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897245+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:39.897245+0000","last_peered":"2024-04-26T11:26:39.897245+0000","last_clean":"2024-04-26T11:26:39.897245+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:39.897245+0000","last_undegraded":"2024-04-26T11:26:39.897245+0000","last_fullsized":"2024-04-26T11:26:39.897245+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":577,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372796+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:40.372796+0000","last_peered":"2024-04-26T11:26:40.372796+0000","last_clean":"2024-04-26T11:26:40.372796+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:40.372796+0000","last_undegraded":"2024-04-26T11:26:40.372796+0000","last_fullsized":"2024-04-26T11:26:40.372796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":584,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375825+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:40.375825+0000","last_peered":"2024-04-26T11:26:40.375825+0000","last_clean":"2024-04-26T11:26:40.375825+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:40.375825+0000","last_undegraded":"2024-04-26T11:26:40.375825+0000","last_fullsized":"2024-04-26T11:26:40.375825+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":623,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371677+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:40.371677+0000","last_peered":"2024-04-26T11:26:40.371677+0000","last_clean":"2024-04-26T11:26:40.371677+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:40.371677+0000","last_undegraded":"2024-04-26T11:26:40.371677+0000","last_fullsized":"2024-04-26T11:26:40.371677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":611,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897131+0000","last_change":"2024-04-26T11:26:29.907661+0000","last_active":"2024-04-26T11:26:39.897131+0000","last_peered":"2024-04-26T11:26:39.897131+0000","last_clean":"2024-04-26T11:26:39.897131+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:26:39.897131+0000","last_undegraded":"2024-04-26T11:26:39.897131+0000","last_fullsized":"2024-04-26T11:26:39.897131+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":549,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896468+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:39.896468+0000","last_peered":"2024-04-26T11:26:39.896468+0000","last_clean":"2024-04-26T11:26:39.896468+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:39.896468+0000","last_undegraded":"2024-04-26T11:26:39.896468+0000","last_fullsized":"2024-04-26T11:26:39.896468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.393282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":978,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374306+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:40.374306+0000","last_peered":"2024-04-26T11:26:40.374306+0000","last_clean":"2024-04-26T11:26:40.374306+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:40.374306+0000","last_undegraded":"2024-04-26T11:26:40.374306+0000","last_fullsized":"2024-04-26T11:26:40.374306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:06.847831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":932,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.369890+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:40.369890+0000","last_peered":"2024-04-26T11:26:40.369890+0000","last_clean":"2024-04-26T11:26:40.369890+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:40.369890+0000","last_undegraded":"2024-04-26T11:26:40.369890+0000","last_fullsized":"2024-04-26T11:26:40.369890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":515,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373716+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:40.373716+0000","last_peered":"2024-04-26T11:26:40.373716+0000","last_clean":"2024-04-26T11:26:40.373716+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:40.373716+0000","last_undegraded":"2024-04-26T11:26:40.373716+0000","last_fullsized":"2024-04-26T11:26:40.373716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":948,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376062+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:40.376062+0000","last_peered":"2024-04-26T11:26:40.376062+0000","last_clean":"2024-04-26T11:26:40.376062+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:40.376062+0000","last_undegraded":"2024-04-26T11:26:40.376062+0000","last_fullsized":"2024-04-26T11:26:40.376062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:04.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1054,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372134+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:40.372134+0000","last_peered":"2024-04-26T11:26:40.372134+0000","last_clean":"2024-04-26T11:26:40.372134+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:40.372134+0000","last_undegraded":"2024-04-26T11:26:40.372134+0000","last_fullsized":"2024-04-26T11:26:40.372134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":558,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897950+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:39.897950+0000","last_peered":"2024-04-26T11:26:39.897950+0000","last_clean":"2024-04-26T11:26:39.897950+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:39.897950+0000","last_undegraded":"2024-04-26T11:26:39.897950+0000","last_fullsized":"2024-04-26T11:26:39.897950+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":951,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375483+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:40.375483+0000","last_peered":"2024-04-26T11:26:40.375483+0000","last_clean":"2024-04-26T11:26:40.375483+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:40.375483+0000","last_undegraded":"2024-04-26T11:26:40.375483+0000","last_fullsized":"2024-04-26T11:26:40.375483+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":508,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371263+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:40.371263+0000","last_peered":"2024-04-26T11:26:40.371263+0000","last_clean":"2024-04-26T11:26:40.371263+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:40.371263+0000","last_undegraded":"2024-04-26T11:26:40.371263+0000","last_fullsized":"2024-04-26T11:26:40.371263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":1028,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374860+0000","last_change":"2024-04-26T11:26:38.377195+0000","last_active":"2024-04-26T11:26:40.374860+0000","last_peered":"2024-04-26T11:26:40.374860+0000","last_clean":"2024-04-26T11:26:40.374860+0000","last_became_active":"2024-04-26T11:26:38.373963+0000","last_became_peered":"2024-04-26T11:26:38.373963+0000","last_unstale":"2024-04-26T11:26:40.374860+0000","last_undegraded":"2024-04-26T11:26:40.374860+0000","last_fullsized":"2024-04-26T11:26:40.374860+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:57.937161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":628,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370077+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:40.370077+0000","last_peered":"2024-04-26T11:26:40.370077+0000","last_clean":"2024-04-26T11:26:40.370077+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:40.370077+0000","last_undegraded":"2024-04-26T11:26:40.370077+0000","last_fullsized":"2024-04-26T11:26:40.370077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":499,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.901431+0000","last_change":"2024-04-26T11:26:40.900605+0000","last_active":"2024-04-26T11:26:40.901431+0000","last_peered":"2024-04-26T11:26:40.901431+0000","last_clean":"2024-04-26T11:26:40.901431+0000","last_became_active":"2024-04-26T11:26:40.895623+0000","last_became_peered":"2024-04-26T11:26:40.895623+0000","last_unstale":"2024-04-26T11:26:40.901431+0000","last_undegraded":"2024-04-26T11:26:40.901431+0000","last_fullsized":"2024-04-26T11:26:40.901431+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:04.320929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":485,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375274+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:40.375274+0000","last_peered":"2024-04-26T11:26:40.375274+0000","last_clean":"2024-04-26T11:26:40.375274+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:40.375274+0000","last_undegraded":"2024-04-26T11:26:40.375274+0000","last_fullsized":"2024-04-26T11:26:40.375274+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":550,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895866+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:39.895866+0000","last_peered":"2024-04-26T11:26:39.895866+0000","last_clean":"2024-04-26T11:26:39.895866+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:39.895866+0000","last_undegraded":"2024-04-26T11:26:39.895866+0000","last_fullsized":"2024-04-26T11:26:39.895866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":505,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375633+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:40.375633+0000","last_peered":"2024-04-26T11:26:40.375633+0000","last_clean":"2024-04-26T11:26:40.375633+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:40.375633+0000","last_undegraded":"2024-04-26T11:26:40.375633+0000","last_fullsized":"2024-04-26T11:26:40.375633+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":176,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370912+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:40.370912+0000","last_peered":"2024-04-26T11:26:40.370912+0000","last_clean":"2024-04-26T11:26:40.370912+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:40.370912+0000","last_undegraded":"2024-04-26T11:26:40.370912+0000","last_fullsized":"2024-04-26T11:26:40.370912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":997,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372764+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:40.372764+0000","last_peered":"2024-04-26T11:26:40.372764+0000","last_clean":"2024-04-26T11:26:40.372764+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:40.372764+0000","last_undegraded":"2024-04-26T11:26:40.372764+0000","last_fullsized":"2024-04-26T11:26:40.372764+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":164,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374326+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:40.374326+0000","last_peered":"2024-04-26T11:26:40.374326+0000","last_clean":"2024-04-26T11:26:40.374326+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:40.374326+0000","last_undegraded":"2024-04-26T11:26:40.374326+0000","last_fullsized":"2024-04-26T11:26:40.374326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":937,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372115+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:40.372115+0000","last_peered":"2024-04-26T11:26:40.372115+0000","last_clean":"2024-04-26T11:26:40.372115+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:40.372115+0000","last_undegraded":"2024-04-26T11:26:40.372115+0000","last_fullsized":"2024-04-26T11:26:40.372115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":52,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895270+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:39.895270+0000","last_peered":"2024-04-26T11:26:39.895270+0000","last_clean":"2024-04-26T11:26:39.895270+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:39.895270+0000","last_undegraded":"2024-04-26T11:26:39.895270+0000","last_fullsized":"2024-04-26T11:26:39.895270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":242,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898259+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:39.898259+0000","last_peered":"2024-04-26T11:26:39.898259+0000","last_clean":"2024-04-26T11:26:39.898259+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:39.898259+0000","last_undegraded":"2024-04-26T11:26:39.898259+0000","last_fullsized":"2024-04-26T11:26:39.898259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":876,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373876+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:40.373876+0000","last_peered":"2024-04-26T11:26:40.373876+0000","last_clean":"2024-04-26T11:26:40.373876+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:40.373876+0000","last_undegraded":"2024-04-26T11:26:40.373876+0000","last_fullsized":"2024-04-26T11:26:40.373876+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":401,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376112+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:40.376112+0000","last_peered":"2024-04-26T11:26:40.376112+0000","last_clean":"2024-04-26T11:26:40.376112+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:40.376112+0000","last_undegraded":"2024-04-26T11:26:40.376112+0000","last_fullsized":"2024-04-26T11:26:40.376112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":580,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374073+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:40.374073+0000","last_peered":"2024-04-26T11:26:40.374073+0000","last_clean":"2024-04-26T11:26:40.374073+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:40.374073+0000","last_undegraded":"2024-04-26T11:26:40.374073+0000","last_fullsized":"2024-04-26T11:26:40.374073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":645,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897731+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:39.897731+0000","last_peered":"2024-04-26T11:26:39.897731+0000","last_clean":"2024-04-26T11:26:39.897731+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:39.897731+0000","last_undegraded":"2024-04-26T11:26:39.897731+0000","last_fullsized":"2024-04-26T11:26:39.897731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":530,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.906286+0000","last_change":"2024-04-26T11:26:39.905388+0000","last_active":"2024-04-26T11:26:39.906286+0000","last_peered":"2024-04-26T11:26:39.906286+0000","last_clean":"2024-04-26T11:26:39.906286+0000","last_became_active":"2024-04-26T11:26:39.900162+0000","last_became_peered":"2024-04-26T11:26:39.900162+0000","last_unstale":"2024-04-26T11:26:39.906286+0000","last_undegraded":"2024-04-26T11:26:39.906286+0000","last_fullsized":"2024-04-26T11:26:39.906286+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:50.194168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897546+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:39.897546+0000","last_peered":"2024-04-26T11:26:39.897546+0000","last_clean":"2024-04-26T11:26:39.897546+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:39.897546+0000","last_undegraded":"2024-04-26T11:26:39.897546+0000","last_fullsized":"2024-04-26T11:26:39.897546+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":958,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370924+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:40.370924+0000","last_peered":"2024-04-26T11:26:40.370924+0000","last_clean":"2024-04-26T11:26:40.370924+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:40.370924+0000","last_undegraded":"2024-04-26T11:26:40.370924+0000","last_fullsized":"2024-04-26T11:26:40.370924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":310,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371534+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:40.371534+0000","last_peered":"2024-04-26T11:26:40.371534+0000","last_clean":"2024-04-26T11:26:40.371534+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:40.371534+0000","last_undegraded":"2024-04-26T11:26:40.371534+0000","last_fullsized":"2024-04-26T11:26:40.371534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":527,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897534+0000","last_change":"2024-04-26T11:26:35.931909+0000","last_active":"2024-04-26T11:26:39.897534+0000","last_peered":"2024-04-26T11:26:39.897534+0000","last_clean":"2024-04-26T11:26:39.897534+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:26:39.897534+0000","last_undegraded":"2024-04-26T11:26:39.897534+0000","last_fullsized":"2024-04-26T11:26:39.897534+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:22.946052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":295,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896059+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:39.896059+0000","last_peered":"2024-04-26T11:26:39.896059+0000","last_clean":"2024-04-26T11:26:39.896059+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:39.896059+0000","last_undegraded":"2024-04-26T11:26:39.896059+0000","last_fullsized":"2024-04-26T11:26:39.896059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":471,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897608+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:39.897608+0000","last_peered":"2024-04-26T11:26:39.897608+0000","last_clean":"2024-04-26T11:26:39.897608+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:39.897608+0000","last_undegraded":"2024-04-26T11:26:39.897608+0000","last_fullsized":"2024-04-26T11:26:39.897608+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":151,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374409+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:40.374409+0000","last_peered":"2024-04-26T11:26:40.374409+0000","last_clean":"2024-04-26T11:26:40.374409+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:40.374409+0000","last_undegraded":"2024-04-26T11:26:40.374409+0000","last_fullsized":"2024-04-26T11:26:40.374409+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":446,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897851+0000","last_change":"2024-04-26T11:26:29.914048+0000","last_active":"2024-04-26T11:26:39.897851+0000","last_peered":"2024-04-26T11:26:39.897851+0000","last_clean":"2024-04-26T11:26:39.897851+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:26:39.897851+0000","last_undegraded":"2024-04-26T11:26:39.897851+0000","last_fullsized":"2024-04-26T11:26:39.897851+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":352,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373885+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:40.373885+0000","last_peered":"2024-04-26T11:26:40.373885+0000","last_clean":"2024-04-26T11:26:40.373885+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:40.373885+0000","last_undegraded":"2024-04-26T11:26:40.373885+0000","last_fullsized":"2024-04-26T11:26:40.373885+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":553,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372264+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:40.372264+0000","last_peered":"2024-04-26T11:26:40.372264+0000","last_clean":"2024-04-26T11:26:40.372264+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:40.372264+0000","last_undegraded":"2024-04-26T11:26:40.372264+0000","last_fullsized":"2024-04-26T11:26:40.372264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":247,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.894834+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:39.894834+0000","last_peered":"2024-04-26T11:26:39.894834+0000","last_clean":"2024-04-26T11:26:39.894834+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:39.894834+0000","last_undegraded":"2024-04-26T11:26:39.894834+0000","last_fullsized":"2024-04-26T11:26:39.894834+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895601+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:39.895601+0000","last_peered":"2024-04-26T11:26:39.895601+0000","last_clean":"2024-04-26T11:26:39.895601+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:39.895601+0000","last_undegraded":"2024-04-26T11:26:39.895601+0000","last_fullsized":"2024-04-26T11:26:39.895601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":851,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371480+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:40.371480+0000","last_peered":"2024-04-26T11:26:40.371480+0000","last_clean":"2024-04-26T11:26:40.371480+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:40.371480+0000","last_undegraded":"2024-04-26T11:26:40.371480+0000","last_fullsized":"2024-04-26T11:26:40.371480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":514,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897848+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:39.897848+0000","last_peered":"2024-04-26T11:26:39.897848+0000","last_clean":"2024-04-26T11:26:39.897848+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:39.897848+0000","last_undegraded":"2024-04-26T11:26:39.897848+0000","last_fullsized":"2024-04-26T11:26:39.897848+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896930+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:39.896930+0000","last_peered":"2024-04-26T11:26:39.896930+0000","last_clean":"2024-04-26T11:26:39.896930+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:39.896930+0000","last_undegraded":"2024-04-26T11:26:39.896930+0000","last_fullsized":"2024-04-26T11:26:39.896930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":292,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370638+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:40.370638+0000","last_peered":"2024-04-26T11:26:40.370638+0000","last_clean":"2024-04-26T11:26:40.370638+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:40.370638+0000","last_undegraded":"2024-04-26T11:26:40.370638+0000","last_fullsized":"2024-04-26T11:26:40.370638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":562,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375681+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:40.375681+0000","last_peered":"2024-04-26T11:26:40.375681+0000","last_clean":"2024-04-26T11:26:40.375681+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:40.375681+0000","last_undegraded":"2024-04-26T11:26:40.375681+0000","last_fullsized":"2024-04-26T11:26:40.375681+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371265+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:40.371265+0000","last_peered":"2024-04-26T11:26:40.371265+0000","last_clean":"2024-04-26T11:26:40.371265+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:40.371265+0000","last_undegraded":"2024-04-26T11:26:40.371265+0000","last_fullsized":"2024-04-26T11:26:40.371265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":482,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374138+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:40.374138+0000","last_peered":"2024-04-26T11:26:40.374138+0000","last_clean":"2024-04-26T11:26:40.374138+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:40.374138+0000","last_undegraded":"2024-04-26T11:26:40.374138+0000","last_fullsized":"2024-04-26T11:26:40.374138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":453,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372369+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:40.372369+0000","last_peered":"2024-04-26T11:26:40.372369+0000","last_clean":"2024-04-26T11:26:40.372369+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:40.372369+0000","last_undegraded":"2024-04-26T11:26:40.372369+0000","last_fullsized":"2024-04-26T11:26:40.372369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895458+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:39.895458+0000","last_peered":"2024-04-26T11:26:39.895458+0000","last_clean":"2024-04-26T11:26:39.895458+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:39.895458+0000","last_undegraded":"2024-04-26T11:26:39.895458+0000","last_fullsized":"2024-04-26T11:26:39.895458+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895632+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:39.895632+0000","last_peered":"2024-04-26T11:26:39.895632+0000","last_clean":"2024-04-26T11:26:39.895632+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:39.895632+0000","last_undegraded":"2024-04-26T11:26:39.895632+0000","last_fullsized":"2024-04-26T11:26:39.895632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":562,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372246+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:40.372246+0000","last_peered":"2024-04-26T11:26:40.372246+0000","last_clean":"2024-04-26T11:26:40.372246+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:40.372246+0000","last_undegraded":"2024-04-26T11:26:40.372246+0000","last_fullsized":"2024-04-26T11:26:40.372246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896978+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:39.896978+0000","last_peered":"2024-04-26T11:26:39.896978+0000","last_clean":"2024-04-26T11:26:39.896978+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:39.896978+0000","last_undegraded":"2024-04-26T11:26:39.896978+0000","last_fullsized":"2024-04-26T11:26:39.896978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372506+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:40.372506+0000","last_peered":"2024-04-26T11:26:40.372506+0000","last_clean":"2024-04-26T11:26:40.372506+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:40.372506+0000","last_undegraded":"2024-04-26T11:26:40.372506+0000","last_fullsized":"2024-04-26T11:26:40.372506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":792,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374549+0000","last_change":"2024-04-26T11:26:35.389500+0000","last_active":"2024-04-26T11:26:40.374549+0000","last_peered":"2024-04-26T11:26:40.374549+0000","last_clean":"2024-04-26T11:26:40.374549+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:26:40.374549+0000","last_undegraded":"2024-04-26T11:26:40.374549+0000","last_fullsized":"2024-04-26T11:26:40.374549+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:56.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":158,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372239+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:40.372239+0000","last_peered":"2024-04-26T11:26:40.372239+0000","last_clean":"2024-04-26T11:26:40.372239+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:40.372239+0000","last_undegraded":"2024-04-26T11:26:40.372239+0000","last_fullsized":"2024-04-26T11:26:40.372239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376205+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:40.376205+0000","last_peered":"2024-04-26T11:26:40.376205+0000","last_clean":"2024-04-26T11:26:40.376205+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:40.376205+0000","last_undegraded":"2024-04-26T11:26:40.376205+0000","last_fullsized":"2024-04-26T11:26:40.376205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":817,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374730+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:40.374730+0000","last_peered":"2024-04-26T11:26:40.374730+0000","last_clean":"2024-04-26T11:26:40.374730+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:40.374730+0000","last_undegraded":"2024-04-26T11:26:40.374730+0000","last_fullsized":"2024-04-26T11:26:40.374730+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":161,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372975+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:40.372975+0000","last_peered":"2024-04-26T11:26:40.372975+0000","last_clean":"2024-04-26T11:26:40.372975+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:40.372975+0000","last_undegraded":"2024-04-26T11:26:40.372975+0000","last_fullsized":"2024-04-26T11:26:40.372975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372900+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:40.372900+0000","last_peered":"2024-04-26T11:26:40.372900+0000","last_clean":"2024-04-26T11:26:40.372900+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:40.372900+0000","last_undegraded":"2024-04-26T11:26:40.372900+0000","last_fullsized":"2024-04-26T11:26:40.372900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":926,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370385+0000","last_change":"2024-04-26T11:26:39.378496+0000","last_active":"2024-04-26T11:26:40.370385+0000","last_peered":"2024-04-26T11:26:40.370385+0000","last_clean":"2024-04-26T11:26:40.370385+0000","last_became_active":"2024-04-26T11:26:39.375075+0000","last_became_peered":"2024-04-26T11:26:39.375075+0000","last_unstale":"2024-04-26T11:26:40.370385+0000","last_undegraded":"2024-04-26T11:26:40.370385+0000","last_fullsized":"2024-04-26T11:26:40.370385+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:37.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":190,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372812+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:40.372812+0000","last_peered":"2024-04-26T11:26:40.372812+0000","last_clean":"2024-04-26T11:26:40.372812+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:40.372812+0000","last_undegraded":"2024-04-26T11:26:40.372812+0000","last_fullsized":"2024-04-26T11:26:40.372812+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897855+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:39.897855+0000","last_peered":"2024-04-26T11:26:39.897855+0000","last_clean":"2024-04-26T11:26:39.897855+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:39.897855+0000","last_undegraded":"2024-04-26T11:26:39.897855+0000","last_fullsized":"2024-04-26T11:26:39.897855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":930,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374136+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:40.374136+0000","last_peered":"2024-04-26T11:26:40.374136+0000","last_clean":"2024-04-26T11:26:40.374136+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:40.374136+0000","last_undegraded":"2024-04-26T11:26:40.374136+0000","last_fullsized":"2024-04-26T11:26:40.374136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":512,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896222+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:39.896222+0000","last_peered":"2024-04-26T11:26:39.896222+0000","last_clean":"2024-04-26T11:26:39.896222+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:39.896222+0000","last_undegraded":"2024-04-26T11:26:39.896222+0000","last_fullsized":"2024-04-26T11:26:39.896222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":491,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896711+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:39.896711+0000","last_peered":"2024-04-26T11:26:39.896711+0000","last_clean":"2024-04-26T11:26:39.896711+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:39.896711+0000","last_undegraded":"2024-04-26T11:26:39.896711+0000","last_fullsized":"2024-04-26T11:26:39.896711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":556,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370468+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:40.370468+0000","last_peered":"2024-04-26T11:26:40.370468+0000","last_clean":"2024-04-26T11:26:40.370468+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:40.370468+0000","last_undegraded":"2024-04-26T11:26:40.370468+0000","last_fullsized":"2024-04-26T11:26:40.370468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":181,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376086+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:40.376086+0000","last_peered":"2024-04-26T11:26:40.376086+0000","last_clean":"2024-04-26T11:26:40.376086+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:40.376086+0000","last_undegraded":"2024-04-26T11:26:40.376086+0000","last_fullsized":"2024-04-26T11:26:40.376086+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":416,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897546+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:39.897546+0000","last_peered":"2024-04-26T11:26:39.897546+0000","last_clean":"2024-04-26T11:26:39.897546+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:39.897546+0000","last_undegraded":"2024-04-26T11:26:39.897546+0000","last_fullsized":"2024-04-26T11:26:39.897546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":1025,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370129+0000","last_change":"2024-04-26T11:26:38.376749+0000","last_active":"2024-04-26T11:26:40.370129+0000","last_peered":"2024-04-26T11:26:40.370129+0000","last_clean":"2024-04-26T11:26:40.370129+0000","last_became_active":"2024-04-26T11:26:38.373800+0000","last_became_peered":"2024-04-26T11:26:38.373800+0000","last_unstale":"2024-04-26T11:26:40.370129+0000","last_undegraded":"2024-04-26T11:26:40.370129+0000","last_fullsized":"2024-04-26T11:26:40.370129+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:23.112909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":165,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372797+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:40.372797+0000","last_peered":"2024-04-26T11:26:40.372797+0000","last_clean":"2024-04-26T11:26:40.372797+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:40.372797+0000","last_undegraded":"2024-04-26T11:26:40.372797+0000","last_fullsized":"2024-04-26T11:26:40.372797+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370124+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:40.370124+0000","last_peered":"2024-04-26T11:26:40.370124+0000","last_clean":"2024-04-26T11:26:40.370124+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:40.370124+0000","last_undegraded":"2024-04-26T11:26:40.370124+0000","last_fullsized":"2024-04-26T11:26:40.370124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":792,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376038+0000","last_change":"2024-04-26T11:26:32.372817+0000","last_active":"2024-04-26T11:26:40.376038+0000","last_peered":"2024-04-26T11:26:40.376038+0000","last_clean":"2024-04-26T11:26:40.376038+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:26:40.376038+0000","last_undegraded":"2024-04-26T11:26:40.376038+0000","last_fullsized":"2024-04-26T11:26:40.376038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:32.214458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":687,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370831+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:40.370831+0000","last_peered":"2024-04-26T11:26:40.370831+0000","last_clean":"2024-04-26T11:26:40.370831+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:40.370831+0000","last_undegraded":"2024-04-26T11:26:40.370831+0000","last_fullsized":"2024-04-26T11:26:40.370831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":922,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372380+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:40.372380+0000","last_peered":"2024-04-26T11:26:40.372380+0000","last_clean":"2024-04-26T11:26:40.372380+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:40.372380+0000","last_undegraded":"2024-04-26T11:26:40.372380+0000","last_fullsized":"2024-04-26T11:26:40.372380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":394,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370389+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:40.370389+0000","last_peered":"2024-04-26T11:26:40.370389+0000","last_clean":"2024-04-26T11:26:40.370389+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:40.370389+0000","last_undegraded":"2024-04-26T11:26:40.370389+0000","last_fullsized":"2024-04-26T11:26:40.370389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1016,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375585+0000","last_change":"2024-04-26T11:26:36.406522+0000","last_active":"2024-04-26T11:26:40.375585+0000","last_peered":"2024-04-26T11:26:40.375585+0000","last_clean":"2024-04-26T11:26:40.375585+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:26:40.375585+0000","last_undegraded":"2024-04-26T11:26:40.375585+0000","last_fullsized":"2024-04-26T11:26:40.375585+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:05.312742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":431,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374748+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:40.374748+0000","last_peered":"2024-04-26T11:26:40.374748+0000","last_clean":"2024-04-26T11:26:40.374748+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:40.374748+0000","last_undegraded":"2024-04-26T11:26:40.374748+0000","last_fullsized":"2024-04-26T11:26:40.374748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":499,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375046+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:40.375046+0000","last_peered":"2024-04-26T11:26:40.375046+0000","last_clean":"2024-04-26T11:26:40.375046+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:40.375046+0000","last_undegraded":"2024-04-26T11:26:40.375046+0000","last_fullsized":"2024-04-26T11:26:40.375046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":152,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375041+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:40.375041+0000","last_peered":"2024-04-26T11:26:40.375041+0000","last_clean":"2024-04-26T11:26:40.375041+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:40.375041+0000","last_undegraded":"2024-04-26T11:26:40.375041+0000","last_fullsized":"2024-04-26T11:26:40.375041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":475,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896112+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:39.896112+0000","last_peered":"2024-04-26T11:26:39.896112+0000","last_clean":"2024-04-26T11:26:39.896112+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:39.896112+0000","last_undegraded":"2024-04-26T11:26:39.896112+0000","last_fullsized":"2024-04-26T11:26:39.896112+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":404,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895905+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:39.895905+0000","last_peered":"2024-04-26T11:26:39.895905+0000","last_clean":"2024-04-26T11:26:39.895905+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:39.895905+0000","last_undegraded":"2024-04-26T11:26:39.895905+0000","last_fullsized":"2024-04-26T11:26:39.895905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":491,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897078+0000","last_change":"2024-04-26T11:26:31.896245+0000","last_active":"2024-04-26T11:26:39.897078+0000","last_peered":"2024-04-26T11:26:39.897078+0000","last_clean":"2024-04-26T11:26:39.897078+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:26:39.897078+0000","last_undegraded":"2024-04-26T11:26:39.897078+0000","last_fullsized":"2024-04-26T11:26:39.897078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:59.173436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":497,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375850+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:40.375850+0000","last_peered":"2024-04-26T11:26:40.375850+0000","last_clean":"2024-04-26T11:26:40.375850+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:40.375850+0000","last_undegraded":"2024-04-26T11:26:40.375850+0000","last_fullsized":"2024-04-26T11:26:40.375850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":498,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374562+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:40.374562+0000","last_peered":"2024-04-26T11:26:40.374562+0000","last_clean":"2024-04-26T11:26:40.374562+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:40.374562+0000","last_undegraded":"2024-04-26T11:26:40.374562+0000","last_fullsized":"2024-04-26T11:26:40.374562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":158,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372672+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:40.372672+0000","last_peered":"2024-04-26T11:26:40.372672+0000","last_clean":"2024-04-26T11:26:40.372672+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:40.372672+0000","last_undegraded":"2024-04-26T11:26:40.372672+0000","last_fullsized":"2024-04-26T11:26:40.372672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":542,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897090+0000","last_change":"2024-04-26T11:26:33.905426+0000","last_active":"2024-04-26T11:26:39.897090+0000","last_peered":"2024-04-26T11:26:39.897090+0000","last_clean":"2024-04-26T11:26:39.897090+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:39.897090+0000","last_undegraded":"2024-04-26T11:26:39.897090+0000","last_fullsized":"2024-04-26T11:26:39.897090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:49.659488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":256,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372499+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:40.372499+0000","last_peered":"2024-04-26T11:26:40.372499+0000","last_clean":"2024-04-26T11:26:40.372499+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:40.372499+0000","last_undegraded":"2024-04-26T11:26:40.372499+0000","last_fullsized":"2024-04-26T11:26:40.372499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142432,"kb_used_data":30992,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229408,"statfs":{"total":96636764160,"available":96490913792,"internally_reserved":0,"allocated":31735808,"data_stored":81608913,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61599999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124352,"kb_used_data":30956,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247488,"statfs":{"total":96636764160,"available":96509427712,"internally_reserved":0,"allocated":31698944,"data_stored":86113033,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56599999999999995}]}]},{"osd":0,"up_from":75,"seq":322122547209,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75944,"kb_used_data":18068,"kb_used_omap":7,"kb_used_meta":57848,"kb_avail":94295896,"statfs":{"total":96636764160,"available":96558997504,"internally_reserved":0,"allocated":18501632,"data_stored":91781533,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":59237367},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:46.905 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:47.232 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:47.234 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:47.249 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2024-04-26T11:26:45.454132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7334,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":342728,"kb_used_data":80016,"kb_used_omap":10,"kb_used_meta":262645,"kb_avail":282772792,"statfs":{"total":289910292480,"available":289559339008,"internally_reserved":0,"allocated":81936384,"data_stored":259503479,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":268949379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1143,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.086259"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":509,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375889+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:40.375889+0000","last_peered":"2024-04-26T11:26:40.375889+0000","last_clean":"2024-04-26T11:26:40.375889+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:40.375889+0000","last_undegraded":"2024-04-26T11:26:40.375889+0000","last_fullsized":"2024-04-26T11:26:40.375889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":565,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375446+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:40.375446+0000","last_peered":"2024-04-26T11:26:40.375446+0000","last_clean":"2024-04-26T11:26:40.375446+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:40.375446+0000","last_undegraded":"2024-04-26T11:26:40.375446+0000","last_fullsized":"2024-04-26T11:26:40.375446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":440,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898192+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:39.898192+0000","last_peered":"2024-04-26T11:26:39.898192+0000","last_clean":"2024-04-26T11:26:39.898192+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:39.898192+0000","last_undegraded":"2024-04-26T11:26:39.898192+0000","last_fullsized":"2024-04-26T11:26:39.898192+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":489,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896372+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:39.896372+0000","last_peered":"2024-04-26T11:26:39.896372+0000","last_clean":"2024-04-26T11:26:39.896372+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:39.896372+0000","last_undegraded":"2024-04-26T11:26:39.896372+0000","last_fullsized":"2024-04-26T11:26:39.896372+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":540,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375005+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:40.375005+0000","last_peered":"2024-04-26T11:26:40.375005+0000","last_clean":"2024-04-26T11:26:40.375005+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:40.375005+0000","last_undegraded":"2024-04-26T11:26:40.375005+0000","last_fullsized":"2024-04-26T11:26:40.375005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":493,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896914+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:39.896914+0000","last_peered":"2024-04-26T11:26:39.896914+0000","last_clean":"2024-04-26T11:26:39.896914+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:39.896914+0000","last_undegraded":"2024-04-26T11:26:39.896914+0000","last_fullsized":"2024-04-26T11:26:39.896914+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":594,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895848+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:39.895848+0000","last_peered":"2024-04-26T11:26:39.895848+0000","last_clean":"2024-04-26T11:26:39.895848+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:39.895848+0000","last_undegraded":"2024-04-26T11:26:39.895848+0000","last_fullsized":"2024-04-26T11:26:39.895848+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":462,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896813+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:39.896813+0000","last_peered":"2024-04-26T11:26:39.896813+0000","last_clean":"2024-04-26T11:26:39.896813+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:39.896813+0000","last_undegraded":"2024-04-26T11:26:39.896813+0000","last_fullsized":"2024-04-26T11:26:39.896813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":596,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372012+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:40.372012+0000","last_peered":"2024-04-26T11:26:40.372012+0000","last_clean":"2024-04-26T11:26:40.372012+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:40.372012+0000","last_undegraded":"2024-04-26T11:26:40.372012+0000","last_fullsized":"2024-04-26T11:26:40.372012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":506,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375596+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:40.375596+0000","last_peered":"2024-04-26T11:26:40.375596+0000","last_clean":"2024-04-26T11:26:40.375596+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:40.375596+0000","last_undegraded":"2024-04-26T11:26:40.375596+0000","last_fullsized":"2024-04-26T11:26:40.375596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":480,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898025+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:39.898025+0000","last_peered":"2024-04-26T11:26:39.898025+0000","last_clean":"2024-04-26T11:26:39.898025+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:39.898025+0000","last_undegraded":"2024-04-26T11:26:39.898025+0000","last_fullsized":"2024-04-26T11:26:39.898025+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:07.200544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":782,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375001+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:40.375001+0000","last_peered":"2024-04-26T11:26:40.375001+0000","last_clean":"2024-04-26T11:26:40.375001+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:40.375001+0000","last_undegraded":"2024-04-26T11:26:40.375001+0000","last_fullsized":"2024-04-26T11:26:40.375001+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":453,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374678+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:40.374678+0000","last_peered":"2024-04-26T11:26:40.374678+0000","last_clean":"2024-04-26T11:26:40.374678+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:40.374678+0000","last_undegraded":"2024-04-26T11:26:40.374678+0000","last_fullsized":"2024-04-26T11:26:40.374678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":482,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896659+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:39.896659+0000","last_peered":"2024-04-26T11:26:39.896659+0000","last_clean":"2024-04-26T11:26:39.896659+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:39.896659+0000","last_undegraded":"2024-04-26T11:26:39.896659+0000","last_fullsized":"2024-04-26T11:26:39.896659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":538,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896114+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:39.896114+0000","last_peered":"2024-04-26T11:26:39.896114+0000","last_clean":"2024-04-26T11:26:39.896114+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:39.896114+0000","last_undegraded":"2024-04-26T11:26:39.896114+0000","last_fullsized":"2024-04-26T11:26:39.896114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":603,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897245+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:39.897245+0000","last_peered":"2024-04-26T11:26:39.897245+0000","last_clean":"2024-04-26T11:26:39.897245+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:39.897245+0000","last_undegraded":"2024-04-26T11:26:39.897245+0000","last_fullsized":"2024-04-26T11:26:39.897245+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":577,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372796+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:40.372796+0000","last_peered":"2024-04-26T11:26:40.372796+0000","last_clean":"2024-04-26T11:26:40.372796+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:40.372796+0000","last_undegraded":"2024-04-26T11:26:40.372796+0000","last_fullsized":"2024-04-26T11:26:40.372796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":584,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375825+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:40.375825+0000","last_peered":"2024-04-26T11:26:40.375825+0000","last_clean":"2024-04-26T11:26:40.375825+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:40.375825+0000","last_undegraded":"2024-04-26T11:26:40.375825+0000","last_fullsized":"2024-04-26T11:26:40.375825+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":623,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371677+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:40.371677+0000","last_peered":"2024-04-26T11:26:40.371677+0000","last_clean":"2024-04-26T11:26:40.371677+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:40.371677+0000","last_undegraded":"2024-04-26T11:26:40.371677+0000","last_fullsized":"2024-04-26T11:26:40.371677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":611,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897131+0000","last_change":"2024-04-26T11:26:29.907661+0000","last_active":"2024-04-26T11:26:39.897131+0000","last_peered":"2024-04-26T11:26:39.897131+0000","last_clean":"2024-04-26T11:26:39.897131+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:26:39.897131+0000","last_undegraded":"2024-04-26T11:26:39.897131+0000","last_fullsized":"2024-04-26T11:26:39.897131+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":549,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896468+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:39.896468+0000","last_peered":"2024-04-26T11:26:39.896468+0000","last_clean":"2024-04-26T11:26:39.896468+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:39.896468+0000","last_undegraded":"2024-04-26T11:26:39.896468+0000","last_fullsized":"2024-04-26T11:26:39.896468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.393282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":978,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374306+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:40.374306+0000","last_peered":"2024-04-26T11:26:40.374306+0000","last_clean":"2024-04-26T11:26:40.374306+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:40.374306+0000","last_undegraded":"2024-04-26T11:26:40.374306+0000","last_fullsized":"2024-04-26T11:26:40.374306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:06.847831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":932,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.369890+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:40.369890+0000","last_peered":"2024-04-26T11:26:40.369890+0000","last_clean":"2024-04-26T11:26:40.369890+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:40.369890+0000","last_undegraded":"2024-04-26T11:26:40.369890+0000","last_fullsized":"2024-04-26T11:26:40.369890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":515,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373716+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:40.373716+0000","last_peered":"2024-04-26T11:26:40.373716+0000","last_clean":"2024-04-26T11:26:40.373716+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:40.373716+0000","last_undegraded":"2024-04-26T11:26:40.373716+0000","last_fullsized":"2024-04-26T11:26:40.373716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":948,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376062+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:40.376062+0000","last_peered":"2024-04-26T11:26:40.376062+0000","last_clean":"2024-04-26T11:26:40.376062+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:40.376062+0000","last_undegraded":"2024-04-26T11:26:40.376062+0000","last_fullsized":"2024-04-26T11:26:40.376062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:04.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1054,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372134+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:40.372134+0000","last_peered":"2024-04-26T11:26:40.372134+0000","last_clean":"2024-04-26T11:26:40.372134+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:40.372134+0000","last_undegraded":"2024-04-26T11:26:40.372134+0000","last_fullsized":"2024-04-26T11:26:40.372134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":558,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897950+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:39.897950+0000","last_peered":"2024-04-26T11:26:39.897950+0000","last_clean":"2024-04-26T11:26:39.897950+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:39.897950+0000","last_undegraded":"2024-04-26T11:26:39.897950+0000","last_fullsized":"2024-04-26T11:26:39.897950+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":951,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375483+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:40.375483+0000","last_peered":"2024-04-26T11:26:40.375483+0000","last_clean":"2024-04-26T11:26:40.375483+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:40.375483+0000","last_undegraded":"2024-04-26T11:26:40.375483+0000","last_fullsized":"2024-04-26T11:26:40.375483+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":508,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371263+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:40.371263+0000","last_peered":"2024-04-26T11:26:40.371263+0000","last_clean":"2024-04-26T11:26:40.371263+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:40.371263+0000","last_undegraded":"2024-04-26T11:26:40.371263+0000","last_fullsized":"2024-04-26T11:26:40.371263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":1028,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374860+0000","last_change":"2024-04-26T11:26:38.377195+0000","last_active":"2024-04-26T11:26:40.374860+0000","last_peered":"2024-04-26T11:26:40.374860+0000","last_clean":"2024-04-26T11:26:40.374860+0000","last_became_active":"2024-04-26T11:26:38.373963+0000","last_became_peered":"2024-04-26T11:26:38.373963+0000","last_unstale":"2024-04-26T11:26:40.374860+0000","last_undegraded":"2024-04-26T11:26:40.374860+0000","last_fullsized":"2024-04-26T11:26:40.374860+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:57.937161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":628,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370077+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:40.370077+0000","last_peered":"2024-04-26T11:26:40.370077+0000","last_clean":"2024-04-26T11:26:40.370077+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:40.370077+0000","last_undegraded":"2024-04-26T11:26:40.370077+0000","last_fullsized":"2024-04-26T11:26:40.370077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":499,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.901431+0000","last_change":"2024-04-26T11:26:40.900605+0000","last_active":"2024-04-26T11:26:40.901431+0000","last_peered":"2024-04-26T11:26:40.901431+0000","last_clean":"2024-04-26T11:26:40.901431+0000","last_became_active":"2024-04-26T11:26:40.895623+0000","last_became_peered":"2024-04-26T11:26:40.895623+0000","last_unstale":"2024-04-26T11:26:40.901431+0000","last_undegraded":"2024-04-26T11:26:40.901431+0000","last_fullsized":"2024-04-26T11:26:40.901431+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:04.320929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":485,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375274+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:40.375274+0000","last_peered":"2024-04-26T11:26:40.375274+0000","last_clean":"2024-04-26T11:26:40.375274+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:40.375274+0000","last_undegraded":"2024-04-26T11:26:40.375274+0000","last_fullsized":"2024-04-26T11:26:40.375274+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":550,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895866+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:39.895866+0000","last_peered":"2024-04-26T11:26:39.895866+0000","last_clean":"2024-04-26T11:26:39.895866+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:39.895866+0000","last_undegraded":"2024-04-26T11:26:39.895866+0000","last_fullsized":"2024-04-26T11:26:39.895866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":505,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375633+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:40.375633+0000","last_peered":"2024-04-26T11:26:40.375633+0000","last_clean":"2024-04-26T11:26:40.375633+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:40.375633+0000","last_undegraded":"2024-04-26T11:26:40.375633+0000","last_fullsized":"2024-04-26T11:26:40.375633+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":176,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370912+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:40.370912+0000","last_peered":"2024-04-26T11:26:40.370912+0000","last_clean":"2024-04-26T11:26:40.370912+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:40.370912+0000","last_undegraded":"2024-04-26T11:26:40.370912+0000","last_fullsized":"2024-04-26T11:26:40.370912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":997,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372764+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:40.372764+0000","last_peered":"2024-04-26T11:26:40.372764+0000","last_clean":"2024-04-26T11:26:40.372764+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:40.372764+0000","last_undegraded":"2024-04-26T11:26:40.372764+0000","last_fullsized":"2024-04-26T11:26:40.372764+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":164,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374326+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:40.374326+0000","last_peered":"2024-04-26T11:26:40.374326+0000","last_clean":"2024-04-26T11:26:40.374326+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:40.374326+0000","last_undegraded":"2024-04-26T11:26:40.374326+0000","last_fullsized":"2024-04-26T11:26:40.374326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":937,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372115+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:40.372115+0000","last_peered":"2024-04-26T11:26:40.372115+0000","last_clean":"2024-04-26T11:26:40.372115+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:40.372115+0000","last_undegraded":"2024-04-26T11:26:40.372115+0000","last_fullsized":"2024-04-26T11:26:40.372115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":52,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895270+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:39.895270+0000","last_peered":"2024-04-26T11:26:39.895270+0000","last_clean":"2024-04-26T11:26:39.895270+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:39.895270+0000","last_undegraded":"2024-04-26T11:26:39.895270+0000","last_fullsized":"2024-04-26T11:26:39.895270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":242,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898259+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:39.898259+0000","last_peered":"2024-04-26T11:26:39.898259+0000","last_clean":"2024-04-26T11:26:39.898259+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:39.898259+0000","last_undegraded":"2024-04-26T11:26:39.898259+0000","last_fullsized":"2024-04-26T11:26:39.898259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":876,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373876+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:40.373876+0000","last_peered":"2024-04-26T11:26:40.373876+0000","last_clean":"2024-04-26T11:26:40.373876+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:40.373876+0000","last_undegraded":"2024-04-26T11:26:40.373876+0000","last_fullsized":"2024-04-26T11:26:40.373876+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":401,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376112+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:40.376112+0000","last_peered":"2024-04-26T11:26:40.376112+0000","last_clean":"2024-04-26T11:26:40.376112+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:40.376112+0000","last_undegraded":"2024-04-26T11:26:40.376112+0000","last_fullsized":"2024-04-26T11:26:40.376112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":580,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374073+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:40.374073+0000","last_peered":"2024-04-26T11:26:40.374073+0000","last_clean":"2024-04-26T11:26:40.374073+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:40.374073+0000","last_undegraded":"2024-04-26T11:26:40.374073+0000","last_fullsized":"2024-04-26T11:26:40.374073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":645,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897731+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:39.897731+0000","last_peered":"2024-04-26T11:26:39.897731+0000","last_clean":"2024-04-26T11:26:39.897731+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:39.897731+0000","last_undegraded":"2024-04-26T11:26:39.897731+0000","last_fullsized":"2024-04-26T11:26:39.897731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":530,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.906286+0000","last_change":"2024-04-26T11:26:39.905388+0000","last_active":"2024-04-26T11:26:39.906286+0000","last_peered":"2024-04-26T11:26:39.906286+0000","last_clean":"2024-04-26T11:26:39.906286+0000","last_became_active":"2024-04-26T11:26:39.900162+0000","last_became_peered":"2024-04-26T11:26:39.900162+0000","last_unstale":"2024-04-26T11:26:39.906286+0000","last_undegraded":"2024-04-26T11:26:39.906286+0000","last_fullsized":"2024-04-26T11:26:39.906286+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:50.194168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897546+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:39.897546+0000","last_peered":"2024-04-26T11:26:39.897546+0000","last_clean":"2024-04-26T11:26:39.897546+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:39.897546+0000","last_undegraded":"2024-04-26T11:26:39.897546+0000","last_fullsized":"2024-04-26T11:26:39.897546+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":958,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370924+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:40.370924+0000","last_peered":"2024-04-26T11:26:40.370924+0000","last_clean":"2024-04-26T11:26:40.370924+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:40.370924+0000","last_undegraded":"2024-04-26T11:26:40.370924+0000","last_fullsized":"2024-04-26T11:26:40.370924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":310,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371534+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:40.371534+0000","last_peered":"2024-04-26T11:26:40.371534+0000","last_clean":"2024-04-26T11:26:40.371534+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:40.371534+0000","last_undegraded":"2024-04-26T11:26:40.371534+0000","last_fullsized":"2024-04-26T11:26:40.371534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":527,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897534+0000","last_change":"2024-04-26T11:26:35.931909+0000","last_active":"2024-04-26T11:26:39.897534+0000","last_peered":"2024-04-26T11:26:39.897534+0000","last_clean":"2024-04-26T11:26:39.897534+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:26:39.897534+0000","last_undegraded":"2024-04-26T11:26:39.897534+0000","last_fullsized":"2024-04-26T11:26:39.897534+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:22.946052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":295,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896059+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:39.896059+0000","last_peered":"2024-04-26T11:26:39.896059+0000","last_clean":"2024-04-26T11:26:39.896059+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:39.896059+0000","last_undegraded":"2024-04-26T11:26:39.896059+0000","last_fullsized":"2024-04-26T11:26:39.896059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":471,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897608+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:39.897608+0000","last_peered":"2024-04-26T11:26:39.897608+0000","last_clean":"2024-04-26T11:26:39.897608+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:39.897608+0000","last_undegraded":"2024-04-26T11:26:39.897608+0000","last_fullsized":"2024-04-26T11:26:39.897608+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":151,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374409+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:40.374409+0000","last_peered":"2024-04-26T11:26:40.374409+0000","last_clean":"2024-04-26T11:26:40.374409+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:40.374409+0000","last_undegraded":"2024-04-26T11:26:40.374409+0000","last_fullsized":"2024-04-26T11:26:40.374409+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":446,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897851+0000","last_change":"2024-04-26T11:26:29.914048+0000","last_active":"2024-04-26T11:26:39.897851+0000","last_peered":"2024-04-26T11:26:39.897851+0000","last_clean":"2024-04-26T11:26:39.897851+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:26:39.897851+0000","last_undegraded":"2024-04-26T11:26:39.897851+0000","last_fullsized":"2024-04-26T11:26:39.897851+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":352,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373885+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:40.373885+0000","last_peered":"2024-04-26T11:26:40.373885+0000","last_clean":"2024-04-26T11:26:40.373885+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:40.373885+0000","last_undegraded":"2024-04-26T11:26:40.373885+0000","last_fullsized":"2024-04-26T11:26:40.373885+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":553,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372264+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:40.372264+0000","last_peered":"2024-04-26T11:26:40.372264+0000","last_clean":"2024-04-26T11:26:40.372264+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:40.372264+0000","last_undegraded":"2024-04-26T11:26:40.372264+0000","last_fullsized":"2024-04-26T11:26:40.372264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":247,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.894834+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:39.894834+0000","last_peered":"2024-04-26T11:26:39.894834+0000","last_clean":"2024-04-26T11:26:39.894834+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:39.894834+0000","last_undegraded":"2024-04-26T11:26:39.894834+0000","last_fullsized":"2024-04-26T11:26:39.894834+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895601+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:39.895601+0000","last_peered":"2024-04-26T11:26:39.895601+0000","last_clean":"2024-04-26T11:26:39.895601+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:39.895601+0000","last_undegraded":"2024-04-26T11:26:39.895601+0000","last_fullsized":"2024-04-26T11:26:39.895601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":851,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371480+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:40.371480+0000","last_peered":"2024-04-26T11:26:40.371480+0000","last_clean":"2024-04-26T11:26:40.371480+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:40.371480+0000","last_undegraded":"2024-04-26T11:26:40.371480+0000","last_fullsized":"2024-04-26T11:26:40.371480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":514,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897848+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:39.897848+0000","last_peered":"2024-04-26T11:26:39.897848+0000","last_clean":"2024-04-26T11:26:39.897848+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:39.897848+0000","last_undegraded":"2024-04-26T11:26:39.897848+0000","last_fullsized":"2024-04-26T11:26:39.897848+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896930+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:39.896930+0000","last_peered":"2024-04-26T11:26:39.896930+0000","last_clean":"2024-04-26T11:26:39.896930+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:39.896930+0000","last_undegraded":"2024-04-26T11:26:39.896930+0000","last_fullsized":"2024-04-26T11:26:39.896930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":292,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370638+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:40.370638+0000","last_peered":"2024-04-26T11:26:40.370638+0000","last_clean":"2024-04-26T11:26:40.370638+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:40.370638+0000","last_undegraded":"2024-04-26T11:26:40.370638+0000","last_fullsized":"2024-04-26T11:26:40.370638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":562,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375681+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:40.375681+0000","last_peered":"2024-04-26T11:26:40.375681+0000","last_clean":"2024-04-26T11:26:40.375681+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:40.375681+0000","last_undegraded":"2024-04-26T11:26:40.375681+0000","last_fullsized":"2024-04-26T11:26:40.375681+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371265+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:40.371265+0000","last_peered":"2024-04-26T11:26:40.371265+0000","last_clean":"2024-04-26T11:26:40.371265+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:40.371265+0000","last_undegraded":"2024-04-26T11:26:40.371265+0000","last_fullsized":"2024-04-26T11:26:40.371265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":482,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374138+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:40.374138+0000","last_peered":"2024-04-26T11:26:40.374138+0000","last_clean":"2024-04-26T11:26:40.374138+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:40.374138+0000","last_undegraded":"2024-04-26T11:26:40.374138+0000","last_fullsized":"2024-04-26T11:26:40.374138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":453,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372369+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:40.372369+0000","last_peered":"2024-04-26T11:26:40.372369+0000","last_clean":"2024-04-26T11:26:40.372369+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:40.372369+0000","last_undegraded":"2024-04-26T11:26:40.372369+0000","last_fullsized":"2024-04-26T11:26:40.372369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895458+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:39.895458+0000","last_peered":"2024-04-26T11:26:39.895458+0000","last_clean":"2024-04-26T11:26:39.895458+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:39.895458+0000","last_undegraded":"2024-04-26T11:26:39.895458+0000","last_fullsized":"2024-04-26T11:26:39.895458+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895632+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:39.895632+0000","last_peered":"2024-04-26T11:26:39.895632+0000","last_clean":"2024-04-26T11:26:39.895632+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:39.895632+0000","last_undegraded":"2024-04-26T11:26:39.895632+0000","last_fullsized":"2024-04-26T11:26:39.895632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":562,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372246+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:40.372246+0000","last_peered":"2024-04-26T11:26:40.372246+0000","last_clean":"2024-04-26T11:26:40.372246+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:40.372246+0000","last_undegraded":"2024-04-26T11:26:40.372246+0000","last_fullsized":"2024-04-26T11:26:40.372246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896978+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:39.896978+0000","last_peered":"2024-04-26T11:26:39.896978+0000","last_clean":"2024-04-26T11:26:39.896978+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:39.896978+0000","last_undegraded":"2024-04-26T11:26:39.896978+0000","last_fullsized":"2024-04-26T11:26:39.896978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372506+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:40.372506+0000","last_peered":"2024-04-26T11:26:40.372506+0000","last_clean":"2024-04-26T11:26:40.372506+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:40.372506+0000","last_undegraded":"2024-04-26T11:26:40.372506+0000","last_fullsized":"2024-04-26T11:26:40.372506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":792,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374549+0000","last_change":"2024-04-26T11:26:35.389500+0000","last_active":"2024-04-26T11:26:40.374549+0000","last_peered":"2024-04-26T11:26:40.374549+0000","last_clean":"2024-04-26T11:26:40.374549+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:26:40.374549+0000","last_undegraded":"2024-04-26T11:26:40.374549+0000","last_fullsized":"2024-04-26T11:26:40.374549+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:56.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":158,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372239+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:40.372239+0000","last_peered":"2024-04-26T11:26:40.372239+0000","last_clean":"2024-04-26T11:26:40.372239+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:40.372239+0000","last_undegraded":"2024-04-26T11:26:40.372239+0000","last_fullsized":"2024-04-26T11:26:40.372239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376205+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:40.376205+0000","last_peered":"2024-04-26T11:26:40.376205+0000","last_clean":"2024-04-26T11:26:40.376205+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:40.376205+0000","last_undegraded":"2024-04-26T11:26:40.376205+0000","last_fullsized":"2024-04-26T11:26:40.376205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":817,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374730+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:40.374730+0000","last_peered":"2024-04-26T11:26:40.374730+0000","last_clean":"2024-04-26T11:26:40.374730+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:40.374730+0000","last_undegraded":"2024-04-26T11:26:40.374730+0000","last_fullsized":"2024-04-26T11:26:40.374730+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":161,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372975+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:40.372975+0000","last_peered":"2024-04-26T11:26:40.372975+0000","last_clean":"2024-04-26T11:26:40.372975+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:40.372975+0000","last_undegraded":"2024-04-26T11:26:40.372975+0000","last_fullsized":"2024-04-26T11:26:40.372975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372900+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:40.372900+0000","last_peered":"2024-04-26T11:26:40.372900+0000","last_clean":"2024-04-26T11:26:40.372900+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:40.372900+0000","last_undegraded":"2024-04-26T11:26:40.372900+0000","last_fullsized":"2024-04-26T11:26:40.372900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":926,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370385+0000","last_change":"2024-04-26T11:26:39.378496+0000","last_active":"2024-04-26T11:26:40.370385+0000","last_peered":"2024-04-26T11:26:40.370385+0000","last_clean":"2024-04-26T11:26:40.370385+0000","last_became_active":"2024-04-26T11:26:39.375075+0000","last_became_peered":"2024-04-26T11:26:39.375075+0000","last_unstale":"2024-04-26T11:26:40.370385+0000","last_undegraded":"2024-04-26T11:26:40.370385+0000","last_fullsized":"2024-04-26T11:26:40.370385+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:37.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":190,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372812+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:40.372812+0000","last_peered":"2024-04-26T11:26:40.372812+0000","last_clean":"2024-04-26T11:26:40.372812+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:40.372812+0000","last_undegraded":"2024-04-26T11:26:40.372812+0000","last_fullsized":"2024-04-26T11:26:40.372812+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897855+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:39.897855+0000","last_peered":"2024-04-26T11:26:39.897855+0000","last_clean":"2024-04-26T11:26:39.897855+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:39.897855+0000","last_undegraded":"2024-04-26T11:26:39.897855+0000","last_fullsized":"2024-04-26T11:26:39.897855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":930,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374136+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:40.374136+0000","last_peered":"2024-04-26T11:26:40.374136+0000","last_clean":"2024-04-26T11:26:40.374136+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:40.374136+0000","last_undegraded":"2024-04-26T11:26:40.374136+0000","last_fullsized":"2024-04-26T11:26:40.374136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":512,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896222+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:39.896222+0000","last_peered":"2024-04-26T11:26:39.896222+0000","last_clean":"2024-04-26T11:26:39.896222+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:39.896222+0000","last_undegraded":"2024-04-26T11:26:39.896222+0000","last_fullsized":"2024-04-26T11:26:39.896222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":491,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896711+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:39.896711+0000","last_peered":"2024-04-26T11:26:39.896711+0000","last_clean":"2024-04-26T11:26:39.896711+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:39.896711+0000","last_undegraded":"2024-04-26T11:26:39.896711+0000","last_fullsized":"2024-04-26T11:26:39.896711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":556,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370468+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:40.370468+0000","last_peered":"2024-04-26T11:26:40.370468+0000","last_clean":"2024-04-26T11:26:40.370468+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:40.370468+0000","last_undegraded":"2024-04-26T11:26:40.370468+0000","last_fullsized":"2024-04-26T11:26:40.370468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":181,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376086+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:40.376086+0000","last_peered":"2024-04-26T11:26:40.376086+0000","last_clean":"2024-04-26T11:26:40.376086+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:40.376086+0000","last_undegraded":"2024-04-26T11:26:40.376086+0000","last_fullsized":"2024-04-26T11:26:40.376086+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":416,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897546+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:39.897546+0000","last_peered":"2024-04-26T11:26:39.897546+0000","last_clean":"2024-04-26T11:26:39.897546+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:39.897546+0000","last_undegraded":"2024-04-26T11:26:39.897546+0000","last_fullsized":"2024-04-26T11:26:39.897546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":1025,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370129+0000","last_change":"2024-04-26T11:26:38.376749+0000","last_active":"2024-04-26T11:26:40.370129+0000","last_peered":"2024-04-26T11:26:40.370129+0000","last_clean":"2024-04-26T11:26:40.370129+0000","last_became_active":"2024-04-26T11:26:38.373800+0000","last_became_peered":"2024-04-26T11:26:38.373800+0000","last_unstale":"2024-04-26T11:26:40.370129+0000","last_undegraded":"2024-04-26T11:26:40.370129+0000","last_fullsized":"2024-04-26T11:26:40.370129+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:23.112909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":165,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372797+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:40.372797+0000","last_peered":"2024-04-26T11:26:40.372797+0000","last_clean":"2024-04-26T11:26:40.372797+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:40.372797+0000","last_undegraded":"2024-04-26T11:26:40.372797+0000","last_fullsized":"2024-04-26T11:26:40.372797+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370124+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:40.370124+0000","last_peered":"2024-04-26T11:26:40.370124+0000","last_clean":"2024-04-26T11:26:40.370124+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:40.370124+0000","last_undegraded":"2024-04-26T11:26:40.370124+0000","last_fullsized":"2024-04-26T11:26:40.370124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":792,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376038+0000","last_change":"2024-04-26T11:26:32.372817+0000","last_active":"2024-04-26T11:26:40.376038+0000","last_peered":"2024-04-26T11:26:40.376038+0000","last_clean":"2024-04-26T11:26:40.376038+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:26:40.376038+0000","last_undegraded":"2024-04-26T11:26:40.376038+0000","last_fullsized":"2024-04-26T11:26:40.376038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:32.214458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":687,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370831+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:40.370831+0000","last_peered":"2024-04-26T11:26:40.370831+0000","last_clean":"2024-04-26T11:26:40.370831+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:40.370831+0000","last_undegraded":"2024-04-26T11:26:40.370831+0000","last_fullsized":"2024-04-26T11:26:40.370831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":922,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372380+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:40.372380+0000","last_peered":"2024-04-26T11:26:40.372380+0000","last_clean":"2024-04-26T11:26:40.372380+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:40.372380+0000","last_undegraded":"2024-04-26T11:26:40.372380+0000","last_fullsized":"2024-04-26T11:26:40.372380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":394,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370389+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:40.370389+0000","last_peered":"2024-04-26T11:26:40.370389+0000","last_clean":"2024-04-26T11:26:40.370389+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:40.370389+0000","last_undegraded":"2024-04-26T11:26:40.370389+0000","last_fullsized":"2024-04-26T11:26:40.370389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1016,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375585+0000","last_change":"2024-04-26T11:26:36.406522+0000","last_active":"2024-04-26T11:26:40.375585+0000","last_peered":"2024-04-26T11:26:40.375585+0000","last_clean":"2024-04-26T11:26:40.375585+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:26:40.375585+0000","last_undegraded":"2024-04-26T11:26:40.375585+0000","last_fullsized":"2024-04-26T11:26:40.375585+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:05.312742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":431,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374748+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:40.374748+0000","last_peered":"2024-04-26T11:26:40.374748+0000","last_clean":"2024-04-26T11:26:40.374748+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:40.374748+0000","last_undegraded":"2024-04-26T11:26:40.374748+0000","last_fullsized":"2024-04-26T11:26:40.374748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":499,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375046+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:40.375046+0000","last_peered":"2024-04-26T11:26:40.375046+0000","last_clean":"2024-04-26T11:26:40.375046+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:40.375046+0000","last_undegraded":"2024-04-26T11:26:40.375046+0000","last_fullsized":"2024-04-26T11:26:40.375046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":152,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375041+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:40.375041+0000","last_peered":"2024-04-26T11:26:40.375041+0000","last_clean":"2024-04-26T11:26:40.375041+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:40.375041+0000","last_undegraded":"2024-04-26T11:26:40.375041+0000","last_fullsized":"2024-04-26T11:26:40.375041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":475,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896112+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:39.896112+0000","last_peered":"2024-04-26T11:26:39.896112+0000","last_clean":"2024-04-26T11:26:39.896112+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:39.896112+0000","last_undegraded":"2024-04-26T11:26:39.896112+0000","last_fullsized":"2024-04-26T11:26:39.896112+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":404,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895905+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:39.895905+0000","last_peered":"2024-04-26T11:26:39.895905+0000","last_clean":"2024-04-26T11:26:39.895905+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:39.895905+0000","last_undegraded":"2024-04-26T11:26:39.895905+0000","last_fullsized":"2024-04-26T11:26:39.895905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":491,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897078+0000","last_change":"2024-04-26T11:26:31.896245+0000","last_active":"2024-04-26T11:26:39.897078+0000","last_peered":"2024-04-26T11:26:39.897078+0000","last_clean":"2024-04-26T11:26:39.897078+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:26:39.897078+0000","last_undegraded":"2024-04-26T11:26:39.897078+0000","last_fullsized":"2024-04-26T11:26:39.897078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:59.173436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":497,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375850+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:40.375850+0000","last_peered":"2024-04-26T11:26:40.375850+0000","last_clean":"2024-04-26T11:26:40.375850+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:40.375850+0000","last_undegraded":"2024-04-26T11:26:40.375850+0000","last_fullsized":"2024-04-26T11:26:40.375850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":498,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374562+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:40.374562+0000","last_peered":"2024-04-26T11:26:40.374562+0000","last_clean":"2024-04-26T11:26:40.374562+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:40.374562+0000","last_undegraded":"2024-04-26T11:26:40.374562+0000","last_fullsized":"2024-04-26T11:26:40.374562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":158,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372672+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:40.372672+0000","last_peered":"2024-04-26T11:26:40.372672+0000","last_clean":"2024-04-26T11:26:40.372672+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:40.372672+0000","last_undegraded":"2024-04-26T11:26:40.372672+0000","last_fullsized":"2024-04-26T11:26:40.372672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":542,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897090+0000","last_change":"2024-04-26T11:26:33.905426+0000","last_active":"2024-04-26T11:26:39.897090+0000","last_peered":"2024-04-26T11:26:39.897090+0000","last_clean":"2024-04-26T11:26:39.897090+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:39.897090+0000","last_undegraded":"2024-04-26T11:26:39.897090+0000","last_fullsized":"2024-04-26T11:26:39.897090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:49.659488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":256,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372499+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:40.372499+0000","last_peered":"2024-04-26T11:26:40.372499+0000","last_clean":"2024-04-26T11:26:40.372499+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:40.372499+0000","last_undegraded":"2024-04-26T11:26:40.372499+0000","last_fullsized":"2024-04-26T11:26:40.372499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738433,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142432,"kb_used_data":30992,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229408,"statfs":{"total":96636764160,"available":96490913792,"internally_reserved":0,"allocated":31735808,"data_stored":81608913,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61599999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738433,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124352,"kb_used_data":30956,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247488,"statfs":{"total":96636764160,"available":96509427712,"internally_reserved":0,"allocated":31698944,"data_stored":86113033,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.56599999999999995}]}]},{"osd":0,"up_from":75,"seq":322122547209,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75944,"kb_used_data":18068,"kb_used_omap":7,"kb_used_meta":57848,"kb_avail":94295896,"statfs":{"total":96636764160,"available":96558997504,"internally_reserved":0,"allocated":18501632,"data_stored":91781533,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":59237367},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:47.253 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T11:26:47.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:47.588 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:47.590 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:47.605 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-04-26T11:26:47.454763+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7334,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":342740,"kb_used_data":80032,"kb_used_omap":10,"kb_used_meta":262645,"kb_avail":282772780,"statfs":{"total":289910292480,"available":289559326720,"internally_reserved":0,"allocated":81952768,"data_stored":259511943,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":268949379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-1143,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002944"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":509,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375889+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:40.375889+0000","last_peered":"2024-04-26T11:26:40.375889+0000","last_clean":"2024-04-26T11:26:40.375889+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:40.375889+0000","last_undegraded":"2024-04-26T11:26:40.375889+0000","last_fullsized":"2024-04-26T11:26:40.375889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":565,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375446+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:40.375446+0000","last_peered":"2024-04-26T11:26:40.375446+0000","last_clean":"2024-04-26T11:26:40.375446+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:40.375446+0000","last_undegraded":"2024-04-26T11:26:40.375446+0000","last_fullsized":"2024-04-26T11:26:40.375446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":440,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898192+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:39.898192+0000","last_peered":"2024-04-26T11:26:39.898192+0000","last_clean":"2024-04-26T11:26:39.898192+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:39.898192+0000","last_undegraded":"2024-04-26T11:26:39.898192+0000","last_fullsized":"2024-04-26T11:26:39.898192+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":489,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896372+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:39.896372+0000","last_peered":"2024-04-26T11:26:39.896372+0000","last_clean":"2024-04-26T11:26:39.896372+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:39.896372+0000","last_undegraded":"2024-04-26T11:26:39.896372+0000","last_fullsized":"2024-04-26T11:26:39.896372+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":540,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375005+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:40.375005+0000","last_peered":"2024-04-26T11:26:40.375005+0000","last_clean":"2024-04-26T11:26:40.375005+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:40.375005+0000","last_undegraded":"2024-04-26T11:26:40.375005+0000","last_fullsized":"2024-04-26T11:26:40.375005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":493,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896914+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:39.896914+0000","last_peered":"2024-04-26T11:26:39.896914+0000","last_clean":"2024-04-26T11:26:39.896914+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:39.896914+0000","last_undegraded":"2024-04-26T11:26:39.896914+0000","last_fullsized":"2024-04-26T11:26:39.896914+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":594,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895848+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:39.895848+0000","last_peered":"2024-04-26T11:26:39.895848+0000","last_clean":"2024-04-26T11:26:39.895848+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:39.895848+0000","last_undegraded":"2024-04-26T11:26:39.895848+0000","last_fullsized":"2024-04-26T11:26:39.895848+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":462,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896813+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:39.896813+0000","last_peered":"2024-04-26T11:26:39.896813+0000","last_clean":"2024-04-26T11:26:39.896813+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:39.896813+0000","last_undegraded":"2024-04-26T11:26:39.896813+0000","last_fullsized":"2024-04-26T11:26:39.896813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":597,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373947+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:41.373947+0000","last_peered":"2024-04-26T11:26:41.373947+0000","last_clean":"2024-04-26T11:26:41.373947+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:41.373947+0000","last_undegraded":"2024-04-26T11:26:41.373947+0000","last_fullsized":"2024-04-26T11:26:41.373947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":507,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375073+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:41.375073+0000","last_peered":"2024-04-26T11:26:41.375073+0000","last_clean":"2024-04-26T11:26:41.375073+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:41.375073+0000","last_undegraded":"2024-04-26T11:26:41.375073+0000","last_fullsized":"2024-04-26T11:26:41.375073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":480,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898025+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:39.898025+0000","last_peered":"2024-04-26T11:26:39.898025+0000","last_clean":"2024-04-26T11:26:39.898025+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:39.898025+0000","last_undegraded":"2024-04-26T11:26:39.898025+0000","last_fullsized":"2024-04-26T11:26:39.898025+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:07.200544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":783,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374335+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:41.374335+0000","last_peered":"2024-04-26T11:26:41.374335+0000","last_clean":"2024-04-26T11:26:41.374335+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:41.374335+0000","last_undegraded":"2024-04-26T11:26:41.374335+0000","last_fullsized":"2024-04-26T11:26:41.374335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":453,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374678+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:40.374678+0000","last_peered":"2024-04-26T11:26:40.374678+0000","last_clean":"2024-04-26T11:26:40.374678+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:40.374678+0000","last_undegraded":"2024-04-26T11:26:40.374678+0000","last_fullsized":"2024-04-26T11:26:40.374678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":482,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896659+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:39.896659+0000","last_peered":"2024-04-26T11:26:39.896659+0000","last_clean":"2024-04-26T11:26:39.896659+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:39.896659+0000","last_undegraded":"2024-04-26T11:26:39.896659+0000","last_fullsized":"2024-04-26T11:26:39.896659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":538,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896114+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:39.896114+0000","last_peered":"2024-04-26T11:26:39.896114+0000","last_clean":"2024-04-26T11:26:39.896114+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:39.896114+0000","last_undegraded":"2024-04-26T11:26:39.896114+0000","last_fullsized":"2024-04-26T11:26:39.896114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":603,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897245+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:39.897245+0000","last_peered":"2024-04-26T11:26:39.897245+0000","last_clean":"2024-04-26T11:26:39.897245+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:39.897245+0000","last_undegraded":"2024-04-26T11:26:39.897245+0000","last_fullsized":"2024-04-26T11:26:39.897245+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":577,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372796+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:40.372796+0000","last_peered":"2024-04-26T11:26:40.372796+0000","last_clean":"2024-04-26T11:26:40.372796+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:40.372796+0000","last_undegraded":"2024-04-26T11:26:40.372796+0000","last_fullsized":"2024-04-26T11:26:40.372796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":584,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375825+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:40.375825+0000","last_peered":"2024-04-26T11:26:40.375825+0000","last_clean":"2024-04-26T11:26:40.375825+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:40.375825+0000","last_undegraded":"2024-04-26T11:26:40.375825+0000","last_fullsized":"2024-04-26T11:26:40.375825+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":623,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371677+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:40.371677+0000","last_peered":"2024-04-26T11:26:40.371677+0000","last_clean":"2024-04-26T11:26:40.371677+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:40.371677+0000","last_undegraded":"2024-04-26T11:26:40.371677+0000","last_fullsized":"2024-04-26T11:26:40.371677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":611,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897131+0000","last_change":"2024-04-26T11:26:29.907661+0000","last_active":"2024-04-26T11:26:39.897131+0000","last_peered":"2024-04-26T11:26:39.897131+0000","last_clean":"2024-04-26T11:26:39.897131+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:26:39.897131+0000","last_undegraded":"2024-04-26T11:26:39.897131+0000","last_fullsized":"2024-04-26T11:26:39.897131+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":549,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896468+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:39.896468+0000","last_peered":"2024-04-26T11:26:39.896468+0000","last_clean":"2024-04-26T11:26:39.896468+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:39.896468+0000","last_undegraded":"2024-04-26T11:26:39.896468+0000","last_fullsized":"2024-04-26T11:26:39.896468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.393282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":978,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374306+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:40.374306+0000","last_peered":"2024-04-26T11:26:40.374306+0000","last_clean":"2024-04-26T11:26:40.374306+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:40.374306+0000","last_undegraded":"2024-04-26T11:26:40.374306+0000","last_fullsized":"2024-04-26T11:26:40.374306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:06.847831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":932,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.369890+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:40.369890+0000","last_peered":"2024-04-26T11:26:40.369890+0000","last_clean":"2024-04-26T11:26:40.369890+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:40.369890+0000","last_undegraded":"2024-04-26T11:26:40.369890+0000","last_fullsized":"2024-04-26T11:26:40.369890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":515,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373716+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:40.373716+0000","last_peered":"2024-04-26T11:26:40.373716+0000","last_clean":"2024-04-26T11:26:40.373716+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:40.373716+0000","last_undegraded":"2024-04-26T11:26:40.373716+0000","last_fullsized":"2024-04-26T11:26:40.373716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":948,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376062+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:40.376062+0000","last_peered":"2024-04-26T11:26:40.376062+0000","last_clean":"2024-04-26T11:26:40.376062+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:40.376062+0000","last_undegraded":"2024-04-26T11:26:40.376062+0000","last_fullsized":"2024-04-26T11:26:40.376062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:04.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1054,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372134+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:40.372134+0000","last_peered":"2024-04-26T11:26:40.372134+0000","last_clean":"2024-04-26T11:26:40.372134+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:40.372134+0000","last_undegraded":"2024-04-26T11:26:40.372134+0000","last_fullsized":"2024-04-26T11:26:40.372134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":558,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897950+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:39.897950+0000","last_peered":"2024-04-26T11:26:39.897950+0000","last_clean":"2024-04-26T11:26:39.897950+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:39.897950+0000","last_undegraded":"2024-04-26T11:26:39.897950+0000","last_fullsized":"2024-04-26T11:26:39.897950+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":951,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375483+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:40.375483+0000","last_peered":"2024-04-26T11:26:40.375483+0000","last_clean":"2024-04-26T11:26:40.375483+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:40.375483+0000","last_undegraded":"2024-04-26T11:26:40.375483+0000","last_fullsized":"2024-04-26T11:26:40.375483+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":508,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371263+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:40.371263+0000","last_peered":"2024-04-26T11:26:40.371263+0000","last_clean":"2024-04-26T11:26:40.371263+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:40.371263+0000","last_undegraded":"2024-04-26T11:26:40.371263+0000","last_fullsized":"2024-04-26T11:26:40.371263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":1028,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374860+0000","last_change":"2024-04-26T11:26:38.377195+0000","last_active":"2024-04-26T11:26:40.374860+0000","last_peered":"2024-04-26T11:26:40.374860+0000","last_clean":"2024-04-26T11:26:40.374860+0000","last_became_active":"2024-04-26T11:26:38.373963+0000","last_became_peered":"2024-04-26T11:26:38.373963+0000","last_unstale":"2024-04-26T11:26:40.374860+0000","last_undegraded":"2024-04-26T11:26:40.374860+0000","last_fullsized":"2024-04-26T11:26:40.374860+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:57.937161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":628,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370077+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:40.370077+0000","last_peered":"2024-04-26T11:26:40.370077+0000","last_clean":"2024-04-26T11:26:40.370077+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:40.370077+0000","last_undegraded":"2024-04-26T11:26:40.370077+0000","last_fullsized":"2024-04-26T11:26:40.370077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":499,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.901431+0000","last_change":"2024-04-26T11:26:40.900605+0000","last_active":"2024-04-26T11:26:40.901431+0000","last_peered":"2024-04-26T11:26:40.901431+0000","last_clean":"2024-04-26T11:26:40.901431+0000","last_became_active":"2024-04-26T11:26:40.895623+0000","last_became_peered":"2024-04-26T11:26:40.895623+0000","last_unstale":"2024-04-26T11:26:40.901431+0000","last_undegraded":"2024-04-26T11:26:40.901431+0000","last_fullsized":"2024-04-26T11:26:40.901431+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:04.320929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":485,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375274+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:40.375274+0000","last_peered":"2024-04-26T11:26:40.375274+0000","last_clean":"2024-04-26T11:26:40.375274+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:40.375274+0000","last_undegraded":"2024-04-26T11:26:40.375274+0000","last_fullsized":"2024-04-26T11:26:40.375274+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":550,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895866+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:39.895866+0000","last_peered":"2024-04-26T11:26:39.895866+0000","last_clean":"2024-04-26T11:26:39.895866+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:39.895866+0000","last_undegraded":"2024-04-26T11:26:39.895866+0000","last_fullsized":"2024-04-26T11:26:39.895866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":505,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375633+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:40.375633+0000","last_peered":"2024-04-26T11:26:40.375633+0000","last_clean":"2024-04-26T11:26:40.375633+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:40.375633+0000","last_undegraded":"2024-04-26T11:26:40.375633+0000","last_fullsized":"2024-04-26T11:26:40.375633+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":176,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370912+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:40.370912+0000","last_peered":"2024-04-26T11:26:40.370912+0000","last_clean":"2024-04-26T11:26:40.370912+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:40.370912+0000","last_undegraded":"2024-04-26T11:26:40.370912+0000","last_fullsized":"2024-04-26T11:26:40.370912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":998,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374371+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:41.374371+0000","last_peered":"2024-04-26T11:26:41.374371+0000","last_clean":"2024-04-26T11:26:41.374371+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:41.374371+0000","last_undegraded":"2024-04-26T11:26:41.374371+0000","last_fullsized":"2024-04-26T11:26:41.374371+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":164,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374326+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:40.374326+0000","last_peered":"2024-04-26T11:26:40.374326+0000","last_clean":"2024-04-26T11:26:40.374326+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:40.374326+0000","last_undegraded":"2024-04-26T11:26:40.374326+0000","last_fullsized":"2024-04-26T11:26:40.374326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":938,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373981+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:41.373981+0000","last_peered":"2024-04-26T11:26:41.373981+0000","last_clean":"2024-04-26T11:26:41.373981+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:41.373981+0000","last_undegraded":"2024-04-26T11:26:41.373981+0000","last_fullsized":"2024-04-26T11:26:41.373981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":52,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895270+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:39.895270+0000","last_peered":"2024-04-26T11:26:39.895270+0000","last_clean":"2024-04-26T11:26:39.895270+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:39.895270+0000","last_undegraded":"2024-04-26T11:26:39.895270+0000","last_fullsized":"2024-04-26T11:26:39.895270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":242,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898259+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:39.898259+0000","last_peered":"2024-04-26T11:26:39.898259+0000","last_clean":"2024-04-26T11:26:39.898259+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:39.898259+0000","last_undegraded":"2024-04-26T11:26:39.898259+0000","last_fullsized":"2024-04-26T11:26:39.898259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":876,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373876+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:40.373876+0000","last_peered":"2024-04-26T11:26:40.373876+0000","last_clean":"2024-04-26T11:26:40.373876+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:40.373876+0000","last_undegraded":"2024-04-26T11:26:40.373876+0000","last_fullsized":"2024-04-26T11:26:40.373876+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":401,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376112+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:40.376112+0000","last_peered":"2024-04-26T11:26:40.376112+0000","last_clean":"2024-04-26T11:26:40.376112+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:40.376112+0000","last_undegraded":"2024-04-26T11:26:40.376112+0000","last_fullsized":"2024-04-26T11:26:40.376112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":580,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374073+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:40.374073+0000","last_peered":"2024-04-26T11:26:40.374073+0000","last_clean":"2024-04-26T11:26:40.374073+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:40.374073+0000","last_undegraded":"2024-04-26T11:26:40.374073+0000","last_fullsized":"2024-04-26T11:26:40.374073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":645,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897731+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:39.897731+0000","last_peered":"2024-04-26T11:26:39.897731+0000","last_clean":"2024-04-26T11:26:39.897731+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:39.897731+0000","last_undegraded":"2024-04-26T11:26:39.897731+0000","last_fullsized":"2024-04-26T11:26:39.897731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":530,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.906286+0000","last_change":"2024-04-26T11:26:39.905388+0000","last_active":"2024-04-26T11:26:39.906286+0000","last_peered":"2024-04-26T11:26:39.906286+0000","last_clean":"2024-04-26T11:26:39.906286+0000","last_became_active":"2024-04-26T11:26:39.900162+0000","last_became_peered":"2024-04-26T11:26:39.900162+0000","last_unstale":"2024-04-26T11:26:39.906286+0000","last_undegraded":"2024-04-26T11:26:39.906286+0000","last_fullsized":"2024-04-26T11:26:39.906286+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:50.194168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897546+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:39.897546+0000","last_peered":"2024-04-26T11:26:39.897546+0000","last_clean":"2024-04-26T11:26:39.897546+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:39.897546+0000","last_undegraded":"2024-04-26T11:26:39.897546+0000","last_fullsized":"2024-04-26T11:26:39.897546+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":958,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370924+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:40.370924+0000","last_peered":"2024-04-26T11:26:40.370924+0000","last_clean":"2024-04-26T11:26:40.370924+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:40.370924+0000","last_undegraded":"2024-04-26T11:26:40.370924+0000","last_fullsized":"2024-04-26T11:26:40.370924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":310,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371534+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:40.371534+0000","last_peered":"2024-04-26T11:26:40.371534+0000","last_clean":"2024-04-26T11:26:40.371534+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:40.371534+0000","last_undegraded":"2024-04-26T11:26:40.371534+0000","last_fullsized":"2024-04-26T11:26:40.371534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":527,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897534+0000","last_change":"2024-04-26T11:26:35.931909+0000","last_active":"2024-04-26T11:26:39.897534+0000","last_peered":"2024-04-26T11:26:39.897534+0000","last_clean":"2024-04-26T11:26:39.897534+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:26:39.897534+0000","last_undegraded":"2024-04-26T11:26:39.897534+0000","last_fullsized":"2024-04-26T11:26:39.897534+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:22.946052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":295,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896059+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:39.896059+0000","last_peered":"2024-04-26T11:26:39.896059+0000","last_clean":"2024-04-26T11:26:39.896059+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:39.896059+0000","last_undegraded":"2024-04-26T11:26:39.896059+0000","last_fullsized":"2024-04-26T11:26:39.896059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":471,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897608+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:39.897608+0000","last_peered":"2024-04-26T11:26:39.897608+0000","last_clean":"2024-04-26T11:26:39.897608+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:39.897608+0000","last_undegraded":"2024-04-26T11:26:39.897608+0000","last_fullsized":"2024-04-26T11:26:39.897608+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":151,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374409+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:40.374409+0000","last_peered":"2024-04-26T11:26:40.374409+0000","last_clean":"2024-04-26T11:26:40.374409+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:40.374409+0000","last_undegraded":"2024-04-26T11:26:40.374409+0000","last_fullsized":"2024-04-26T11:26:40.374409+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":446,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897851+0000","last_change":"2024-04-26T11:26:29.914048+0000","last_active":"2024-04-26T11:26:39.897851+0000","last_peered":"2024-04-26T11:26:39.897851+0000","last_clean":"2024-04-26T11:26:39.897851+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:26:39.897851+0000","last_undegraded":"2024-04-26T11:26:39.897851+0000","last_fullsized":"2024-04-26T11:26:39.897851+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":352,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373885+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:40.373885+0000","last_peered":"2024-04-26T11:26:40.373885+0000","last_clean":"2024-04-26T11:26:40.373885+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:40.373885+0000","last_undegraded":"2024-04-26T11:26:40.373885+0000","last_fullsized":"2024-04-26T11:26:40.373885+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":553,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372264+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:40.372264+0000","last_peered":"2024-04-26T11:26:40.372264+0000","last_clean":"2024-04-26T11:26:40.372264+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:40.372264+0000","last_undegraded":"2024-04-26T11:26:40.372264+0000","last_fullsized":"2024-04-26T11:26:40.372264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":247,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.894834+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:39.894834+0000","last_peered":"2024-04-26T11:26:39.894834+0000","last_clean":"2024-04-26T11:26:39.894834+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:39.894834+0000","last_undegraded":"2024-04-26T11:26:39.894834+0000","last_fullsized":"2024-04-26T11:26:39.894834+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895601+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:39.895601+0000","last_peered":"2024-04-26T11:26:39.895601+0000","last_clean":"2024-04-26T11:26:39.895601+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:39.895601+0000","last_undegraded":"2024-04-26T11:26:39.895601+0000","last_fullsized":"2024-04-26T11:26:39.895601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":851,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371480+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:40.371480+0000","last_peered":"2024-04-26T11:26:40.371480+0000","last_clean":"2024-04-26T11:26:40.371480+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:40.371480+0000","last_undegraded":"2024-04-26T11:26:40.371480+0000","last_fullsized":"2024-04-26T11:26:40.371480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":514,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897848+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:39.897848+0000","last_peered":"2024-04-26T11:26:39.897848+0000","last_clean":"2024-04-26T11:26:39.897848+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:39.897848+0000","last_undegraded":"2024-04-26T11:26:39.897848+0000","last_fullsized":"2024-04-26T11:26:39.897848+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896930+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:39.896930+0000","last_peered":"2024-04-26T11:26:39.896930+0000","last_clean":"2024-04-26T11:26:39.896930+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:39.896930+0000","last_undegraded":"2024-04-26T11:26:39.896930+0000","last_fullsized":"2024-04-26T11:26:39.896930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":292,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370638+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:40.370638+0000","last_peered":"2024-04-26T11:26:40.370638+0000","last_clean":"2024-04-26T11:26:40.370638+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:40.370638+0000","last_undegraded":"2024-04-26T11:26:40.370638+0000","last_fullsized":"2024-04-26T11:26:40.370638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":562,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375681+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:40.375681+0000","last_peered":"2024-04-26T11:26:40.375681+0000","last_clean":"2024-04-26T11:26:40.375681+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:40.375681+0000","last_undegraded":"2024-04-26T11:26:40.375681+0000","last_fullsized":"2024-04-26T11:26:40.375681+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371265+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:40.371265+0000","last_peered":"2024-04-26T11:26:40.371265+0000","last_clean":"2024-04-26T11:26:40.371265+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:40.371265+0000","last_undegraded":"2024-04-26T11:26:40.371265+0000","last_fullsized":"2024-04-26T11:26:40.371265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":482,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374138+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:40.374138+0000","last_peered":"2024-04-26T11:26:40.374138+0000","last_clean":"2024-04-26T11:26:40.374138+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:40.374138+0000","last_undegraded":"2024-04-26T11:26:40.374138+0000","last_fullsized":"2024-04-26T11:26:40.374138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":453,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372369+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:40.372369+0000","last_peered":"2024-04-26T11:26:40.372369+0000","last_clean":"2024-04-26T11:26:40.372369+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:40.372369+0000","last_undegraded":"2024-04-26T11:26:40.372369+0000","last_fullsized":"2024-04-26T11:26:40.372369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895458+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:39.895458+0000","last_peered":"2024-04-26T11:26:39.895458+0000","last_clean":"2024-04-26T11:26:39.895458+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:39.895458+0000","last_undegraded":"2024-04-26T11:26:39.895458+0000","last_fullsized":"2024-04-26T11:26:39.895458+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895632+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:39.895632+0000","last_peered":"2024-04-26T11:26:39.895632+0000","last_clean":"2024-04-26T11:26:39.895632+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:39.895632+0000","last_undegraded":"2024-04-26T11:26:39.895632+0000","last_fullsized":"2024-04-26T11:26:39.895632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":562,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372246+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:40.372246+0000","last_peered":"2024-04-26T11:26:40.372246+0000","last_clean":"2024-04-26T11:26:40.372246+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:40.372246+0000","last_undegraded":"2024-04-26T11:26:40.372246+0000","last_fullsized":"2024-04-26T11:26:40.372246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896978+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:39.896978+0000","last_peered":"2024-04-26T11:26:39.896978+0000","last_clean":"2024-04-26T11:26:39.896978+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:39.896978+0000","last_undegraded":"2024-04-26T11:26:39.896978+0000","last_fullsized":"2024-04-26T11:26:39.896978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372506+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:40.372506+0000","last_peered":"2024-04-26T11:26:40.372506+0000","last_clean":"2024-04-26T11:26:40.372506+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:40.372506+0000","last_undegraded":"2024-04-26T11:26:40.372506+0000","last_fullsized":"2024-04-26T11:26:40.372506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":792,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374549+0000","last_change":"2024-04-26T11:26:35.389500+0000","last_active":"2024-04-26T11:26:40.374549+0000","last_peered":"2024-04-26T11:26:40.374549+0000","last_clean":"2024-04-26T11:26:40.374549+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:26:40.374549+0000","last_undegraded":"2024-04-26T11:26:40.374549+0000","last_fullsized":"2024-04-26T11:26:40.374549+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:56.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":158,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372239+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:40.372239+0000","last_peered":"2024-04-26T11:26:40.372239+0000","last_clean":"2024-04-26T11:26:40.372239+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:40.372239+0000","last_undegraded":"2024-04-26T11:26:40.372239+0000","last_fullsized":"2024-04-26T11:26:40.372239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376205+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:40.376205+0000","last_peered":"2024-04-26T11:26:40.376205+0000","last_clean":"2024-04-26T11:26:40.376205+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:40.376205+0000","last_undegraded":"2024-04-26T11:26:40.376205+0000","last_fullsized":"2024-04-26T11:26:40.376205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":817,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374730+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:40.374730+0000","last_peered":"2024-04-26T11:26:40.374730+0000","last_clean":"2024-04-26T11:26:40.374730+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:40.374730+0000","last_undegraded":"2024-04-26T11:26:40.374730+0000","last_fullsized":"2024-04-26T11:26:40.374730+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":161,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372975+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:40.372975+0000","last_peered":"2024-04-26T11:26:40.372975+0000","last_clean":"2024-04-26T11:26:40.372975+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:40.372975+0000","last_undegraded":"2024-04-26T11:26:40.372975+0000","last_fullsized":"2024-04-26T11:26:40.372975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372900+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:40.372900+0000","last_peered":"2024-04-26T11:26:40.372900+0000","last_clean":"2024-04-26T11:26:40.372900+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:40.372900+0000","last_undegraded":"2024-04-26T11:26:40.372900+0000","last_fullsized":"2024-04-26T11:26:40.372900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":926,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370385+0000","last_change":"2024-04-26T11:26:39.378496+0000","last_active":"2024-04-26T11:26:40.370385+0000","last_peered":"2024-04-26T11:26:40.370385+0000","last_clean":"2024-04-26T11:26:40.370385+0000","last_became_active":"2024-04-26T11:26:39.375075+0000","last_became_peered":"2024-04-26T11:26:39.375075+0000","last_unstale":"2024-04-26T11:26:40.370385+0000","last_undegraded":"2024-04-26T11:26:40.370385+0000","last_fullsized":"2024-04-26T11:26:40.370385+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:37.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":190,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372812+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:40.372812+0000","last_peered":"2024-04-26T11:26:40.372812+0000","last_clean":"2024-04-26T11:26:40.372812+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:40.372812+0000","last_undegraded":"2024-04-26T11:26:40.372812+0000","last_fullsized":"2024-04-26T11:26:40.372812+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897855+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:39.897855+0000","last_peered":"2024-04-26T11:26:39.897855+0000","last_clean":"2024-04-26T11:26:39.897855+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:39.897855+0000","last_undegraded":"2024-04-26T11:26:39.897855+0000","last_fullsized":"2024-04-26T11:26:39.897855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":930,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374136+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:40.374136+0000","last_peered":"2024-04-26T11:26:40.374136+0000","last_clean":"2024-04-26T11:26:40.374136+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:40.374136+0000","last_undegraded":"2024-04-26T11:26:40.374136+0000","last_fullsized":"2024-04-26T11:26:40.374136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":512,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896222+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:39.896222+0000","last_peered":"2024-04-26T11:26:39.896222+0000","last_clean":"2024-04-26T11:26:39.896222+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:39.896222+0000","last_undegraded":"2024-04-26T11:26:39.896222+0000","last_fullsized":"2024-04-26T11:26:39.896222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":491,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896711+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:39.896711+0000","last_peered":"2024-04-26T11:26:39.896711+0000","last_clean":"2024-04-26T11:26:39.896711+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:39.896711+0000","last_undegraded":"2024-04-26T11:26:39.896711+0000","last_fullsized":"2024-04-26T11:26:39.896711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":556,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370468+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:40.370468+0000","last_peered":"2024-04-26T11:26:40.370468+0000","last_clean":"2024-04-26T11:26:40.370468+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:40.370468+0000","last_undegraded":"2024-04-26T11:26:40.370468+0000","last_fullsized":"2024-04-26T11:26:40.370468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":182,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375310+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:41.375310+0000","last_peered":"2024-04-26T11:26:41.375310+0000","last_clean":"2024-04-26T11:26:41.375310+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:41.375310+0000","last_undegraded":"2024-04-26T11:26:41.375310+0000","last_fullsized":"2024-04-26T11:26:41.375310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":416,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897546+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:39.897546+0000","last_peered":"2024-04-26T11:26:39.897546+0000","last_clean":"2024-04-26T11:26:39.897546+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:39.897546+0000","last_undegraded":"2024-04-26T11:26:39.897546+0000","last_fullsized":"2024-04-26T11:26:39.897546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":1025,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370129+0000","last_change":"2024-04-26T11:26:38.376749+0000","last_active":"2024-04-26T11:26:40.370129+0000","last_peered":"2024-04-26T11:26:40.370129+0000","last_clean":"2024-04-26T11:26:40.370129+0000","last_became_active":"2024-04-26T11:26:38.373800+0000","last_became_peered":"2024-04-26T11:26:38.373800+0000","last_unstale":"2024-04-26T11:26:40.370129+0000","last_undegraded":"2024-04-26T11:26:40.370129+0000","last_fullsized":"2024-04-26T11:26:40.370129+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:23.112909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":166,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374428+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:41.374428+0000","last_peered":"2024-04-26T11:26:41.374428+0000","last_clean":"2024-04-26T11:26:41.374428+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:41.374428+0000","last_undegraded":"2024-04-26T11:26:41.374428+0000","last_fullsized":"2024-04-26T11:26:41.374428+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370124+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:40.370124+0000","last_peered":"2024-04-26T11:26:40.370124+0000","last_clean":"2024-04-26T11:26:40.370124+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:40.370124+0000","last_undegraded":"2024-04-26T11:26:40.370124+0000","last_fullsized":"2024-04-26T11:26:40.370124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":792,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376038+0000","last_change":"2024-04-26T11:26:32.372817+0000","last_active":"2024-04-26T11:26:40.376038+0000","last_peered":"2024-04-26T11:26:40.376038+0000","last_clean":"2024-04-26T11:26:40.376038+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:26:40.376038+0000","last_undegraded":"2024-04-26T11:26:40.376038+0000","last_fullsized":"2024-04-26T11:26:40.376038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:32.214458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":688,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373246+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:41.373246+0000","last_peered":"2024-04-26T11:26:41.373246+0000","last_clean":"2024-04-26T11:26:41.373246+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:41.373246+0000","last_undegraded":"2024-04-26T11:26:41.373246+0000","last_fullsized":"2024-04-26T11:26:41.373246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":922,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372380+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:40.372380+0000","last_peered":"2024-04-26T11:26:40.372380+0000","last_clean":"2024-04-26T11:26:40.372380+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:40.372380+0000","last_undegraded":"2024-04-26T11:26:40.372380+0000","last_fullsized":"2024-04-26T11:26:40.372380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":395,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372497+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:41.372497+0000","last_peered":"2024-04-26T11:26:41.372497+0000","last_clean":"2024-04-26T11:26:41.372497+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:41.372497+0000","last_undegraded":"2024-04-26T11:26:41.372497+0000","last_fullsized":"2024-04-26T11:26:41.372497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1016,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375585+0000","last_change":"2024-04-26T11:26:36.406522+0000","last_active":"2024-04-26T11:26:40.375585+0000","last_peered":"2024-04-26T11:26:40.375585+0000","last_clean":"2024-04-26T11:26:40.375585+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:26:40.375585+0000","last_undegraded":"2024-04-26T11:26:40.375585+0000","last_fullsized":"2024-04-26T11:26:40.375585+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:05.312742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":431,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374748+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:40.374748+0000","last_peered":"2024-04-26T11:26:40.374748+0000","last_clean":"2024-04-26T11:26:40.374748+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:40.374748+0000","last_undegraded":"2024-04-26T11:26:40.374748+0000","last_fullsized":"2024-04-26T11:26:40.374748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":499,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375046+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:40.375046+0000","last_peered":"2024-04-26T11:26:40.375046+0000","last_clean":"2024-04-26T11:26:40.375046+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:40.375046+0000","last_undegraded":"2024-04-26T11:26:40.375046+0000","last_fullsized":"2024-04-26T11:26:40.375046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":152,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375041+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:40.375041+0000","last_peered":"2024-04-26T11:26:40.375041+0000","last_clean":"2024-04-26T11:26:40.375041+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:40.375041+0000","last_undegraded":"2024-04-26T11:26:40.375041+0000","last_fullsized":"2024-04-26T11:26:40.375041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":475,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896112+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:39.896112+0000","last_peered":"2024-04-26T11:26:39.896112+0000","last_clean":"2024-04-26T11:26:39.896112+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:39.896112+0000","last_undegraded":"2024-04-26T11:26:39.896112+0000","last_fullsized":"2024-04-26T11:26:39.896112+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":404,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895905+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:39.895905+0000","last_peered":"2024-04-26T11:26:39.895905+0000","last_clean":"2024-04-26T11:26:39.895905+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:39.895905+0000","last_undegraded":"2024-04-26T11:26:39.895905+0000","last_fullsized":"2024-04-26T11:26:39.895905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":491,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897078+0000","last_change":"2024-04-26T11:26:31.896245+0000","last_active":"2024-04-26T11:26:39.897078+0000","last_peered":"2024-04-26T11:26:39.897078+0000","last_clean":"2024-04-26T11:26:39.897078+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:26:39.897078+0000","last_undegraded":"2024-04-26T11:26:39.897078+0000","last_fullsized":"2024-04-26T11:26:39.897078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:59.173436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":497,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375850+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:40.375850+0000","last_peered":"2024-04-26T11:26:40.375850+0000","last_clean":"2024-04-26T11:26:40.375850+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:40.375850+0000","last_undegraded":"2024-04-26T11:26:40.375850+0000","last_fullsized":"2024-04-26T11:26:40.375850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":498,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374562+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:40.374562+0000","last_peered":"2024-04-26T11:26:40.374562+0000","last_clean":"2024-04-26T11:26:40.374562+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:40.374562+0000","last_undegraded":"2024-04-26T11:26:40.374562+0000","last_fullsized":"2024-04-26T11:26:40.374562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":158,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372672+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:40.372672+0000","last_peered":"2024-04-26T11:26:40.372672+0000","last_clean":"2024-04-26T11:26:40.372672+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:40.372672+0000","last_undegraded":"2024-04-26T11:26:40.372672+0000","last_fullsized":"2024-04-26T11:26:40.372672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":542,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897090+0000","last_change":"2024-04-26T11:26:33.905426+0000","last_active":"2024-04-26T11:26:39.897090+0000","last_peered":"2024-04-26T11:26:39.897090+0000","last_clean":"2024-04-26T11:26:39.897090+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:39.897090+0000","last_undegraded":"2024-04-26T11:26:39.897090+0000","last_fullsized":"2024-04-26T11:26:39.897090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:49.659488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":256,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372499+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:40.372499+0000","last_peered":"2024-04-26T11:26:40.372499+0000","last_clean":"2024-04-26T11:26:40.372499+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:40.372499+0000","last_undegraded":"2024-04-26T11:26:40.372499+0000","last_fullsized":"2024-04-26T11:26:40.372499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142444,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229396,"statfs":{"total":96636764160,"available":96490901504,"internally_reserved":0,"allocated":31744000,"data_stored":81613145,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124352,"kb_used_data":30964,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247488,"statfs":{"total":96636764160,"available":96509427712,"internally_reserved":0,"allocated":31707136,"data_stored":86117265,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76500000000000001}]}]},{"osd":0,"up_from":75,"seq":322122547209,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75944,"kb_used_data":18068,"kb_used_omap":7,"kb_used_meta":57848,"kb_avail":94295896,"statfs":{"total":96636764160,"available":96558997504,"internally_reserved":0,"allocated":18501632,"data_stored":91781533,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":59237367},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:47.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:26:47.949 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:47.950 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":106,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:26:41.366381+0000","last_up_change":"2024-04-26T11:26:10.538684+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":49,"up_from":75,"up_thru":105,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1525},{"type":"v1","addr":"172.21.15.88:6801","nonce":1525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1525},{"type":"v1","addr":"172.21.15.88:6803","nonce":1525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1525},{"type":"v1","addr":"172.21.15.88:6807","nonce":1525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1525},{"type":"v1","addr":"172.21.15.88:6805","nonce":1525}]},"public_addr":"172.21.15.88:6801/1525","cluster_addr":"172.21.15.88:6803/1525","heartbeat_back_addr":"172.21.15.88:6807/1525","heartbeat_front_addr":"172.21.15.88:6805/1525","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:26:48.970 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T11:26:48.970 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T11:26:49.129 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-26T11:26:49.129 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T11:26:49.129 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-26T11:26:49.145 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T11:26:49.429 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T11:26:49.448 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T11:26:49.448 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T11:26:49.582 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-26T11:26:49.582 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T11:26:49.583 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-26T11:26:49.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T11:26:49.878 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T11:26:49.897 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T11:26:49.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T11:26:50.051 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-04-26T11:26:50.051 INFO:teuthology.orchestra.run.smithi073.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T11:26:50.051 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-04-26T11:26:50.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T11:26:50.330 INFO:teuthology.orchestra.run.smithi073.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T11:26:50.348 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:26:50.620 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:26:50.621 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:26:50.636 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":258,"stamp":"2024-04-26T11:26:49.455348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7334,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34362,"ondisk_log_size":34362,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":342740,"kb_used_data":80032,"kb_used_omap":10,"kb_used_meta":262645,"kb_avail":282772780,"statfs":{"total":289910292480,"available":289559326720,"internally_reserved":0,"allocated":81952768,"data_stored":259511943,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":268949379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-576,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":614,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.081985"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":509,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375889+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:40.375889+0000","last_peered":"2024-04-26T11:26:40.375889+0000","last_clean":"2024-04-26T11:26:40.375889+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:40.375889+0000","last_undegraded":"2024-04-26T11:26:40.375889+0000","last_fullsized":"2024-04-26T11:26:40.375889+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:04:25.252705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":565,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375446+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:40.375446+0000","last_peered":"2024-04-26T11:26:40.375446+0000","last_clean":"2024-04-26T11:26:40.375446+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:40.375446+0000","last_undegraded":"2024-04-26T11:26:40.375446+0000","last_fullsized":"2024-04-26T11:26:40.375446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:06.545854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":440,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898192+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:39.898192+0000","last_peered":"2024-04-26T11:26:39.898192+0000","last_clean":"2024-04-26T11:26:39.898192+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:39.898192+0000","last_undegraded":"2024-04-26T11:26:39.898192+0000","last_fullsized":"2024-04-26T11:26:39.898192+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:44:55.446005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":489,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896372+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:39.896372+0000","last_peered":"2024-04-26T11:26:39.896372+0000","last_clean":"2024-04-26T11:26:39.896372+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:39.896372+0000","last_undegraded":"2024-04-26T11:26:39.896372+0000","last_fullsized":"2024-04-26T11:26:39.896372+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:47:22.627645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":540,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375005+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:40.375005+0000","last_peered":"2024-04-26T11:26:40.375005+0000","last_clean":"2024-04-26T11:26:40.375005+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:40.375005+0000","last_undegraded":"2024-04-26T11:26:40.375005+0000","last_fullsized":"2024-04-26T11:26:40.375005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:53.256943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":493,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896914+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:39.896914+0000","last_peered":"2024-04-26T11:26:39.896914+0000","last_clean":"2024-04-26T11:26:39.896914+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:39.896914+0000","last_undegraded":"2024-04-26T11:26:39.896914+0000","last_fullsized":"2024-04-26T11:26:39.896914+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:36:20.167431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":594,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895848+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:39.895848+0000","last_peered":"2024-04-26T11:26:39.895848+0000","last_clean":"2024-04-26T11:26:39.895848+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:39.895848+0000","last_undegraded":"2024-04-26T11:26:39.895848+0000","last_fullsized":"2024-04-26T11:26:39.895848+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:09.235413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":462,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896813+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:39.896813+0000","last_peered":"2024-04-26T11:26:39.896813+0000","last_clean":"2024-04-26T11:26:39.896813+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:39.896813+0000","last_undegraded":"2024-04-26T11:26:39.896813+0000","last_fullsized":"2024-04-26T11:26:39.896813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:03:48.138878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":597,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373947+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:41.373947+0000","last_peered":"2024-04-26T11:26:41.373947+0000","last_clean":"2024-04-26T11:26:41.373947+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:41.373947+0000","last_undegraded":"2024-04-26T11:26:41.373947+0000","last_fullsized":"2024-04-26T11:26:41.373947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:54:23.210493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":507,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375073+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:41.375073+0000","last_peered":"2024-04-26T11:26:41.375073+0000","last_clean":"2024-04-26T11:26:41.375073+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:41.375073+0000","last_undegraded":"2024-04-26T11:26:41.375073+0000","last_fullsized":"2024-04-26T11:26:41.375073+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":480,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898025+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:39.898025+0000","last_peered":"2024-04-26T11:26:39.898025+0000","last_clean":"2024-04-26T11:26:39.898025+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:39.898025+0000","last_undegraded":"2024-04-26T11:26:39.898025+0000","last_fullsized":"2024-04-26T11:26:39.898025+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:33:07.200544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":783,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374335+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:41.374335+0000","last_peered":"2024-04-26T11:26:41.374335+0000","last_clean":"2024-04-26T11:26:41.374335+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:41.374335+0000","last_undegraded":"2024-04-26T11:26:41.374335+0000","last_fullsized":"2024-04-26T11:26:41.374335+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:06.211513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":453,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374678+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:40.374678+0000","last_peered":"2024-04-26T11:26:40.374678+0000","last_clean":"2024-04-26T11:26:40.374678+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:40.374678+0000","last_undegraded":"2024-04-26T11:26:40.374678+0000","last_fullsized":"2024-04-26T11:26:40.374678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:14.081388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":482,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896659+0000","last_change":"2024-04-26T11:26:21.930114+0000","last_active":"2024-04-26T11:26:39.896659+0000","last_peered":"2024-04-26T11:26:39.896659+0000","last_clean":"2024-04-26T11:26:39.896659+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:26:39.896659+0000","last_undegraded":"2024-04-26T11:26:39.896659+0000","last_fullsized":"2024-04-26T11:26:39.896659+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:16:12.917260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":538,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896114+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:39.896114+0000","last_peered":"2024-04-26T11:26:39.896114+0000","last_clean":"2024-04-26T11:26:39.896114+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:39.896114+0000","last_undegraded":"2024-04-26T11:26:39.896114+0000","last_fullsized":"2024-04-26T11:26:39.896114+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:26.462934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":603,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897245+0000","last_change":"2024-04-26T11:26:24.910704+0000","last_active":"2024-04-26T11:26:39.897245+0000","last_peered":"2024-04-26T11:26:39.897245+0000","last_clean":"2024-04-26T11:26:39.897245+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:39.897245+0000","last_undegraded":"2024-04-26T11:26:39.897245+0000","last_fullsized":"2024-04-26T11:26:39.897245+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:23.368808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":577,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372796+0000","last_change":"2024-04-26T11:22:40.574998+0000","last_active":"2024-04-26T11:26:40.372796+0000","last_peered":"2024-04-26T11:26:40.372796+0000","last_clean":"2024-04-26T11:26:40.372796+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:40.372796+0000","last_undegraded":"2024-04-26T11:26:40.372796+0000","last_fullsized":"2024-04-26T11:26:40.372796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:32:53.987880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":584,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375825+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:40.375825+0000","last_peered":"2024-04-26T11:26:40.375825+0000","last_clean":"2024-04-26T11:26:40.375825+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:40.375825+0000","last_undegraded":"2024-04-26T11:26:40.375825+0000","last_fullsized":"2024-04-26T11:26:40.375825+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:04.821011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":623,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371677+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:40.371677+0000","last_peered":"2024-04-26T11:26:40.371677+0000","last_clean":"2024-04-26T11:26:40.371677+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:40.371677+0000","last_undegraded":"2024-04-26T11:26:40.371677+0000","last_fullsized":"2024-04-26T11:26:40.371677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:14.907185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":611,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897131+0000","last_change":"2024-04-26T11:26:29.907661+0000","last_active":"2024-04-26T11:26:39.897131+0000","last_peered":"2024-04-26T11:26:39.897131+0000","last_clean":"2024-04-26T11:26:39.897131+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:26:39.897131+0000","last_undegraded":"2024-04-26T11:26:39.897131+0000","last_fullsized":"2024-04-26T11:26:39.897131+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:16:36.426022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":549,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896468+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:39.896468+0000","last_peered":"2024-04-26T11:26:39.896468+0000","last_clean":"2024-04-26T11:26:39.896468+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:39.896468+0000","last_undegraded":"2024-04-26T11:26:39.896468+0000","last_fullsized":"2024-04-26T11:26:39.896468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:25:09.393282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":978,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374306+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:40.374306+0000","last_peered":"2024-04-26T11:26:40.374306+0000","last_clean":"2024-04-26T11:26:40.374306+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:40.374306+0000","last_undegraded":"2024-04-26T11:26:40.374306+0000","last_fullsized":"2024-04-26T11:26:40.374306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:06.847831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":932,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.369890+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:40.369890+0000","last_peered":"2024-04-26T11:26:40.369890+0000","last_clean":"2024-04-26T11:26:40.369890+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:40.369890+0000","last_undegraded":"2024-04-26T11:26:40.369890+0000","last_fullsized":"2024-04-26T11:26:40.369890+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:40:38.581419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":515,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373716+0000","last_change":"2024-04-26T11:26:22.384304+0000","last_active":"2024-04-26T11:26:40.373716+0000","last_peered":"2024-04-26T11:26:40.373716+0000","last_clean":"2024-04-26T11:26:40.373716+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:40.373716+0000","last_undegraded":"2024-04-26T11:26:40.373716+0000","last_fullsized":"2024-04-26T11:26:40.373716+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:15:37.771549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":948,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376062+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:40.376062+0000","last_peered":"2024-04-26T11:26:40.376062+0000","last_clean":"2024-04-26T11:26:40.376062+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:40.376062+0000","last_undegraded":"2024-04-26T11:26:40.376062+0000","last_fullsized":"2024-04-26T11:26:40.376062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:08:04.260925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1054,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372134+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:40.372134+0000","last_peered":"2024-04-26T11:26:40.372134+0000","last_clean":"2024-04-26T11:26:40.372134+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:40.372134+0000","last_undegraded":"2024-04-26T11:26:40.372134+0000","last_fullsized":"2024-04-26T11:26:40.372134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:16.415106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":558,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897950+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:39.897950+0000","last_peered":"2024-04-26T11:26:39.897950+0000","last_clean":"2024-04-26T11:26:39.897950+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:39.897950+0000","last_undegraded":"2024-04-26T11:26:39.897950+0000","last_fullsized":"2024-04-26T11:26:39.897950+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:27.415626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":951,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375483+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:40.375483+0000","last_peered":"2024-04-26T11:26:40.375483+0000","last_clean":"2024-04-26T11:26:40.375483+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:40.375483+0000","last_undegraded":"2024-04-26T11:26:40.375483+0000","last_fullsized":"2024-04-26T11:26:40.375483+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:48:12.070641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":508,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371263+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:40.371263+0000","last_peered":"2024-04-26T11:26:40.371263+0000","last_clean":"2024-04-26T11:26:40.371263+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:40.371263+0000","last_undegraded":"2024-04-26T11:26:40.371263+0000","last_fullsized":"2024-04-26T11:26:40.371263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:16.160872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":1028,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374860+0000","last_change":"2024-04-26T11:26:38.377195+0000","last_active":"2024-04-26T11:26:40.374860+0000","last_peered":"2024-04-26T11:26:40.374860+0000","last_clean":"2024-04-26T11:26:40.374860+0000","last_became_active":"2024-04-26T11:26:38.373963+0000","last_became_peered":"2024-04-26T11:26:38.373963+0000","last_unstale":"2024-04-26T11:26:40.374860+0000","last_undegraded":"2024-04-26T11:26:40.374860+0000","last_fullsized":"2024-04-26T11:26:40.374860+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:57.937161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":628,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370077+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:40.370077+0000","last_peered":"2024-04-26T11:26:40.370077+0000","last_clean":"2024-04-26T11:26:40.370077+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:40.370077+0000","last_undegraded":"2024-04-26T11:26:40.370077+0000","last_fullsized":"2024-04-26T11:26:40.370077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:34.309238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":499,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.901431+0000","last_change":"2024-04-26T11:26:40.900605+0000","last_active":"2024-04-26T11:26:40.901431+0000","last_peered":"2024-04-26T11:26:40.901431+0000","last_clean":"2024-04-26T11:26:40.901431+0000","last_became_active":"2024-04-26T11:26:40.895623+0000","last_became_peered":"2024-04-26T11:26:40.895623+0000","last_unstale":"2024-04-26T11:26:40.901431+0000","last_undegraded":"2024-04-26T11:26:40.901431+0000","last_fullsized":"2024-04-26T11:26:40.901431+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:04.320929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":485,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375274+0000","last_change":"2024-04-26T11:26:22.397751+0000","last_active":"2024-04-26T11:26:40.375274+0000","last_peered":"2024-04-26T11:26:40.375274+0000","last_clean":"2024-04-26T11:26:40.375274+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:40.375274+0000","last_undegraded":"2024-04-26T11:26:40.375274+0000","last_fullsized":"2024-04-26T11:26:40.375274+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:17:47.850385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":550,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895866+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:39.895866+0000","last_peered":"2024-04-26T11:26:39.895866+0000","last_clean":"2024-04-26T11:26:39.895866+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:39.895866+0000","last_undegraded":"2024-04-26T11:26:39.895866+0000","last_fullsized":"2024-04-26T11:26:39.895866+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:38.453114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":505,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375633+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:40.375633+0000","last_peered":"2024-04-26T11:26:40.375633+0000","last_clean":"2024-04-26T11:26:40.375633+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:40.375633+0000","last_undegraded":"2024-04-26T11:26:40.375633+0000","last_fullsized":"2024-04-26T11:26:40.375633+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:02:55.668801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":176,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370912+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:40.370912+0000","last_peered":"2024-04-26T11:26:40.370912+0000","last_clean":"2024-04-26T11:26:40.370912+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:40.370912+0000","last_undegraded":"2024-04-26T11:26:40.370912+0000","last_fullsized":"2024-04-26T11:26:40.370912+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:15:57.654512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":998,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374371+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:41.374371+0000","last_peered":"2024-04-26T11:26:41.374371+0000","last_clean":"2024-04-26T11:26:41.374371+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:41.374371+0000","last_undegraded":"2024-04-26T11:26:41.374371+0000","last_fullsized":"2024-04-26T11:26:41.374371+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:49.862010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":164,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374326+0000","last_change":"2024-04-26T11:26:22.388054+0000","last_active":"2024-04-26T11:26:40.374326+0000","last_peered":"2024-04-26T11:26:40.374326+0000","last_clean":"2024-04-26T11:26:40.374326+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:26:40.374326+0000","last_undegraded":"2024-04-26T11:26:40.374326+0000","last_fullsized":"2024-04-26T11:26:40.374326+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:09:19.892190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":938,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373981+0000","last_change":"2024-04-26T11:26:16.629407+0000","last_active":"2024-04-26T11:26:41.373981+0000","last_peered":"2024-04-26T11:26:41.373981+0000","last_clean":"2024-04-26T11:26:41.373981+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:26:41.373981+0000","last_undegraded":"2024-04-26T11:26:41.373981+0000","last_fullsized":"2024-04-26T11:26:41.373981+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:23.450430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":52,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895270+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:39.895270+0000","last_peered":"2024-04-26T11:26:39.895270+0000","last_clean":"2024-04-26T11:26:39.895270+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:39.895270+0000","last_undegraded":"2024-04-26T11:26:39.895270+0000","last_fullsized":"2024-04-26T11:26:39.895270+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:35.229196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":242,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.898259+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:39.898259+0000","last_peered":"2024-04-26T11:26:39.898259+0000","last_clean":"2024-04-26T11:26:39.898259+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:39.898259+0000","last_undegraded":"2024-04-26T11:26:39.898259+0000","last_fullsized":"2024-04-26T11:26:39.898259+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:45:27.738794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":876,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373876+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:40.373876+0000","last_peered":"2024-04-26T11:26:40.373876+0000","last_clean":"2024-04-26T11:26:40.373876+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:40.373876+0000","last_undegraded":"2024-04-26T11:26:40.373876+0000","last_fullsized":"2024-04-26T11:26:40.373876+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:21.308330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":401,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376112+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:40.376112+0000","last_peered":"2024-04-26T11:26:40.376112+0000","last_clean":"2024-04-26T11:26:40.376112+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:40.376112+0000","last_undegraded":"2024-04-26T11:26:40.376112+0000","last_fullsized":"2024-04-26T11:26:40.376112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:25:16.969634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":580,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374073+0000","last_change":"2024-04-26T11:26:22.381776+0000","last_active":"2024-04-26T11:26:40.374073+0000","last_peered":"2024-04-26T11:26:40.374073+0000","last_clean":"2024-04-26T11:26:40.374073+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:40.374073+0000","last_undegraded":"2024-04-26T11:26:40.374073+0000","last_fullsized":"2024-04-26T11:26:40.374073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:34:54.149295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"70'565","reported_seq":645,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897731+0000","last_change":"2024-04-26T11:26:14.134645+0000","last_active":"2024-04-26T11:26:39.897731+0000","last_peered":"2024-04-26T11:26:39.897731+0000","last_clean":"2024-04-26T11:26:39.897731+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:26:39.897731+0000","last_undegraded":"2024-04-26T11:26:39.897731+0000","last_fullsized":"2024-04-26T11:26:39.897731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:13:17.456242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":530,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.906286+0000","last_change":"2024-04-26T11:26:39.905388+0000","last_active":"2024-04-26T11:26:39.906286+0000","last_peered":"2024-04-26T11:26:39.906286+0000","last_clean":"2024-04-26T11:26:39.906286+0000","last_became_active":"2024-04-26T11:26:39.900162+0000","last_became_peered":"2024-04-26T11:26:39.900162+0000","last_unstale":"2024-04-26T11:26:39.906286+0000","last_undegraded":"2024-04-26T11:26:39.906286+0000","last_fullsized":"2024-04-26T11:26:39.906286+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:37:50.194168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897546+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:39.897546+0000","last_peered":"2024-04-26T11:26:39.897546+0000","last_clean":"2024-04-26T11:26:39.897546+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:39.897546+0000","last_undegraded":"2024-04-26T11:26:39.897546+0000","last_fullsized":"2024-04-26T11:26:39.897546+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:14.167041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":958,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370924+0000","last_change":"2024-04-26T11:26:19.374227+0000","last_active":"2024-04-26T11:26:40.370924+0000","last_peered":"2024-04-26T11:26:40.370924+0000","last_clean":"2024-04-26T11:26:40.370924+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:26:40.370924+0000","last_undegraded":"2024-04-26T11:26:40.370924+0000","last_fullsized":"2024-04-26T11:26:40.370924+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:07.699224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":310,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371534+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:40.371534+0000","last_peered":"2024-04-26T11:26:40.371534+0000","last_clean":"2024-04-26T11:26:40.371534+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:40.371534+0000","last_undegraded":"2024-04-26T11:26:40.371534+0000","last_fullsized":"2024-04-26T11:26:40.371534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:04.304364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":527,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897534+0000","last_change":"2024-04-26T11:26:35.931909+0000","last_active":"2024-04-26T11:26:39.897534+0000","last_peered":"2024-04-26T11:26:39.897534+0000","last_clean":"2024-04-26T11:26:39.897534+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:26:39.897534+0000","last_undegraded":"2024-04-26T11:26:39.897534+0000","last_fullsized":"2024-04-26T11:26:39.897534+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:22.946052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":295,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896059+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:39.896059+0000","last_peered":"2024-04-26T11:26:39.896059+0000","last_clean":"2024-04-26T11:26:39.896059+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:39.896059+0000","last_undegraded":"2024-04-26T11:26:39.896059+0000","last_fullsized":"2024-04-26T11:26:39.896059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:51:50.181233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":471,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897608+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:39.897608+0000","last_peered":"2024-04-26T11:26:39.897608+0000","last_clean":"2024-04-26T11:26:39.897608+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:39.897608+0000","last_undegraded":"2024-04-26T11:26:39.897608+0000","last_fullsized":"2024-04-26T11:26:39.897608+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:14:22.600986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":151,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374409+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:40.374409+0000","last_peered":"2024-04-26T11:26:40.374409+0000","last_clean":"2024-04-26T11:26:40.374409+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:40.374409+0000","last_undegraded":"2024-04-26T11:26:40.374409+0000","last_fullsized":"2024-04-26T11:26:40.374409+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:14.647712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":446,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897851+0000","last_change":"2024-04-26T11:26:29.914048+0000","last_active":"2024-04-26T11:26:39.897851+0000","last_peered":"2024-04-26T11:26:39.897851+0000","last_clean":"2024-04-26T11:26:39.897851+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:26:39.897851+0000","last_undegraded":"2024-04-26T11:26:39.897851+0000","last_fullsized":"2024-04-26T11:26:39.897851+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:31.880547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":352,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.373885+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:40.373885+0000","last_peered":"2024-04-26T11:26:40.373885+0000","last_clean":"2024-04-26T11:26:40.373885+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:40.373885+0000","last_undegraded":"2024-04-26T11:26:40.373885+0000","last_fullsized":"2024-04-26T11:26:40.373885+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:09.686474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":553,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372264+0000","last_change":"2024-04-26T11:21:53.713096+0000","last_active":"2024-04-26T11:26:40.372264+0000","last_peered":"2024-04-26T11:26:40.372264+0000","last_clean":"2024-04-26T11:26:40.372264+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:26:40.372264+0000","last_undegraded":"2024-04-26T11:26:40.372264+0000","last_fullsized":"2024-04-26T11:26:40.372264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:00:14.150533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":247,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.894834+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:39.894834+0000","last_peered":"2024-04-26T11:26:39.894834+0000","last_clean":"2024-04-26T11:26:39.894834+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:39.894834+0000","last_undegraded":"2024-04-26T11:26:39.894834+0000","last_fullsized":"2024-04-26T11:26:39.894834+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:33.925378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895601+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:39.895601+0000","last_peered":"2024-04-26T11:26:39.895601+0000","last_clean":"2024-04-26T11:26:39.895601+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:39.895601+0000","last_undegraded":"2024-04-26T11:26:39.895601+0000","last_fullsized":"2024-04-26T11:26:39.895601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:47.818862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":851,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371480+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:40.371480+0000","last_peered":"2024-04-26T11:26:40.371480+0000","last_clean":"2024-04-26T11:26:40.371480+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:40.371480+0000","last_undegraded":"2024-04-26T11:26:40.371480+0000","last_fullsized":"2024-04-26T11:26:40.371480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:09:35.718415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":514,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897848+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:39.897848+0000","last_peered":"2024-04-26T11:26:39.897848+0000","last_clean":"2024-04-26T11:26:39.897848+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:39.897848+0000","last_undegraded":"2024-04-26T11:26:39.897848+0000","last_fullsized":"2024-04-26T11:26:39.897848+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:14.868404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896930+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:39.896930+0000","last_peered":"2024-04-26T11:26:39.896930+0000","last_clean":"2024-04-26T11:26:39.896930+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:39.896930+0000","last_undegraded":"2024-04-26T11:26:39.896930+0000","last_fullsized":"2024-04-26T11:26:39.896930+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:09:14.500497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":292,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370638+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:40.370638+0000","last_peered":"2024-04-26T11:26:40.370638+0000","last_clean":"2024-04-26T11:26:40.370638+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:40.370638+0000","last_undegraded":"2024-04-26T11:26:40.370638+0000","last_fullsized":"2024-04-26T11:26:40.370638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:57.462511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":562,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375681+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:40.375681+0000","last_peered":"2024-04-26T11:26:40.375681+0000","last_clean":"2024-04-26T11:26:40.375681+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:40.375681+0000","last_undegraded":"2024-04-26T11:26:40.375681+0000","last_fullsized":"2024-04-26T11:26:40.375681+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:29:56.691465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":104,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.371265+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:40.371265+0000","last_peered":"2024-04-26T11:26:40.371265+0000","last_clean":"2024-04-26T11:26:40.371265+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:40.371265+0000","last_undegraded":"2024-04-26T11:26:40.371265+0000","last_fullsized":"2024-04-26T11:26:40.371265+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:16.577152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":482,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374138+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:40.374138+0000","last_peered":"2024-04-26T11:26:40.374138+0000","last_clean":"2024-04-26T11:26:40.374138+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:40.374138+0000","last_undegraded":"2024-04-26T11:26:40.374138+0000","last_fullsized":"2024-04-26T11:26:40.374138+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:06:26.431552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":453,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372369+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:40.372369+0000","last_peered":"2024-04-26T11:26:40.372369+0000","last_clean":"2024-04-26T11:26:40.372369+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:40.372369+0000","last_undegraded":"2024-04-26T11:26:40.372369+0000","last_fullsized":"2024-04-26T11:26:40.372369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:12.651417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895458+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:39.895458+0000","last_peered":"2024-04-26T11:26:39.895458+0000","last_clean":"2024-04-26T11:26:39.895458+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:39.895458+0000","last_undegraded":"2024-04-26T11:26:39.895458+0000","last_fullsized":"2024-04-26T11:26:39.895458+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:52.300861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895632+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:39.895632+0000","last_peered":"2024-04-26T11:26:39.895632+0000","last_clean":"2024-04-26T11:26:39.895632+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:39.895632+0000","last_undegraded":"2024-04-26T11:26:39.895632+0000","last_fullsized":"2024-04-26T11:26:39.895632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:35.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":562,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372246+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:40.372246+0000","last_peered":"2024-04-26T11:26:40.372246+0000","last_clean":"2024-04-26T11:26:40.372246+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:40.372246+0000","last_undegraded":"2024-04-26T11:26:40.372246+0000","last_fullsized":"2024-04-26T11:26:40.372246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:37.146914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896978+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:39.896978+0000","last_peered":"2024-04-26T11:26:39.896978+0000","last_clean":"2024-04-26T11:26:39.896978+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:39.896978+0000","last_undegraded":"2024-04-26T11:26:39.896978+0000","last_fullsized":"2024-04-26T11:26:39.896978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:57.968061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372506+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:40.372506+0000","last_peered":"2024-04-26T11:26:40.372506+0000","last_clean":"2024-04-26T11:26:40.372506+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:40.372506+0000","last_undegraded":"2024-04-26T11:26:40.372506+0000","last_fullsized":"2024-04-26T11:26:40.372506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:59:20.503289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":792,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374549+0000","last_change":"2024-04-26T11:26:35.389500+0000","last_active":"2024-04-26T11:26:40.374549+0000","last_peered":"2024-04-26T11:26:40.374549+0000","last_clean":"2024-04-26T11:26:40.374549+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:26:40.374549+0000","last_undegraded":"2024-04-26T11:26:40.374549+0000","last_fullsized":"2024-04-26T11:26:40.374549+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:56.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":158,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372239+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:40.372239+0000","last_peered":"2024-04-26T11:26:40.372239+0000","last_clean":"2024-04-26T11:26:40.372239+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:40.372239+0000","last_undegraded":"2024-04-26T11:26:40.372239+0000","last_fullsized":"2024-04-26T11:26:40.372239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:22:09.165050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376205+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:40.376205+0000","last_peered":"2024-04-26T11:26:40.376205+0000","last_clean":"2024-04-26T11:26:40.376205+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:40.376205+0000","last_undegraded":"2024-04-26T11:26:40.376205+0000","last_fullsized":"2024-04-26T11:26:40.376205+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:03:57.834934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":817,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374730+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:40.374730+0000","last_peered":"2024-04-26T11:26:40.374730+0000","last_clean":"2024-04-26T11:26:40.374730+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:40.374730+0000","last_undegraded":"2024-04-26T11:26:40.374730+0000","last_fullsized":"2024-04-26T11:26:40.374730+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:58:20.000973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":161,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372975+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:40.372975+0000","last_peered":"2024-04-26T11:26:40.372975+0000","last_clean":"2024-04-26T11:26:40.372975+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:40.372975+0000","last_undegraded":"2024-04-26T11:26:40.372975+0000","last_fullsized":"2024-04-26T11:26:40.372975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:48.918559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372900+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:40.372900+0000","last_peered":"2024-04-26T11:26:40.372900+0000","last_clean":"2024-04-26T11:26:40.372900+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:40.372900+0000","last_undegraded":"2024-04-26T11:26:40.372900+0000","last_fullsized":"2024-04-26T11:26:40.372900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:36:29.707589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":926,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370385+0000","last_change":"2024-04-26T11:26:39.378496+0000","last_active":"2024-04-26T11:26:40.370385+0000","last_peered":"2024-04-26T11:26:40.370385+0000","last_clean":"2024-04-26T11:26:40.370385+0000","last_became_active":"2024-04-26T11:26:39.375075+0000","last_became_peered":"2024-04-26T11:26:39.375075+0000","last_unstale":"2024-04-26T11:26:40.370385+0000","last_undegraded":"2024-04-26T11:26:40.370385+0000","last_fullsized":"2024-04-26T11:26:40.370385+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:37.660443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":190,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372812+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:40.372812+0000","last_peered":"2024-04-26T11:26:40.372812+0000","last_clean":"2024-04-26T11:26:40.372812+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:40.372812+0000","last_undegraded":"2024-04-26T11:26:40.372812+0000","last_fullsized":"2024-04-26T11:26:40.372812+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:28.502838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897855+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:39.897855+0000","last_peered":"2024-04-26T11:26:39.897855+0000","last_clean":"2024-04-26T11:26:39.897855+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:39.897855+0000","last_undegraded":"2024-04-26T11:26:39.897855+0000","last_fullsized":"2024-04-26T11:26:39.897855+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:15.011917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":930,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374136+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:40.374136+0000","last_peered":"2024-04-26T11:26:40.374136+0000","last_clean":"2024-04-26T11:26:40.374136+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:40.374136+0000","last_undegraded":"2024-04-26T11:26:40.374136+0000","last_fullsized":"2024-04-26T11:26:40.374136+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:21:52.817975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":512,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896222+0000","last_change":"2024-04-26T11:26:17.894778+0000","last_active":"2024-04-26T11:26:39.896222+0000","last_peered":"2024-04-26T11:26:39.896222+0000","last_clean":"2024-04-26T11:26:39.896222+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:39.896222+0000","last_undegraded":"2024-04-26T11:26:39.896222+0000","last_fullsized":"2024-04-26T11:26:39.896222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:43.166321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":491,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896711+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:39.896711+0000","last_peered":"2024-04-26T11:26:39.896711+0000","last_clean":"2024-04-26T11:26:39.896711+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:39.896711+0000","last_undegraded":"2024-04-26T11:26:39.896711+0000","last_fullsized":"2024-04-26T11:26:39.896711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:00:17.791263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":556,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370468+0000","last_change":"2024-04-26T11:21:53.704630+0000","last_active":"2024-04-26T11:26:40.370468+0000","last_peered":"2024-04-26T11:26:40.370468+0000","last_clean":"2024-04-26T11:26:40.370468+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:40.370468+0000","last_undegraded":"2024-04-26T11:26:40.370468+0000","last_fullsized":"2024-04-26T11:26:40.370468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:01:41.701511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":182,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375310+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:41.375310+0000","last_peered":"2024-04-26T11:26:41.375310+0000","last_clean":"2024-04-26T11:26:41.375310+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:41.375310+0000","last_undegraded":"2024-04-26T11:26:41.375310+0000","last_fullsized":"2024-04-26T11:26:41.375310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:02:55.718880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":416,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897546+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:39.897546+0000","last_peered":"2024-04-26T11:26:39.897546+0000","last_clean":"2024-04-26T11:26:39.897546+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:39.897546+0000","last_undegraded":"2024-04-26T11:26:39.897546+0000","last_fullsized":"2024-04-26T11:26:39.897546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:00.750716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":1025,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370129+0000","last_change":"2024-04-26T11:26:38.376749+0000","last_active":"2024-04-26T11:26:40.370129+0000","last_peered":"2024-04-26T11:26:40.370129+0000","last_clean":"2024-04-26T11:26:40.370129+0000","last_became_active":"2024-04-26T11:26:38.373800+0000","last_became_peered":"2024-04-26T11:26:38.373800+0000","last_unstale":"2024-04-26T11:26:40.370129+0000","last_undegraded":"2024-04-26T11:26:40.370129+0000","last_fullsized":"2024-04-26T11:26:40.370129+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:12:23.112909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":166,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374428+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:41.374428+0000","last_peered":"2024-04-26T11:26:41.374428+0000","last_clean":"2024-04-26T11:26:41.374428+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:41.374428+0000","last_undegraded":"2024-04-26T11:26:41.374428+0000","last_fullsized":"2024-04-26T11:26:41.374428+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:17:34.641401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":570,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.370124+0000","last_change":"2024-04-26T11:21:53.706193+0000","last_active":"2024-04-26T11:26:40.370124+0000","last_peered":"2024-04-26T11:26:40.370124+0000","last_clean":"2024-04-26T11:26:40.370124+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:40.370124+0000","last_undegraded":"2024-04-26T11:26:40.370124+0000","last_fullsized":"2024-04-26T11:26:40.370124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:13.150299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":792,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.376038+0000","last_change":"2024-04-26T11:26:32.372817+0000","last_active":"2024-04-26T11:26:40.376038+0000","last_peered":"2024-04-26T11:26:40.376038+0000","last_clean":"2024-04-26T11:26:40.376038+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:26:40.376038+0000","last_undegraded":"2024-04-26T11:26:40.376038+0000","last_fullsized":"2024-04-26T11:26:40.376038+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:32.214458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":688,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373246+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:41.373246+0000","last_peered":"2024-04-26T11:26:41.373246+0000","last_clean":"2024-04-26T11:26:41.373246+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:41.373246+0000","last_undegraded":"2024-04-26T11:26:41.373246+0000","last_fullsized":"2024-04-26T11:26:41.373246+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:22.546336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":922,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372380+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:40.372380+0000","last_peered":"2024-04-26T11:26:40.372380+0000","last_clean":"2024-04-26T11:26:40.372380+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:40.372380+0000","last_undegraded":"2024-04-26T11:26:40.372380+0000","last_fullsized":"2024-04-26T11:26:40.372380+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:15:23.246741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":395,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372497+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:41.372497+0000","last_peered":"2024-04-26T11:26:41.372497+0000","last_clean":"2024-04-26T11:26:41.372497+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:41.372497+0000","last_undegraded":"2024-04-26T11:26:41.372497+0000","last_fullsized":"2024-04-26T11:26:41.372497+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:55.033605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1016,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375585+0000","last_change":"2024-04-26T11:26:36.406522+0000","last_active":"2024-04-26T11:26:40.375585+0000","last_peered":"2024-04-26T11:26:40.375585+0000","last_clean":"2024-04-26T11:26:40.375585+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:26:40.375585+0000","last_undegraded":"2024-04-26T11:26:40.375585+0000","last_fullsized":"2024-04-26T11:26:40.375585+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:05.312742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":431,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374748+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:40.374748+0000","last_peered":"2024-04-26T11:26:40.374748+0000","last_clean":"2024-04-26T11:26:40.374748+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:40.374748+0000","last_undegraded":"2024-04-26T11:26:40.374748+0000","last_fullsized":"2024-04-26T11:26:40.374748+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:26.003789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":499,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375046+0000","last_change":"2024-04-26T11:26:22.397850+0000","last_active":"2024-04-26T11:26:40.375046+0000","last_peered":"2024-04-26T11:26:40.375046+0000","last_clean":"2024-04-26T11:26:40.375046+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:40.375046+0000","last_undegraded":"2024-04-26T11:26:40.375046+0000","last_fullsized":"2024-04-26T11:26:40.375046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:04:32.868492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":152,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375041+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:40.375041+0000","last_peered":"2024-04-26T11:26:40.375041+0000","last_clean":"2024-04-26T11:26:40.375041+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:40.375041+0000","last_undegraded":"2024-04-26T11:26:40.375041+0000","last_fullsized":"2024-04-26T11:26:40.375041+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:39.411500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":475,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.896112+0000","last_change":"2024-04-26T11:26:16.885826+0000","last_active":"2024-04-26T11:26:39.896112+0000","last_peered":"2024-04-26T11:26:39.896112+0000","last_clean":"2024-04-26T11:26:39.896112+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:26:39.896112+0000","last_undegraded":"2024-04-26T11:26:39.896112+0000","last_fullsized":"2024-04-26T11:26:39.896112+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:47.743469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":404,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.895905+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:39.895905+0000","last_peered":"2024-04-26T11:26:39.895905+0000","last_clean":"2024-04-26T11:26:39.895905+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:39.895905+0000","last_undegraded":"2024-04-26T11:26:39.895905+0000","last_fullsized":"2024-04-26T11:26:39.895905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:07.959465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":491,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897078+0000","last_change":"2024-04-26T11:26:31.896245+0000","last_active":"2024-04-26T11:26:39.897078+0000","last_peered":"2024-04-26T11:26:39.897078+0000","last_clean":"2024-04-26T11:26:39.897078+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:26:39.897078+0000","last_undegraded":"2024-04-26T11:26:39.897078+0000","last_fullsized":"2024-04-26T11:26:39.897078+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:42:59.173436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"70'390","reported_seq":497,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.375850+0000","last_change":"2024-04-26T11:26:22.405881+0000","last_active":"2024-04-26T11:26:40.375850+0000","last_peered":"2024-04-26T11:26:40.375850+0000","last_clean":"2024-04-26T11:26:40.375850+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:26:40.375850+0000","last_undegraded":"2024-04-26T11:26:40.375850+0000","last_fullsized":"2024-04-26T11:26:40.375850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:36.397118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":498,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.374562+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:40.374562+0000","last_peered":"2024-04-26T11:26:40.374562+0000","last_clean":"2024-04-26T11:26:40.374562+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:40.374562+0000","last_undegraded":"2024-04-26T11:26:40.374562+0000","last_fullsized":"2024-04-26T11:26:40.374562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:21.744893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":158,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372672+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:40.372672+0000","last_peered":"2024-04-26T11:26:40.372672+0000","last_clean":"2024-04-26T11:26:40.372672+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:40.372672+0000","last_undegraded":"2024-04-26T11:26:40.372672+0000","last_fullsized":"2024-04-26T11:26:40.372672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:08.746659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":542,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:39.897090+0000","last_change":"2024-04-26T11:26:33.905426+0000","last_active":"2024-04-26T11:26:39.897090+0000","last_peered":"2024-04-26T11:26:39.897090+0000","last_clean":"2024-04-26T11:26:39.897090+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:39.897090+0000","last_undegraded":"2024-04-26T11:26:39.897090+0000","last_fullsized":"2024-04-26T11:26:39.897090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:49.659488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":256,"reported_epoch":105,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.372499+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:40.372499+0000","last_peered":"2024-04-26T11:26:40.372499+0000","last_clean":"2024-04-26T11:26:40.372499+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:40.372499+0000","last_undegraded":"2024-04-26T11:26:40.372499+0000","last_fullsized":"2024-04-26T11:26:40.372499+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:54:07.506446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7654,"ondisk_log_size":7654,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738434,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142444,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229396,"statfs":{"total":96636764160,"available":96490901504,"internally_reserved":0,"allocated":31744000,"data_stored":81613145,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri Apr 26 11:25:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.56499999999999995,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.76300000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.626,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.73799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738434,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124352,"kb_used_data":30964,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247488,"statfs":{"total":96636764160,"available":96509427712,"internally_reserved":0,"allocated":31707136,"data_stored":86117265,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Apr 26 11:25:46 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.68600000000000005},"min":{"1min":0.61399999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.69899999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.65200000000000002,"15min":0.68799999999999994},"min":{"1min":0.55500000000000005,"5min":0.371,"15min":0.371},"max":{"1min":0.70099999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.76500000000000001}]}]},{"osd":0,"up_from":75,"seq":322122547209,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75944,"kb_used_data":18068,"kb_used_omap":7,"kb_used_meta":57848,"kb_avail":94295896,"statfs":{"total":96636764160,"available":96558997504,"internally_reserved":0,"allocated":18501632,"data_stored":91781533,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":59237367},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:26:50.643 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.643 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.643 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.643 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.643 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.644 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.644 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.644 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.644 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.644 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.644 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.644 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.644 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.644 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.645 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.645 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.645 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.645 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.645 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.645 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.645 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.645 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.645 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.646 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.646 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.646 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.646 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.646 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.646 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.646 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.646 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.647 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.647 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.647 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.647 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.647 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.647 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.647 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.647 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.648 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.648 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.648 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.648 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.648 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.648 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.648 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.648 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.648 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.649 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.649 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.649 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.649 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.649 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.649 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.649 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.649 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.649 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T11:21:42.211238+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.649 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.650 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.650 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.650 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.650 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.650 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.650 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.650 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.650 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.651 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.651 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.651 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.651 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.651 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.651 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.651 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.651 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.651 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.652 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.652 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.652 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.652 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.652 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.652 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.652 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.652 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.652 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.652 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.653 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.653 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.653 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.653 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.653 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.653 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.653 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.653 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.654 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.654 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.654 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.654 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.654 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.654 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.654 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.654 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.654 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.655 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.655 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.655 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:26:50.655 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:27:10.656 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:27:10.975 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:27:10.977 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:27:10.992 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":268,"stamp":"2024-04-26T11:27:09.462468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7334,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34368,"ondisk_log_size":34368,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":342712,"kb_used_data":80032,"kb_used_omap":10,"kb_used_meta":262645,"kb_avail":282772808,"statfs":{"total":289910292480,"available":289559355392,"internally_reserved":0,"allocated":81952768,"data_stored":259511943,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":268949379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004451"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":510,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375537+0000","last_change":"2024-04-26T11:26:22.396002+0000","last_active":"2024-04-26T11:26:41.375537+0000","last_peered":"2024-04-26T11:26:41.375537+0000","last_clean":"2024-04-26T11:26:41.375537+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:26:41.375537+0000","last_undegraded":"2024-04-26T11:26:41.375537+0000","last_fullsized":"2024-04-26T11:26:41.375537+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":566,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374935+0000","last_change":"2024-04-26T11:26:22.400808+0000","last_active":"2024-04-26T11:26:41.374935+0000","last_peered":"2024-04-26T11:26:41.374935+0000","last_clean":"2024-04-26T11:26:41.374935+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:26:41.374935+0000","last_undegraded":"2024-04-26T11:26:41.374935+0000","last_fullsized":"2024-04-26T11:26:41.374935+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":441,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895857+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:40.895857+0000","last_peered":"2024-04-26T11:26:40.895857+0000","last_clean":"2024-04-26T11:26:40.895857+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:40.895857+0000","last_undegraded":"2024-04-26T11:26:40.895857+0000","last_fullsized":"2024-04-26T11:26:40.895857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":490,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894201+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:40.894201+0000","last_peered":"2024-04-26T11:26:40.894201+0000","last_clean":"2024-04-26T11:26:40.894201+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:40.894201+0000","last_undegraded":"2024-04-26T11:26:40.894201+0000","last_fullsized":"2024-04-26T11:26:40.894201+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":541,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374262+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:41.374262+0000","last_peered":"2024-04-26T11:26:41.374262+0000","last_clean":"2024-04-26T11:26:41.374262+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:41.374262+0000","last_undegraded":"2024-04-26T11:26:41.374262+0000","last_fullsized":"2024-04-26T11:26:41.374262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":494,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893513+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:40.893513+0000","last_peered":"2024-04-26T11:26:40.893513+0000","last_clean":"2024-04-26T11:26:40.893513+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:40.893513+0000","last_undegraded":"2024-04-26T11:26:40.893513+0000","last_fullsized":"2024-04-26T11:26:40.893513+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":595,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893161+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:40.893161+0000","last_peered":"2024-04-26T11:26:40.893161+0000","last_clean":"2024-04-26T11:26:40.893161+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:40.893161+0000","last_undegraded":"2024-04-26T11:26:40.893161+0000","last_fullsized":"2024-04-26T11:26:40.893161+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":463,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893722+0000","last_change":"2024-04-26T11:26:25.910658+0000","last_active":"2024-04-26T11:26:40.893722+0000","last_peered":"2024-04-26T11:26:40.893722+0000","last_clean":"2024-04-26T11:26:40.893722+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:26:40.893722+0000","last_undegraded":"2024-04-26T11:26:40.893722+0000","last_fullsized":"2024-04-26T11:26:40.893722+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":598,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498493+0000","last_change":"2024-04-26T11:21:53.712617+0000","last_active":"2024-04-26T11:26:46.498493+0000","last_peered":"2024-04-26T11:26:46.498493+0000","last_clean":"2024-04-26T11:26:46.498493+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:26:46.498493+0000","last_undegraded":"2024-04-26T11:26:46.498493+0000","last_fullsized":"2024-04-26T11:26:46.498493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":508,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.477487+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:46.477487+0000","last_peered":"2024-04-26T11:26:46.477487+0000","last_clean":"2024-04-26T11:26:46.477487+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:46.477487+0000","last_undegraded":"2024-04-26T11:26:46.477487+0000","last_fullsized":"2024-04-26T11:26:46.477487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":481,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895738+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:40.895738+0000","last_peered":"2024-04-26T11:26:40.895738+0000","last_clean":"2024-04-26T11:26:40.895738+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:40.895738+0000","last_undegraded":"2024-04-26T11:26:40.895738+0000","last_fullsized":"2024-04-26T11:26:40.895738+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":784,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.477334+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:46.477334+0000","last_peered":"2024-04-26T11:26:46.477334+0000","last_clean":"2024-04-26T11:26:46.477334+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:46.477334+0000","last_undegraded":"2024-04-26T11:26:46.477334+0000","last_fullsized":"2024-04-26T11:26:46.477334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":454,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374000+0000","last_change":"2024-04-26T11:26:22.387605+0000","last_active":"2024-04-26T11:26:41.374000+0000","last_peered":"2024-04-26T11:26:41.374000+0000","last_clean":"2024-04-26T11:26:41.374000+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:26:41.374000+0000","last_undegraded":"2024-04-26T11:26:41.374000+0000","last_fullsized":"2024-04-26T11:26:41.374000+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":494,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:02.539257+0000","last_change":"2024-04-26T11:27:02.539472+0000","last_active":"2024-04-26T11:27:02.539257+0000","last_peered":"2024-04-26T11:27:02.539257+0000","last_clean":"2024-04-26T11:27:02.539257+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:27:02.539257+0000","last_undegraded":"2024-04-26T11:27:02.539257+0000","last_fullsized":"2024-04-26T11:27:02.539257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_clean_scrub_stamp":"2024-04-26T11:27:02.539206+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:43.230821+0000","scrub_duration":0.003815648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":539,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893042+0000","last_change":"2024-04-26T11:26:16.151760+0000","last_active":"2024-04-26T11:26:40.893042+0000","last_peered":"2024-04-26T11:26:40.893042+0000","last_clean":"2024-04-26T11:26:40.893042+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:26:40.893042+0000","last_undegraded":"2024-04-26T11:26:40.893042+0000","last_fullsized":"2024-04-26T11:26:40.893042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":615,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.393743+0000","last_change":"2024-04-26T11:26:54.393969+0000","last_active":"2024-04-26T11:26:54.393743+0000","last_peered":"2024-04-26T11:26:54.393743+0000","last_clean":"2024-04-26T11:26:54.393743+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:54.393743+0000","last_undegraded":"2024-04-26T11:26:54.393743+0000","last_fullsized":"2024-04-26T11:26:54.393743+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'453","last_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_deep_scrub":"71'453","last_deep_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.393690+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:41.730233+0000","scrub_duration":0.0038895330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":589,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:51.960476+0000","last_change":"2024-04-26T11:26:51.960725+0000","last_active":"2024-04-26T11:26:51.960476+0000","last_peered":"2024-04-26T11:26:51.960476+0000","last_clean":"2024-04-26T11:26:51.960476+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:51.960476+0000","last_undegraded":"2024-04-26T11:26:51.960476+0000","last_fullsized":"2024-04-26T11:26:51.960476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_clean_scrub_stamp":"2024-04-26T11:26:51.960424+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:17.833759+0000","scrub_duration":0.0043861689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":585,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375318+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:41.375318+0000","last_peered":"2024-04-26T11:26:41.375318+0000","last_clean":"2024-04-26T11:26:41.375318+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:41.375318+0000","last_undegraded":"2024-04-26T11:26:41.375318+0000","last_fullsized":"2024-04-26T11:26:41.375318+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":624,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373584+0000","last_change":"2024-04-26T11:21:53.707890+0000","last_active":"2024-04-26T11:26:41.373584+0000","last_peered":"2024-04-26T11:26:41.373584+0000","last_clean":"2024-04-26T11:26:41.373584+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:26:41.373584+0000","last_undegraded":"2024-04-26T11:26:41.373584+0000","last_fullsized":"2024-04-26T11:26:41.373584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":612,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894527+0000","last_change":"2024-04-26T11:26:29.907661+0000","last_active":"2024-04-26T11:26:40.894527+0000","last_peered":"2024-04-26T11:26:40.894527+0000","last_clean":"2024-04-26T11:26:40.894527+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:26:40.894527+0000","last_undegraded":"2024-04-26T11:26:40.894527+0000","last_fullsized":"2024-04-26T11:26:40.894527+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":550,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893719+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:40.893719+0000","last_peered":"2024-04-26T11:26:40.893719+0000","last_clean":"2024-04-26T11:26:40.893719+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:40.893719+0000","last_undegraded":"2024-04-26T11:26:40.893719+0000","last_fullsized":"2024-04-26T11:26:40.893719+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":979,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373779+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:41.373779+0000","last_peered":"2024-04-26T11:26:41.373779+0000","last_clean":"2024-04-26T11:26:41.373779+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:41.373779+0000","last_undegraded":"2024-04-26T11:26:41.373779+0000","last_fullsized":"2024-04-26T11:26:41.373779+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":933,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.371879+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:41.371879+0000","last_peered":"2024-04-26T11:26:41.371879+0000","last_clean":"2024-04-26T11:26:41.371879+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:41.371879+0000","last_undegraded":"2024-04-26T11:26:41.371879+0000","last_fullsized":"2024-04-26T11:26:41.371879+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":527,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.097877+0000","last_change":"2024-04-26T11:26:58.098112+0000","last_active":"2024-04-26T11:26:58.097877+0000","last_peered":"2024-04-26T11:26:58.097877+0000","last_clean":"2024-04-26T11:26:58.097877+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:58.097877+0000","last_undegraded":"2024-04-26T11:26:58.097877+0000","last_fullsized":"2024-04-26T11:26:58.097877+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'433","last_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_deep_scrub":"71'433","last_deep_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.097826+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:39.261277+0000","scrub_duration":0.0045929860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":949,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375583+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:41.375583+0000","last_peered":"2024-04-26T11:26:41.375583+0000","last_clean":"2024-04-26T11:26:41.375583+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:41.375583+0000","last_undegraded":"2024-04-26T11:26:41.375583+0000","last_fullsized":"2024-04-26T11:26:41.375583+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1055,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373938+0000","last_change":"2024-04-26T11:26:18.374064+0000","last_active":"2024-04-26T11:26:41.373938+0000","last_peered":"2024-04-26T11:26:41.373938+0000","last_clean":"2024-04-26T11:26:41.373938+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:26:41.373938+0000","last_undegraded":"2024-04-26T11:26:41.373938+0000","last_fullsized":"2024-04-26T11:26:41.373938+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":559,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895562+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:40.895562+0000","last_peered":"2024-04-26T11:26:40.895562+0000","last_clean":"2024-04-26T11:26:40.895562+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:40.895562+0000","last_undegraded":"2024-04-26T11:26:40.895562+0000","last_fullsized":"2024-04-26T11:26:40.895562+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":952,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374743+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:41.374743+0000","last_peered":"2024-04-26T11:26:41.374743+0000","last_clean":"2024-04-26T11:26:41.374743+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:41.374743+0000","last_undegraded":"2024-04-26T11:26:41.374743+0000","last_fullsized":"2024-04-26T11:26:41.374743+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":509,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372856+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:41.372856+0000","last_peered":"2024-04-26T11:26:41.372856+0000","last_clean":"2024-04-26T11:26:41.372856+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:41.372856+0000","last_undegraded":"2024-04-26T11:26:41.372856+0000","last_fullsized":"2024-04-26T11:26:41.372856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":1029,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374233+0000","last_change":"2024-04-26T11:26:38.377195+0000","last_active":"2024-04-26T11:26:41.374233+0000","last_peered":"2024-04-26T11:26:41.374233+0000","last_clean":"2024-04-26T11:26:41.374233+0000","last_became_active":"2024-04-26T11:26:38.373963+0000","last_became_peered":"2024-04-26T11:26:38.373963+0000","last_unstale":"2024-04-26T11:26:41.374233+0000","last_undegraded":"2024-04-26T11:26:41.374233+0000","last_fullsized":"2024-04-26T11:26:41.374233+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":629,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372005+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:41.372005+0000","last_peered":"2024-04-26T11:26:41.372005+0000","last_clean":"2024-04-26T11:26:41.372005+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:41.372005+0000","last_undegraded":"2024-04-26T11:26:41.372005+0000","last_fullsized":"2024-04-26T11:26:41.372005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":500,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:44.181532+0000","last_change":"2024-04-26T11:26:40.900605+0000","last_active":"2024-04-26T11:26:44.181532+0000","last_peered":"2024-04-26T11:26:44.181532+0000","last_clean":"2024-04-26T11:26:44.181532+0000","last_became_active":"2024-04-26T11:26:40.895623+0000","last_became_peered":"2024-04-26T11:26:40.895623+0000","last_unstale":"2024-04-26T11:26:44.181532+0000","last_undegraded":"2024-04-26T11:26:44.181532+0000","last_fullsized":"2024-04-26T11:26:44.181532+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":497,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:50.003786+0000","last_change":"2024-04-26T11:26:50.004040+0000","last_active":"2024-04-26T11:26:50.003786+0000","last_peered":"2024-04-26T11:26:50.003786+0000","last_clean":"2024-04-26T11:26:50.003786+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:50.003786+0000","last_undegraded":"2024-04-26T11:26:50.003786+0000","last_fullsized":"2024-04-26T11:26:50.003786+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_clean_scrub_stamp":"2024-04-26T11:26:50.003733+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:47.677731+0000","scrub_duration":0.0047410569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"70'471","reported_seq":551,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893064+0000","last_change":"2024-04-26T11:26:14.131679+0000","last_active":"2024-04-26T11:26:40.893064+0000","last_peered":"2024-04-26T11:26:40.893064+0000","last_clean":"2024-04-26T11:26:40.893064+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:26:40.893064+0000","last_undegraded":"2024-04-26T11:26:40.893064+0000","last_fullsized":"2024-04-26T11:26:40.893064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":506,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375083+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:41.375083+0000","last_peered":"2024-04-26T11:26:41.375083+0000","last_clean":"2024-04-26T11:26:41.375083+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:41.375083+0000","last_undegraded":"2024-04-26T11:26:41.375083+0000","last_fullsized":"2024-04-26T11:26:41.375083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":177,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372790+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:41.372790+0000","last_peered":"2024-04-26T11:26:41.372790+0000","last_clean":"2024-04-26T11:26:41.372790+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:41.372790+0000","last_undegraded":"2024-04-26T11:26:41.372790+0000","last_fullsized":"2024-04-26T11:26:41.372790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":999,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498440+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:46.498440+0000","last_peered":"2024-04-26T11:26:46.498440+0000","last_clean":"2024-04-26T11:26:46.498440+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:46.498440+0000","last_undegraded":"2024-04-26T11:26:46.498440+0000","last_fullsized":"2024-04-26T11:26:46.498440+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:00.101549+0000","last_change":"2024-04-26T11:27:00.101771+0000","last_active":"2024-04-26T11:27:00.101549+0000","last_peered":"2024-04-26T11:27:00.101549+0000","last_clean":"2024-04-26T11:27:00.101549+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:27:00.101549+0000","last_undegraded":"2024-04-26T11:27:00.101549+0000","last_fullsized":"2024-04-26T11:27:00.101549+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'72","last_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_deep_scrub":"70'72","last_deep_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_clean_scrub_stamp":"2024-04-26T11:27:00.101498+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:38.755366+0000","scrub_duration":0.0029441889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":950,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.915251+0000","last_change":"2024-04-26T11:27:03.915526+0000","last_active":"2024-04-26T11:27:03.915251+0000","last_peered":"2024-04-26T11:27:03.915251+0000","last_clean":"2024-04-26T11:27:03.915251+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:27:03.915251+0000","last_undegraded":"2024-04-26T11:27:03.915251+0000","last_fullsized":"2024-04-26T11:27:03.915251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'411","last_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_deep_scrub":"71'411","last_deep_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.915200+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:44.598651+0000","scrub_duration":0.0040090890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":53,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.892424+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:40.892424+0000","last_peered":"2024-04-26T11:26:40.892424+0000","last_clean":"2024-04-26T11:26:40.892424+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:40.892424+0000","last_undegraded":"2024-04-26T11:26:40.892424+0000","last_fullsized":"2024-04-26T11:26:40.892424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"70'162","reported_seq":243,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895436+0000","last_change":"2024-04-26T11:26:14.134337+0000","last_active":"2024-04-26T11:26:40.895436+0000","last_peered":"2024-04-26T11:26:40.895436+0000","last_clean":"2024-04-26T11:26:40.895436+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:26:40.895436+0000","last_undegraded":"2024-04-26T11:26:40.895436+0000","last_fullsized":"2024-04-26T11:26:40.895436+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":877,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373303+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:41.373303+0000","last_peered":"2024-04-26T11:26:41.373303+0000","last_clean":"2024-04-26T11:26:41.373303+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:41.373303+0000","last_undegraded":"2024-04-26T11:26:41.373303+0000","last_fullsized":"2024-04-26T11:26:41.373303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":402,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375603+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:41.375603+0000","last_peered":"2024-04-26T11:26:41.375603+0000","last_clean":"2024-04-26T11:26:41.375603+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:41.375603+0000","last_undegraded":"2024-04-26T11:26:41.375603+0000","last_fullsized":"2024-04-26T11:26:41.375603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":592,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.044886+0000","last_change":"2024-04-26T11:26:54.045110+0000","last_active":"2024-04-26T11:26:54.044886+0000","last_peered":"2024-04-26T11:26:54.044886+0000","last_clean":"2024-04-26T11:26:54.044886+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:54.044886+0000","last_undegraded":"2024-04-26T11:26:54.044886+0000","last_fullsized":"2024-04-26T11:26:54.044886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'455","last_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_deep_scrub":"71'455","last_deep_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.044831+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:23.986621+0000","scrub_duration":0.0050259290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"106'567","reported_seq":659,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.588175+0000","last_change":"2024-04-26T11:27:01.588510+0000","last_active":"2024-04-26T11:27:01.588175+0000","last_peered":"2024-04-26T11:27:01.588175+0000","last_clean":"2024-04-26T11:27:01.588175+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:27:01.588175+0000","last_undegraded":"2024-04-26T11:27:01.588175+0000","last_fullsized":"2024-04-26T11:27:01.588175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'567","last_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_deep_scrub":"106'567","last_deep_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.588061+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:05.825620+0000","scrub_duration":0.031697134000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":531,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893616+0000","last_change":"2024-04-26T11:26:39.905388+0000","last_active":"2024-04-26T11:26:40.893616+0000","last_peered":"2024-04-26T11:26:40.893616+0000","last_clean":"2024-04-26T11:26:40.893616+0000","last_became_active":"2024-04-26T11:26:39.900162+0000","last_became_peered":"2024-04-26T11:26:39.900162+0000","last_unstale":"2024-04-26T11:26:40.893616+0000","last_undegraded":"2024-04-26T11:26:40.893616+0000","last_fullsized":"2024-04-26T11:26:40.893616+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894227+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:40.894227+0000","last_peered":"2024-04-26T11:26:40.894227+0000","last_clean":"2024-04-26T11:26:40.894227+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:40.894227+0000","last_undegraded":"2024-04-26T11:26:40.894227+0000","last_fullsized":"2024-04-26T11:26:40.894227+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":970,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:05.965271+0000","last_change":"2024-04-26T11:27:05.965500+0000","last_active":"2024-04-26T11:27:05.965271+0000","last_peered":"2024-04-26T11:27:05.965271+0000","last_clean":"2024-04-26T11:27:05.965271+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:27:05.965271+0000","last_undegraded":"2024-04-26T11:27:05.965271+0000","last_fullsized":"2024-04-26T11:27:05.965271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_clean_scrub_stamp":"2024-04-26T11:27:05.965214+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:34:49.834938+0000","scrub_duration":0.0039580659999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":311,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373199+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:41.373199+0000","last_peered":"2024-04-26T11:26:41.373199+0000","last_clean":"2024-04-26T11:26:41.373199+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:41.373199+0000","last_undegraded":"2024-04-26T11:26:41.373199+0000","last_fullsized":"2024-04-26T11:26:41.373199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":528,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894748+0000","last_change":"2024-04-26T11:26:35.931909+0000","last_active":"2024-04-26T11:26:40.894748+0000","last_peered":"2024-04-26T11:26:40.894748+0000","last_clean":"2024-04-26T11:26:40.894748+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:26:40.894748+0000","last_undegraded":"2024-04-26T11:26:40.894748+0000","last_fullsized":"2024-04-26T11:26:40.894748+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":296,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.892704+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:40.892704+0000","last_peered":"2024-04-26T11:26:40.892704+0000","last_clean":"2024-04-26T11:26:40.892704+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:40.892704+0000","last_undegraded":"2024-04-26T11:26:40.892704+0000","last_fullsized":"2024-04-26T11:26:40.892704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":472,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895021+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:40.895021+0000","last_peered":"2024-04-26T11:26:40.895021+0000","last_clean":"2024-04-26T11:26:40.895021+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:40.895021+0000","last_undegraded":"2024-04-26T11:26:40.895021+0000","last_fullsized":"2024-04-26T11:26:40.895021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":152,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373797+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:41.373797+0000","last_peered":"2024-04-26T11:26:41.373797+0000","last_clean":"2024-04-26T11:26:41.373797+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:41.373797+0000","last_undegraded":"2024-04-26T11:26:41.373797+0000","last_fullsized":"2024-04-26T11:26:41.373797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":447,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895312+0000","last_change":"2024-04-26T11:26:29.914048+0000","last_active":"2024-04-26T11:26:40.895312+0000","last_peered":"2024-04-26T11:26:40.895312+0000","last_clean":"2024-04-26T11:26:40.895312+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:26:40.895312+0000","last_undegraded":"2024-04-26T11:26:40.895312+0000","last_fullsized":"2024-04-26T11:26:40.895312+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"70'359","reported_seq":353,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373371+0000","last_change":"2024-04-26T11:26:22.372119+0000","last_active":"2024-04-26T11:26:41.373371+0000","last_peered":"2024-04-26T11:26:41.373371+0000","last_clean":"2024-04-26T11:26:41.373371+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:26:41.373371+0000","last_undegraded":"2024-04-26T11:26:41.373371+0000","last_fullsized":"2024-04-26T11:26:41.373371+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":565,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.907340+0000","last_change":"2024-04-26T11:27:01.907573+0000","last_active":"2024-04-26T11:27:01.907340+0000","last_peered":"2024-04-26T11:27:01.907340+0000","last_clean":"2024-04-26T11:27:01.907340+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:27:01.907340+0000","last_undegraded":"2024-04-26T11:27:01.907340+0000","last_fullsized":"2024-04-26T11:27:01.907340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.907287+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:00.821083+0000","scrub_duration":0.0045510610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":248,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.892147+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:40.892147+0000","last_peered":"2024-04-26T11:26:40.892147+0000","last_clean":"2024-04-26T11:26:40.892147+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:40.892147+0000","last_undegraded":"2024-04-26T11:26:40.892147+0000","last_fullsized":"2024-04-26T11:26:40.892147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.892781+0000","last_change":"2024-04-26T11:26:11.129583+0000","last_active":"2024-04-26T11:26:40.892781+0000","last_peered":"2024-04-26T11:26:40.892781+0000","last_clean":"2024-04-26T11:26:40.892781+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:26:40.892781+0000","last_undegraded":"2024-04-26T11:26:40.892781+0000","last_fullsized":"2024-04-26T11:26:40.892781+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":852,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373222+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:41.373222+0000","last_peered":"2024-04-26T11:26:41.373222+0000","last_clean":"2024-04-26T11:26:41.373222+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:41.373222+0000","last_undegraded":"2024-04-26T11:26:41.373222+0000","last_fullsized":"2024-04-26T11:26:41.373222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":515,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895391+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:40.895391+0000","last_peered":"2024-04-26T11:26:40.895391+0000","last_clean":"2024-04-26T11:26:40.895391+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:40.895391+0000","last_undegraded":"2024-04-26T11:26:40.895391+0000","last_fullsized":"2024-04-26T11:26:40.895391+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894009+0000","last_change":"2024-04-26T11:26:11.131833+0000","last_active":"2024-04-26T11:26:40.894009+0000","last_peered":"2024-04-26T11:26:40.894009+0000","last_clean":"2024-04-26T11:26:40.894009+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:26:40.894009+0000","last_undegraded":"2024-04-26T11:26:40.894009+0000","last_fullsized":"2024-04-26T11:26:40.894009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":293,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372609+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:41.372609+0000","last_peered":"2024-04-26T11:26:41.372609+0000","last_clean":"2024-04-26T11:26:41.372609+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:41.372609+0000","last_undegraded":"2024-04-26T11:26:41.372609+0000","last_fullsized":"2024-04-26T11:26:41.372609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":563,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375219+0000","last_change":"2024-04-26T11:26:22.402777+0000","last_active":"2024-04-26T11:26:41.375219+0000","last_peered":"2024-04-26T11:26:41.375219+0000","last_clean":"2024-04-26T11:26:41.375219+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:26:41.375219+0000","last_undegraded":"2024-04-26T11:26:41.375219+0000","last_fullsized":"2024-04-26T11:26:41.375219+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":105,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372847+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:41.372847+0000","last_peered":"2024-04-26T11:26:41.372847+0000","last_clean":"2024-04-26T11:26:41.372847+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:41.372847+0000","last_undegraded":"2024-04-26T11:26:41.372847+0000","last_fullsized":"2024-04-26T11:26:41.372847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":483,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373584+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:41.373584+0000","last_peered":"2024-04-26T11:26:41.373584+0000","last_clean":"2024-04-26T11:26:41.373584+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:41.373584+0000","last_undegraded":"2024-04-26T11:26:41.373584+0000","last_fullsized":"2024-04-26T11:26:41.373584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":454,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374153+0000","last_change":"2024-04-26T11:21:53.713802+0000","last_active":"2024-04-26T11:26:41.374153+0000","last_peered":"2024-04-26T11:26:41.374153+0000","last_clean":"2024-04-26T11:26:41.374153+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:26:41.374153+0000","last_undegraded":"2024-04-26T11:26:41.374153+0000","last_fullsized":"2024-04-26T11:26:41.374153+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.892457+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:40.892457+0000","last_peered":"2024-04-26T11:26:40.892457+0000","last_clean":"2024-04-26T11:26:40.892457+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:40.892457+0000","last_undegraded":"2024-04-26T11:26:40.892457+0000","last_fullsized":"2024-04-26T11:26:40.892457+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893014+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:40.893014+0000","last_peered":"2024-04-26T11:26:40.893014+0000","last_clean":"2024-04-26T11:26:40.893014+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:40.893014+0000","last_undegraded":"2024-04-26T11:26:40.893014+0000","last_fullsized":"2024-04-26T11:26:40.893014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":563,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373624+0000","last_change":"2024-04-26T11:21:53.710699+0000","last_active":"2024-04-26T11:26:41.373624+0000","last_peered":"2024-04-26T11:26:41.373624+0000","last_clean":"2024-04-26T11:26:41.373624+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:26:41.373624+0000","last_undegraded":"2024-04-26T11:26:41.373624+0000","last_fullsized":"2024-04-26T11:26:41.373624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":571,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894557+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:40.894557+0000","last_peered":"2024-04-26T11:26:40.894557+0000","last_clean":"2024-04-26T11:26:40.894557+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:40.894557+0000","last_undegraded":"2024-04-26T11:26:40.894557+0000","last_fullsized":"2024-04-26T11:26:40.894557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":102,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373833+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:41.373833+0000","last_peered":"2024-04-26T11:26:41.373833+0000","last_clean":"2024-04-26T11:26:41.373833+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:41.373833+0000","last_undegraded":"2024-04-26T11:26:41.373833+0000","last_fullsized":"2024-04-26T11:26:41.373833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":793,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374572+0000","last_change":"2024-04-26T11:26:35.389500+0000","last_active":"2024-04-26T11:26:41.374572+0000","last_peered":"2024-04-26T11:26:41.374572+0000","last_clean":"2024-04-26T11:26:41.374572+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:26:41.374572+0000","last_undegraded":"2024-04-26T11:26:41.374572+0000","last_fullsized":"2024-04-26T11:26:41.374572+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373693+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:41.373693+0000","last_peered":"2024-04-26T11:26:41.373693+0000","last_clean":"2024-04-26T11:26:41.373693+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:41.373693+0000","last_undegraded":"2024-04-26T11:26:41.373693+0000","last_fullsized":"2024-04-26T11:26:41.373693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375446+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:41.375446+0000","last_peered":"2024-04-26T11:26:41.375446+0000","last_clean":"2024-04-26T11:26:41.375446+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:41.375446+0000","last_undegraded":"2024-04-26T11:26:41.375446+0000","last_fullsized":"2024-04-26T11:26:41.375446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":818,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374153+0000","last_change":"2024-04-26T11:26:22.397931+0000","last_active":"2024-04-26T11:26:41.374153+0000","last_peered":"2024-04-26T11:26:41.374153+0000","last_clean":"2024-04-26T11:26:41.374153+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:26:41.374153+0000","last_undegraded":"2024-04-26T11:26:41.374153+0000","last_fullsized":"2024-04-26T11:26:41.374153+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374564+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:41.374564+0000","last_peered":"2024-04-26T11:26:41.374564+0000","last_clean":"2024-04-26T11:26:41.374564+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:41.374564+0000","last_undegraded":"2024-04-26T11:26:41.374564+0000","last_fullsized":"2024-04-26T11:26:41.374564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374508+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:41.374508+0000","last_peered":"2024-04-26T11:26:41.374508+0000","last_clean":"2024-04-26T11:26:41.374508+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:41.374508+0000","last_undegraded":"2024-04-26T11:26:41.374508+0000","last_fullsized":"2024-04-26T11:26:41.374508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":927,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372921+0000","last_change":"2024-04-26T11:26:39.378496+0000","last_active":"2024-04-26T11:26:41.372921+0000","last_peered":"2024-04-26T11:26:41.372921+0000","last_clean":"2024-04-26T11:26:41.372921+0000","last_became_active":"2024-04-26T11:26:39.375075+0000","last_became_peered":"2024-04-26T11:26:39.375075+0000","last_unstale":"2024-04-26T11:26:41.372921+0000","last_undegraded":"2024-04-26T11:26:41.372921+0000","last_fullsized":"2024-04-26T11:26:41.372921+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":191,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374422+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:41.374422+0000","last_peered":"2024-04-26T11:26:41.374422+0000","last_clean":"2024-04-26T11:26:41.374422+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:41.374422+0000","last_undegraded":"2024-04-26T11:26:41.374422+0000","last_fullsized":"2024-04-26T11:26:41.374422+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895009+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:40.895009+0000","last_peered":"2024-04-26T11:26:40.895009+0000","last_clean":"2024-04-26T11:26:40.895009+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:40.895009+0000","last_undegraded":"2024-04-26T11:26:40.895009+0000","last_fullsized":"2024-04-26T11:26:40.895009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":931,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373545+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:41.373545+0000","last_peered":"2024-04-26T11:26:41.373545+0000","last_clean":"2024-04-26T11:26:41.373545+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:41.373545+0000","last_undegraded":"2024-04-26T11:26:41.373545+0000","last_fullsized":"2024-04-26T11:26:41.373545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":524,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:53.400187+0000","last_change":"2024-04-26T11:26:53.400430+0000","last_active":"2024-04-26T11:26:53.400187+0000","last_peered":"2024-04-26T11:26:53.400187+0000","last_clean":"2024-04-26T11:26:53.400187+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:53.400187+0000","last_undegraded":"2024-04-26T11:26:53.400187+0000","last_fullsized":"2024-04-26T11:26:53.400187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'415","last_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_deep_scrub":"71'415","last_deep_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_clean_scrub_stamp":"2024-04-26T11:26:53.400136+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:43.847441+0000","scrub_duration":0.0041863550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":492,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893106+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:40.893106+0000","last_peered":"2024-04-26T11:26:40.893106+0000","last_clean":"2024-04-26T11:26:40.893106+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:40.893106+0000","last_undegraded":"2024-04-26T11:26:40.893106+0000","last_fullsized":"2024-04-26T11:26:40.893106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":568,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:56.983899+0000","last_change":"2024-04-26T11:26:56.984139+0000","last_active":"2024-04-26T11:26:56.983899+0000","last_peered":"2024-04-26T11:26:56.983899+0000","last_clean":"2024-04-26T11:26:56.983899+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:56.983899+0000","last_undegraded":"2024-04-26T11:26:56.983899+0000","last_fullsized":"2024-04-26T11:26:56.983899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'425","last_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_deep_scrub":"71'425","last_deep_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_clean_scrub_stamp":"2024-04-26T11:26:56.983841+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:06.726299+0000","scrub_duration":0.0046040439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.477440+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:46.477440+0000","last_peered":"2024-04-26T11:26:46.477440+0000","last_clean":"2024-04-26T11:26:46.477440+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:46.477440+0000","last_undegraded":"2024-04-26T11:26:46.477440+0000","last_fullsized":"2024-04-26T11:26:46.477440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":417,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895052+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:40.895052+0000","last_peered":"2024-04-26T11:26:40.895052+0000","last_clean":"2024-04-26T11:26:40.895052+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:40.895052+0000","last_undegraded":"2024-04-26T11:26:40.895052+0000","last_fullsized":"2024-04-26T11:26:40.895052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":1037,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:57.986343+0000","last_change":"2024-04-26T11:26:57.986559+0000","last_active":"2024-04-26T11:26:57.986343+0000","last_peered":"2024-04-26T11:26:57.986343+0000","last_clean":"2024-04-26T11:26:57.986343+0000","last_became_active":"2024-04-26T11:26:38.373800+0000","last_became_peered":"2024-04-26T11:26:38.373800+0000","last_unstale":"2024-04-26T11:26:57.986343+0000","last_undegraded":"2024-04-26T11:26:57.986343+0000","last_fullsized":"2024-04-26T11:26:57.986343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'468","last_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_deep_scrub":"71'468","last_deep_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_clean_scrub_stamp":"2024-04-26T11:26:57.986292+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:27.125276+0000","scrub_duration":0.0037409510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":167,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498584+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:46.498584+0000","last_peered":"2024-04-26T11:26:46.498584+0000","last_clean":"2024-04-26T11:26:46.498584+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:46.498584+0000","last_undegraded":"2024-04-26T11:26:46.498584+0000","last_fullsized":"2024-04-26T11:26:46.498584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":582,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.962038+0000","last_change":"2024-04-26T11:26:58.962297+0000","last_active":"2024-04-26T11:26:58.962038+0000","last_peered":"2024-04-26T11:26:58.962038+0000","last_clean":"2024-04-26T11:26:58.962038+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:58.962038+0000","last_undegraded":"2024-04-26T11:26:58.962038+0000","last_fullsized":"2024-04-26T11:26:58.962038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'454","last_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_deep_scrub":"71'454","last_deep_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.961980+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:21.020921+0000","scrub_duration":0.0044732579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":793,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375776+0000","last_change":"2024-04-26T11:26:32.372817+0000","last_active":"2024-04-26T11:26:41.375776+0000","last_peered":"2024-04-26T11:26:41.375776+0000","last_clean":"2024-04-26T11:26:41.375776+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:26:41.375776+0000","last_undegraded":"2024-04-26T11:26:41.375776+0000","last_fullsized":"2024-04-26T11:26:41.375776+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":689,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498107+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:46.498107+0000","last_peered":"2024-04-26T11:26:46.498107+0000","last_clean":"2024-04-26T11:26:46.498107+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:46.498107+0000","last_undegraded":"2024-04-26T11:26:46.498107+0000","last_fullsized":"2024-04-26T11:26:46.498107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":923,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374034+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:41.374034+0000","last_peered":"2024-04-26T11:26:41.374034+0000","last_clean":"2024-04-26T11:26:41.374034+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:41.374034+0000","last_undegraded":"2024-04-26T11:26:41.374034+0000","last_fullsized":"2024-04-26T11:26:41.374034+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":396,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498182+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:46.498182+0000","last_peered":"2024-04-26T11:26:46.498182+0000","last_clean":"2024-04-26T11:26:46.498182+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:46.498182+0000","last_undegraded":"2024-04-26T11:26:46.498182+0000","last_fullsized":"2024-04-26T11:26:46.498182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1018,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:49.880515+0000","last_change":"2024-04-26T11:26:36.406522+0000","last_active":"2024-04-26T11:26:49.880515+0000","last_peered":"2024-04-26T11:26:49.880515+0000","last_clean":"2024-04-26T11:26:49.880515+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:26:49.880515+0000","last_undegraded":"2024-04-26T11:26:49.880515+0000","last_fullsized":"2024-04-26T11:26:49.880515+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":432,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374388+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:41.374388+0000","last_peered":"2024-04-26T11:26:41.374388+0000","last_clean":"2024-04-26T11:26:41.374388+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:41.374388+0000","last_undegraded":"2024-04-26T11:26:41.374388+0000","last_fullsized":"2024-04-26T11:26:41.374388+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:52.009464+0000","last_change":"2024-04-26T11:26:52.009713+0000","last_active":"2024-04-26T11:26:52.009464+0000","last_peered":"2024-04-26T11:26:52.009464+0000","last_clean":"2024-04-26T11:26:52.009464+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:52.009464+0000","last_undegraded":"2024-04-26T11:26:52.009464+0000","last_fullsized":"2024-04-26T11:26:52.009464+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_clean_scrub_stamp":"2024-04-26T11:26:52.009412+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:59.423751+0000","scrub_duration":0.0045503360000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":154,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:49.880095+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:49.880095+0000","last_peered":"2024-04-26T11:26:49.880095+0000","last_clean":"2024-04-26T11:26:49.880095+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:49.880095+0000","last_undegraded":"2024-04-26T11:26:49.880095+0000","last_fullsized":"2024-04-26T11:26:49.880095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":487,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.491082+0000","last_change":"2024-04-26T11:27:03.491361+0000","last_active":"2024-04-26T11:27:03.491082+0000","last_peered":"2024-04-26T11:27:03.491082+0000","last_clean":"2024-04-26T11:27:03.491082+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:27:03.491082+0000","last_undegraded":"2024-04-26T11:27:03.491082+0000","last_fullsized":"2024-04-26T11:27:03.491082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'375","last_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_deep_scrub":"71'375","last_deep_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.491032+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:52.444748+0000","scrub_duration":0.0043129789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":405,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893932+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:40.893932+0000","last_peered":"2024-04-26T11:26:40.893932+0000","last_clean":"2024-04-26T11:26:40.893932+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:40.893932+0000","last_undegraded":"2024-04-26T11:26:40.893932+0000","last_fullsized":"2024-04-26T11:26:40.893932+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":492,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893301+0000","last_change":"2024-04-26T11:26:31.896245+0000","last_active":"2024-04-26T11:26:40.893301+0000","last_peered":"2024-04-26T11:26:40.893301+0000","last_clean":"2024-04-26T11:26:40.893301+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:26:40.893301+0000","last_undegraded":"2024-04-26T11:26:40.893301+0000","last_fullsized":"2024-04-26T11:26:40.893301+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"106'394","reported_seq":514,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:04.167993+0000","last_change":"2024-04-26T11:27:04.168232+0000","last_active":"2024-04-26T11:27:04.167993+0000","last_peered":"2024-04-26T11:27:04.167993+0000","last_clean":"2024-04-26T11:27:04.167993+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:27:04.167993+0000","last_undegraded":"2024-04-26T11:27:04.167993+0000","last_fullsized":"2024-04-26T11:27:04.167993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'394","last_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_deep_scrub":"106'394","last_deep_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_clean_scrub_stamp":"2024-04-26T11:27:04.167933+0000","objects_scrubbed":4,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.292388+0000","scrub_duration":0.059480993000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":499,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373982+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:41.373982+0000","last_peered":"2024-04-26T11:26:41.373982+0000","last_clean":"2024-04-26T11:26:41.373982+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:41.373982+0000","last_undegraded":"2024-04-26T11:26:41.373982+0000","last_fullsized":"2024-04-26T11:26:41.373982+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374207+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:41.374207+0000","last_peered":"2024-04-26T11:26:41.374207+0000","last_clean":"2024-04-26T11:26:41.374207+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:41.374207+0000","last_undegraded":"2024-04-26T11:26:41.374207+0000","last_fullsized":"2024-04-26T11:26:41.374207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":554,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:59.498154+0000","last_change":"2024-04-26T11:26:59.498428+0000","last_active":"2024-04-26T11:26:59.498154+0000","last_peered":"2024-04-26T11:26:59.498154+0000","last_clean":"2024-04-26T11:26:59.498154+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:59.498154+0000","last_undegraded":"2024-04-26T11:26:59.498154+0000","last_fullsized":"2024-04-26T11:26:59.498154+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'446","last_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_deep_scrub":"71'446","last_deep_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_clean_scrub_stamp":"2024-04-26T11:26:59.498100+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:08.316575+0000","scrub_duration":0.003708294,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"70'130","reported_seq":257,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374297+0000","last_change":"2024-04-26T11:26:14.616522+0000","last_active":"2024-04-26T11:26:41.374297+0000","last_peered":"2024-04-26T11:26:41.374297+0000","last_clean":"2024-04-26T11:26:41.374297+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:26:41.374297+0000","last_undegraded":"2024-04-26T11:26:41.374297+0000","last_fullsized":"2024-04-26T11:26:41.374297+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7660,"ondisk_log_size":7660,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738438,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142432,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229408,"statfs":{"total":96636764160,"available":96490913792,"internally_reserved":0,"allocated":31744000,"data_stored":81613145,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Apr 26 11:26:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64000000000000001,"15min":0.65700000000000003},"min":{"1min":0.58799999999999997,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.79500000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63,"15min":0.65800000000000003},"min":{"1min":0.61599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.78400000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.80800000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738438,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124348,"kb_used_data":30964,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247492,"statfs":{"total":96636764160,"available":96509431808,"internally_reserved":0,"allocated":31707136,"data_stored":86117265,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:22:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Apr 26 11:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64800000000000002,"15min":0.68400000000000005},"min":{"1min":0.60099999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.68400000000000005},"min":{"1min":0.53400000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57999999999999996}]}]},{"osd":0,"up_from":75,"seq":322122547213,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75932,"kb_used_data":18068,"kb_used_omap":7,"kb_used_meta":57848,"kb_avail":94295908,"statfs":{"total":96636764160,"available":96559009792,"internally_reserved":0,"allocated":18501632,"data_stored":91781533,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":59237367},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:27:10.997 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.997 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.997 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.997 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.998 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.998 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.998 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.998 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.998 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.998 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.998 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.998 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.998 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.999 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.999 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.999 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.999 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.999 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.999 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.999 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:10.999 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.000 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.000 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.000 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.000 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.000 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.000 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.000 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.000 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.000 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.001 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.001 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.001 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.001 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.001 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.001 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.001 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.001 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.001 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.002 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.002 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.002 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.002 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.002 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.002 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.002 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T11:21:42.211238+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.002 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.003 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.003 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.003 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.003 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.003 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.003 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.003 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.003 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.003 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.003 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.004 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.004 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.004 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.004 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.004 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.004 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.004 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.004 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.005 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.005 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.005 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.005 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.005 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.005 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.005 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.005 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.005 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.006 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.006 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.006 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.006 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.006 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.007 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.007 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.007 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.007 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.007 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.007 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.007 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:11.007 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:27:31.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:27:31.335 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:27:31.337 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:27:31.356 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-04-26T11:27:29.469827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7334,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34378,"ondisk_log_size":34378,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":342712,"kb_used_data":80032,"kb_used_omap":10,"kb_used_meta":262645,"kb_avail":282772808,"statfs":{"total":289910292480,"available":289559355392,"internally_reserved":0,"allocated":81952768,"data_stored":259511943,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":268949379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004557"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":521,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:11.072905+0000","last_change":"2024-04-26T11:27:11.073124+0000","last_active":"2024-04-26T11:27:11.072905+0000","last_peered":"2024-04-26T11:27:11.072905+0000","last_clean":"2024-04-26T11:27:11.072905+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:27:11.072905+0000","last_undegraded":"2024-04-26T11:27:11.072905+0000","last_fullsized":"2024-04-26T11:27:11.072905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:27:11.072854+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:27:11.072854+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.072854+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:41.048439+0000","scrub_duration":0.0036583589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":577,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:16.039167+0000","last_change":"2024-04-26T11:27:16.039433+0000","last_active":"2024-04-26T11:27:16.039167+0000","last_peered":"2024-04-26T11:27:16.039167+0000","last_clean":"2024-04-26T11:27:16.039167+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:27:16.039167+0000","last_undegraded":"2024-04-26T11:27:16.039167+0000","last_fullsized":"2024-04-26T11:27:16.039167+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'427","last_scrub_stamp":"2024-04-26T11:27:16.039112+0000","last_deep_scrub":"71'427","last_deep_scrub_stamp":"2024-04-26T11:27:16.039112+0000","last_clean_scrub_stamp":"2024-04-26T11:27:16.039112+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:41.912448+0000","scrub_duration":0.0051090520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":441,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895857+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:40.895857+0000","last_peered":"2024-04-26T11:26:40.895857+0000","last_clean":"2024-04-26T11:26:40.895857+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:40.895857+0000","last_undegraded":"2024-04-26T11:26:40.895857+0000","last_fullsized":"2024-04-26T11:26:40.895857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":490,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894201+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:40.894201+0000","last_peered":"2024-04-26T11:26:40.894201+0000","last_clean":"2024-04-26T11:26:40.894201+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:40.894201+0000","last_undegraded":"2024-04-26T11:26:40.894201+0000","last_fullsized":"2024-04-26T11:26:40.894201+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":541,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374262+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:41.374262+0000","last_peered":"2024-04-26T11:26:41.374262+0000","last_clean":"2024-04-26T11:26:41.374262+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:41.374262+0000","last_undegraded":"2024-04-26T11:26:41.374262+0000","last_fullsized":"2024-04-26T11:26:41.374262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":494,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893513+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:40.893513+0000","last_peered":"2024-04-26T11:26:40.893513+0000","last_clean":"2024-04-26T11:26:40.893513+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:40.893513+0000","last_undegraded":"2024-04-26T11:26:40.893513+0000","last_fullsized":"2024-04-26T11:26:40.893513+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":595,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893161+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:40.893161+0000","last_peered":"2024-04-26T11:26:40.893161+0000","last_clean":"2024-04-26T11:26:40.893161+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:40.893161+0000","last_undegraded":"2024-04-26T11:26:40.893161+0000","last_fullsized":"2024-04-26T11:26:40.893161+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":474,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:04.461767+0000","last_change":"2024-04-26T11:27:04.461975+0000","last_active":"2024-04-26T11:27:04.461767+0000","last_peered":"2024-04-26T11:27:04.461767+0000","last_clean":"2024-04-26T11:27:04.461767+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:27:04.461767+0000","last_undegraded":"2024-04-26T11:27:04.461767+0000","last_fullsized":"2024-04-26T11:27:04.461767+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'373","last_scrub_stamp":"2024-04-26T11:27:04.461717+0000","last_deep_scrub":"71'373","last_deep_scrub_stamp":"2024-04-26T11:27:04.461717+0000","last_clean_scrub_stamp":"2024-04-26T11:27:04.461717+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:24.859328+0000","scrub_duration":0.0041768209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":609,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:23.965512+0000","last_change":"2024-04-26T11:27:23.965730+0000","last_active":"2024-04-26T11:27:23.965512+0000","last_peered":"2024-04-26T11:27:23.965512+0000","last_clean":"2024-04-26T11:27:23.965512+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:27:23.965512+0000","last_undegraded":"2024-04-26T11:27:23.965512+0000","last_fullsized":"2024-04-26T11:27:23.965512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'447","last_scrub_stamp":"2024-04-26T11:27:23.965459+0000","last_deep_scrub":"71'447","last_deep_scrub_stamp":"2024-04-26T11:27:23.965459+0000","last_clean_scrub_stamp":"2024-04-26T11:27:23.965459+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:17.028067+0000","scrub_duration":0.0044560520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":508,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.477487+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:46.477487+0000","last_peered":"2024-04-26T11:26:46.477487+0000","last_clean":"2024-04-26T11:26:46.477487+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:46.477487+0000","last_undegraded":"2024-04-26T11:26:46.477487+0000","last_fullsized":"2024-04-26T11:26:46.477487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":481,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895738+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:40.895738+0000","last_peered":"2024-04-26T11:26:40.895738+0000","last_clean":"2024-04-26T11:26:40.895738+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:40.895738+0000","last_undegraded":"2024-04-26T11:26:40.895738+0000","last_fullsized":"2024-04-26T11:26:40.895738+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":784,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.477334+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:46.477334+0000","last_peered":"2024-04-26T11:26:46.477334+0000","last_clean":"2024-04-26T11:26:46.477334+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:46.477334+0000","last_undegraded":"2024-04-26T11:26:46.477334+0000","last_fullsized":"2024-04-26T11:26:46.477334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":465,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:07.138603+0000","last_change":"2024-04-26T11:27:07.138812+0000","last_active":"2024-04-26T11:27:07.138603+0000","last_peered":"2024-04-26T11:27:07.138603+0000","last_clean":"2024-04-26T11:27:07.138603+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:27:07.138603+0000","last_undegraded":"2024-04-26T11:27:07.138603+0000","last_fullsized":"2024-04-26T11:27:07.138603+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'385","last_scrub_stamp":"2024-04-26T11:27:07.138550+0000","last_deep_scrub":"71'385","last_deep_scrub_stamp":"2024-04-26T11:27:07.138550+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.138550+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:51.494043+0000","scrub_duration":0.0046149509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":494,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:02.539257+0000","last_change":"2024-04-26T11:27:02.539472+0000","last_active":"2024-04-26T11:27:02.539257+0000","last_peered":"2024-04-26T11:27:02.539257+0000","last_clean":"2024-04-26T11:27:02.539257+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:27:02.539257+0000","last_undegraded":"2024-04-26T11:27:02.539257+0000","last_fullsized":"2024-04-26T11:27:02.539257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_clean_scrub_stamp":"2024-04-26T11:27:02.539206+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:43.230821+0000","scrub_duration":0.003815648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":550,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:18.484587+0000","last_change":"2024-04-26T11:27:18.484810+0000","last_active":"2024-04-26T11:27:18.484587+0000","last_peered":"2024-04-26T11:27:18.484587+0000","last_clean":"2024-04-26T11:27:18.484587+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:27:18.484587+0000","last_undegraded":"2024-04-26T11:27:18.484587+0000","last_fullsized":"2024-04-26T11:27:18.484587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'431","last_scrub_stamp":"2024-04-26T11:27:18.484532+0000","last_deep_scrub":"71'431","last_deep_scrub_stamp":"2024-04-26T11:27:18.484532+0000","last_clean_scrub_stamp":"2024-04-26T11:27:18.484532+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:43.402024+0000","scrub_duration":0.0042561730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":615,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.393743+0000","last_change":"2024-04-26T11:26:54.393969+0000","last_active":"2024-04-26T11:26:54.393743+0000","last_peered":"2024-04-26T11:26:54.393743+0000","last_clean":"2024-04-26T11:26:54.393743+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:54.393743+0000","last_undegraded":"2024-04-26T11:26:54.393743+0000","last_fullsized":"2024-04-26T11:26:54.393743+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'453","last_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_deep_scrub":"71'453","last_deep_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.393690+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:41.730233+0000","scrub_duration":0.0038895330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":589,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:51.960476+0000","last_change":"2024-04-26T11:26:51.960725+0000","last_active":"2024-04-26T11:26:51.960476+0000","last_peered":"2024-04-26T11:26:51.960476+0000","last_clean":"2024-04-26T11:26:51.960476+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:51.960476+0000","last_undegraded":"2024-04-26T11:26:51.960476+0000","last_fullsized":"2024-04-26T11:26:51.960476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_clean_scrub_stamp":"2024-04-26T11:26:51.960424+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:17.833759+0000","scrub_duration":0.0043861689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":585,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375318+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:41.375318+0000","last_peered":"2024-04-26T11:26:41.375318+0000","last_clean":"2024-04-26T11:26:41.375318+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:41.375318+0000","last_undegraded":"2024-04-26T11:26:41.375318+0000","last_fullsized":"2024-04-26T11:26:41.375318+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":635,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.965160+0000","last_change":"2024-04-26T11:27:15.965379+0000","last_active":"2024-04-26T11:27:15.965160+0000","last_peered":"2024-04-26T11:27:15.965160+0000","last_clean":"2024-04-26T11:27:15.965160+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:27:15.965160+0000","last_undegraded":"2024-04-26T11:27:15.965160+0000","last_fullsized":"2024-04-26T11:27:15.965160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-26T11:27:15.965105+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-26T11:27:15.965105+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.965105+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:02.906065+0000","scrub_duration":0.0046149279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":612,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894527+0000","last_change":"2024-04-26T11:26:29.907661+0000","last_active":"2024-04-26T11:26:40.894527+0000","last_peered":"2024-04-26T11:26:40.894527+0000","last_clean":"2024-04-26T11:26:40.894527+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:26:40.894527+0000","last_undegraded":"2024-04-26T11:26:40.894527+0000","last_fullsized":"2024-04-26T11:26:40.894527+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":550,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893719+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:40.893719+0000","last_peered":"2024-04-26T11:26:40.893719+0000","last_clean":"2024-04-26T11:26:40.893719+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:40.893719+0000","last_undegraded":"2024-04-26T11:26:40.893719+0000","last_fullsized":"2024-04-26T11:26:40.893719+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":979,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373779+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:41.373779+0000","last_peered":"2024-04-26T11:26:41.373779+0000","last_clean":"2024-04-26T11:26:41.373779+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:41.373779+0000","last_undegraded":"2024-04-26T11:26:41.373779+0000","last_fullsized":"2024-04-26T11:26:41.373779+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":933,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.371879+0000","last_change":"2024-04-26T11:26:20.377951+0000","last_active":"2024-04-26T11:26:41.371879+0000","last_peered":"2024-04-26T11:26:41.371879+0000","last_clean":"2024-04-26T11:26:41.371879+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:26:41.371879+0000","last_undegraded":"2024-04-26T11:26:41.371879+0000","last_fullsized":"2024-04-26T11:26:41.371879+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":527,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.097877+0000","last_change":"2024-04-26T11:26:58.098112+0000","last_active":"2024-04-26T11:26:58.097877+0000","last_peered":"2024-04-26T11:26:58.097877+0000","last_clean":"2024-04-26T11:26:58.097877+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:58.097877+0000","last_undegraded":"2024-04-26T11:26:58.097877+0000","last_fullsized":"2024-04-26T11:26:58.097877+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'433","last_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_deep_scrub":"71'433","last_deep_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.097826+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:39.261277+0000","scrub_duration":0.0045929860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":949,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375583+0000","last_change":"2024-04-26T11:26:31.395767+0000","last_active":"2024-04-26T11:26:41.375583+0000","last_peered":"2024-04-26T11:26:41.375583+0000","last_clean":"2024-04-26T11:26:41.375583+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:26:41.375583+0000","last_undegraded":"2024-04-26T11:26:41.375583+0000","last_fullsized":"2024-04-26T11:26:41.375583+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1066,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:11.020271+0000","last_change":"2024-04-26T11:27:11.020512+0000","last_active":"2024-04-26T11:27:11.020271+0000","last_peered":"2024-04-26T11:27:11.020271+0000","last_clean":"2024-04-26T11:27:11.020271+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:27:11.020271+0000","last_undegraded":"2024-04-26T11:27:11.020271+0000","last_fullsized":"2024-04-26T11:27:11.020271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-26T11:27:11.020208+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-26T11:27:11.020208+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.020208+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:49.564877+0000","scrub_duration":0.0040859049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":559,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895562+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:40.895562+0000","last_peered":"2024-04-26T11:26:40.895562+0000","last_clean":"2024-04-26T11:26:40.895562+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:40.895562+0000","last_undegraded":"2024-04-26T11:26:40.895562+0000","last_fullsized":"2024-04-26T11:26:40.895562+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":952,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374743+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:41.374743+0000","last_peered":"2024-04-26T11:26:41.374743+0000","last_clean":"2024-04-26T11:26:41.374743+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:41.374743+0000","last_undegraded":"2024-04-26T11:26:41.374743+0000","last_fullsized":"2024-04-26T11:26:41.374743+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":509,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372856+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:41.372856+0000","last_peered":"2024-04-26T11:26:41.372856+0000","last_clean":"2024-04-26T11:26:41.372856+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:41.372856+0000","last_undegraded":"2024-04-26T11:26:41.372856+0000","last_fullsized":"2024-04-26T11:26:41.372856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":1040,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:09.107060+0000","last_change":"2024-04-26T11:27:09.107336+0000","last_active":"2024-04-26T11:27:09.107060+0000","last_peered":"2024-04-26T11:27:09.107060+0000","last_clean":"2024-04-26T11:27:09.107060+0000","last_became_active":"2024-04-26T11:26:38.373963+0000","last_became_peered":"2024-04-26T11:26:38.373963+0000","last_unstale":"2024-04-26T11:27:09.107060+0000","last_undegraded":"2024-04-26T11:27:09.107060+0000","last_fullsized":"2024-04-26T11:27:09.107060+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'461","last_scrub_stamp":"2024-04-26T11:27:09.107005+0000","last_deep_scrub":"71'461","last_deep_scrub_stamp":"2024-04-26T11:27:09.107005+0000","last_clean_scrub_stamp":"2024-04-26T11:27:09.107005+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:02.026982+0000","scrub_duration":0.0039544200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":629,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372005+0000","last_change":"2024-04-26T11:22:40.572558+0000","last_active":"2024-04-26T11:26:41.372005+0000","last_peered":"2024-04-26T11:26:41.372005+0000","last_clean":"2024-04-26T11:26:41.372005+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:26:41.372005+0000","last_undegraded":"2024-04-26T11:26:41.372005+0000","last_fullsized":"2024-04-26T11:26:41.372005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:17.444221+0000","last_change":"2024-04-26T11:27:17.444506+0000","last_active":"2024-04-26T11:27:17.444221+0000","last_peered":"2024-04-26T11:27:17.444221+0000","last_clean":"2024-04-26T11:27:17.444221+0000","last_became_active":"2024-04-26T11:26:40.895623+0000","last_became_peered":"2024-04-26T11:26:40.895623+0000","last_unstale":"2024-04-26T11:27:17.444221+0000","last_undegraded":"2024-04-26T11:27:17.444221+0000","last_fullsized":"2024-04-26T11:27:17.444221+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'424","last_scrub_stamp":"2024-04-26T11:27:17.444171+0000","last_deep_scrub":"71'424","last_deep_scrub_stamp":"2024-04-26T11:27:17.444171+0000","last_clean_scrub_stamp":"2024-04-26T11:27:17.444171+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:49.762789+0000","scrub_duration":0.0037779910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":497,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:50.003786+0000","last_change":"2024-04-26T11:26:50.004040+0000","last_active":"2024-04-26T11:26:50.003786+0000","last_peered":"2024-04-26T11:26:50.003786+0000","last_clean":"2024-04-26T11:26:50.003786+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:50.003786+0000","last_undegraded":"2024-04-26T11:26:50.003786+0000","last_fullsized":"2024-04-26T11:26:50.003786+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_clean_scrub_stamp":"2024-04-26T11:26:50.003733+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:47.677731+0000","scrub_duration":0.0047410569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"106'475","reported_seq":566,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:06.503180+0000","last_change":"2024-04-26T11:27:06.503394+0000","last_active":"2024-04-26T11:27:06.503180+0000","last_peered":"2024-04-26T11:27:06.503180+0000","last_clean":"2024-04-26T11:27:06.503180+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:27:06.503180+0000","last_undegraded":"2024-04-26T11:27:06.503180+0000","last_fullsized":"2024-04-26T11:27:06.503180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'475","last_scrub_stamp":"2024-04-26T11:27:06.503128+0000","last_deep_scrub":"106'475","last_deep_scrub_stamp":"2024-04-26T11:27:06.503128+0000","last_clean_scrub_stamp":"2024-04-26T11:27:06.503128+0000","objects_scrubbed":4,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:30.876920+0000","scrub_duration":0.042185009000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":506,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375083+0000","last_change":"2024-04-26T11:26:22.404426+0000","last_active":"2024-04-26T11:26:41.375083+0000","last_peered":"2024-04-26T11:26:41.375083+0000","last_clean":"2024-04-26T11:26:41.375083+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:26:41.375083+0000","last_undegraded":"2024-04-26T11:26:41.375083+0000","last_fullsized":"2024-04-26T11:26:41.375083+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":177,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372790+0000","last_change":"2024-04-26T11:26:11.615782+0000","last_active":"2024-04-26T11:26:41.372790+0000","last_peered":"2024-04-26T11:26:41.372790+0000","last_clean":"2024-04-26T11:26:41.372790+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:26:41.372790+0000","last_undegraded":"2024-04-26T11:26:41.372790+0000","last_fullsized":"2024-04-26T11:26:41.372790+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":999,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498440+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:46.498440+0000","last_peered":"2024-04-26T11:26:46.498440+0000","last_clean":"2024-04-26T11:26:46.498440+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:46.498440+0000","last_undegraded":"2024-04-26T11:26:46.498440+0000","last_fullsized":"2024-04-26T11:26:46.498440+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:00.101549+0000","last_change":"2024-04-26T11:27:00.101771+0000","last_active":"2024-04-26T11:27:00.101549+0000","last_peered":"2024-04-26T11:27:00.101549+0000","last_clean":"2024-04-26T11:27:00.101549+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:27:00.101549+0000","last_undegraded":"2024-04-26T11:27:00.101549+0000","last_fullsized":"2024-04-26T11:27:00.101549+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'72","last_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_deep_scrub":"70'72","last_deep_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_clean_scrub_stamp":"2024-04-26T11:27:00.101498+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:38.755366+0000","scrub_duration":0.0029441889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":950,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.915251+0000","last_change":"2024-04-26T11:27:03.915526+0000","last_active":"2024-04-26T11:27:03.915251+0000","last_peered":"2024-04-26T11:27:03.915251+0000","last_clean":"2024-04-26T11:27:03.915251+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:27:03.915251+0000","last_undegraded":"2024-04-26T11:27:03.915251+0000","last_fullsized":"2024-04-26T11:27:03.915251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'411","last_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_deep_scrub":"71'411","last_deep_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.915200+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:44.598651+0000","scrub_duration":0.0040090890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"71'72","reported_seq":53,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.892424+0000","last_change":"2024-04-26T11:26:11.130695+0000","last_active":"2024-04-26T11:26:40.892424+0000","last_peered":"2024-04-26T11:26:40.892424+0000","last_clean":"2024-04-26T11:26:40.892424+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:26:40.892424+0000","last_undegraded":"2024-04-26T11:26:40.892424+0000","last_fullsized":"2024-04-26T11:26:40.892424+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"106'164","reported_seq":256,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:08.511478+0000","last_change":"2024-04-26T11:27:08.511702+0000","last_active":"2024-04-26T11:27:08.511478+0000","last_peered":"2024-04-26T11:27:08.511478+0000","last_clean":"2024-04-26T11:27:08.511478+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:27:08.511478+0000","last_undegraded":"2024-04-26T11:27:08.511478+0000","last_fullsized":"2024-04-26T11:27:08.511478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'164","last_scrub_stamp":"2024-04-26T11:27:08.511426+0000","last_deep_scrub":"106'164","last_deep_scrub_stamp":"2024-04-26T11:27:08.511426+0000","last_clean_scrub_stamp":"2024-04-26T11:27:08.511426+0000","objects_scrubbed":2,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:26.618845+0000","scrub_duration":0.024844353999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":877,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373303+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:41.373303+0000","last_peered":"2024-04-26T11:26:41.373303+0000","last_clean":"2024-04-26T11:26:41.373303+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:41.373303+0000","last_undegraded":"2024-04-26T11:26:41.373303+0000","last_fullsized":"2024-04-26T11:26:41.373303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"70'275","reported_seq":402,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375603+0000","last_change":"2024-04-26T11:26:14.614424+0000","last_active":"2024-04-26T11:26:41.375603+0000","last_peered":"2024-04-26T11:26:41.375603+0000","last_clean":"2024-04-26T11:26:41.375603+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:26:41.375603+0000","last_undegraded":"2024-04-26T11:26:41.375603+0000","last_fullsized":"2024-04-26T11:26:41.375603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":592,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.044886+0000","last_change":"2024-04-26T11:26:54.045110+0000","last_active":"2024-04-26T11:26:54.044886+0000","last_peered":"2024-04-26T11:26:54.044886+0000","last_clean":"2024-04-26T11:26:54.044886+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:54.044886+0000","last_undegraded":"2024-04-26T11:26:54.044886+0000","last_fullsized":"2024-04-26T11:26:54.044886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'455","last_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_deep_scrub":"71'455","last_deep_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.044831+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:23.986621+0000","scrub_duration":0.0050259290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"106'567","reported_seq":659,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.588175+0000","last_change":"2024-04-26T11:27:01.588510+0000","last_active":"2024-04-26T11:27:01.588175+0000","last_peered":"2024-04-26T11:27:01.588175+0000","last_clean":"2024-04-26T11:27:01.588175+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:27:01.588175+0000","last_undegraded":"2024-04-26T11:27:01.588175+0000","last_fullsized":"2024-04-26T11:27:01.588175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'567","last_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_deep_scrub":"106'567","last_deep_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.588061+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:05.825620+0000","scrub_duration":0.031697134000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":531,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893616+0000","last_change":"2024-04-26T11:26:39.905388+0000","last_active":"2024-04-26T11:26:40.893616+0000","last_peered":"2024-04-26T11:26:40.893616+0000","last_clean":"2024-04-26T11:26:40.893616+0000","last_became_active":"2024-04-26T11:26:39.900162+0000","last_became_peered":"2024-04-26T11:26:39.900162+0000","last_unstale":"2024-04-26T11:26:40.893616+0000","last_undegraded":"2024-04-26T11:26:40.893616+0000","last_fullsized":"2024-04-26T11:26:40.893616+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894227+0000","last_change":"2024-04-26T11:26:11.128778+0000","last_active":"2024-04-26T11:26:40.894227+0000","last_peered":"2024-04-26T11:26:40.894227+0000","last_clean":"2024-04-26T11:26:40.894227+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:26:40.894227+0000","last_undegraded":"2024-04-26T11:26:40.894227+0000","last_fullsized":"2024-04-26T11:26:40.894227+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":970,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:05.965271+0000","last_change":"2024-04-26T11:27:05.965500+0000","last_active":"2024-04-26T11:27:05.965271+0000","last_peered":"2024-04-26T11:27:05.965271+0000","last_clean":"2024-04-26T11:27:05.965271+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:27:05.965271+0000","last_undegraded":"2024-04-26T11:27:05.965271+0000","last_fullsized":"2024-04-26T11:27:05.965271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_clean_scrub_stamp":"2024-04-26T11:27:05.965214+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:34:49.834938+0000","scrub_duration":0.0039580659999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":311,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373199+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:41.373199+0000","last_peered":"2024-04-26T11:26:41.373199+0000","last_clean":"2024-04-26T11:26:41.373199+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:41.373199+0000","last_undegraded":"2024-04-26T11:26:41.373199+0000","last_fullsized":"2024-04-26T11:26:41.373199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":528,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894748+0000","last_change":"2024-04-26T11:26:35.931909+0000","last_active":"2024-04-26T11:26:40.894748+0000","last_peered":"2024-04-26T11:26:40.894748+0000","last_clean":"2024-04-26T11:26:40.894748+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:26:40.894748+0000","last_undegraded":"2024-04-26T11:26:40.894748+0000","last_fullsized":"2024-04-26T11:26:40.894748+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"70'223","reported_seq":296,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.892704+0000","last_change":"2024-04-26T11:26:14.130026+0000","last_active":"2024-04-26T11:26:40.892704+0000","last_peered":"2024-04-26T11:26:40.892704+0000","last_clean":"2024-04-26T11:26:40.892704+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:26:40.892704+0000","last_undegraded":"2024-04-26T11:26:40.892704+0000","last_fullsized":"2024-04-26T11:26:40.892704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":472,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895021+0000","last_change":"2024-04-26T11:26:26.894647+0000","last_active":"2024-04-26T11:26:40.895021+0000","last_peered":"2024-04-26T11:26:40.895021+0000","last_clean":"2024-04-26T11:26:40.895021+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:26:40.895021+0000","last_undegraded":"2024-04-26T11:26:40.895021+0000","last_fullsized":"2024-04-26T11:26:40.895021+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":152,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373797+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:41.373797+0000","last_peered":"2024-04-26T11:26:41.373797+0000","last_clean":"2024-04-26T11:26:41.373797+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:41.373797+0000","last_undegraded":"2024-04-26T11:26:41.373797+0000","last_fullsized":"2024-04-26T11:26:41.373797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":458,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:05.437065+0000","last_change":"2024-04-26T11:27:05.437300+0000","last_active":"2024-04-26T11:27:05.437065+0000","last_peered":"2024-04-26T11:27:05.437065+0000","last_clean":"2024-04-26T11:27:05.437065+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:27:05.437065+0000","last_undegraded":"2024-04-26T11:27:05.437065+0000","last_fullsized":"2024-04-26T11:27:05.437065+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'359","last_scrub_stamp":"2024-04-26T11:27:05.437012+0000","last_deep_scrub":"71'359","last_deep_scrub_stamp":"2024-04-26T11:27:05.437012+0000","last_clean_scrub_stamp":"2024-04-26T11:27:05.437012+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.035867+0000","scrub_duration":0.0040043329999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"106'360","reported_seq":365,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:26.055820+0000","last_change":"2024-04-26T11:27:26.056052+0000","last_active":"2024-04-26T11:27:26.055820+0000","last_peered":"2024-04-26T11:27:26.055820+0000","last_clean":"2024-04-26T11:27:26.055820+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:27:26.055820+0000","last_undegraded":"2024-04-26T11:27:26.055820+0000","last_fullsized":"2024-04-26T11:27:26.055820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'360","last_scrub_stamp":"2024-04-26T11:27:26.055763+0000","last_deep_scrub":"106'360","last_deep_scrub_stamp":"2024-04-26T11:27:26.055763+0000","last_clean_scrub_stamp":"2024-04-26T11:27:26.055763+0000","objects_scrubbed":1,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:24.969559+0000","scrub_duration":0.033125239000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":565,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.907340+0000","last_change":"2024-04-26T11:27:01.907573+0000","last_active":"2024-04-26T11:27:01.907340+0000","last_peered":"2024-04-26T11:27:01.907340+0000","last_clean":"2024-04-26T11:27:01.907340+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:27:01.907340+0000","last_undegraded":"2024-04-26T11:27:01.907340+0000","last_fullsized":"2024-04-26T11:27:01.907340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.907287+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:00.821083+0000","scrub_duration":0.0045510610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":248,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.892147+0000","last_change":"2024-04-26T11:26:11.130656+0000","last_active":"2024-04-26T11:26:40.892147+0000","last_peered":"2024-04-26T11:26:40.892147+0000","last_clean":"2024-04-26T11:26:40.892147+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:26:40.892147+0000","last_undegraded":"2024-04-26T11:26:40.892147+0000","last_fullsized":"2024-04-26T11:26:40.892147+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:42.211238+0000","last_clean_scrub_stamp":"2024-04-26T11:21:42.211238+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:14.398167+0000","last_change":"2024-04-26T11:27:14.398442+0000","last_active":"2024-04-26T11:27:14.398167+0000","last_peered":"2024-04-26T11:27:14.398167+0000","last_clean":"2024-04-26T11:27:14.398167+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:27:14.398167+0000","last_undegraded":"2024-04-26T11:27:14.398167+0000","last_fullsized":"2024-04-26T11:27:14.398167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:14.398118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:14.398118+0000","last_clean_scrub_stamp":"2024-04-26T11:27:14.398118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:26.192505+0000","scrub_duration":0.0032486720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":852,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373222+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:41.373222+0000","last_peered":"2024-04-26T11:26:41.373222+0000","last_clean":"2024-04-26T11:26:41.373222+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:41.373222+0000","last_undegraded":"2024-04-26T11:26:41.373222+0000","last_fullsized":"2024-04-26T11:26:41.373222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":515,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895391+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:40.895391+0000","last_peered":"2024-04-26T11:26:40.895391+0000","last_clean":"2024-04-26T11:26:40.895391+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:40.895391+0000","last_undegraded":"2024-04-26T11:26:40.895391+0000","last_fullsized":"2024-04-26T11:26:40.895391+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.409683+0000","last_change":"2024-04-26T11:27:15.409932+0000","last_active":"2024-04-26T11:27:15.409683+0000","last_peered":"2024-04-26T11:27:15.409683+0000","last_clean":"2024-04-26T11:27:15.409683+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:27:15.409683+0000","last_undegraded":"2024-04-26T11:27:15.409683+0000","last_fullsized":"2024-04-26T11:27:15.409683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:15.409633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:15.409633+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.409633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:38.286104+0000","scrub_duration":0.0031725590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":293,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372609+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:41.372609+0000","last_peered":"2024-04-26T11:26:41.372609+0000","last_clean":"2024-04-26T11:26:41.372609+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:41.372609+0000","last_undegraded":"2024-04-26T11:26:41.372609+0000","last_fullsized":"2024-04-26T11:26:41.372609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":574,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:22.039392+0000","last_change":"2024-04-26T11:27:22.039648+0000","last_active":"2024-04-26T11:27:22.039392+0000","last_peered":"2024-04-26T11:27:22.039392+0000","last_clean":"2024-04-26T11:27:22.039392+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:27:22.039392+0000","last_undegraded":"2024-04-26T11:27:22.039392+0000","last_fullsized":"2024-04-26T11:27:22.039392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'444","last_scrub_stamp":"2024-04-26T11:27:22.039342+0000","last_deep_scrub":"71'444","last_deep_scrub_stamp":"2024-04-26T11:27:22.039342+0000","last_clean_scrub_stamp":"2024-04-26T11:27:22.039342+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:51.178326+0000","scrub_duration":0.0046559649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":105,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372847+0000","last_change":"2024-04-26T11:21:49.292381+0000","last_active":"2024-04-26T11:26:41.372847+0000","last_peered":"2024-04-26T11:26:41.372847+0000","last_clean":"2024-04-26T11:26:41.372847+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:26:41.372847+0000","last_undegraded":"2024-04-26T11:26:41.372847+0000","last_fullsized":"2024-04-26T11:26:41.372847+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":483,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373584+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:41.373584+0000","last_peered":"2024-04-26T11:26:41.373584+0000","last_clean":"2024-04-26T11:26:41.373584+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:41.373584+0000","last_undegraded":"2024-04-26T11:26:41.373584+0000","last_fullsized":"2024-04-26T11:26:41.373584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":465,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:13.017518+0000","last_change":"2024-04-26T11:27:13.017795+0000","last_active":"2024-04-26T11:27:13.017518+0000","last_peered":"2024-04-26T11:27:13.017518+0000","last_clean":"2024-04-26T11:27:13.017518+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:27:13.017518+0000","last_undegraded":"2024-04-26T11:27:13.017518+0000","last_fullsized":"2024-04-26T11:27:13.017518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'334","last_scrub_stamp":"2024-04-26T11:27:13.017468+0000","last_deep_scrub":"71'334","last_deep_scrub_stamp":"2024-04-26T11:27:13.017468+0000","last_clean_scrub_stamp":"2024-04-26T11:27:13.017468+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:48.346628+0000","scrub_duration":0.0044577050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.892457+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:40.892457+0000","last_peered":"2024-04-26T11:26:40.892457+0000","last_clean":"2024-04-26T11:26:40.892457+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:40.892457+0000","last_undegraded":"2024-04-26T11:26:40.892457+0000","last_fullsized":"2024-04-26T11:26:40.892457+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893014+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:40.893014+0000","last_peered":"2024-04-26T11:26:40.893014+0000","last_clean":"2024-04-26T11:26:40.893014+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:40.893014+0000","last_undegraded":"2024-04-26T11:26:40.893014+0000","last_fullsized":"2024-04-26T11:26:40.893014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":574,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:22.966742+0000","last_change":"2024-04-26T11:27:22.966985+0000","last_active":"2024-04-26T11:27:22.966742+0000","last_peered":"2024-04-26T11:27:22.966742+0000","last_clean":"2024-04-26T11:27:22.966742+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:27:22.966742+0000","last_undegraded":"2024-04-26T11:27:22.966742+0000","last_fullsized":"2024-04-26T11:27:22.966742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-26T11:27:22.966689+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-26T11:27:22.966689+0000","last_clean_scrub_stamp":"2024-04-26T11:27:22.966689+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:56.913479+0000","scrub_duration":0.0049556590000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":571,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894557+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:40.894557+0000","last_peered":"2024-04-26T11:26:40.894557+0000","last_clean":"2024-04-26T11:26:40.894557+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:40.894557+0000","last_undegraded":"2024-04-26T11:26:40.894557+0000","last_fullsized":"2024-04-26T11:26:40.894557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":102,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373833+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:41.373833+0000","last_peered":"2024-04-26T11:26:41.373833+0000","last_clean":"2024-04-26T11:26:41.373833+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:41.373833+0000","last_undegraded":"2024-04-26T11:26:41.373833+0000","last_fullsized":"2024-04-26T11:26:41.373833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":793,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374572+0000","last_change":"2024-04-26T11:26:35.389500+0000","last_active":"2024-04-26T11:26:41.374572+0000","last_peered":"2024-04-26T11:26:41.374572+0000","last_clean":"2024-04-26T11:26:41.374572+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:26:41.374572+0000","last_undegraded":"2024-04-26T11:26:41.374572+0000","last_fullsized":"2024-04-26T11:26:41.374572+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373693+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:41.373693+0000","last_peered":"2024-04-26T11:26:41.373693+0000","last_clean":"2024-04-26T11:26:41.373693+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:41.373693+0000","last_undegraded":"2024-04-26T11:26:41.373693+0000","last_fullsized":"2024-04-26T11:26:41.373693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375446+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:41.375446+0000","last_peered":"2024-04-26T11:26:41.375446+0000","last_clean":"2024-04-26T11:26:41.375446+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:41.375446+0000","last_undegraded":"2024-04-26T11:26:41.375446+0000","last_fullsized":"2024-04-26T11:26:41.375446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":829,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:21.037998+0000","last_change":"2024-04-26T11:27:21.038232+0000","last_active":"2024-04-26T11:27:21.037998+0000","last_peered":"2024-04-26T11:27:21.037998+0000","last_clean":"2024-04-26T11:27:21.037998+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:27:21.037998+0000","last_undegraded":"2024-04-26T11:27:21.037998+0000","last_fullsized":"2024-04-26T11:27:21.037998+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'376","last_scrub_stamp":"2024-04-26T11:27:21.037943+0000","last_deep_scrub":"71'376","last_deep_scrub_stamp":"2024-04-26T11:27:21.037943+0000","last_clean_scrub_stamp":"2024-04-26T11:27:21.037943+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.198741+0000","scrub_duration":0.0040199060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374564+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:41.374564+0000","last_peered":"2024-04-26T11:26:41.374564+0000","last_clean":"2024-04-26T11:26:41.374564+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:41.374564+0000","last_undegraded":"2024-04-26T11:26:41.374564+0000","last_fullsized":"2024-04-26T11:26:41.374564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374508+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:41.374508+0000","last_peered":"2024-04-26T11:26:41.374508+0000","last_clean":"2024-04-26T11:26:41.374508+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:41.374508+0000","last_undegraded":"2024-04-26T11:26:41.374508+0000","last_fullsized":"2024-04-26T11:26:41.374508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":927,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372921+0000","last_change":"2024-04-26T11:26:39.378496+0000","last_active":"2024-04-26T11:26:41.372921+0000","last_peered":"2024-04-26T11:26:41.372921+0000","last_clean":"2024-04-26T11:26:41.372921+0000","last_became_active":"2024-04-26T11:26:39.375075+0000","last_became_peered":"2024-04-26T11:26:39.375075+0000","last_unstale":"2024-04-26T11:26:41.372921+0000","last_undegraded":"2024-04-26T11:26:41.372921+0000","last_fullsized":"2024-04-26T11:26:41.372921+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":191,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374422+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:41.374422+0000","last_peered":"2024-04-26T11:26:41.374422+0000","last_clean":"2024-04-26T11:26:41.374422+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:41.374422+0000","last_undegraded":"2024-04-26T11:26:41.374422+0000","last_fullsized":"2024-04-26T11:26:41.374422+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895009+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:40.895009+0000","last_peered":"2024-04-26T11:26:40.895009+0000","last_clean":"2024-04-26T11:26:40.895009+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:40.895009+0000","last_undegraded":"2024-04-26T11:26:40.895009+0000","last_fullsized":"2024-04-26T11:26:40.895009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":931,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373545+0000","last_change":"2024-04-26T11:26:17.364572+0000","last_active":"2024-04-26T11:26:41.373545+0000","last_peered":"2024-04-26T11:26:41.373545+0000","last_clean":"2024-04-26T11:26:41.373545+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:26:41.373545+0000","last_undegraded":"2024-04-26T11:26:41.373545+0000","last_fullsized":"2024-04-26T11:26:41.373545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":524,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:53.400187+0000","last_change":"2024-04-26T11:26:53.400430+0000","last_active":"2024-04-26T11:26:53.400187+0000","last_peered":"2024-04-26T11:26:53.400187+0000","last_clean":"2024-04-26T11:26:53.400187+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:53.400187+0000","last_undegraded":"2024-04-26T11:26:53.400187+0000","last_fullsized":"2024-04-26T11:26:53.400187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'415","last_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_deep_scrub":"71'415","last_deep_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_clean_scrub_stamp":"2024-04-26T11:26:53.400136+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:43.847441+0000","scrub_duration":0.0041863550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":492,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893106+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:40.893106+0000","last_peered":"2024-04-26T11:26:40.893106+0000","last_clean":"2024-04-26T11:26:40.893106+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:40.893106+0000","last_undegraded":"2024-04-26T11:26:40.893106+0000","last_fullsized":"2024-04-26T11:26:40.893106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":568,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:56.983899+0000","last_change":"2024-04-26T11:26:56.984139+0000","last_active":"2024-04-26T11:26:56.983899+0000","last_peered":"2024-04-26T11:26:56.983899+0000","last_clean":"2024-04-26T11:26:56.983899+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:56.983899+0000","last_undegraded":"2024-04-26T11:26:56.983899+0000","last_fullsized":"2024-04-26T11:26:56.983899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'425","last_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_deep_scrub":"71'425","last_deep_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_clean_scrub_stamp":"2024-04-26T11:26:56.983841+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:06.726299+0000","scrub_duration":0.0046040439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.477440+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:46.477440+0000","last_peered":"2024-04-26T11:26:46.477440+0000","last_clean":"2024-04-26T11:26:46.477440+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:46.477440+0000","last_undegraded":"2024-04-26T11:26:46.477440+0000","last_fullsized":"2024-04-26T11:26:46.477440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"70'344","reported_seq":417,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895052+0000","last_change":"2024-04-26T11:26:14.134004+0000","last_active":"2024-04-26T11:26:40.895052+0000","last_peered":"2024-04-26T11:26:40.895052+0000","last_clean":"2024-04-26T11:26:40.895052+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:26:40.895052+0000","last_undegraded":"2024-04-26T11:26:40.895052+0000","last_fullsized":"2024-04-26T11:26:40.895052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":1037,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:57.986343+0000","last_change":"2024-04-26T11:26:57.986559+0000","last_active":"2024-04-26T11:26:57.986343+0000","last_peered":"2024-04-26T11:26:57.986343+0000","last_clean":"2024-04-26T11:26:57.986343+0000","last_became_active":"2024-04-26T11:26:38.373800+0000","last_became_peered":"2024-04-26T11:26:38.373800+0000","last_unstale":"2024-04-26T11:26:57.986343+0000","last_undegraded":"2024-04-26T11:26:57.986343+0000","last_fullsized":"2024-04-26T11:26:57.986343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'468","last_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_deep_scrub":"71'468","last_deep_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_clean_scrub_stamp":"2024-04-26T11:26:57.986292+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:27.125276+0000","scrub_duration":0.0037409510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":167,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498584+0000","last_change":"2024-04-26T11:26:11.605739+0000","last_active":"2024-04-26T11:26:46.498584+0000","last_peered":"2024-04-26T11:26:46.498584+0000","last_clean":"2024-04-26T11:26:46.498584+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:26:46.498584+0000","last_undegraded":"2024-04-26T11:26:46.498584+0000","last_fullsized":"2024-04-26T11:26:46.498584+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":582,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.962038+0000","last_change":"2024-04-26T11:26:58.962297+0000","last_active":"2024-04-26T11:26:58.962038+0000","last_peered":"2024-04-26T11:26:58.962038+0000","last_clean":"2024-04-26T11:26:58.962038+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:58.962038+0000","last_undegraded":"2024-04-26T11:26:58.962038+0000","last_fullsized":"2024-04-26T11:26:58.962038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'454","last_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_deep_scrub":"71'454","last_deep_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.961980+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:21.020921+0000","scrub_duration":0.0044732579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":804,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:23.050748+0000","last_change":"2024-04-26T11:27:23.051045+0000","last_active":"2024-04-26T11:27:23.050748+0000","last_peered":"2024-04-26T11:27:23.050748+0000","last_clean":"2024-04-26T11:27:23.050748+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:27:23.050748+0000","last_undegraded":"2024-04-26T11:27:23.050748+0000","last_fullsized":"2024-04-26T11:27:23.050748+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'352","last_scrub_stamp":"2024-04-26T11:27:23.050694+0000","last_deep_scrub":"71'352","last_deep_scrub_stamp":"2024-04-26T11:27:23.050694+0000","last_clean_scrub_stamp":"2024-04-26T11:27:23.050694+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:45.109635+0000","scrub_duration":0.0037690789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"70'587","reported_seq":689,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498107+0000","last_change":"2024-04-26T11:21:53.327923+0000","last_active":"2024-04-26T11:26:46.498107+0000","last_peered":"2024-04-26T11:26:46.498107+0000","last_clean":"2024-04-26T11:26:46.498107+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:26:46.498107+0000","last_undegraded":"2024-04-26T11:26:46.498107+0000","last_fullsized":"2024-04-26T11:26:46.498107+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":587,"log_dups_size":0,"ondisk_log_size":587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":923,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374034+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:41.374034+0000","last_peered":"2024-04-26T11:26:41.374034+0000","last_clean":"2024-04-26T11:26:41.374034+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:41.374034+0000","last_undegraded":"2024-04-26T11:26:41.374034+0000","last_fullsized":"2024-04-26T11:26:41.374034+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":396,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498182+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:46.498182+0000","last_peered":"2024-04-26T11:26:46.498182+0000","last_clean":"2024-04-26T11:26:46.498182+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:46.498182+0000","last_undegraded":"2024-04-26T11:26:46.498182+0000","last_fullsized":"2024-04-26T11:26:46.498182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1029,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.080170+0000","last_change":"2024-04-26T11:27:15.080408+0000","last_active":"2024-04-26T11:27:15.080170+0000","last_peered":"2024-04-26T11:27:15.080170+0000","last_clean":"2024-04-26T11:27:15.080170+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:27:15.080170+0000","last_undegraded":"2024-04-26T11:27:15.080170+0000","last_fullsized":"2024-04-26T11:27:15.080170+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'439","last_scrub_stamp":"2024-04-26T11:27:15.080115+0000","last_deep_scrub":"71'439","last_deep_scrub_stamp":"2024-04-26T11:27:15.080115+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.080115+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:37.378024+0000","scrub_duration":0.0040451460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":432,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374388+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:41.374388+0000","last_peered":"2024-04-26T11:26:41.374388+0000","last_clean":"2024-04-26T11:26:41.374388+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:41.374388+0000","last_undegraded":"2024-04-26T11:26:41.374388+0000","last_fullsized":"2024-04-26T11:26:41.374388+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:52.009464+0000","last_change":"2024-04-26T11:26:52.009713+0000","last_active":"2024-04-26T11:26:52.009464+0000","last_peered":"2024-04-26T11:26:52.009464+0000","last_clean":"2024-04-26T11:26:52.009464+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:52.009464+0000","last_undegraded":"2024-04-26T11:26:52.009464+0000","last_fullsized":"2024-04-26T11:26:52.009464+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_clean_scrub_stamp":"2024-04-26T11:26:52.009412+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:59.423751+0000","scrub_duration":0.0045503360000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":154,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:49.880095+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:49.880095+0000","last_peered":"2024-04-26T11:26:49.880095+0000","last_clean":"2024-04-26T11:26:49.880095+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:49.880095+0000","last_undegraded":"2024-04-26T11:26:49.880095+0000","last_fullsized":"2024-04-26T11:26:49.880095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":487,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.491082+0000","last_change":"2024-04-26T11:27:03.491361+0000","last_active":"2024-04-26T11:27:03.491082+0000","last_peered":"2024-04-26T11:27:03.491082+0000","last_clean":"2024-04-26T11:27:03.491082+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:27:03.491082+0000","last_undegraded":"2024-04-26T11:27:03.491082+0000","last_fullsized":"2024-04-26T11:27:03.491082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'375","last_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_deep_scrub":"71'375","last_deep_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.491032+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:52.444748+0000","scrub_duration":0.0043129789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":405,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893932+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:40.893932+0000","last_peered":"2024-04-26T11:26:40.893932+0000","last_clean":"2024-04-26T11:26:40.893932+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:40.893932+0000","last_undegraded":"2024-04-26T11:26:40.893932+0000","last_fullsized":"2024-04-26T11:26:40.893932+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":503,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:09.525104+0000","last_change":"2024-04-26T11:27:09.525341+0000","last_active":"2024-04-26T11:27:09.525104+0000","last_peered":"2024-04-26T11:27:09.525104+0000","last_clean":"2024-04-26T11:27:09.525104+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:27:09.525104+0000","last_undegraded":"2024-04-26T11:27:09.525104+0000","last_fullsized":"2024-04-26T11:27:09.525104+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-26T11:27:09.525054+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-26T11:27:09.525054+0000","last_clean_scrub_stamp":"2024-04-26T11:27:09.525054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:30.705220+0000","scrub_duration":0.0044574929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"106'394","reported_seq":514,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:04.167993+0000","last_change":"2024-04-26T11:27:04.168232+0000","last_active":"2024-04-26T11:27:04.167993+0000","last_peered":"2024-04-26T11:27:04.167993+0000","last_clean":"2024-04-26T11:27:04.167993+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:27:04.167993+0000","last_undegraded":"2024-04-26T11:27:04.167993+0000","last_fullsized":"2024-04-26T11:27:04.167993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'394","last_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_deep_scrub":"106'394","last_deep_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_clean_scrub_stamp":"2024-04-26T11:27:04.167933+0000","objects_scrubbed":4,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.292388+0000","scrub_duration":0.059480993000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":499,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373982+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:41.373982+0000","last_peered":"2024-04-26T11:26:41.373982+0000","last_clean":"2024-04-26T11:26:41.373982+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:41.373982+0000","last_undegraded":"2024-04-26T11:26:41.373982+0000","last_fullsized":"2024-04-26T11:26:41.373982+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374207+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:41.374207+0000","last_peered":"2024-04-26T11:26:41.374207+0000","last_clean":"2024-04-26T11:26:41.374207+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:41.374207+0000","last_undegraded":"2024-04-26T11:26:41.374207+0000","last_fullsized":"2024-04-26T11:26:41.374207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":554,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:59.498154+0000","last_change":"2024-04-26T11:26:59.498428+0000","last_active":"2024-04-26T11:26:59.498154+0000","last_peered":"2024-04-26T11:26:59.498154+0000","last_clean":"2024-04-26T11:26:59.498154+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:59.498154+0000","last_undegraded":"2024-04-26T11:26:59.498154+0000","last_fullsized":"2024-04-26T11:26:59.498154+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'446","last_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_deep_scrub":"71'446","last_deep_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_clean_scrub_stamp":"2024-04-26T11:26:59.498100+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:08.316575+0000","scrub_duration":0.003708294,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"106'133","reported_seq":271,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:25.003141+0000","last_change":"2024-04-26T11:27:25.003403+0000","last_active":"2024-04-26T11:27:25.003141+0000","last_peered":"2024-04-26T11:27:25.003141+0000","last_clean":"2024-04-26T11:27:25.003141+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:27:25.003141+0000","last_undegraded":"2024-04-26T11:27:25.003141+0000","last_fullsized":"2024-04-26T11:27:25.003141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'133","last_scrub_stamp":"2024-04-26T11:27:25.003082+0000","last_deep_scrub":"106'133","last_deep_scrub_stamp":"2024-04-26T11:27:25.003082+0000","last_clean_scrub_stamp":"2024-04-26T11:27:25.003082+0000","objects_scrubbed":3,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:32.644341+0000","scrub_duration":0.025665877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7670,"ondisk_log_size":7670,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738442,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142432,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229408,"statfs":{"total":96636764160,"available":96490913792,"internally_reserved":0,"allocated":31744000,"data_stored":81613145,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":1.026},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":1.075}]},{"osd":1,"last update":"Fri Apr 26 11:26:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64000000000000001,"15min":0.65700000000000003},"min":{"1min":0.58799999999999997,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.79500000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63,"15min":0.65800000000000003},"min":{"1min":0.61599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.78400000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.98199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738442,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124348,"kb_used_data":30964,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247492,"statfs":{"total":96636764160,"available":96509431808,"internally_reserved":0,"allocated":31707136,"data_stored":86117265,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64800000000000002,"15min":0.68400000000000005},"min":{"1min":0.60099999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.68400000000000005},"min":{"1min":0.53400000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.64500000000000002}]}]},{"osd":0,"up_from":75,"seq":322122547217,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75932,"kb_used_data":18068,"kb_used_omap":7,"kb_used_meta":57848,"kb_avail":94295908,"statfs":{"total":96636764160,"available":96559009792,"internally_reserved":0,"allocated":18501632,"data_stored":91781533,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":59237367},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:27:31.361 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.361 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.361 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.362 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.362 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.362 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.362 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.362 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.362 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.362 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.363 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.363 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.363 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.363 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.363 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.363 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.363 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.363 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.364 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.364 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.364 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.364 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.364 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.364 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.364 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.364 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.364 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.365 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.365 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.365 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.365 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.365 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T11:21:42.211238+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.366 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.366 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.366 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.366 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.366 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.367 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.367 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.367 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.367 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.367 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.367 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.367 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.367 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.367 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.368 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.368 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.368 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.368 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.368 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.368 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.368 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.368 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.368 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.369 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.369 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.369 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.369 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.369 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.369 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.369 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:31.369 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:27:51.371 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:27:51.682 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:27:51.683 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:27:51.699 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-04-26T11:27:51.477504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7334,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34390,"ondisk_log_size":34390,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":342712,"kb_used_data":80032,"kb_used_omap":10,"kb_used_meta":262645,"kb_avail":282772808,"statfs":{"total":289910292480,"available":289559355392,"internally_reserved":0,"allocated":81952768,"data_stored":259511943,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":268949379},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004055"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":521,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:11.072905+0000","last_change":"2024-04-26T11:27:11.073124+0000","last_active":"2024-04-26T11:27:11.072905+0000","last_peered":"2024-04-26T11:27:11.072905+0000","last_clean":"2024-04-26T11:27:11.072905+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:27:11.072905+0000","last_undegraded":"2024-04-26T11:27:11.072905+0000","last_fullsized":"2024-04-26T11:27:11.072905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:27:11.072854+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:27:11.072854+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.072854+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:41.048439+0000","scrub_duration":0.0036583589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":577,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:16.039167+0000","last_change":"2024-04-26T11:27:16.039433+0000","last_active":"2024-04-26T11:27:16.039167+0000","last_peered":"2024-04-26T11:27:16.039167+0000","last_clean":"2024-04-26T11:27:16.039167+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:27:16.039167+0000","last_undegraded":"2024-04-26T11:27:16.039167+0000","last_fullsized":"2024-04-26T11:27:16.039167+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'427","last_scrub_stamp":"2024-04-26T11:27:16.039112+0000","last_deep_scrub":"71'427","last_deep_scrub_stamp":"2024-04-26T11:27:16.039112+0000","last_clean_scrub_stamp":"2024-04-26T11:27:16.039112+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:41.912448+0000","scrub_duration":0.0051090520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":441,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895857+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:40.895857+0000","last_peered":"2024-04-26T11:26:40.895857+0000","last_clean":"2024-04-26T11:26:40.895857+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:40.895857+0000","last_undegraded":"2024-04-26T11:26:40.895857+0000","last_fullsized":"2024-04-26T11:26:40.895857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":490,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894201+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:40.894201+0000","last_peered":"2024-04-26T11:26:40.894201+0000","last_clean":"2024-04-26T11:26:40.894201+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:40.894201+0000","last_undegraded":"2024-04-26T11:26:40.894201+0000","last_fullsized":"2024-04-26T11:26:40.894201+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":541,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374262+0000","last_change":"2024-04-26T11:26:22.405582+0000","last_active":"2024-04-26T11:26:41.374262+0000","last_peered":"2024-04-26T11:26:41.374262+0000","last_clean":"2024-04-26T11:26:41.374262+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:26:41.374262+0000","last_undegraded":"2024-04-26T11:26:41.374262+0000","last_fullsized":"2024-04-26T11:26:41.374262+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":494,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893513+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:40.893513+0000","last_peered":"2024-04-26T11:26:40.893513+0000","last_clean":"2024-04-26T11:26:40.893513+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:40.893513+0000","last_undegraded":"2024-04-26T11:26:40.893513+0000","last_fullsized":"2024-04-26T11:26:40.893513+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":595,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893161+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:40.893161+0000","last_peered":"2024-04-26T11:26:40.893161+0000","last_clean":"2024-04-26T11:26:40.893161+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:40.893161+0000","last_undegraded":"2024-04-26T11:26:40.893161+0000","last_fullsized":"2024-04-26T11:26:40.893161+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":474,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:04.461767+0000","last_change":"2024-04-26T11:27:04.461975+0000","last_active":"2024-04-26T11:27:04.461767+0000","last_peered":"2024-04-26T11:27:04.461767+0000","last_clean":"2024-04-26T11:27:04.461767+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:27:04.461767+0000","last_undegraded":"2024-04-26T11:27:04.461767+0000","last_fullsized":"2024-04-26T11:27:04.461767+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'373","last_scrub_stamp":"2024-04-26T11:27:04.461717+0000","last_deep_scrub":"71'373","last_deep_scrub_stamp":"2024-04-26T11:27:04.461717+0000","last_clean_scrub_stamp":"2024-04-26T11:27:04.461717+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:24.859328+0000","scrub_duration":0.0041768209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":609,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:23.965512+0000","last_change":"2024-04-26T11:27:23.965730+0000","last_active":"2024-04-26T11:27:23.965512+0000","last_peered":"2024-04-26T11:27:23.965512+0000","last_clean":"2024-04-26T11:27:23.965512+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:27:23.965512+0000","last_undegraded":"2024-04-26T11:27:23.965512+0000","last_fullsized":"2024-04-26T11:27:23.965512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'447","last_scrub_stamp":"2024-04-26T11:27:23.965459+0000","last_deep_scrub":"71'447","last_deep_scrub_stamp":"2024-04-26T11:27:23.965459+0000","last_clean_scrub_stamp":"2024-04-26T11:27:23.965459+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:17.028067+0000","scrub_duration":0.0044560520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":508,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.477487+0000","last_change":"2024-04-26T11:21:53.715497+0000","last_active":"2024-04-26T11:26:46.477487+0000","last_peered":"2024-04-26T11:26:46.477487+0000","last_clean":"2024-04-26T11:26:46.477487+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:26:46.477487+0000","last_undegraded":"2024-04-26T11:26:46.477487+0000","last_fullsized":"2024-04-26T11:26:46.477487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":481,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895738+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:40.895738+0000","last_peered":"2024-04-26T11:26:40.895738+0000","last_clean":"2024-04-26T11:26:40.895738+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:40.895738+0000","last_undegraded":"2024-04-26T11:26:40.895738+0000","last_fullsized":"2024-04-26T11:26:40.895738+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":784,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.477334+0000","last_change":"2024-04-26T11:26:22.387025+0000","last_active":"2024-04-26T11:26:46.477334+0000","last_peered":"2024-04-26T11:26:46.477334+0000","last_clean":"2024-04-26T11:26:46.477334+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:26:46.477334+0000","last_undegraded":"2024-04-26T11:26:46.477334+0000","last_fullsized":"2024-04-26T11:26:46.477334+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":465,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:07.138603+0000","last_change":"2024-04-26T11:27:07.138812+0000","last_active":"2024-04-26T11:27:07.138603+0000","last_peered":"2024-04-26T11:27:07.138603+0000","last_clean":"2024-04-26T11:27:07.138603+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:27:07.138603+0000","last_undegraded":"2024-04-26T11:27:07.138603+0000","last_fullsized":"2024-04-26T11:27:07.138603+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'385","last_scrub_stamp":"2024-04-26T11:27:07.138550+0000","last_deep_scrub":"71'385","last_deep_scrub_stamp":"2024-04-26T11:27:07.138550+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.138550+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:51.494043+0000","scrub_duration":0.0046149509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":494,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:02.539257+0000","last_change":"2024-04-26T11:27:02.539472+0000","last_active":"2024-04-26T11:27:02.539257+0000","last_peered":"2024-04-26T11:27:02.539257+0000","last_clean":"2024-04-26T11:27:02.539257+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:27:02.539257+0000","last_undegraded":"2024-04-26T11:27:02.539257+0000","last_fullsized":"2024-04-26T11:27:02.539257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_clean_scrub_stamp":"2024-04-26T11:27:02.539206+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:43.230821+0000","scrub_duration":0.003815648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":550,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:18.484587+0000","last_change":"2024-04-26T11:27:18.484810+0000","last_active":"2024-04-26T11:27:18.484587+0000","last_peered":"2024-04-26T11:27:18.484587+0000","last_clean":"2024-04-26T11:27:18.484587+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:27:18.484587+0000","last_undegraded":"2024-04-26T11:27:18.484587+0000","last_fullsized":"2024-04-26T11:27:18.484587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'431","last_scrub_stamp":"2024-04-26T11:27:18.484532+0000","last_deep_scrub":"71'431","last_deep_scrub_stamp":"2024-04-26T11:27:18.484532+0000","last_clean_scrub_stamp":"2024-04-26T11:27:18.484532+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:43.402024+0000","scrub_duration":0.0042561730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":615,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.393743+0000","last_change":"2024-04-26T11:26:54.393969+0000","last_active":"2024-04-26T11:26:54.393743+0000","last_peered":"2024-04-26T11:26:54.393743+0000","last_clean":"2024-04-26T11:26:54.393743+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:54.393743+0000","last_undegraded":"2024-04-26T11:26:54.393743+0000","last_fullsized":"2024-04-26T11:26:54.393743+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'453","last_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_deep_scrub":"71'453","last_deep_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.393690+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:41.730233+0000","scrub_duration":0.0038895330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":589,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:51.960476+0000","last_change":"2024-04-26T11:26:51.960725+0000","last_active":"2024-04-26T11:26:51.960476+0000","last_peered":"2024-04-26T11:26:51.960476+0000","last_clean":"2024-04-26T11:26:51.960476+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:51.960476+0000","last_undegraded":"2024-04-26T11:26:51.960476+0000","last_fullsized":"2024-04-26T11:26:51.960476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_clean_scrub_stamp":"2024-04-26T11:26:51.960424+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:17.833759+0000","scrub_duration":0.0043861689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":585,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375318+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:41.375318+0000","last_peered":"2024-04-26T11:26:41.375318+0000","last_clean":"2024-04-26T11:26:41.375318+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:41.375318+0000","last_undegraded":"2024-04-26T11:26:41.375318+0000","last_fullsized":"2024-04-26T11:26:41.375318+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":635,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.965160+0000","last_change":"2024-04-26T11:27:15.965379+0000","last_active":"2024-04-26T11:27:15.965160+0000","last_peered":"2024-04-26T11:27:15.965160+0000","last_clean":"2024-04-26T11:27:15.965160+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:27:15.965160+0000","last_undegraded":"2024-04-26T11:27:15.965160+0000","last_fullsized":"2024-04-26T11:27:15.965160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-26T11:27:15.965105+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-26T11:27:15.965105+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.965105+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:02.906065+0000","scrub_duration":0.0046149279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":623,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:39.660737+0000","last_change":"2024-04-26T11:27:39.660968+0000","last_active":"2024-04-26T11:27:39.660737+0000","last_peered":"2024-04-26T11:27:39.660737+0000","last_clean":"2024-04-26T11:27:39.660737+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:27:39.660737+0000","last_undegraded":"2024-04-26T11:27:39.660737+0000","last_fullsized":"2024-04-26T11:27:39.660737+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'475","last_scrub_stamp":"2024-04-26T11:27:39.660681+0000","last_deep_scrub":"71'475","last_deep_scrub_stamp":"2024-04-26T11:27:39.660681+0000","last_clean_scrub_stamp":"2024-04-26T11:27:39.660681+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:13.243958+0000","scrub_duration":0.0042850270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":550,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893719+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:40.893719+0000","last_peered":"2024-04-26T11:26:40.893719+0000","last_clean":"2024-04-26T11:26:40.893719+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:40.893719+0000","last_undegraded":"2024-04-26T11:26:40.893719+0000","last_fullsized":"2024-04-26T11:26:40.893719+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":979,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373779+0000","last_change":"2024-04-26T11:26:34.386623+0000","last_active":"2024-04-26T11:26:41.373779+0000","last_peered":"2024-04-26T11:26:41.373779+0000","last_clean":"2024-04-26T11:26:41.373779+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:26:41.373779+0000","last_undegraded":"2024-04-26T11:26:41.373779+0000","last_fullsized":"2024-04-26T11:26:41.373779+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":944,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:34.936983+0000","last_change":"2024-04-26T11:27:34.937203+0000","last_active":"2024-04-26T11:27:34.936983+0000","last_peered":"2024-04-26T11:27:34.936983+0000","last_clean":"2024-04-26T11:27:34.936983+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:27:34.936983+0000","last_undegraded":"2024-04-26T11:27:34.936983+0000","last_fullsized":"2024-04-26T11:27:34.936983+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-26T11:27:34.936929+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-26T11:27:34.936929+0000","last_clean_scrub_stamp":"2024-04-26T11:27:34.936929+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:25.920048+0000","scrub_duration":0.0042325840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":527,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.097877+0000","last_change":"2024-04-26T11:26:58.098112+0000","last_active":"2024-04-26T11:26:58.097877+0000","last_peered":"2024-04-26T11:26:58.097877+0000","last_clean":"2024-04-26T11:26:58.097877+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:58.097877+0000","last_undegraded":"2024-04-26T11:26:58.097877+0000","last_fullsized":"2024-04-26T11:26:58.097877+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'433","last_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_deep_scrub":"71'433","last_deep_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.097826+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:39.261277+0000","scrub_duration":0.0045929860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":960,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:35.990373+0000","last_change":"2024-04-26T11:27:35.990604+0000","last_active":"2024-04-26T11:27:35.990373+0000","last_peered":"2024-04-26T11:27:35.990373+0000","last_clean":"2024-04-26T11:27:35.990373+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:27:35.990373+0000","last_undegraded":"2024-04-26T11:27:35.990373+0000","last_fullsized":"2024-04-26T11:27:35.990373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'422","last_scrub_stamp":"2024-04-26T11:27:35.990321+0000","last_deep_scrub":"71'422","last_deep_scrub_stamp":"2024-04-26T11:27:35.990321+0000","last_clean_scrub_stamp":"2024-04-26T11:27:35.990321+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:42.180497+0000","scrub_duration":0.0039948070000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1066,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:11.020271+0000","last_change":"2024-04-26T11:27:11.020512+0000","last_active":"2024-04-26T11:27:11.020271+0000","last_peered":"2024-04-26T11:27:11.020271+0000","last_clean":"2024-04-26T11:27:11.020271+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:27:11.020271+0000","last_undegraded":"2024-04-26T11:27:11.020271+0000","last_fullsized":"2024-04-26T11:27:11.020271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-26T11:27:11.020208+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-26T11:27:11.020208+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.020208+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:49.564877+0000","scrub_duration":0.0040859049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":559,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895562+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:40.895562+0000","last_peered":"2024-04-26T11:26:40.895562+0000","last_clean":"2024-04-26T11:26:40.895562+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:40.895562+0000","last_undegraded":"2024-04-26T11:26:40.895562+0000","last_fullsized":"2024-04-26T11:26:40.895562+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":952,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374743+0000","last_change":"2024-04-26T11:26:26.392116+0000","last_active":"2024-04-26T11:26:41.374743+0000","last_peered":"2024-04-26T11:26:41.374743+0000","last_clean":"2024-04-26T11:26:41.374743+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:26:41.374743+0000","last_undegraded":"2024-04-26T11:26:41.374743+0000","last_fullsized":"2024-04-26T11:26:41.374743+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":509,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372856+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:41.372856+0000","last_peered":"2024-04-26T11:26:41.372856+0000","last_clean":"2024-04-26T11:26:41.372856+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:41.372856+0000","last_undegraded":"2024-04-26T11:26:41.372856+0000","last_fullsized":"2024-04-26T11:26:41.372856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":1040,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:09.107060+0000","last_change":"2024-04-26T11:27:09.107336+0000","last_active":"2024-04-26T11:27:09.107060+0000","last_peered":"2024-04-26T11:27:09.107060+0000","last_clean":"2024-04-26T11:27:09.107060+0000","last_became_active":"2024-04-26T11:26:38.373963+0000","last_became_peered":"2024-04-26T11:26:38.373963+0000","last_unstale":"2024-04-26T11:27:09.107060+0000","last_undegraded":"2024-04-26T11:27:09.107060+0000","last_fullsized":"2024-04-26T11:27:09.107060+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'461","last_scrub_stamp":"2024-04-26T11:27:09.107005+0000","last_deep_scrub":"71'461","last_deep_scrub_stamp":"2024-04-26T11:27:09.107005+0000","last_clean_scrub_stamp":"2024-04-26T11:27:09.107005+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:02.026982+0000","scrub_duration":0.0039544200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":640,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:28.974290+0000","last_change":"2024-04-26T11:27:28.974503+0000","last_active":"2024-04-26T11:27:28.974290+0000","last_peered":"2024-04-26T11:27:28.974290+0000","last_clean":"2024-04-26T11:27:28.974290+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:27:28.974290+0000","last_undegraded":"2024-04-26T11:27:28.974290+0000","last_fullsized":"2024-04-26T11:27:28.974290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'452","last_scrub_stamp":"2024-04-26T11:27:28.974238+0000","last_deep_scrub":"71'452","last_deep_scrub_stamp":"2024-04-26T11:27:28.974238+0000","last_clean_scrub_stamp":"2024-04-26T11:27:28.974238+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:48.460183+0000","scrub_duration":0.0047380240000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:17.444221+0000","last_change":"2024-04-26T11:27:17.444506+0000","last_active":"2024-04-26T11:27:17.444221+0000","last_peered":"2024-04-26T11:27:17.444221+0000","last_clean":"2024-04-26T11:27:17.444221+0000","last_became_active":"2024-04-26T11:26:40.895623+0000","last_became_peered":"2024-04-26T11:26:40.895623+0000","last_unstale":"2024-04-26T11:27:17.444221+0000","last_undegraded":"2024-04-26T11:27:17.444221+0000","last_fullsized":"2024-04-26T11:27:17.444221+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'424","last_scrub_stamp":"2024-04-26T11:27:17.444171+0000","last_deep_scrub":"71'424","last_deep_scrub_stamp":"2024-04-26T11:27:17.444171+0000","last_clean_scrub_stamp":"2024-04-26T11:27:17.444171+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:49.762789+0000","scrub_duration":0.0037779910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":497,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:50.003786+0000","last_change":"2024-04-26T11:26:50.004040+0000","last_active":"2024-04-26T11:26:50.003786+0000","last_peered":"2024-04-26T11:26:50.003786+0000","last_clean":"2024-04-26T11:26:50.003786+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:50.003786+0000","last_undegraded":"2024-04-26T11:26:50.003786+0000","last_fullsized":"2024-04-26T11:26:50.003786+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_clean_scrub_stamp":"2024-04-26T11:26:50.003733+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:47.677731+0000","scrub_duration":0.0047410569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"106'475","reported_seq":566,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:06.503180+0000","last_change":"2024-04-26T11:27:06.503394+0000","last_active":"2024-04-26T11:27:06.503180+0000","last_peered":"2024-04-26T11:27:06.503180+0000","last_clean":"2024-04-26T11:27:06.503180+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:27:06.503180+0000","last_undegraded":"2024-04-26T11:27:06.503180+0000","last_fullsized":"2024-04-26T11:27:06.503180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'475","last_scrub_stamp":"2024-04-26T11:27:06.503128+0000","last_deep_scrub":"106'475","last_deep_scrub_stamp":"2024-04-26T11:27:06.503128+0000","last_clean_scrub_stamp":"2024-04-26T11:27:06.503128+0000","objects_scrubbed":4,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:30.876920+0000","scrub_duration":0.042185009000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":517,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:33.931170+0000","last_change":"2024-04-26T11:27:33.931390+0000","last_active":"2024-04-26T11:27:33.931170+0000","last_peered":"2024-04-26T11:27:33.931170+0000","last_clean":"2024-04-26T11:27:33.931170+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:27:33.931170+0000","last_undegraded":"2024-04-26T11:27:33.931170+0000","last_fullsized":"2024-04-26T11:27:33.931170+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-26T11:27:33.931119+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-26T11:27:33.931119+0000","last_clean_scrub_stamp":"2024-04-26T11:27:33.931119+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:48.509771+0000","scrub_duration":0.0051701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:35.899107+0000","last_change":"2024-04-26T11:27:35.899321+0000","last_active":"2024-04-26T11:27:35.899107+0000","last_peered":"2024-04-26T11:27:35.899107+0000","last_clean":"2024-04-26T11:27:35.899107+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:27:35.899107+0000","last_undegraded":"2024-04-26T11:27:35.899107+0000","last_fullsized":"2024-04-26T11:27:35.899107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'62","last_scrub_stamp":"2024-04-26T11:27:35.899055+0000","last_deep_scrub":"70'62","last_deep_scrub_stamp":"2024-04-26T11:27:35.899055+0000","last_clean_scrub_stamp":"2024-04-26T11:27:35.899055+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:16.959260+0000","scrub_duration":0.003685298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":999,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498440+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:46.498440+0000","last_peered":"2024-04-26T11:26:46.498440+0000","last_clean":"2024-04-26T11:26:46.498440+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:46.498440+0000","last_undegraded":"2024-04-26T11:26:46.498440+0000","last_fullsized":"2024-04-26T11:26:46.498440+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:00.101549+0000","last_change":"2024-04-26T11:27:00.101771+0000","last_active":"2024-04-26T11:27:00.101549+0000","last_peered":"2024-04-26T11:27:00.101549+0000","last_clean":"2024-04-26T11:27:00.101549+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:27:00.101549+0000","last_undegraded":"2024-04-26T11:27:00.101549+0000","last_fullsized":"2024-04-26T11:27:00.101549+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'72","last_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_deep_scrub":"70'72","last_deep_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_clean_scrub_stamp":"2024-04-26T11:27:00.101498+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:38.755366+0000","scrub_duration":0.0029441889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":950,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.915251+0000","last_change":"2024-04-26T11:27:03.915526+0000","last_active":"2024-04-26T11:27:03.915251+0000","last_peered":"2024-04-26T11:27:03.915251+0000","last_clean":"2024-04-26T11:27:03.915251+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:27:03.915251+0000","last_undegraded":"2024-04-26T11:27:03.915251+0000","last_fullsized":"2024-04-26T11:27:03.915251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'411","last_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_deep_scrub":"71'411","last_deep_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.915200+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:44.598651+0000","scrub_duration":0.0040090890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"106'76","reported_seq":68,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:38.631208+0000","last_change":"2024-04-26T11:27:38.631416+0000","last_active":"2024-04-26T11:27:38.631208+0000","last_peered":"2024-04-26T11:27:38.631208+0000","last_clean":"2024-04-26T11:27:38.631208+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:27:38.631208+0000","last_undegraded":"2024-04-26T11:27:38.631208+0000","last_fullsized":"2024-04-26T11:27:38.631208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'76","last_scrub_stamp":"2024-04-26T11:27:38.631155+0000","last_deep_scrub":"106'76","last_deep_scrub_stamp":"2024-04-26T11:27:38.631155+0000","last_clean_scrub_stamp":"2024-04-26T11:27:38.631155+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:00.190020+0000","scrub_duration":0.012059947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"106'164","reported_seq":256,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:08.511478+0000","last_change":"2024-04-26T11:27:08.511702+0000","last_active":"2024-04-26T11:27:08.511478+0000","last_peered":"2024-04-26T11:27:08.511478+0000","last_clean":"2024-04-26T11:27:08.511478+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:27:08.511478+0000","last_undegraded":"2024-04-26T11:27:08.511478+0000","last_fullsized":"2024-04-26T11:27:08.511478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'164","last_scrub_stamp":"2024-04-26T11:27:08.511426+0000","last_deep_scrub":"106'164","last_deep_scrub_stamp":"2024-04-26T11:27:08.511426+0000","last_clean_scrub_stamp":"2024-04-26T11:27:08.511426+0000","objects_scrubbed":2,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:26.618845+0000","scrub_duration":0.024844353999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":877,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373303+0000","last_change":"2024-04-26T11:26:22.400196+0000","last_active":"2024-04-26T11:26:41.373303+0000","last_peered":"2024-04-26T11:26:41.373303+0000","last_clean":"2024-04-26T11:26:41.373303+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:26:41.373303+0000","last_undegraded":"2024-04-26T11:26:41.373303+0000","last_fullsized":"2024-04-26T11:26:41.373303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"106'277","reported_seq":415,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:38.001763+0000","last_change":"2024-04-26T11:27:38.001991+0000","last_active":"2024-04-26T11:27:38.001763+0000","last_peered":"2024-04-26T11:27:38.001763+0000","last_clean":"2024-04-26T11:27:38.001763+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:27:38.001763+0000","last_undegraded":"2024-04-26T11:27:38.001763+0000","last_fullsized":"2024-04-26T11:27:38.001763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'277","last_scrub_stamp":"2024-04-26T11:27:38.001710+0000","last_deep_scrub":"106'277","last_deep_scrub_stamp":"2024-04-26T11:27:38.001710+0000","last_clean_scrub_stamp":"2024-04-26T11:27:38.001710+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.703001+0000","scrub_duration":0.032027241999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":592,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.044886+0000","last_change":"2024-04-26T11:26:54.045110+0000","last_active":"2024-04-26T11:26:54.044886+0000","last_peered":"2024-04-26T11:26:54.044886+0000","last_clean":"2024-04-26T11:26:54.044886+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:54.044886+0000","last_undegraded":"2024-04-26T11:26:54.044886+0000","last_fullsized":"2024-04-26T11:26:54.044886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'455","last_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_deep_scrub":"71'455","last_deep_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.044831+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:23.986621+0000","scrub_duration":0.0050259290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"106'567","reported_seq":659,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.588175+0000","last_change":"2024-04-26T11:27:01.588510+0000","last_active":"2024-04-26T11:27:01.588175+0000","last_peered":"2024-04-26T11:27:01.588175+0000","last_clean":"2024-04-26T11:27:01.588175+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:27:01.588175+0000","last_undegraded":"2024-04-26T11:27:01.588175+0000","last_fullsized":"2024-04-26T11:27:01.588175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'567","last_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_deep_scrub":"106'567","last_deep_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.588061+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:05.825620+0000","scrub_duration":0.031697134000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":531,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893616+0000","last_change":"2024-04-26T11:26:39.905388+0000","last_active":"2024-04-26T11:26:40.893616+0000","last_peered":"2024-04-26T11:26:40.893616+0000","last_clean":"2024-04-26T11:26:40.893616+0000","last_became_active":"2024-04-26T11:26:39.900162+0000","last_became_peered":"2024-04-26T11:26:39.900162+0000","last_unstale":"2024-04-26T11:26:40.893616+0000","last_undegraded":"2024-04-26T11:26:40.893616+0000","last_fullsized":"2024-04-26T11:26:40.893616+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:40.651918+0000","last_change":"2024-04-26T11:27:40.652134+0000","last_active":"2024-04-26T11:27:40.651918+0000","last_peered":"2024-04-26T11:27:40.651918+0000","last_clean":"2024-04-26T11:27:40.651918+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:27:40.651918+0000","last_undegraded":"2024-04-26T11:27:40.651918+0000","last_fullsized":"2024-04-26T11:27:40.651918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'58","last_scrub_stamp":"2024-04-26T11:27:40.651867+0000","last_deep_scrub":"70'58","last_deep_scrub_stamp":"2024-04-26T11:27:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T11:27:40.651867+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:53.157507+0000","scrub_duration":0.0035582550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":970,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:05.965271+0000","last_change":"2024-04-26T11:27:05.965500+0000","last_active":"2024-04-26T11:27:05.965271+0000","last_peered":"2024-04-26T11:27:05.965271+0000","last_clean":"2024-04-26T11:27:05.965271+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:27:05.965271+0000","last_undegraded":"2024-04-26T11:27:05.965271+0000","last_fullsized":"2024-04-26T11:27:05.965271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_clean_scrub_stamp":"2024-04-26T11:27:05.965214+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:34:49.834938+0000","scrub_duration":0.0039580659999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"70'182","reported_seq":311,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373199+0000","last_change":"2024-04-26T11:26:15.626129+0000","last_active":"2024-04-26T11:26:41.373199+0000","last_peered":"2024-04-26T11:26:41.373199+0000","last_clean":"2024-04-26T11:26:41.373199+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:26:41.373199+0000","last_undegraded":"2024-04-26T11:26:41.373199+0000","last_fullsized":"2024-04-26T11:26:41.373199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":539,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:33.534181+0000","last_change":"2024-04-26T11:27:33.534438+0000","last_active":"2024-04-26T11:27:33.534181+0000","last_peered":"2024-04-26T11:27:33.534181+0000","last_clean":"2024-04-26T11:27:33.534181+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:27:33.534181+0000","last_undegraded":"2024-04-26T11:27:33.534181+0000","last_fullsized":"2024-04-26T11:27:33.534181+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'454","last_scrub_stamp":"2024-04-26T11:27:33.534129+0000","last_deep_scrub":"71'454","last_deep_scrub_stamp":"2024-04-26T11:27:33.534129+0000","last_clean_scrub_stamp":"2024-04-26T11:27:33.534129+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:47.874020+0000","scrub_duration":0.004313679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"106'224","reported_seq":308,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:25.516420+0000","last_change":"2024-04-26T11:27:25.516689+0000","last_active":"2024-04-26T11:27:25.516420+0000","last_peered":"2024-04-26T11:27:25.516420+0000","last_clean":"2024-04-26T11:27:25.516420+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:27:25.516420+0000","last_undegraded":"2024-04-26T11:27:25.516420+0000","last_fullsized":"2024-04-26T11:27:25.516420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'224","last_scrub_stamp":"2024-04-26T11:27:25.516369+0000","last_deep_scrub":"106'224","last_deep_scrub_stamp":"2024-04-26T11:27:25.516369+0000","last_clean_scrub_stamp":"2024-04-26T11:27:25.516369+0000","objects_scrubbed":1,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:04.438733+0000","scrub_duration":0.023037851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":483,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:28.532289+0000","last_change":"2024-04-26T11:27:28.532511+0000","last_active":"2024-04-26T11:27:28.532289+0000","last_peered":"2024-04-26T11:27:28.532289+0000","last_clean":"2024-04-26T11:27:28.532289+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:27:28.532289+0000","last_undegraded":"2024-04-26T11:27:28.532289+0000","last_fullsized":"2024-04-26T11:27:28.532289+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-26T11:27:28.532239+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-26T11:27:28.532239+0000","last_clean_scrub_stamp":"2024-04-26T11:27:28.532239+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:56.163930+0000","scrub_duration":0.003558299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":152,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373797+0000","last_change":"2024-04-26T11:26:22.389106+0000","last_active":"2024-04-26T11:26:41.373797+0000","last_peered":"2024-04-26T11:26:41.373797+0000","last_clean":"2024-04-26T11:26:41.373797+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:26:41.373797+0000","last_undegraded":"2024-04-26T11:26:41.373797+0000","last_fullsized":"2024-04-26T11:26:41.373797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":458,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:05.437065+0000","last_change":"2024-04-26T11:27:05.437300+0000","last_active":"2024-04-26T11:27:05.437065+0000","last_peered":"2024-04-26T11:27:05.437065+0000","last_clean":"2024-04-26T11:27:05.437065+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:27:05.437065+0000","last_undegraded":"2024-04-26T11:27:05.437065+0000","last_fullsized":"2024-04-26T11:27:05.437065+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'359","last_scrub_stamp":"2024-04-26T11:27:05.437012+0000","last_deep_scrub":"71'359","last_deep_scrub_stamp":"2024-04-26T11:27:05.437012+0000","last_clean_scrub_stamp":"2024-04-26T11:27:05.437012+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.035867+0000","scrub_duration":0.0040043329999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"106'360","reported_seq":365,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:26.055820+0000","last_change":"2024-04-26T11:27:26.056052+0000","last_active":"2024-04-26T11:27:26.055820+0000","last_peered":"2024-04-26T11:27:26.055820+0000","last_clean":"2024-04-26T11:27:26.055820+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:27:26.055820+0000","last_undegraded":"2024-04-26T11:27:26.055820+0000","last_fullsized":"2024-04-26T11:27:26.055820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'360","last_scrub_stamp":"2024-04-26T11:27:26.055763+0000","last_deep_scrub":"106'360","last_deep_scrub_stamp":"2024-04-26T11:27:26.055763+0000","last_clean_scrub_stamp":"2024-04-26T11:27:26.055763+0000","objects_scrubbed":1,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:24.969559+0000","scrub_duration":0.033125239000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":565,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.907340+0000","last_change":"2024-04-26T11:27:01.907573+0000","last_active":"2024-04-26T11:27:01.907340+0000","last_peered":"2024-04-26T11:27:01.907340+0000","last_clean":"2024-04-26T11:27:01.907340+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:27:01.907340+0000","last_undegraded":"2024-04-26T11:27:01.907340+0000","last_fullsized":"2024-04-26T11:27:01.907340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.907287+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:00.821083+0000","scrub_duration":0.0045510610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"106'159","reported_seq":261,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:43.695999+0000","last_change":"2024-04-26T11:27:43.696225+0000","last_active":"2024-04-26T11:27:43.695999+0000","last_peered":"2024-04-26T11:27:43.695999+0000","last_clean":"2024-04-26T11:27:43.695999+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:27:43.695999+0000","last_undegraded":"2024-04-26T11:27:43.695999+0000","last_fullsized":"2024-04-26T11:27:43.695999+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'159","last_scrub_stamp":"2024-04-26T11:27:43.695947+0000","last_deep_scrub":"106'159","last_deep_scrub_stamp":"2024-04-26T11:27:43.695947+0000","last_clean_scrub_stamp":"2024-04-26T11:27:43.695947+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:18.719077+0000","scrub_duration":0.0098550570000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:14.398167+0000","last_change":"2024-04-26T11:27:14.398442+0000","last_active":"2024-04-26T11:27:14.398167+0000","last_peered":"2024-04-26T11:27:14.398167+0000","last_clean":"2024-04-26T11:27:14.398167+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:27:14.398167+0000","last_undegraded":"2024-04-26T11:27:14.398167+0000","last_fullsized":"2024-04-26T11:27:14.398167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:14.398118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:14.398118+0000","last_clean_scrub_stamp":"2024-04-26T11:27:14.398118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:26.192505+0000","scrub_duration":0.0032486720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":852,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373222+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:41.373222+0000","last_peered":"2024-04-26T11:26:41.373222+0000","last_clean":"2024-04-26T11:26:41.373222+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:41.373222+0000","last_undegraded":"2024-04-26T11:26:41.373222+0000","last_fullsized":"2024-04-26T11:26:41.373222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":515,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895391+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:40.895391+0000","last_peered":"2024-04-26T11:26:40.895391+0000","last_clean":"2024-04-26T11:26:40.895391+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:40.895391+0000","last_undegraded":"2024-04-26T11:26:40.895391+0000","last_fullsized":"2024-04-26T11:26:40.895391+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.409683+0000","last_change":"2024-04-26T11:27:15.409932+0000","last_active":"2024-04-26T11:27:15.409683+0000","last_peered":"2024-04-26T11:27:15.409683+0000","last_clean":"2024-04-26T11:27:15.409683+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:27:15.409683+0000","last_undegraded":"2024-04-26T11:27:15.409683+0000","last_fullsized":"2024-04-26T11:27:15.409683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:15.409633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:15.409633+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.409633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:38.286104+0000","scrub_duration":0.0031725590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":293,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372609+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:41.372609+0000","last_peered":"2024-04-26T11:26:41.372609+0000","last_clean":"2024-04-26T11:26:41.372609+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:41.372609+0000","last_undegraded":"2024-04-26T11:26:41.372609+0000","last_fullsized":"2024-04-26T11:26:41.372609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":574,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:22.039392+0000","last_change":"2024-04-26T11:27:22.039648+0000","last_active":"2024-04-26T11:27:22.039392+0000","last_peered":"2024-04-26T11:27:22.039392+0000","last_clean":"2024-04-26T11:27:22.039392+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:27:22.039392+0000","last_undegraded":"2024-04-26T11:27:22.039392+0000","last_fullsized":"2024-04-26T11:27:22.039392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'444","last_scrub_stamp":"2024-04-26T11:27:22.039342+0000","last_deep_scrub":"71'444","last_deep_scrub_stamp":"2024-04-26T11:27:22.039342+0000","last_clean_scrub_stamp":"2024-04-26T11:27:22.039342+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:51.178326+0000","scrub_duration":0.0046559649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":116,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:41.891127+0000","last_change":"2024-04-26T11:27:41.891342+0000","last_active":"2024-04-26T11:27:41.891127+0000","last_peered":"2024-04-26T11:27:41.891127+0000","last_clean":"2024-04-26T11:27:41.891127+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:27:41.891127+0000","last_undegraded":"2024-04-26T11:27:41.891127+0000","last_fullsized":"2024-04-26T11:27:41.891127+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:41.891074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:41.891074+0000","last_clean_scrub_stamp":"2024-04-26T11:27:41.891074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:42.028673+0000","scrub_duration":0.0032036479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"70'377","reported_seq":483,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373584+0000","last_change":"2024-04-26T11:26:22.392489+0000","last_active":"2024-04-26T11:26:41.373584+0000","last_peered":"2024-04-26T11:26:41.373584+0000","last_clean":"2024-04-26T11:26:41.373584+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:26:41.373584+0000","last_undegraded":"2024-04-26T11:26:41.373584+0000","last_fullsized":"2024-04-26T11:26:41.373584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":465,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:13.017518+0000","last_change":"2024-04-26T11:27:13.017795+0000","last_active":"2024-04-26T11:27:13.017518+0000","last_peered":"2024-04-26T11:27:13.017518+0000","last_clean":"2024-04-26T11:27:13.017518+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:27:13.017518+0000","last_undegraded":"2024-04-26T11:27:13.017518+0000","last_fullsized":"2024-04-26T11:27:13.017518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'334","last_scrub_stamp":"2024-04-26T11:27:13.017468+0000","last_deep_scrub":"71'334","last_deep_scrub_stamp":"2024-04-26T11:27:13.017468+0000","last_clean_scrub_stamp":"2024-04-26T11:27:13.017468+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:48.346628+0000","scrub_duration":0.0044577050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.892457+0000","last_change":"2024-04-26T11:26:11.128809+0000","last_active":"2024-04-26T11:26:40.892457+0000","last_peered":"2024-04-26T11:26:40.892457+0000","last_clean":"2024-04-26T11:26:40.892457+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:26:40.892457+0000","last_undegraded":"2024-04-26T11:26:40.892457+0000","last_fullsized":"2024-04-26T11:26:40.892457+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893014+0000","last_change":"2024-04-26T11:26:11.129761+0000","last_active":"2024-04-26T11:26:40.893014+0000","last_peered":"2024-04-26T11:26:40.893014+0000","last_clean":"2024-04-26T11:26:40.893014+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:26:40.893014+0000","last_undegraded":"2024-04-26T11:26:40.893014+0000","last_fullsized":"2024-04-26T11:26:40.893014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":574,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:22.966742+0000","last_change":"2024-04-26T11:27:22.966985+0000","last_active":"2024-04-26T11:27:22.966742+0000","last_peered":"2024-04-26T11:27:22.966742+0000","last_clean":"2024-04-26T11:27:22.966742+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:27:22.966742+0000","last_undegraded":"2024-04-26T11:27:22.966742+0000","last_fullsized":"2024-04-26T11:27:22.966742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-26T11:27:22.966689+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-26T11:27:22.966689+0000","last_clean_scrub_stamp":"2024-04-26T11:27:22.966689+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:56.913479+0000","scrub_duration":0.0049556590000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":571,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894557+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:40.894557+0000","last_peered":"2024-04-26T11:26:40.894557+0000","last_clean":"2024-04-26T11:26:40.894557+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:40.894557+0000","last_undegraded":"2024-04-26T11:26:40.894557+0000","last_fullsized":"2024-04-26T11:26:40.894557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":102,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373833+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:41.373833+0000","last_peered":"2024-04-26T11:26:41.373833+0000","last_clean":"2024-04-26T11:26:41.373833+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:41.373833+0000","last_undegraded":"2024-04-26T11:26:41.373833+0000","last_fullsized":"2024-04-26T11:26:41.373833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":804,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:29.994026+0000","last_change":"2024-04-26T11:27:29.994255+0000","last_active":"2024-04-26T11:27:29.994026+0000","last_peered":"2024-04-26T11:27:29.994026+0000","last_clean":"2024-04-26T11:27:29.994026+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:27:29.994026+0000","last_undegraded":"2024-04-26T11:27:29.994026+0000","last_fullsized":"2024-04-26T11:27:29.994026+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'351","last_scrub_stamp":"2024-04-26T11:27:29.993974+0000","last_deep_scrub":"71'351","last_deep_scrub_stamp":"2024-04-26T11:27:29.993974+0000","last_clean_scrub_stamp":"2024-04-26T11:27:29.993974+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:35:13.863697+0000","scrub_duration":0.0044014229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373693+0000","last_change":"2024-04-26T11:21:53.332880+0000","last_active":"2024-04-26T11:26:41.373693+0000","last_peered":"2024-04-26T11:26:41.373693+0000","last_clean":"2024-04-26T11:26:41.373693+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:26:41.373693+0000","last_undegraded":"2024-04-26T11:26:41.373693+0000","last_fullsized":"2024-04-26T11:26:41.373693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375446+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:41.375446+0000","last_peered":"2024-04-26T11:26:41.375446+0000","last_clean":"2024-04-26T11:26:41.375446+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:41.375446+0000","last_undegraded":"2024-04-26T11:26:41.375446+0000","last_fullsized":"2024-04-26T11:26:41.375446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":829,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:21.037998+0000","last_change":"2024-04-26T11:27:21.038232+0000","last_active":"2024-04-26T11:27:21.037998+0000","last_peered":"2024-04-26T11:27:21.037998+0000","last_clean":"2024-04-26T11:27:21.037998+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:27:21.037998+0000","last_undegraded":"2024-04-26T11:27:21.037998+0000","last_fullsized":"2024-04-26T11:27:21.037998+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'376","last_scrub_stamp":"2024-04-26T11:27:21.037943+0000","last_deep_scrub":"71'376","last_deep_scrub_stamp":"2024-04-26T11:27:21.037943+0000","last_clean_scrub_stamp":"2024-04-26T11:27:21.037943+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.198741+0000","scrub_duration":0.0040199060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"70'60","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374564+0000","last_change":"2024-04-26T11:21:53.330848+0000","last_active":"2024-04-26T11:26:41.374564+0000","last_peered":"2024-04-26T11:26:41.374564+0000","last_clean":"2024-04-26T11:26:41.374564+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:26:41.374564+0000","last_undegraded":"2024-04-26T11:26:41.374564+0000","last_fullsized":"2024-04-26T11:26:41.374564+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374508+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:41.374508+0000","last_peered":"2024-04-26T11:26:41.374508+0000","last_clean":"2024-04-26T11:26:41.374508+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:41.374508+0000","last_undegraded":"2024-04-26T11:26:41.374508+0000","last_fullsized":"2024-04-26T11:26:41.374508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":927,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372921+0000","last_change":"2024-04-26T11:26:39.378496+0000","last_active":"2024-04-26T11:26:41.372921+0000","last_peered":"2024-04-26T11:26:41.372921+0000","last_clean":"2024-04-26T11:26:41.372921+0000","last_became_active":"2024-04-26T11:26:39.375075+0000","last_became_peered":"2024-04-26T11:26:39.375075+0000","last_unstale":"2024-04-26T11:26:41.372921+0000","last_undegraded":"2024-04-26T11:26:41.372921+0000","last_fullsized":"2024-04-26T11:26:41.372921+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"71'71","reported_seq":191,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374422+0000","last_change":"2024-04-26T11:26:11.637259+0000","last_active":"2024-04-26T11:26:41.374422+0000","last_peered":"2024-04-26T11:26:41.374422+0000","last_clean":"2024-04-26T11:26:41.374422+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:26:41.374422+0000","last_undegraded":"2024-04-26T11:26:41.374422+0000","last_fullsized":"2024-04-26T11:26:41.374422+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":51,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895009+0000","last_change":"2024-04-26T11:26:11.122026+0000","last_active":"2024-04-26T11:26:40.895009+0000","last_peered":"2024-04-26T11:26:40.895009+0000","last_clean":"2024-04-26T11:26:40.895009+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:26:40.895009+0000","last_undegraded":"2024-04-26T11:26:40.895009+0000","last_fullsized":"2024-04-26T11:26:40.895009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":942,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:39.936798+0000","last_change":"2024-04-26T11:27:39.937043+0000","last_active":"2024-04-26T11:27:39.936798+0000","last_peered":"2024-04-26T11:27:39.936798+0000","last_clean":"2024-04-26T11:27:39.936798+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:27:39.936798+0000","last_undegraded":"2024-04-26T11:27:39.936798+0000","last_fullsized":"2024-04-26T11:27:39.936798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-26T11:27:39.936745+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-26T11:27:39.936745+0000","last_clean_scrub_stamp":"2024-04-26T11:27:39.936745+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:26.877705+0000","scrub_duration":0.0041433700000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":524,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:53.400187+0000","last_change":"2024-04-26T11:26:53.400430+0000","last_active":"2024-04-26T11:26:53.400187+0000","last_peered":"2024-04-26T11:26:53.400187+0000","last_clean":"2024-04-26T11:26:53.400187+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:53.400187+0000","last_undegraded":"2024-04-26T11:26:53.400187+0000","last_fullsized":"2024-04-26T11:26:53.400187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'415","last_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_deep_scrub":"71'415","last_deep_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_clean_scrub_stamp":"2024-04-26T11:26:53.400136+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:43.847441+0000","scrub_duration":0.0041863550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"73'404","reported_seq":492,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893106+0000","last_change":"2024-04-26T11:26:14.131171+0000","last_active":"2024-04-26T11:26:40.893106+0000","last_peered":"2024-04-26T11:26:40.893106+0000","last_clean":"2024-04-26T11:26:40.893106+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:26:40.893106+0000","last_undegraded":"2024-04-26T11:26:40.893106+0000","last_fullsized":"2024-04-26T11:26:40.893106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":568,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:56.983899+0000","last_change":"2024-04-26T11:26:56.984139+0000","last_active":"2024-04-26T11:26:56.983899+0000","last_peered":"2024-04-26T11:26:56.983899+0000","last_clean":"2024-04-26T11:26:56.983899+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:56.983899+0000","last_undegraded":"2024-04-26T11:26:56.983899+0000","last_fullsized":"2024-04-26T11:26:56.983899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'425","last_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_deep_scrub":"71'425","last_deep_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_clean_scrub_stamp":"2024-04-26T11:26:56.983841+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:06.726299+0000","scrub_duration":0.0046040439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.477440+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:46.477440+0000","last_peered":"2024-04-26T11:26:46.477440+0000","last_clean":"2024-04-26T11:26:46.477440+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:46.477440+0000","last_undegraded":"2024-04-26T11:26:46.477440+0000","last_fullsized":"2024-04-26T11:26:46.477440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"106'345","reported_seq":429,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:32.598123+0000","last_change":"2024-04-26T11:27:32.598338+0000","last_active":"2024-04-26T11:27:32.598123+0000","last_peered":"2024-04-26T11:27:32.598123+0000","last_clean":"2024-04-26T11:27:32.598123+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:27:32.598123+0000","last_undegraded":"2024-04-26T11:27:32.598123+0000","last_fullsized":"2024-04-26T11:27:32.598123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'345","last_scrub_stamp":"2024-04-26T11:27:32.598068+0000","last_deep_scrub":"106'345","last_deep_scrub_stamp":"2024-04-26T11:27:32.598068+0000","last_clean_scrub_stamp":"2024-04-26T11:27:32.598068+0000","objects_scrubbed":1,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:49.040005+0000","scrub_duration":0.028263885999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":1037,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:57.986343+0000","last_change":"2024-04-26T11:26:57.986559+0000","last_active":"2024-04-26T11:26:57.986343+0000","last_peered":"2024-04-26T11:26:57.986343+0000","last_clean":"2024-04-26T11:26:57.986343+0000","last_became_active":"2024-04-26T11:26:38.373800+0000","last_became_peered":"2024-04-26T11:26:38.373800+0000","last_unstale":"2024-04-26T11:26:57.986343+0000","last_undegraded":"2024-04-26T11:26:57.986343+0000","last_fullsized":"2024-04-26T11:26:57.986343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'468","last_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_deep_scrub":"71'468","last_deep_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_clean_scrub_stamp":"2024-04-26T11:26:57.986292+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:27.125276+0000","scrub_duration":0.0037409510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":178,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:30.984202+0000","last_change":"2024-04-26T11:27:30.984422+0000","last_active":"2024-04-26T11:27:30.984202+0000","last_peered":"2024-04-26T11:27:30.984202+0000","last_clean":"2024-04-26T11:27:30.984202+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:27:30.984202+0000","last_undegraded":"2024-04-26T11:27:30.984202+0000","last_fullsized":"2024-04-26T11:27:30.984202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'52","last_scrub_stamp":"2024-04-26T11:27:30.984151+0000","last_deep_scrub":"70'52","last_deep_scrub_stamp":"2024-04-26T11:27:30.984151+0000","last_clean_scrub_stamp":"2024-04-26T11:27:30.984151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:01.509557+0000","scrub_duration":0.0034089770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":582,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.962038+0000","last_change":"2024-04-26T11:26:58.962297+0000","last_active":"2024-04-26T11:26:58.962038+0000","last_peered":"2024-04-26T11:26:58.962038+0000","last_clean":"2024-04-26T11:26:58.962038+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:58.962038+0000","last_undegraded":"2024-04-26T11:26:58.962038+0000","last_fullsized":"2024-04-26T11:26:58.962038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'454","last_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_deep_scrub":"71'454","last_deep_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.961980+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:21.020921+0000","scrub_duration":0.0044732579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":804,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:23.050748+0000","last_change":"2024-04-26T11:27:23.051045+0000","last_active":"2024-04-26T11:27:23.050748+0000","last_peered":"2024-04-26T11:27:23.050748+0000","last_clean":"2024-04-26T11:27:23.050748+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:27:23.050748+0000","last_undegraded":"2024-04-26T11:27:23.050748+0000","last_fullsized":"2024-04-26T11:27:23.050748+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'352","last_scrub_stamp":"2024-04-26T11:27:23.050694+0000","last_deep_scrub":"71'352","last_deep_scrub_stamp":"2024-04-26T11:27:23.050694+0000","last_clean_scrub_stamp":"2024-04-26T11:27:23.050694+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:45.109635+0000","scrub_duration":0.0037690789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"106'589","reported_seq":702,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:42.979638+0000","last_change":"2024-04-26T11:27:42.979875+0000","last_active":"2024-04-26T11:27:42.979638+0000","last_peered":"2024-04-26T11:27:42.979638+0000","last_clean":"2024-04-26T11:27:42.979638+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:27:42.979638+0000","last_undegraded":"2024-04-26T11:27:42.979638+0000","last_fullsized":"2024-04-26T11:27:42.979638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'589","last_scrub_stamp":"2024-04-26T11:27:42.979583+0000","last_deep_scrub":"106'589","last_deep_scrub_stamp":"2024-04-26T11:27:42.979583+0000","last_clean_scrub_stamp":"2024-04-26T11:27:42.979583+0000","objects_scrubbed":2,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:29.434420+0000","scrub_duration":0.052572714999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":923,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374034+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:41.374034+0000","last_peered":"2024-04-26T11:26:41.374034+0000","last_clean":"2024-04-26T11:26:41.374034+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:41.374034+0000","last_undegraded":"2024-04-26T11:26:41.374034+0000","last_fullsized":"2024-04-26T11:26:41.374034+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"70'270","reported_seq":396,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498182+0000","last_change":"2024-04-26T11:26:14.608107+0000","last_active":"2024-04-26T11:26:46.498182+0000","last_peered":"2024-04-26T11:26:46.498182+0000","last_clean":"2024-04-26T11:26:46.498182+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:26:46.498182+0000","last_undegraded":"2024-04-26T11:26:46.498182+0000","last_fullsized":"2024-04-26T11:26:46.498182+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1029,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.080170+0000","last_change":"2024-04-26T11:27:15.080408+0000","last_active":"2024-04-26T11:27:15.080170+0000","last_peered":"2024-04-26T11:27:15.080170+0000","last_clean":"2024-04-26T11:27:15.080170+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:27:15.080170+0000","last_undegraded":"2024-04-26T11:27:15.080170+0000","last_fullsized":"2024-04-26T11:27:15.080170+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'439","last_scrub_stamp":"2024-04-26T11:27:15.080115+0000","last_deep_scrub":"71'439","last_deep_scrub_stamp":"2024-04-26T11:27:15.080115+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.080115+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:37.378024+0000","scrub_duration":0.0040451460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"70'374","reported_seq":432,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374388+0000","last_change":"2024-04-26T11:26:22.384078+0000","last_active":"2024-04-26T11:26:41.374388+0000","last_peered":"2024-04-26T11:26:41.374388+0000","last_clean":"2024-04-26T11:26:41.374388+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:26:41.374388+0000","last_undegraded":"2024-04-26T11:26:41.374388+0000","last_fullsized":"2024-04-26T11:26:41.374388+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:52.009464+0000","last_change":"2024-04-26T11:26:52.009713+0000","last_active":"2024-04-26T11:26:52.009464+0000","last_peered":"2024-04-26T11:26:52.009464+0000","last_clean":"2024-04-26T11:26:52.009464+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:52.009464+0000","last_undegraded":"2024-04-26T11:26:52.009464+0000","last_fullsized":"2024-04-26T11:26:52.009464+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_clean_scrub_stamp":"2024-04-26T11:26:52.009412+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:59.423751+0000","scrub_duration":0.0045503360000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":154,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:49.880095+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:49.880095+0000","last_peered":"2024-04-26T11:26:49.880095+0000","last_clean":"2024-04-26T11:26:49.880095+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:49.880095+0000","last_undegraded":"2024-04-26T11:26:49.880095+0000","last_fullsized":"2024-04-26T11:26:49.880095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":487,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.491082+0000","last_change":"2024-04-26T11:27:03.491361+0000","last_active":"2024-04-26T11:27:03.491082+0000","last_peered":"2024-04-26T11:27:03.491082+0000","last_clean":"2024-04-26T11:27:03.491082+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:27:03.491082+0000","last_undegraded":"2024-04-26T11:27:03.491082+0000","last_fullsized":"2024-04-26T11:27:03.491082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'375","last_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_deep_scrub":"71'375","last_deep_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.491032+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:52.444748+0000","scrub_duration":0.0043129789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"70'326","reported_seq":405,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893932+0000","last_change":"2024-04-26T11:26:15.146353+0000","last_active":"2024-04-26T11:26:40.893932+0000","last_peered":"2024-04-26T11:26:40.893932+0000","last_clean":"2024-04-26T11:26:40.893932+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:26:40.893932+0000","last_undegraded":"2024-04-26T11:26:40.893932+0000","last_fullsized":"2024-04-26T11:26:40.893932+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":503,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:09.525104+0000","last_change":"2024-04-26T11:27:09.525341+0000","last_active":"2024-04-26T11:27:09.525104+0000","last_peered":"2024-04-26T11:27:09.525104+0000","last_clean":"2024-04-26T11:27:09.525104+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:27:09.525104+0000","last_undegraded":"2024-04-26T11:27:09.525104+0000","last_fullsized":"2024-04-26T11:27:09.525104+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-26T11:27:09.525054+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-26T11:27:09.525054+0000","last_clean_scrub_stamp":"2024-04-26T11:27:09.525054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:30.705220+0000","scrub_duration":0.0044574929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"106'394","reported_seq":514,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:04.167993+0000","last_change":"2024-04-26T11:27:04.168232+0000","last_active":"2024-04-26T11:27:04.167993+0000","last_peered":"2024-04-26T11:27:04.167993+0000","last_clean":"2024-04-26T11:27:04.167993+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:27:04.167993+0000","last_undegraded":"2024-04-26T11:27:04.167993+0000","last_fullsized":"2024-04-26T11:27:04.167993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'394","last_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_deep_scrub":"106'394","last_deep_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_clean_scrub_stamp":"2024-04-26T11:27:04.167933+0000","objects_scrubbed":4,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.292388+0000","scrub_duration":0.059480993000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":499,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373982+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:41.373982+0000","last_peered":"2024-04-26T11:26:41.373982+0000","last_clean":"2024-04-26T11:26:41.373982+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:41.373982+0000","last_undegraded":"2024-04-26T11:26:41.373982+0000","last_fullsized":"2024-04-26T11:26:41.373982+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"70'57","reported_seq":159,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374207+0000","last_change":"2024-04-26T11:21:53.330956+0000","last_active":"2024-04-26T11:26:41.374207+0000","last_peered":"2024-04-26T11:26:41.374207+0000","last_clean":"2024-04-26T11:26:41.374207+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:26:41.374207+0000","last_undegraded":"2024-04-26T11:26:41.374207+0000","last_fullsized":"2024-04-26T11:26:41.374207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":554,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:59.498154+0000","last_change":"2024-04-26T11:26:59.498428+0000","last_active":"2024-04-26T11:26:59.498154+0000","last_peered":"2024-04-26T11:26:59.498154+0000","last_clean":"2024-04-26T11:26:59.498154+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:59.498154+0000","last_undegraded":"2024-04-26T11:26:59.498154+0000","last_fullsized":"2024-04-26T11:26:59.498154+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'446","last_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_deep_scrub":"71'446","last_deep_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_clean_scrub_stamp":"2024-04-26T11:26:59.498100+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:08.316575+0000","scrub_duration":0.003708294,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"106'133","reported_seq":271,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:25.003141+0000","last_change":"2024-04-26T11:27:25.003403+0000","last_active":"2024-04-26T11:27:25.003141+0000","last_peered":"2024-04-26T11:27:25.003141+0000","last_clean":"2024-04-26T11:27:25.003141+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:27:25.003141+0000","last_undegraded":"2024-04-26T11:27:25.003141+0000","last_fullsized":"2024-04-26T11:27:25.003141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'133","last_scrub_stamp":"2024-04-26T11:27:25.003082+0000","last_deep_scrub":"106'133","last_deep_scrub_stamp":"2024-04-26T11:27:25.003082+0000","last_clean_scrub_stamp":"2024-04-26T11:27:25.003082+0000","objects_scrubbed":3,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:32.644341+0000","scrub_duration":0.025665877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7680,"ondisk_log_size":7680,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738446,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":142432,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":111422,"kb_avail":94229408,"statfs":{"total":96636764160,"available":96490913792,"internally_reserved":0,"allocated":31744000,"data_stored":81613145,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":114096582},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.77300000000000002}]},{"osd":1,"last update":"Fri Apr 26 11:26:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.64000000000000001,"15min":0.65700000000000003},"min":{"1min":0.58799999999999997,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.79500000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63,"15min":0.65800000000000003},"min":{"1min":0.61599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.78400000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.65700000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738446,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124348,"kb_used_data":30964,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247492,"statfs":{"total":96636764160,"available":96509431808,"internally_reserved":0,"allocated":31707136,"data_stored":86117265,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:26:49 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64800000000000002,"15min":0.68400000000000005},"min":{"1min":0.60099999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.79300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64200000000000002,"15min":0.68400000000000005},"min":{"1min":0.53400000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.77800000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.629}]}]},{"osd":0,"up_from":75,"seq":322122547222,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75932,"kb_used_data":18068,"kb_used_omap":7,"kb_used_meta":57848,"kb_avail":94295908,"statfs":{"total":96636764160,"available":96559009792,"internally_reserved":0,"allocated":18501632,"data_stored":91781533,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":59237367},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:27:51.704 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.704 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.704 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.704 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.705 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.705 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.705 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.705 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.705 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.705 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.705 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.705 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.706 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.706 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.706 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.706 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.706 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.706 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.707 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.707 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.707 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.707 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.707 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.707 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.707 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.707 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.708 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.708 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.708 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.708 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.708 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.708 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.708 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.708 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.708 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.709 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.709 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.709 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.709 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.709 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.709 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.709 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.710 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:27:51.710 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:28:11.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:28:12.033 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:28:12.035 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:28:12.052 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-04-26T11:28:11.484482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7334,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34410,"ondisk_log_size":34410,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":346808,"kb_used_data":80032,"kb_used_omap":10,"kb_used_meta":266741,"kb_avail":282768712,"statfs":{"total":289910292480,"available":289555161088,"internally_reserved":0,"allocated":81952768,"data_stored":259511943,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":273143683},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004128"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":521,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:11.072905+0000","last_change":"2024-04-26T11:27:11.073124+0000","last_active":"2024-04-26T11:27:11.072905+0000","last_peered":"2024-04-26T11:27:11.072905+0000","last_clean":"2024-04-26T11:27:11.072905+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:27:11.072905+0000","last_undegraded":"2024-04-26T11:27:11.072905+0000","last_fullsized":"2024-04-26T11:27:11.072905+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:27:11.072854+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:27:11.072854+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.072854+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:41.048439+0000","scrub_duration":0.0036583589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":577,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:16.039167+0000","last_change":"2024-04-26T11:27:16.039433+0000","last_active":"2024-04-26T11:27:16.039167+0000","last_peered":"2024-04-26T11:27:16.039167+0000","last_clean":"2024-04-26T11:27:16.039167+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:27:16.039167+0000","last_undegraded":"2024-04-26T11:27:16.039167+0000","last_fullsized":"2024-04-26T11:27:16.039167+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'427","last_scrub_stamp":"2024-04-26T11:27:16.039112+0000","last_deep_scrub":"71'427","last_deep_scrub_stamp":"2024-04-26T11:27:16.039112+0000","last_clean_scrub_stamp":"2024-04-26T11:27:16.039112+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:41.912448+0000","scrub_duration":0.0051090520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":441,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895857+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:40.895857+0000","last_peered":"2024-04-26T11:26:40.895857+0000","last_clean":"2024-04-26T11:26:40.895857+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:40.895857+0000","last_undegraded":"2024-04-26T11:26:40.895857+0000","last_fullsized":"2024-04-26T11:26:40.895857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":490,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894201+0000","last_change":"2024-04-26T11:26:27.902538+0000","last_active":"2024-04-26T11:26:40.894201+0000","last_peered":"2024-04-26T11:26:40.894201+0000","last_clean":"2024-04-26T11:26:40.894201+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:26:40.894201+0000","last_undegraded":"2024-04-26T11:26:40.894201+0000","last_fullsized":"2024-04-26T11:26:40.894201+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":552,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:06.222463+0000","last_change":"2024-04-26T11:28:06.222682+0000","last_active":"2024-04-26T11:28:06.222463+0000","last_peered":"2024-04-26T11:28:06.222463+0000","last_clean":"2024-04-26T11:28:06.222463+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:28:06.222463+0000","last_undegraded":"2024-04-26T11:28:06.222463+0000","last_fullsized":"2024-04-26T11:28:06.222463+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'432","last_scrub_stamp":"2024-04-26T11:28:06.222413+0000","last_deep_scrub":"71'432","last_deep_scrub_stamp":"2024-04-26T11:28:06.222413+0000","last_clean_scrub_stamp":"2024-04-26T11:28:06.222413+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:03.342933+0000","scrub_duration":0.0044749630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":494,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893513+0000","last_change":"2024-04-26T11:26:28.910720+0000","last_active":"2024-04-26T11:26:40.893513+0000","last_peered":"2024-04-26T11:26:40.893513+0000","last_clean":"2024-04-26T11:26:40.893513+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:26:40.893513+0000","last_undegraded":"2024-04-26T11:26:40.893513+0000","last_fullsized":"2024-04-26T11:26:40.893513+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":595,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893161+0000","last_change":"2024-04-26T11:26:20.917123+0000","last_active":"2024-04-26T11:26:40.893161+0000","last_peered":"2024-04-26T11:26:40.893161+0000","last_clean":"2024-04-26T11:26:40.893161+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:26:40.893161+0000","last_undegraded":"2024-04-26T11:26:40.893161+0000","last_fullsized":"2024-04-26T11:26:40.893161+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":474,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:04.461767+0000","last_change":"2024-04-26T11:27:04.461975+0000","last_active":"2024-04-26T11:27:04.461767+0000","last_peered":"2024-04-26T11:27:04.461767+0000","last_clean":"2024-04-26T11:27:04.461767+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:27:04.461767+0000","last_undegraded":"2024-04-26T11:27:04.461767+0000","last_fullsized":"2024-04-26T11:27:04.461767+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'373","last_scrub_stamp":"2024-04-26T11:27:04.461717+0000","last_deep_scrub":"71'373","last_deep_scrub_stamp":"2024-04-26T11:27:04.461717+0000","last_clean_scrub_stamp":"2024-04-26T11:27:04.461717+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:24.859328+0000","scrub_duration":0.0041768209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":609,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:23.965512+0000","last_change":"2024-04-26T11:27:23.965730+0000","last_active":"2024-04-26T11:27:23.965512+0000","last_peered":"2024-04-26T11:27:23.965512+0000","last_clean":"2024-04-26T11:27:23.965512+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:27:23.965512+0000","last_undegraded":"2024-04-26T11:27:23.965512+0000","last_fullsized":"2024-04-26T11:27:23.965512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'447","last_scrub_stamp":"2024-04-26T11:27:23.965459+0000","last_deep_scrub":"71'447","last_deep_scrub_stamp":"2024-04-26T11:27:23.965459+0000","last_clean_scrub_stamp":"2024-04-26T11:27:23.965459+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:17.028067+0000","scrub_duration":0.0044560520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":519,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:47.980740+0000","last_change":"2024-04-26T11:27:47.980944+0000","last_active":"2024-04-26T11:27:47.980740+0000","last_peered":"2024-04-26T11:27:47.980740+0000","last_clean":"2024-04-26T11:27:47.980740+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:27:47.980740+0000","last_undegraded":"2024-04-26T11:27:47.980740+0000","last_fullsized":"2024-04-26T11:27:47.980740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'389","last_scrub_stamp":"2024-04-26T11:27:47.980687+0000","last_deep_scrub":"71'389","last_deep_scrub_stamp":"2024-04-26T11:27:47.980687+0000","last_clean_scrub_stamp":"2024-04-26T11:27:47.980687+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:14.673060+0000","scrub_duration":0.0047600280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":481,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895738+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:40.895738+0000","last_peered":"2024-04-26T11:26:40.895738+0000","last_clean":"2024-04-26T11:26:40.895738+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:40.895738+0000","last_undegraded":"2024-04-26T11:26:40.895738+0000","last_fullsized":"2024-04-26T11:26:40.895738+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":795,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:55.137005+0000","last_change":"2024-04-26T11:27:55.137295+0000","last_active":"2024-04-26T11:27:55.137005+0000","last_peered":"2024-04-26T11:27:55.137005+0000","last_clean":"2024-04-26T11:27:55.137005+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:27:55.137005+0000","last_undegraded":"2024-04-26T11:27:55.137005+0000","last_fullsized":"2024-04-26T11:27:55.137005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'350","last_scrub_stamp":"2024-04-26T11:27:55.136953+0000","last_deep_scrub":"71'350","last_deep_scrub_stamp":"2024-04-26T11:27:55.136953+0000","last_clean_scrub_stamp":"2024-04-26T11:27:55.136953+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:25.662360+0000","scrub_duration":0.0045968290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":465,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:07.138603+0000","last_change":"2024-04-26T11:27:07.138812+0000","last_active":"2024-04-26T11:27:07.138603+0000","last_peered":"2024-04-26T11:27:07.138603+0000","last_clean":"2024-04-26T11:27:07.138603+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:27:07.138603+0000","last_undegraded":"2024-04-26T11:27:07.138603+0000","last_fullsized":"2024-04-26T11:27:07.138603+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'385","last_scrub_stamp":"2024-04-26T11:27:07.138550+0000","last_deep_scrub":"71'385","last_deep_scrub_stamp":"2024-04-26T11:27:07.138550+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.138550+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:51.494043+0000","scrub_duration":0.0046149509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":494,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:02.539257+0000","last_change":"2024-04-26T11:27:02.539472+0000","last_active":"2024-04-26T11:27:02.539257+0000","last_peered":"2024-04-26T11:27:02.539257+0000","last_clean":"2024-04-26T11:27:02.539257+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:27:02.539257+0000","last_undegraded":"2024-04-26T11:27:02.539257+0000","last_fullsized":"2024-04-26T11:27:02.539257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_clean_scrub_stamp":"2024-04-26T11:27:02.539206+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:43.230821+0000","scrub_duration":0.003815648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":550,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:18.484587+0000","last_change":"2024-04-26T11:27:18.484810+0000","last_active":"2024-04-26T11:27:18.484587+0000","last_peered":"2024-04-26T11:27:18.484587+0000","last_clean":"2024-04-26T11:27:18.484587+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:27:18.484587+0000","last_undegraded":"2024-04-26T11:27:18.484587+0000","last_fullsized":"2024-04-26T11:27:18.484587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'431","last_scrub_stamp":"2024-04-26T11:27:18.484532+0000","last_deep_scrub":"71'431","last_deep_scrub_stamp":"2024-04-26T11:27:18.484532+0000","last_clean_scrub_stamp":"2024-04-26T11:27:18.484532+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:43.402024+0000","scrub_duration":0.0042561730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":615,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.393743+0000","last_change":"2024-04-26T11:26:54.393969+0000","last_active":"2024-04-26T11:26:54.393743+0000","last_peered":"2024-04-26T11:26:54.393743+0000","last_clean":"2024-04-26T11:26:54.393743+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:54.393743+0000","last_undegraded":"2024-04-26T11:26:54.393743+0000","last_fullsized":"2024-04-26T11:26:54.393743+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'453","last_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_deep_scrub":"71'453","last_deep_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.393690+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:41.730233+0000","scrub_duration":0.0038895330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":589,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:51.960476+0000","last_change":"2024-04-26T11:26:51.960725+0000","last_active":"2024-04-26T11:26:51.960476+0000","last_peered":"2024-04-26T11:26:51.960476+0000","last_clean":"2024-04-26T11:26:51.960476+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:51.960476+0000","last_undegraded":"2024-04-26T11:26:51.960476+0000","last_fullsized":"2024-04-26T11:26:51.960476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_clean_scrub_stamp":"2024-04-26T11:26:51.960424+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:17.833759+0000","scrub_duration":0.0043861689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":585,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375318+0000","last_change":"2024-04-26T11:26:22.402854+0000","last_active":"2024-04-26T11:26:41.375318+0000","last_peered":"2024-04-26T11:26:41.375318+0000","last_clean":"2024-04-26T11:26:41.375318+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:26:41.375318+0000","last_undegraded":"2024-04-26T11:26:41.375318+0000","last_fullsized":"2024-04-26T11:26:41.375318+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":635,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.965160+0000","last_change":"2024-04-26T11:27:15.965379+0000","last_active":"2024-04-26T11:27:15.965160+0000","last_peered":"2024-04-26T11:27:15.965160+0000","last_clean":"2024-04-26T11:27:15.965160+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:27:15.965160+0000","last_undegraded":"2024-04-26T11:27:15.965160+0000","last_fullsized":"2024-04-26T11:27:15.965160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-26T11:27:15.965105+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-26T11:27:15.965105+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.965105+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:02.906065+0000","scrub_duration":0.0046149279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":623,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:39.660737+0000","last_change":"2024-04-26T11:27:39.660968+0000","last_active":"2024-04-26T11:27:39.660737+0000","last_peered":"2024-04-26T11:27:39.660737+0000","last_clean":"2024-04-26T11:27:39.660737+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:27:39.660737+0000","last_undegraded":"2024-04-26T11:27:39.660737+0000","last_fullsized":"2024-04-26T11:27:39.660737+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'475","last_scrub_stamp":"2024-04-26T11:27:39.660681+0000","last_deep_scrub":"71'475","last_deep_scrub_stamp":"2024-04-26T11:27:39.660681+0000","last_clean_scrub_stamp":"2024-04-26T11:27:39.660681+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:13.243958+0000","scrub_duration":0.0042850270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":550,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893719+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:40.893719+0000","last_peered":"2024-04-26T11:26:40.893719+0000","last_clean":"2024-04-26T11:26:40.893719+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:40.893719+0000","last_undegraded":"2024-04-26T11:26:40.893719+0000","last_fullsized":"2024-04-26T11:26:40.893719+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":990,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:54.086650+0000","last_change":"2024-04-26T11:27:54.086867+0000","last_active":"2024-04-26T11:27:54.086650+0000","last_peered":"2024-04-26T11:27:54.086650+0000","last_clean":"2024-04-26T11:27:54.086650+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:27:54.086650+0000","last_undegraded":"2024-04-26T11:27:54.086650+0000","last_fullsized":"2024-04-26T11:27:54.086650+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'440","last_scrub_stamp":"2024-04-26T11:27:54.086592+0000","last_deep_scrub":"71'440","last_deep_scrub_stamp":"2024-04-26T11:27:54.086592+0000","last_clean_scrub_stamp":"2024-04-26T11:27:54.086592+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:13.572538+0000","scrub_duration":0.0036755160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":944,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:34.936983+0000","last_change":"2024-04-26T11:27:34.937203+0000","last_active":"2024-04-26T11:27:34.936983+0000","last_peered":"2024-04-26T11:27:34.936983+0000","last_clean":"2024-04-26T11:27:34.936983+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:27:34.936983+0000","last_undegraded":"2024-04-26T11:27:34.936983+0000","last_fullsized":"2024-04-26T11:27:34.936983+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-26T11:27:34.936929+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-26T11:27:34.936929+0000","last_clean_scrub_stamp":"2024-04-26T11:27:34.936929+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:25.920048+0000","scrub_duration":0.0042325840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":527,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.097877+0000","last_change":"2024-04-26T11:26:58.098112+0000","last_active":"2024-04-26T11:26:58.097877+0000","last_peered":"2024-04-26T11:26:58.097877+0000","last_clean":"2024-04-26T11:26:58.097877+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:58.097877+0000","last_undegraded":"2024-04-26T11:26:58.097877+0000","last_fullsized":"2024-04-26T11:26:58.097877+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'433","last_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_deep_scrub":"71'433","last_deep_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.097826+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:39.261277+0000","scrub_duration":0.0045929860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":960,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:35.990373+0000","last_change":"2024-04-26T11:27:35.990604+0000","last_active":"2024-04-26T11:27:35.990373+0000","last_peered":"2024-04-26T11:27:35.990373+0000","last_clean":"2024-04-26T11:27:35.990373+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:27:35.990373+0000","last_undegraded":"2024-04-26T11:27:35.990373+0000","last_fullsized":"2024-04-26T11:27:35.990373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'422","last_scrub_stamp":"2024-04-26T11:27:35.990321+0000","last_deep_scrub":"71'422","last_deep_scrub_stamp":"2024-04-26T11:27:35.990321+0000","last_clean_scrub_stamp":"2024-04-26T11:27:35.990321+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:42.180497+0000","scrub_duration":0.0039948070000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1066,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:11.020271+0000","last_change":"2024-04-26T11:27:11.020512+0000","last_active":"2024-04-26T11:27:11.020271+0000","last_peered":"2024-04-26T11:27:11.020271+0000","last_clean":"2024-04-26T11:27:11.020271+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:27:11.020271+0000","last_undegraded":"2024-04-26T11:27:11.020271+0000","last_fullsized":"2024-04-26T11:27:11.020271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-26T11:27:11.020208+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-26T11:27:11.020208+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.020208+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:49.564877+0000","scrub_duration":0.0040859049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":559,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895562+0000","last_change":"2024-04-26T11:26:27.902918+0000","last_active":"2024-04-26T11:26:40.895562+0000","last_peered":"2024-04-26T11:26:40.895562+0000","last_clean":"2024-04-26T11:26:40.895562+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:26:40.895562+0000","last_undegraded":"2024-04-26T11:26:40.895562+0000","last_fullsized":"2024-04-26T11:26:40.895562+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":963,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:46.987108+0000","last_change":"2024-04-26T11:27:46.987372+0000","last_active":"2024-04-26T11:27:46.987108+0000","last_peered":"2024-04-26T11:27:46.987108+0000","last_clean":"2024-04-26T11:27:46.987108+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:27:46.987108+0000","last_undegraded":"2024-04-26T11:27:46.987108+0000","last_fullsized":"2024-04-26T11:27:46.987108+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-26T11:27:46.987053+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-26T11:27:46.987053+0000","last_clean_scrub_stamp":"2024-04-26T11:27:46.987053+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:27.678697+0000","scrub_duration":0.003826851,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":509,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372856+0000","last_change":"2024-04-26T11:22:40.572149+0000","last_active":"2024-04-26T11:26:41.372856+0000","last_peered":"2024-04-26T11:26:41.372856+0000","last_clean":"2024-04-26T11:26:41.372856+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:26:41.372856+0000","last_undegraded":"2024-04-26T11:26:41.372856+0000","last_fullsized":"2024-04-26T11:26:41.372856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":1040,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:09.107060+0000","last_change":"2024-04-26T11:27:09.107336+0000","last_active":"2024-04-26T11:27:09.107060+0000","last_peered":"2024-04-26T11:27:09.107060+0000","last_clean":"2024-04-26T11:27:09.107060+0000","last_became_active":"2024-04-26T11:26:38.373963+0000","last_became_peered":"2024-04-26T11:26:38.373963+0000","last_unstale":"2024-04-26T11:27:09.107060+0000","last_undegraded":"2024-04-26T11:27:09.107060+0000","last_fullsized":"2024-04-26T11:27:09.107060+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'461","last_scrub_stamp":"2024-04-26T11:27:09.107005+0000","last_deep_scrub":"71'461","last_deep_scrub_stamp":"2024-04-26T11:27:09.107005+0000","last_clean_scrub_stamp":"2024-04-26T11:27:09.107005+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:02.026982+0000","scrub_duration":0.0039544200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":640,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:28.974290+0000","last_change":"2024-04-26T11:27:28.974503+0000","last_active":"2024-04-26T11:27:28.974290+0000","last_peered":"2024-04-26T11:27:28.974290+0000","last_clean":"2024-04-26T11:27:28.974290+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:27:28.974290+0000","last_undegraded":"2024-04-26T11:27:28.974290+0000","last_fullsized":"2024-04-26T11:27:28.974290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'452","last_scrub_stamp":"2024-04-26T11:27:28.974238+0000","last_deep_scrub":"71'452","last_deep_scrub_stamp":"2024-04-26T11:27:28.974238+0000","last_clean_scrub_stamp":"2024-04-26T11:27:28.974238+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:48.460183+0000","scrub_duration":0.0047380240000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:17.444221+0000","last_change":"2024-04-26T11:27:17.444506+0000","last_active":"2024-04-26T11:27:17.444221+0000","last_peered":"2024-04-26T11:27:17.444221+0000","last_clean":"2024-04-26T11:27:17.444221+0000","last_became_active":"2024-04-26T11:26:40.895623+0000","last_became_peered":"2024-04-26T11:26:40.895623+0000","last_unstale":"2024-04-26T11:27:17.444221+0000","last_undegraded":"2024-04-26T11:27:17.444221+0000","last_fullsized":"2024-04-26T11:27:17.444221+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'424","last_scrub_stamp":"2024-04-26T11:27:17.444171+0000","last_deep_scrub":"71'424","last_deep_scrub_stamp":"2024-04-26T11:27:17.444171+0000","last_clean_scrub_stamp":"2024-04-26T11:27:17.444171+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:49.762789+0000","scrub_duration":0.0037779910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":497,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:50.003786+0000","last_change":"2024-04-26T11:26:50.004040+0000","last_active":"2024-04-26T11:26:50.003786+0000","last_peered":"2024-04-26T11:26:50.003786+0000","last_clean":"2024-04-26T11:26:50.003786+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:50.003786+0000","last_undegraded":"2024-04-26T11:26:50.003786+0000","last_fullsized":"2024-04-26T11:26:50.003786+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_clean_scrub_stamp":"2024-04-26T11:26:50.003733+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:47.677731+0000","scrub_duration":0.0047410569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"106'475","reported_seq":566,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:06.503180+0000","last_change":"2024-04-26T11:27:06.503394+0000","last_active":"2024-04-26T11:27:06.503180+0000","last_peered":"2024-04-26T11:27:06.503180+0000","last_clean":"2024-04-26T11:27:06.503180+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:27:06.503180+0000","last_undegraded":"2024-04-26T11:27:06.503180+0000","last_fullsized":"2024-04-26T11:27:06.503180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'475","last_scrub_stamp":"2024-04-26T11:27:06.503128+0000","last_deep_scrub":"106'475","last_deep_scrub_stamp":"2024-04-26T11:27:06.503128+0000","last_clean_scrub_stamp":"2024-04-26T11:27:06.503128+0000","objects_scrubbed":4,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:30.876920+0000","scrub_duration":0.042185009000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":517,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:33.931170+0000","last_change":"2024-04-26T11:27:33.931390+0000","last_active":"2024-04-26T11:27:33.931170+0000","last_peered":"2024-04-26T11:27:33.931170+0000","last_clean":"2024-04-26T11:27:33.931170+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:27:33.931170+0000","last_undegraded":"2024-04-26T11:27:33.931170+0000","last_fullsized":"2024-04-26T11:27:33.931170+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-26T11:27:33.931119+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-26T11:27:33.931119+0000","last_clean_scrub_stamp":"2024-04-26T11:27:33.931119+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:48.509771+0000","scrub_duration":0.0051701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:35.899107+0000","last_change":"2024-04-26T11:27:35.899321+0000","last_active":"2024-04-26T11:27:35.899107+0000","last_peered":"2024-04-26T11:27:35.899107+0000","last_clean":"2024-04-26T11:27:35.899107+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:27:35.899107+0000","last_undegraded":"2024-04-26T11:27:35.899107+0000","last_fullsized":"2024-04-26T11:27:35.899107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'62","last_scrub_stamp":"2024-04-26T11:27:35.899055+0000","last_deep_scrub":"70'62","last_deep_scrub_stamp":"2024-04-26T11:27:35.899055+0000","last_clean_scrub_stamp":"2024-04-26T11:27:35.899055+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:16.959260+0000","scrub_duration":0.003685298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":999,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498440+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:46.498440+0000","last_peered":"2024-04-26T11:26:46.498440+0000","last_clean":"2024-04-26T11:26:46.498440+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:46.498440+0000","last_undegraded":"2024-04-26T11:26:46.498440+0000","last_fullsized":"2024-04-26T11:26:46.498440+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:00.101549+0000","last_change":"2024-04-26T11:27:00.101771+0000","last_active":"2024-04-26T11:27:00.101549+0000","last_peered":"2024-04-26T11:27:00.101549+0000","last_clean":"2024-04-26T11:27:00.101549+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:27:00.101549+0000","last_undegraded":"2024-04-26T11:27:00.101549+0000","last_fullsized":"2024-04-26T11:27:00.101549+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'72","last_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_deep_scrub":"70'72","last_deep_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_clean_scrub_stamp":"2024-04-26T11:27:00.101498+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:38.755366+0000","scrub_duration":0.0029441889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":950,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.915251+0000","last_change":"2024-04-26T11:27:03.915526+0000","last_active":"2024-04-26T11:27:03.915251+0000","last_peered":"2024-04-26T11:27:03.915251+0000","last_clean":"2024-04-26T11:27:03.915251+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:27:03.915251+0000","last_undegraded":"2024-04-26T11:27:03.915251+0000","last_fullsized":"2024-04-26T11:27:03.915251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'411","last_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_deep_scrub":"71'411","last_deep_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.915200+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:44.598651+0000","scrub_duration":0.0040090890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"106'76","reported_seq":68,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:38.631208+0000","last_change":"2024-04-26T11:27:38.631416+0000","last_active":"2024-04-26T11:27:38.631208+0000","last_peered":"2024-04-26T11:27:38.631208+0000","last_clean":"2024-04-26T11:27:38.631208+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:27:38.631208+0000","last_undegraded":"2024-04-26T11:27:38.631208+0000","last_fullsized":"2024-04-26T11:27:38.631208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'76","last_scrub_stamp":"2024-04-26T11:27:38.631155+0000","last_deep_scrub":"106'76","last_deep_scrub_stamp":"2024-04-26T11:27:38.631155+0000","last_clean_scrub_stamp":"2024-04-26T11:27:38.631155+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:00.190020+0000","scrub_duration":0.012059947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"106'164","reported_seq":256,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:08.511478+0000","last_change":"2024-04-26T11:27:08.511702+0000","last_active":"2024-04-26T11:27:08.511478+0000","last_peered":"2024-04-26T11:27:08.511478+0000","last_clean":"2024-04-26T11:27:08.511478+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:27:08.511478+0000","last_undegraded":"2024-04-26T11:27:08.511478+0000","last_fullsized":"2024-04-26T11:27:08.511478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'164","last_scrub_stamp":"2024-04-26T11:27:08.511426+0000","last_deep_scrub":"106'164","last_deep_scrub_stamp":"2024-04-26T11:27:08.511426+0000","last_clean_scrub_stamp":"2024-04-26T11:27:08.511426+0000","objects_scrubbed":2,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:26.618845+0000","scrub_duration":0.024844353999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":888,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:49.997589+0000","last_change":"2024-04-26T11:27:49.997828+0000","last_active":"2024-04-26T11:27:49.997589+0000","last_peered":"2024-04-26T11:27:49.997589+0000","last_clean":"2024-04-26T11:27:49.997589+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:27:49.997589+0000","last_undegraded":"2024-04-26T11:27:49.997589+0000","last_fullsized":"2024-04-26T11:27:49.997589+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'402","last_scrub_stamp":"2024-04-26T11:27:49.997532+0000","last_deep_scrub":"71'402","last_deep_scrub_stamp":"2024-04-26T11:27:49.997532+0000","last_clean_scrub_stamp":"2024-04-26T11:27:49.997532+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:57.638791+0000","scrub_duration":0.0037416060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"106'277","reported_seq":415,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:38.001763+0000","last_change":"2024-04-26T11:27:38.001991+0000","last_active":"2024-04-26T11:27:38.001763+0000","last_peered":"2024-04-26T11:27:38.001763+0000","last_clean":"2024-04-26T11:27:38.001763+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:27:38.001763+0000","last_undegraded":"2024-04-26T11:27:38.001763+0000","last_fullsized":"2024-04-26T11:27:38.001763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'277","last_scrub_stamp":"2024-04-26T11:27:38.001710+0000","last_deep_scrub":"106'277","last_deep_scrub_stamp":"2024-04-26T11:27:38.001710+0000","last_clean_scrub_stamp":"2024-04-26T11:27:38.001710+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.703001+0000","scrub_duration":0.032027241999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":592,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.044886+0000","last_change":"2024-04-26T11:26:54.045110+0000","last_active":"2024-04-26T11:26:54.044886+0000","last_peered":"2024-04-26T11:26:54.044886+0000","last_clean":"2024-04-26T11:26:54.044886+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:54.044886+0000","last_undegraded":"2024-04-26T11:26:54.044886+0000","last_fullsized":"2024-04-26T11:26:54.044886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'455","last_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_deep_scrub":"71'455","last_deep_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.044831+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:23.986621+0000","scrub_duration":0.0050259290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"106'567","reported_seq":659,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.588175+0000","last_change":"2024-04-26T11:27:01.588510+0000","last_active":"2024-04-26T11:27:01.588175+0000","last_peered":"2024-04-26T11:27:01.588175+0000","last_clean":"2024-04-26T11:27:01.588175+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:27:01.588175+0000","last_undegraded":"2024-04-26T11:27:01.588175+0000","last_fullsized":"2024-04-26T11:27:01.588175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'567","last_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_deep_scrub":"106'567","last_deep_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.588061+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:05.825620+0000","scrub_duration":0.031697134000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":531,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893616+0000","last_change":"2024-04-26T11:26:39.905388+0000","last_active":"2024-04-26T11:26:40.893616+0000","last_peered":"2024-04-26T11:26:40.893616+0000","last_clean":"2024-04-26T11:26:40.893616+0000","last_became_active":"2024-04-26T11:26:39.900162+0000","last_became_peered":"2024-04-26T11:26:39.900162+0000","last_unstale":"2024-04-26T11:26:40.893616+0000","last_undegraded":"2024-04-26T11:26:40.893616+0000","last_fullsized":"2024-04-26T11:26:40.893616+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:40.651918+0000","last_change":"2024-04-26T11:27:40.652134+0000","last_active":"2024-04-26T11:27:40.651918+0000","last_peered":"2024-04-26T11:27:40.651918+0000","last_clean":"2024-04-26T11:27:40.651918+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:27:40.651918+0000","last_undegraded":"2024-04-26T11:27:40.651918+0000","last_fullsized":"2024-04-26T11:27:40.651918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'58","last_scrub_stamp":"2024-04-26T11:27:40.651867+0000","last_deep_scrub":"70'58","last_deep_scrub_stamp":"2024-04-26T11:27:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T11:27:40.651867+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:53.157507+0000","scrub_duration":0.0035582550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":970,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:05.965271+0000","last_change":"2024-04-26T11:27:05.965500+0000","last_active":"2024-04-26T11:27:05.965271+0000","last_peered":"2024-04-26T11:27:05.965271+0000","last_clean":"2024-04-26T11:27:05.965271+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:27:05.965271+0000","last_undegraded":"2024-04-26T11:27:05.965271+0000","last_fullsized":"2024-04-26T11:27:05.965271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_clean_scrub_stamp":"2024-04-26T11:27:05.965214+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:34:49.834938+0000","scrub_duration":0.0039580659999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"106'185","reported_seq":325,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:46.946204+0000","last_change":"2024-04-26T11:27:46.946454+0000","last_active":"2024-04-26T11:27:46.946204+0000","last_peered":"2024-04-26T11:27:46.946204+0000","last_clean":"2024-04-26T11:27:46.946204+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:27:46.946204+0000","last_undegraded":"2024-04-26T11:27:46.946204+0000","last_fullsized":"2024-04-26T11:27:46.946204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'185","last_scrub_stamp":"2024-04-26T11:27:46.946144+0000","last_deep_scrub":"106'185","last_deep_scrub_stamp":"2024-04-26T11:27:46.946144+0000","last_clean_scrub_stamp":"2024-04-26T11:27:46.946144+0000","objects_scrubbed":3,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:31.045011+0000","scrub_duration":0.040368755999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":539,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:33.534181+0000","last_change":"2024-04-26T11:27:33.534438+0000","last_active":"2024-04-26T11:27:33.534181+0000","last_peered":"2024-04-26T11:27:33.534181+0000","last_clean":"2024-04-26T11:27:33.534181+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:27:33.534181+0000","last_undegraded":"2024-04-26T11:27:33.534181+0000","last_fullsized":"2024-04-26T11:27:33.534181+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'454","last_scrub_stamp":"2024-04-26T11:27:33.534129+0000","last_deep_scrub":"71'454","last_deep_scrub_stamp":"2024-04-26T11:27:33.534129+0000","last_clean_scrub_stamp":"2024-04-26T11:27:33.534129+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:47.874020+0000","scrub_duration":0.004313679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"106'224","reported_seq":308,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:25.516420+0000","last_change":"2024-04-26T11:27:25.516689+0000","last_active":"2024-04-26T11:27:25.516420+0000","last_peered":"2024-04-26T11:27:25.516420+0000","last_clean":"2024-04-26T11:27:25.516420+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:27:25.516420+0000","last_undegraded":"2024-04-26T11:27:25.516420+0000","last_fullsized":"2024-04-26T11:27:25.516420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'224","last_scrub_stamp":"2024-04-26T11:27:25.516369+0000","last_deep_scrub":"106'224","last_deep_scrub_stamp":"2024-04-26T11:27:25.516369+0000","last_clean_scrub_stamp":"2024-04-26T11:27:25.516369+0000","objects_scrubbed":1,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:04.438733+0000","scrub_duration":0.023037851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":483,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:28.532289+0000","last_change":"2024-04-26T11:27:28.532511+0000","last_active":"2024-04-26T11:27:28.532289+0000","last_peered":"2024-04-26T11:27:28.532289+0000","last_clean":"2024-04-26T11:27:28.532289+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:27:28.532289+0000","last_undegraded":"2024-04-26T11:27:28.532289+0000","last_fullsized":"2024-04-26T11:27:28.532289+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-26T11:27:28.532239+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-26T11:27:28.532239+0000","last_clean_scrub_stamp":"2024-04-26T11:27:28.532239+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:56.163930+0000","scrub_duration":0.003558299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:05.238476+0000","last_change":"2024-04-26T11:28:05.238702+0000","last_active":"2024-04-26T11:28:05.238476+0000","last_peered":"2024-04-26T11:28:05.238476+0000","last_clean":"2024-04-26T11:28:05.238476+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:28:05.238476+0000","last_undegraded":"2024-04-26T11:28:05.238476+0000","last_fullsized":"2024-04-26T11:28:05.238476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'59","last_scrub_stamp":"2024-04-26T11:28:05.238424+0000","last_deep_scrub":"70'59","last_deep_scrub_stamp":"2024-04-26T11:28:05.238424+0000","last_clean_scrub_stamp":"2024-04-26T11:28:05.238424+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:05.376023+0000","scrub_duration":0.003275133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":458,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:05.437065+0000","last_change":"2024-04-26T11:27:05.437300+0000","last_active":"2024-04-26T11:27:05.437065+0000","last_peered":"2024-04-26T11:27:05.437065+0000","last_clean":"2024-04-26T11:27:05.437065+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:27:05.437065+0000","last_undegraded":"2024-04-26T11:27:05.437065+0000","last_fullsized":"2024-04-26T11:27:05.437065+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'359","last_scrub_stamp":"2024-04-26T11:27:05.437012+0000","last_deep_scrub":"71'359","last_deep_scrub_stamp":"2024-04-26T11:27:05.437012+0000","last_clean_scrub_stamp":"2024-04-26T11:27:05.437012+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.035867+0000","scrub_duration":0.0040043329999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"106'360","reported_seq":365,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:26.055820+0000","last_change":"2024-04-26T11:27:26.056052+0000","last_active":"2024-04-26T11:27:26.055820+0000","last_peered":"2024-04-26T11:27:26.055820+0000","last_clean":"2024-04-26T11:27:26.055820+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:27:26.055820+0000","last_undegraded":"2024-04-26T11:27:26.055820+0000","last_fullsized":"2024-04-26T11:27:26.055820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'360","last_scrub_stamp":"2024-04-26T11:27:26.055763+0000","last_deep_scrub":"106'360","last_deep_scrub_stamp":"2024-04-26T11:27:26.055763+0000","last_clean_scrub_stamp":"2024-04-26T11:27:26.055763+0000","objects_scrubbed":1,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:24.969559+0000","scrub_duration":0.033125239000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":565,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.907340+0000","last_change":"2024-04-26T11:27:01.907573+0000","last_active":"2024-04-26T11:27:01.907340+0000","last_peered":"2024-04-26T11:27:01.907340+0000","last_clean":"2024-04-26T11:27:01.907340+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:27:01.907340+0000","last_undegraded":"2024-04-26T11:27:01.907340+0000","last_fullsized":"2024-04-26T11:27:01.907340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.907287+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:00.821083+0000","scrub_duration":0.0045510610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"106'159","reported_seq":261,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:43.695999+0000","last_change":"2024-04-26T11:27:43.696225+0000","last_active":"2024-04-26T11:27:43.695999+0000","last_peered":"2024-04-26T11:27:43.695999+0000","last_clean":"2024-04-26T11:27:43.695999+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:27:43.695999+0000","last_undegraded":"2024-04-26T11:27:43.695999+0000","last_fullsized":"2024-04-26T11:27:43.695999+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'159","last_scrub_stamp":"2024-04-26T11:27:43.695947+0000","last_deep_scrub":"106'159","last_deep_scrub_stamp":"2024-04-26T11:27:43.695947+0000","last_clean_scrub_stamp":"2024-04-26T11:27:43.695947+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:18.719077+0000","scrub_duration":0.0098550570000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:14.398167+0000","last_change":"2024-04-26T11:27:14.398442+0000","last_active":"2024-04-26T11:27:14.398167+0000","last_peered":"2024-04-26T11:27:14.398167+0000","last_clean":"2024-04-26T11:27:14.398167+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:27:14.398167+0000","last_undegraded":"2024-04-26T11:27:14.398167+0000","last_fullsized":"2024-04-26T11:27:14.398167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:14.398118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:14.398118+0000","last_clean_scrub_stamp":"2024-04-26T11:27:14.398118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:26.192505+0000","scrub_duration":0.0032486720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"70'753","reported_seq":852,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373222+0000","last_change":"2024-04-26T11:22:40.573560+0000","last_active":"2024-04-26T11:26:41.373222+0000","last_peered":"2024-04-26T11:26:41.373222+0000","last_clean":"2024-04-26T11:26:41.373222+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:26:41.373222+0000","last_undegraded":"2024-04-26T11:26:41.373222+0000","last_fullsized":"2024-04-26T11:26:41.373222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":515,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895391+0000","last_change":"2024-04-26T11:26:24.910671+0000","last_active":"2024-04-26T11:26:40.895391+0000","last_peered":"2024-04-26T11:26:40.895391+0000","last_clean":"2024-04-26T11:26:40.895391+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:26:40.895391+0000","last_undegraded":"2024-04-26T11:26:40.895391+0000","last_fullsized":"2024-04-26T11:26:40.895391+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.409683+0000","last_change":"2024-04-26T11:27:15.409932+0000","last_active":"2024-04-26T11:27:15.409683+0000","last_peered":"2024-04-26T11:27:15.409683+0000","last_clean":"2024-04-26T11:27:15.409683+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:27:15.409683+0000","last_undegraded":"2024-04-26T11:27:15.409683+0000","last_fullsized":"2024-04-26T11:27:15.409683+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:15.409633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:15.409633+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.409633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:38.286104+0000","scrub_duration":0.0031725590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"71'114","reported_seq":293,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.372609+0000","last_change":"2024-04-26T11:26:14.611309+0000","last_active":"2024-04-26T11:26:41.372609+0000","last_peered":"2024-04-26T11:26:41.372609+0000","last_clean":"2024-04-26T11:26:41.372609+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:26:41.372609+0000","last_undegraded":"2024-04-26T11:26:41.372609+0000","last_fullsized":"2024-04-26T11:26:41.372609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":574,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:22.039392+0000","last_change":"2024-04-26T11:27:22.039648+0000","last_active":"2024-04-26T11:27:22.039392+0000","last_peered":"2024-04-26T11:27:22.039392+0000","last_clean":"2024-04-26T11:27:22.039392+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:27:22.039392+0000","last_undegraded":"2024-04-26T11:27:22.039392+0000","last_fullsized":"2024-04-26T11:27:22.039392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'444","last_scrub_stamp":"2024-04-26T11:27:22.039342+0000","last_deep_scrub":"71'444","last_deep_scrub_stamp":"2024-04-26T11:27:22.039342+0000","last_clean_scrub_stamp":"2024-04-26T11:27:22.039342+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:51.178326+0000","scrub_duration":0.0046559649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":117,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:41.891342+0000","last_change":"2024-04-26T11:27:41.891342+0000","last_active":"2024-04-26T11:27:41.891342+0000","last_peered":"2024-04-26T11:27:41.891342+0000","last_clean":"2024-04-26T11:27:41.891342+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:27:41.891342+0000","last_undegraded":"2024-04-26T11:27:41.891342+0000","last_fullsized":"2024-04-26T11:27:41.891342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:41.891074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:41.891074+0000","last_clean_scrub_stamp":"2024-04-26T11:27:41.891074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:42.028673+0000","scrub_duration":0.0032036479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"106'379","reported_seq":497,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:00.161581+0000","last_change":"2024-04-26T11:28:00.161893+0000","last_active":"2024-04-26T11:28:00.161581+0000","last_peered":"2024-04-26T11:28:00.161581+0000","last_clean":"2024-04-26T11:28:00.161581+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:28:00.161581+0000","last_undegraded":"2024-04-26T11:28:00.161581+0000","last_fullsized":"2024-04-26T11:28:00.161581+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'379","last_scrub_stamp":"2024-04-26T11:28:00.161528+0000","last_deep_scrub":"106'379","last_deep_scrub_stamp":"2024-04-26T11:28:00.161528+0000","last_clean_scrub_stamp":"2024-04-26T11:28:00.161528+0000","objects_scrubbed":2,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:51.144647+0000","scrub_duration":0.036958244000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":465,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:13.017518+0000","last_change":"2024-04-26T11:27:13.017795+0000","last_active":"2024-04-26T11:27:13.017518+0000","last_peered":"2024-04-26T11:27:13.017518+0000","last_clean":"2024-04-26T11:27:13.017518+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:27:13.017518+0000","last_undegraded":"2024-04-26T11:27:13.017518+0000","last_fullsized":"2024-04-26T11:27:13.017518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'334","last_scrub_stamp":"2024-04-26T11:27:13.017468+0000","last_deep_scrub":"71'334","last_deep_scrub_stamp":"2024-04-26T11:27:13.017468+0000","last_clean_scrub_stamp":"2024-04-26T11:27:13.017468+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:48.346628+0000","scrub_duration":0.0044577050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:52.649555+0000","last_change":"2024-04-26T11:27:52.649768+0000","last_active":"2024-04-26T11:27:52.649555+0000","last_peered":"2024-04-26T11:27:52.649555+0000","last_clean":"2024-04-26T11:27:52.649555+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:27:52.649555+0000","last_undegraded":"2024-04-26T11:27:52.649555+0000","last_fullsized":"2024-04-26T11:27:52.649555+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:52.649503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:52.649503+0000","last_clean_scrub_stamp":"2024-04-26T11:27:52.649503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:54.233318+0000","scrub_duration":0.003234579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:04.483954+0000","last_change":"2024-04-26T11:28:04.484225+0000","last_active":"2024-04-26T11:28:04.483954+0000","last_peered":"2024-04-26T11:28:04.483954+0000","last_clean":"2024-04-26T11:28:04.483954+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:28:04.483954+0000","last_undegraded":"2024-04-26T11:28:04.483954+0000","last_fullsized":"2024-04-26T11:28:04.483954+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'79","last_scrub_stamp":"2024-04-26T11:28:04.483898+0000","last_deep_scrub":"70'79","last_deep_scrub_stamp":"2024-04-26T11:28:04.483898+0000","last_clean_scrub_stamp":"2024-04-26T11:28:04.483898+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:41.466273+0000","scrub_duration":0.0033086280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":574,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:22.966742+0000","last_change":"2024-04-26T11:27:22.966985+0000","last_active":"2024-04-26T11:27:22.966742+0000","last_peered":"2024-04-26T11:27:22.966742+0000","last_clean":"2024-04-26T11:27:22.966742+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:27:22.966742+0000","last_undegraded":"2024-04-26T11:27:22.966742+0000","last_fullsized":"2024-04-26T11:27:22.966742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-26T11:27:22.966689+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-26T11:27:22.966689+0000","last_clean_scrub_stamp":"2024-04-26T11:27:22.966689+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:56.913479+0000","scrub_duration":0.0049556590000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"70'498","reported_seq":571,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.894557+0000","last_change":"2024-04-26T11:26:14.133862+0000","last_active":"2024-04-26T11:26:40.894557+0000","last_peered":"2024-04-26T11:26:40.894557+0000","last_clean":"2024-04-26T11:26:40.894557+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:26:40.894557+0000","last_undegraded":"2024-04-26T11:26:40.894557+0000","last_fullsized":"2024-04-26T11:26:40.894557+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":103,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:50.330954+0000","last_change":"2024-04-26T11:22:40.574533+0000","last_active":"2024-04-26T11:26:50.330954+0000","last_peered":"2024-04-26T11:26:50.330954+0000","last_clean":"2024-04-26T11:26:50.330954+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:26:50.330954+0000","last_undegraded":"2024-04-26T11:26:50.330954+0000","last_fullsized":"2024-04-26T11:26:50.330954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":804,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:29.994026+0000","last_change":"2024-04-26T11:27:29.994255+0000","last_active":"2024-04-26T11:27:29.994026+0000","last_peered":"2024-04-26T11:27:29.994026+0000","last_clean":"2024-04-26T11:27:29.994026+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:27:29.994026+0000","last_undegraded":"2024-04-26T11:27:29.994026+0000","last_fullsized":"2024-04-26T11:27:29.994026+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'351","last_scrub_stamp":"2024-04-26T11:27:29.993974+0000","last_deep_scrub":"71'351","last_deep_scrub_stamp":"2024-04-26T11:27:29.993974+0000","last_clean_scrub_stamp":"2024-04-26T11:27:29.993974+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:35:13.863697+0000","scrub_duration":0.0044014229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":170,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:48.898315+0000","last_change":"2024-04-26T11:27:48.898532+0000","last_active":"2024-04-26T11:27:48.898315+0000","last_peered":"2024-04-26T11:27:48.898315+0000","last_clean":"2024-04-26T11:27:48.898315+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:27:48.898315+0000","last_undegraded":"2024-04-26T11:27:48.898315+0000","last_fullsized":"2024-04-26T11:27:48.898315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'57","last_scrub_stamp":"2024-04-26T11:27:48.898263+0000","last_deep_scrub":"70'57","last_deep_scrub_stamp":"2024-04-26T11:27:48.898263+0000","last_clean_scrub_stamp":"2024-04-26T11:27:48.898263+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:02.150454+0000","scrub_duration":0.003307787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.375446+0000","last_change":"2024-04-26T11:26:22.406401+0000","last_active":"2024-04-26T11:26:41.375446+0000","last_peered":"2024-04-26T11:26:41.375446+0000","last_clean":"2024-04-26T11:26:41.375446+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:26:41.375446+0000","last_undegraded":"2024-04-26T11:26:41.375446+0000","last_fullsized":"2024-04-26T11:26:41.375446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":829,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:21.037998+0000","last_change":"2024-04-26T11:27:21.038232+0000","last_active":"2024-04-26T11:27:21.037998+0000","last_peered":"2024-04-26T11:27:21.037998+0000","last_clean":"2024-04-26T11:27:21.037998+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:27:21.037998+0000","last_undegraded":"2024-04-26T11:27:21.037998+0000","last_fullsized":"2024-04-26T11:27:21.037998+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'376","last_scrub_stamp":"2024-04-26T11:27:21.037943+0000","last_deep_scrub":"71'376","last_deep_scrub_stamp":"2024-04-26T11:27:21.037943+0000","last_clean_scrub_stamp":"2024-04-26T11:27:21.037943+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.198741+0000","scrub_duration":0.0040199060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"106'61","reported_seq":174,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:50.930787+0000","last_change":"2024-04-26T11:27:50.931076+0000","last_active":"2024-04-26T11:27:50.930787+0000","last_peered":"2024-04-26T11:27:50.930787+0000","last_clean":"2024-04-26T11:27:50.930787+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:27:50.930787+0000","last_undegraded":"2024-04-26T11:27:50.930787+0000","last_fullsized":"2024-04-26T11:27:50.930787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'61","last_scrub_stamp":"2024-04-26T11:27:50.930733+0000","last_deep_scrub":"106'61","last_deep_scrub_stamp":"2024-04-26T11:27:50.930733+0000","last_clean_scrub_stamp":"2024-04-26T11:27:50.930733+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:36.226248+0000","scrub_duration":0.0067521899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.374508+0000","last_change":"2024-04-26T11:22:40.575573+0000","last_active":"2024-04-26T11:26:41.374508+0000","last_peered":"2024-04-26T11:26:41.374508+0000","last_clean":"2024-04-26T11:26:41.374508+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:26:41.374508+0000","last_undegraded":"2024-04-26T11:26:41.374508+0000","last_fullsized":"2024-04-26T11:26:41.374508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:48.269501+0000","last_clean_scrub_stamp":"2024-04-26T11:21:48.269501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":928,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:50.331883+0000","last_change":"2024-04-26T11:26:39.378496+0000","last_active":"2024-04-26T11:26:50.331883+0000","last_peered":"2024-04-26T11:26:50.331883+0000","last_clean":"2024-04-26T11:26:50.331883+0000","last_became_active":"2024-04-26T11:26:39.375075+0000","last_became_peered":"2024-04-26T11:26:39.375075+0000","last_unstale":"2024-04-26T11:26:50.331883+0000","last_undegraded":"2024-04-26T11:26:50.331883+0000","last_fullsized":"2024-04-26T11:26:50.331883+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"106'72","reported_seq":203,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:49.926255+0000","last_change":"2024-04-26T11:27:49.926492+0000","last_active":"2024-04-26T11:27:49.926255+0000","last_peered":"2024-04-26T11:27:49.926255+0000","last_clean":"2024-04-26T11:27:49.926255+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:27:49.926255+0000","last_undegraded":"2024-04-26T11:27:49.926255+0000","last_fullsized":"2024-04-26T11:27:49.926255+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'72","last_scrub_stamp":"2024-04-26T11:27:49.926200+0000","last_deep_scrub":"106'72","last_deep_scrub_stamp":"2024-04-26T11:27:49.926200+0000","last_clean_scrub_stamp":"2024-04-26T11:27:49.926200+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.161530+0000","scrub_duration":0.026289052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":62,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:06.547127+0000","last_change":"2024-04-26T11:28:06.547357+0000","last_active":"2024-04-26T11:28:06.547127+0000","last_peered":"2024-04-26T11:28:06.547127+0000","last_clean":"2024-04-26T11:28:06.547127+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:28:06.547127+0000","last_undegraded":"2024-04-26T11:28:06.547127+0000","last_fullsized":"2024-04-26T11:28:06.547127+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:28:06.547079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:28:06.547079+0000","last_clean_scrub_stamp":"2024-04-26T11:28:06.547079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:12.810401+0000","scrub_duration":0.003433714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":942,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:39.936798+0000","last_change":"2024-04-26T11:27:39.937043+0000","last_active":"2024-04-26T11:27:39.936798+0000","last_peered":"2024-04-26T11:27:39.936798+0000","last_clean":"2024-04-26T11:27:39.936798+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:27:39.936798+0000","last_undegraded":"2024-04-26T11:27:39.936798+0000","last_fullsized":"2024-04-26T11:27:39.936798+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-26T11:27:39.936745+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-26T11:27:39.936745+0000","last_clean_scrub_stamp":"2024-04-26T11:27:39.936745+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:26.877705+0000","scrub_duration":0.0041433700000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":524,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:53.400187+0000","last_change":"2024-04-26T11:26:53.400430+0000","last_active":"2024-04-26T11:26:53.400187+0000","last_peered":"2024-04-26T11:26:53.400187+0000","last_clean":"2024-04-26T11:26:53.400187+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:53.400187+0000","last_undegraded":"2024-04-26T11:26:53.400187+0000","last_fullsized":"2024-04-26T11:26:53.400187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'415","last_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_deep_scrub":"71'415","last_deep_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_clean_scrub_stamp":"2024-04-26T11:26:53.400136+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:43.847441+0000","scrub_duration":0.0041863550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"106'410","reported_seq":509,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:53.676581+0000","last_change":"2024-04-26T11:27:53.676852+0000","last_active":"2024-04-26T11:27:53.676581+0000","last_peered":"2024-04-26T11:27:53.676581+0000","last_clean":"2024-04-26T11:27:53.676581+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:27:53.676581+0000","last_undegraded":"2024-04-26T11:27:53.676581+0000","last_fullsized":"2024-04-26T11:27:53.676581+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'410","last_scrub_stamp":"2024-04-26T11:27:53.676525+0000","last_deep_scrub":"106'410","last_deep_scrub_stamp":"2024-04-26T11:27:53.676525+0000","last_clean_scrub_stamp":"2024-04-26T11:27:53.676525+0000","objects_scrubbed":6,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:57.894166+0000","scrub_duration":0.044552915999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":568,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:56.983899+0000","last_change":"2024-04-26T11:26:56.984139+0000","last_active":"2024-04-26T11:26:56.983899+0000","last_peered":"2024-04-26T11:26:56.983899+0000","last_clean":"2024-04-26T11:26:56.983899+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:56.983899+0000","last_undegraded":"2024-04-26T11:26:56.983899+0000","last_fullsized":"2024-04-26T11:26:56.983899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'425","last_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_deep_scrub":"71'425","last_deep_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_clean_scrub_stamp":"2024-04-26T11:26:56.983841+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:06.726299+0000","scrub_duration":0.0046040439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"71'90","reported_seq":183,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.477440+0000","last_change":"2024-04-26T11:26:22.406866+0000","last_active":"2024-04-26T11:26:46.477440+0000","last_peered":"2024-04-26T11:26:46.477440+0000","last_clean":"2024-04-26T11:26:46.477440+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:26:46.477440+0000","last_undegraded":"2024-04-26T11:26:46.477440+0000","last_fullsized":"2024-04-26T11:26:46.477440+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"106'345","reported_seq":429,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:32.598123+0000","last_change":"2024-04-26T11:27:32.598338+0000","last_active":"2024-04-26T11:27:32.598123+0000","last_peered":"2024-04-26T11:27:32.598123+0000","last_clean":"2024-04-26T11:27:32.598123+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:27:32.598123+0000","last_undegraded":"2024-04-26T11:27:32.598123+0000","last_fullsized":"2024-04-26T11:27:32.598123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'345","last_scrub_stamp":"2024-04-26T11:27:32.598068+0000","last_deep_scrub":"106'345","last_deep_scrub_stamp":"2024-04-26T11:27:32.598068+0000","last_clean_scrub_stamp":"2024-04-26T11:27:32.598068+0000","objects_scrubbed":1,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:49.040005+0000","scrub_duration":0.028263885999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":1037,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:57.986343+0000","last_change":"2024-04-26T11:26:57.986559+0000","last_active":"2024-04-26T11:26:57.986343+0000","last_peered":"2024-04-26T11:26:57.986343+0000","last_clean":"2024-04-26T11:26:57.986343+0000","last_became_active":"2024-04-26T11:26:38.373800+0000","last_became_peered":"2024-04-26T11:26:38.373800+0000","last_unstale":"2024-04-26T11:26:57.986343+0000","last_undegraded":"2024-04-26T11:26:57.986343+0000","last_fullsized":"2024-04-26T11:26:57.986343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'468","last_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_deep_scrub":"71'468","last_deep_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_clean_scrub_stamp":"2024-04-26T11:26:57.986292+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:27.125276+0000","scrub_duration":0.0037409510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":178,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:30.984202+0000","last_change":"2024-04-26T11:27:30.984422+0000","last_active":"2024-04-26T11:27:30.984202+0000","last_peered":"2024-04-26T11:27:30.984202+0000","last_clean":"2024-04-26T11:27:30.984202+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:27:30.984202+0000","last_undegraded":"2024-04-26T11:27:30.984202+0000","last_fullsized":"2024-04-26T11:27:30.984202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'52","last_scrub_stamp":"2024-04-26T11:27:30.984151+0000","last_deep_scrub":"70'52","last_deep_scrub_stamp":"2024-04-26T11:27:30.984151+0000","last_clean_scrub_stamp":"2024-04-26T11:27:30.984151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:01.509557+0000","scrub_duration":0.0034089770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":582,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.962038+0000","last_change":"2024-04-26T11:26:58.962297+0000","last_active":"2024-04-26T11:26:58.962038+0000","last_peered":"2024-04-26T11:26:58.962038+0000","last_clean":"2024-04-26T11:26:58.962038+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:58.962038+0000","last_undegraded":"2024-04-26T11:26:58.962038+0000","last_fullsized":"2024-04-26T11:26:58.962038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'454","last_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_deep_scrub":"71'454","last_deep_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.961980+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:21.020921+0000","scrub_duration":0.0044732579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":804,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:23.050748+0000","last_change":"2024-04-26T11:27:23.051045+0000","last_active":"2024-04-26T11:27:23.050748+0000","last_peered":"2024-04-26T11:27:23.050748+0000","last_clean":"2024-04-26T11:27:23.050748+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:27:23.050748+0000","last_undegraded":"2024-04-26T11:27:23.050748+0000","last_fullsized":"2024-04-26T11:27:23.050748+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'352","last_scrub_stamp":"2024-04-26T11:27:23.050694+0000","last_deep_scrub":"71'352","last_deep_scrub_stamp":"2024-04-26T11:27:23.050694+0000","last_clean_scrub_stamp":"2024-04-26T11:27:23.050694+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:45.109635+0000","scrub_duration":0.0037690789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"106'589","reported_seq":702,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:42.979638+0000","last_change":"2024-04-26T11:27:42.979875+0000","last_active":"2024-04-26T11:27:42.979638+0000","last_peered":"2024-04-26T11:27:42.979638+0000","last_clean":"2024-04-26T11:27:42.979638+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:27:42.979638+0000","last_undegraded":"2024-04-26T11:27:42.979638+0000","last_fullsized":"2024-04-26T11:27:42.979638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'589","last_scrub_stamp":"2024-04-26T11:27:42.979583+0000","last_deep_scrub":"106'589","last_deep_scrub_stamp":"2024-04-26T11:27:42.979583+0000","last_clean_scrub_stamp":"2024-04-26T11:27:42.979583+0000","objects_scrubbed":2,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:29.434420+0000","scrub_duration":0.052572714999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":924,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:50.331533+0000","last_change":"2024-04-26T11:26:24.382336+0000","last_active":"2024-04-26T11:26:50.331533+0000","last_peered":"2024-04-26T11:26:50.331533+0000","last_clean":"2024-04-26T11:26:50.331533+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:26:50.331533+0000","last_undegraded":"2024-04-26T11:26:50.331533+0000","last_fullsized":"2024-04-26T11:26:50.331533+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"106'271","reported_seq":408,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:56.059175+0000","last_change":"2024-04-26T11:27:56.059489+0000","last_active":"2024-04-26T11:27:56.059175+0000","last_peered":"2024-04-26T11:27:56.059175+0000","last_clean":"2024-04-26T11:27:56.059175+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:27:56.059175+0000","last_undegraded":"2024-04-26T11:27:56.059175+0000","last_fullsized":"2024-04-26T11:27:56.059175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'271","last_scrub_stamp":"2024-04-26T11:27:56.059067+0000","last_deep_scrub":"106'271","last_deep_scrub_stamp":"2024-04-26T11:27:56.059067+0000","last_clean_scrub_stamp":"2024-04-26T11:27:56.059067+0000","objects_scrubbed":1,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:38.198483+0000","scrub_duration":0.029952316999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1029,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.080170+0000","last_change":"2024-04-26T11:27:15.080408+0000","last_active":"2024-04-26T11:27:15.080170+0000","last_peered":"2024-04-26T11:27:15.080170+0000","last_clean":"2024-04-26T11:27:15.080170+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:27:15.080170+0000","last_undegraded":"2024-04-26T11:27:15.080170+0000","last_fullsized":"2024-04-26T11:27:15.080170+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'439","last_scrub_stamp":"2024-04-26T11:27:15.080115+0000","last_deep_scrub":"71'439","last_deep_scrub_stamp":"2024-04-26T11:27:15.080115+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.080115+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:37.378024+0000","scrub_duration":0.0040451460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"106'377","reported_seq":446,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:02.238246+0000","last_change":"2024-04-26T11:28:02.238492+0000","last_active":"2024-04-26T11:28:02.238246+0000","last_peered":"2024-04-26T11:28:02.238246+0000","last_clean":"2024-04-26T11:28:02.238246+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:28:02.238246+0000","last_undegraded":"2024-04-26T11:28:02.238246+0000","last_fullsized":"2024-04-26T11:28:02.238246+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'377","last_scrub_stamp":"2024-04-26T11:28:02.238190+0000","last_deep_scrub":"106'377","last_deep_scrub_stamp":"2024-04-26T11:28:02.238190+0000","last_clean_scrub_stamp":"2024-04-26T11:28:02.238190+0000","objects_scrubbed":3,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:12.560437+0000","scrub_duration":0.052441278000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:52.009464+0000","last_change":"2024-04-26T11:26:52.009713+0000","last_active":"2024-04-26T11:26:52.009464+0000","last_peered":"2024-04-26T11:26:52.009464+0000","last_clean":"2024-04-26T11:26:52.009464+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:52.009464+0000","last_undegraded":"2024-04-26T11:26:52.009464+0000","last_fullsized":"2024-04-26T11:26:52.009464+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_clean_scrub_stamp":"2024-04-26T11:26:52.009412+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:59.423751+0000","scrub_duration":0.0045503360000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"70'61","reported_seq":154,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:49.880095+0000","last_change":"2024-04-26T11:26:22.404981+0000","last_active":"2024-04-26T11:26:49.880095+0000","last_peered":"2024-04-26T11:26:49.880095+0000","last_clean":"2024-04-26T11:26:49.880095+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:26:49.880095+0000","last_undegraded":"2024-04-26T11:26:49.880095+0000","last_fullsized":"2024-04-26T11:26:49.880095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:52.296572+0000","last_clean_scrub_stamp":"2024-04-26T11:21:52.296572+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":487,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.491082+0000","last_change":"2024-04-26T11:27:03.491361+0000","last_active":"2024-04-26T11:27:03.491082+0000","last_peered":"2024-04-26T11:27:03.491082+0000","last_clean":"2024-04-26T11:27:03.491082+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:27:03.491082+0000","last_undegraded":"2024-04-26T11:27:03.491082+0000","last_fullsized":"2024-04-26T11:27:03.491082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'375","last_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_deep_scrub":"71'375","last_deep_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.491032+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:52.444748+0000","scrub_duration":0.0043129789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"106'328","reported_seq":418,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:57.584921+0000","last_change":"2024-04-26T11:27:57.585141+0000","last_active":"2024-04-26T11:27:57.584921+0000","last_peered":"2024-04-26T11:27:57.584921+0000","last_clean":"2024-04-26T11:27:57.584921+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:27:57.584921+0000","last_undegraded":"2024-04-26T11:27:57.584921+0000","last_fullsized":"2024-04-26T11:27:57.584921+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'328","last_scrub_stamp":"2024-04-26T11:27:57.584866+0000","last_deep_scrub":"106'328","last_deep_scrub_stamp":"2024-04-26T11:27:57.584866+0000","last_clean_scrub_stamp":"2024-04-26T11:27:57.584866+0000","objects_scrubbed":2,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:15.471404+0000","scrub_duration":0.026502560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":503,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:09.525104+0000","last_change":"2024-04-26T11:27:09.525341+0000","last_active":"2024-04-26T11:27:09.525104+0000","last_peered":"2024-04-26T11:27:09.525104+0000","last_clean":"2024-04-26T11:27:09.525104+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:27:09.525104+0000","last_undegraded":"2024-04-26T11:27:09.525104+0000","last_fullsized":"2024-04-26T11:27:09.525104+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-26T11:27:09.525054+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-26T11:27:09.525054+0000","last_clean_scrub_stamp":"2024-04-26T11:27:09.525054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:30.705220+0000","scrub_duration":0.0044574929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"106'394","reported_seq":514,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:04.167993+0000","last_change":"2024-04-26T11:27:04.168232+0000","last_active":"2024-04-26T11:27:04.167993+0000","last_peered":"2024-04-26T11:27:04.167993+0000","last_clean":"2024-04-26T11:27:04.167993+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:27:04.167993+0000","last_undegraded":"2024-04-26T11:27:04.167993+0000","last_fullsized":"2024-04-26T11:27:04.167993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'394","last_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_deep_scrub":"106'394","last_deep_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_clean_scrub_stamp":"2024-04-26T11:27:04.167933+0000","objects_scrubbed":4,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.292388+0000","scrub_duration":0.059480993000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":499,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:41.373982+0000","last_change":"2024-04-26T11:26:22.399751+0000","last_active":"2024-04-26T11:26:41.373982+0000","last_peered":"2024-04-26T11:26:41.373982+0000","last_clean":"2024-04-26T11:26:41.373982+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:26:41.373982+0000","last_undegraded":"2024-04-26T11:26:41.373982+0000","last_fullsized":"2024-04-26T11:26:41.373982+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"106'58","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:04.024643+0000","last_change":"2024-04-26T11:28:04.024856+0000","last_active":"2024-04-26T11:28:04.024643+0000","last_peered":"2024-04-26T11:28:04.024643+0000","last_clean":"2024-04-26T11:28:04.024643+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:28:04.024643+0000","last_undegraded":"2024-04-26T11:28:04.024643+0000","last_fullsized":"2024-04-26T11:28:04.024643+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'58","last_scrub_stamp":"2024-04-26T11:28:04.024591+0000","last_deep_scrub":"106'58","last_deep_scrub_stamp":"2024-04-26T11:28:04.024591+0000","last_clean_scrub_stamp":"2024-04-26T11:28:04.024591+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:46.722631+0000","scrub_duration":0.016948365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":554,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:59.498154+0000","last_change":"2024-04-26T11:26:59.498428+0000","last_active":"2024-04-26T11:26:59.498154+0000","last_peered":"2024-04-26T11:26:59.498154+0000","last_clean":"2024-04-26T11:26:59.498154+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:59.498154+0000","last_undegraded":"2024-04-26T11:26:59.498154+0000","last_fullsized":"2024-04-26T11:26:59.498154+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'446","last_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_deep_scrub":"71'446","last_deep_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_clean_scrub_stamp":"2024-04-26T11:26:59.498100+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:08.316575+0000","scrub_duration":0.003708294,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"106'133","reported_seq":271,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:25.003141+0000","last_change":"2024-04-26T11:27:25.003403+0000","last_active":"2024-04-26T11:27:25.003141+0000","last_peered":"2024-04-26T11:27:25.003141+0000","last_clean":"2024-04-26T11:27:25.003141+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:27:25.003141+0000","last_undegraded":"2024-04-26T11:27:25.003141+0000","last_fullsized":"2024-04-26T11:27:25.003141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'133","last_scrub_stamp":"2024-04-26T11:27:25.003082+0000","last_deep_scrub":"106'133","last_deep_scrub_stamp":"2024-04-26T11:27:25.003082+0000","last_clean_scrub_stamp":"2024-04-26T11:27:25.003082+0000","objects_scrubbed":3,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:32.644341+0000","scrub_duration":0.025665877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7700,"ondisk_log_size":7700,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738450,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146528,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94225312,"statfs":{"total":96636764160,"available":96486719488,"internally_reserved":0,"allocated":31744000,"data_stored":81613145,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71799999999999997}]},{"osd":1,"last update":"Fri Apr 26 11:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.66400000000000003,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.84299999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.629,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.57099999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738450,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124348,"kb_used_data":30964,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247492,"statfs":{"total":96636764160,"available":96509431808,"internally_reserved":0,"allocated":31707136,"data_stored":86117265,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.66000000000000003}]},{"osd":2,"last update":"Fri Apr 26 11:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.68200000000000005},"min":{"1min":0.54700000000000004,"5min":0.312,"15min":0.312},"max":{"1min":0.755,"5min":0.80400000000000005,"15min":0.93000000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63100000000000001,"15min":0.68100000000000005},"min":{"1min":0.52600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.80500000000000005,"5min":0.83999999999999997,"15min":0.84499999999999997},"last":0.63700000000000001}]}]},{"osd":0,"up_from":75,"seq":322122547226,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75932,"kb_used_data":18068,"kb_used_omap":7,"kb_used_meta":57848,"kb_avail":94295908,"statfs":{"total":96636764160,"available":96559009792,"internally_reserved":0,"allocated":18501632,"data_stored":91781533,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":59237367},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Apr 26 11:27:11 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.65000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:28:12.098 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.098 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.098 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.098 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.098 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.099 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.099 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.099 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.099 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.099 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.100 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.100 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.100 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.100 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.100 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.101 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.101 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.101 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T11:21:48.269501+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=48, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.101 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.101 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.101 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.102 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T11:21:52.296572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=52, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.102 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:12.102 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:28:32.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:28:32.408 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:28:32.410 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:28:32.424 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-04-26T11:28:31.492345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7334,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34417,"ondisk_log_size":34417,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":346808,"kb_used_data":80032,"kb_used_omap":10,"kb_used_meta":266741,"kb_avail":282768712,"statfs":{"total":289910292480,"available":289555161088,"internally_reserved":0,"allocated":81952768,"data_stored":259511943,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":273143683},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004620"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":522,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:11.073124+0000","last_change":"2024-04-26T11:27:11.073124+0000","last_active":"2024-04-26T11:27:11.073124+0000","last_peered":"2024-04-26T11:27:11.073124+0000","last_clean":"2024-04-26T11:27:11.073124+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:27:11.073124+0000","last_undegraded":"2024-04-26T11:27:11.073124+0000","last_fullsized":"2024-04-26T11:27:11.073124+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:27:11.072854+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:27:11.072854+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.072854+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:41.048439+0000","scrub_duration":0.0036583589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":578,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:16.039433+0000","last_change":"2024-04-26T11:27:16.039433+0000","last_active":"2024-04-26T11:27:16.039433+0000","last_peered":"2024-04-26T11:27:16.039433+0000","last_clean":"2024-04-26T11:27:16.039433+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:27:16.039433+0000","last_undegraded":"2024-04-26T11:27:16.039433+0000","last_fullsized":"2024-04-26T11:27:16.039433+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'427","last_scrub_stamp":"2024-04-26T11:27:16.039112+0000","last_deep_scrub":"71'427","last_deep_scrub_stamp":"2024-04-26T11:27:16.039112+0000","last_clean_scrub_stamp":"2024-04-26T11:27:16.039112+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:41.912448+0000","scrub_duration":0.0051090520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":442,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:48.951088+0000","last_change":"2024-04-26T11:26:22.899296+0000","last_active":"2024-04-26T11:26:48.951088+0000","last_peered":"2024-04-26T11:26:48.951088+0000","last_clean":"2024-04-26T11:26:48.951088+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:26:48.951088+0000","last_undegraded":"2024-04-26T11:26:48.951088+0000","last_fullsized":"2024-04-26T11:26:48.951088+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":502,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:14.553869+0000","last_change":"2024-04-26T11:28:14.553869+0000","last_active":"2024-04-26T11:28:14.553869+0000","last_peered":"2024-04-26T11:28:14.553869+0000","last_clean":"2024-04-26T11:28:14.553869+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:28:14.553869+0000","last_undegraded":"2024-04-26T11:28:14.553869+0000","last_fullsized":"2024-04-26T11:28:14.553869+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'391","last_scrub_stamp":"2024-04-26T11:28:14.553593+0000","last_deep_scrub":"71'391","last_deep_scrub_stamp":"2024-04-26T11:28:14.553593+0000","last_clean_scrub_stamp":"2024-04-26T11:28:14.553593+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:35.685181+0000","scrub_duration":0.0035977100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":552,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:06.222463+0000","last_change":"2024-04-26T11:28:06.222682+0000","last_active":"2024-04-26T11:28:06.222463+0000","last_peered":"2024-04-26T11:28:06.222463+0000","last_clean":"2024-04-26T11:28:06.222463+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:28:06.222463+0000","last_undegraded":"2024-04-26T11:28:06.222463+0000","last_fullsized":"2024-04-26T11:28:06.222463+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'432","last_scrub_stamp":"2024-04-26T11:28:06.222413+0000","last_deep_scrub":"71'432","last_deep_scrub_stamp":"2024-04-26T11:28:06.222413+0000","last_clean_scrub_stamp":"2024-04-26T11:28:06.222413+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:03.342933+0000","scrub_duration":0.0044749630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":505,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:19.665433+0000","last_change":"2024-04-26T11:28:19.665709+0000","last_active":"2024-04-26T11:28:19.665433+0000","last_peered":"2024-04-26T11:28:19.665433+0000","last_clean":"2024-04-26T11:28:19.665433+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:28:19.665433+0000","last_undegraded":"2024-04-26T11:28:19.665433+0000","last_fullsized":"2024-04-26T11:28:19.665433+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'401","last_scrub_stamp":"2024-04-26T11:28:19.665380+0000","last_deep_scrub":"71'401","last_deep_scrub_stamp":"2024-04-26T11:28:19.665380+0000","last_clean_scrub_stamp":"2024-04-26T11:28:19.665380+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:40.327138+0000","scrub_duration":0.0044913619999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":606,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:16.605754+0000","last_change":"2024-04-26T11:28:16.605975+0000","last_active":"2024-04-26T11:28:16.605754+0000","last_peered":"2024-04-26T11:28:16.605754+0000","last_clean":"2024-04-26T11:28:16.605754+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:28:16.605754+0000","last_undegraded":"2024-04-26T11:28:16.605754+0000","last_fullsized":"2024-04-26T11:28:16.605754+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'442","last_scrub_stamp":"2024-04-26T11:28:16.605697+0000","last_deep_scrub":"71'442","last_deep_scrub_stamp":"2024-04-26T11:28:16.605697+0000","last_clean_scrub_stamp":"2024-04-26T11:28:16.605697+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:21.820675+0000","scrub_duration":0.0046125239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":474,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:04.461767+0000","last_change":"2024-04-26T11:27:04.461975+0000","last_active":"2024-04-26T11:27:04.461767+0000","last_peered":"2024-04-26T11:27:04.461767+0000","last_clean":"2024-04-26T11:27:04.461767+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:27:04.461767+0000","last_undegraded":"2024-04-26T11:27:04.461767+0000","last_fullsized":"2024-04-26T11:27:04.461767+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'373","last_scrub_stamp":"2024-04-26T11:27:04.461717+0000","last_deep_scrub":"71'373","last_deep_scrub_stamp":"2024-04-26T11:27:04.461717+0000","last_clean_scrub_stamp":"2024-04-26T11:27:04.461717+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:24.859328+0000","scrub_duration":0.0041768209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":609,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:23.965512+0000","last_change":"2024-04-26T11:27:23.965730+0000","last_active":"2024-04-26T11:27:23.965512+0000","last_peered":"2024-04-26T11:27:23.965512+0000","last_clean":"2024-04-26T11:27:23.965512+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:27:23.965512+0000","last_undegraded":"2024-04-26T11:27:23.965512+0000","last_fullsized":"2024-04-26T11:27:23.965512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'447","last_scrub_stamp":"2024-04-26T11:27:23.965459+0000","last_deep_scrub":"71'447","last_deep_scrub_stamp":"2024-04-26T11:27:23.965459+0000","last_clean_scrub_stamp":"2024-04-26T11:27:23.965459+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:17.028067+0000","scrub_duration":0.0044560520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":519,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:47.980740+0000","last_change":"2024-04-26T11:27:47.980944+0000","last_active":"2024-04-26T11:27:47.980740+0000","last_peered":"2024-04-26T11:27:47.980740+0000","last_clean":"2024-04-26T11:27:47.980740+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:27:47.980740+0000","last_undegraded":"2024-04-26T11:27:47.980740+0000","last_fullsized":"2024-04-26T11:27:47.980740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'389","last_scrub_stamp":"2024-04-26T11:27:47.980687+0000","last_deep_scrub":"71'389","last_deep_scrub_stamp":"2024-04-26T11:27:47.980687+0000","last_clean_scrub_stamp":"2024-04-26T11:27:47.980687+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:14.673060+0000","scrub_duration":0.0047600280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":481,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.895738+0000","last_change":"2024-04-26T11:26:32.895372+0000","last_active":"2024-04-26T11:26:40.895738+0000","last_peered":"2024-04-26T11:26:40.895738+0000","last_clean":"2024-04-26T11:26:40.895738+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:26:40.895738+0000","last_undegraded":"2024-04-26T11:26:40.895738+0000","last_fullsized":"2024-04-26T11:26:40.895738+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":795,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:55.137005+0000","last_change":"2024-04-26T11:27:55.137295+0000","last_active":"2024-04-26T11:27:55.137005+0000","last_peered":"2024-04-26T11:27:55.137005+0000","last_clean":"2024-04-26T11:27:55.137005+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:27:55.137005+0000","last_undegraded":"2024-04-26T11:27:55.137005+0000","last_fullsized":"2024-04-26T11:27:55.137005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'350","last_scrub_stamp":"2024-04-26T11:27:55.136953+0000","last_deep_scrub":"71'350","last_deep_scrub_stamp":"2024-04-26T11:27:55.136953+0000","last_clean_scrub_stamp":"2024-04-26T11:27:55.136953+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:25.662360+0000","scrub_duration":0.0045968290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":465,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:07.138603+0000","last_change":"2024-04-26T11:27:07.138812+0000","last_active":"2024-04-26T11:27:07.138603+0000","last_peered":"2024-04-26T11:27:07.138603+0000","last_clean":"2024-04-26T11:27:07.138603+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:27:07.138603+0000","last_undegraded":"2024-04-26T11:27:07.138603+0000","last_fullsized":"2024-04-26T11:27:07.138603+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'385","last_scrub_stamp":"2024-04-26T11:27:07.138550+0000","last_deep_scrub":"71'385","last_deep_scrub_stamp":"2024-04-26T11:27:07.138550+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.138550+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:51.494043+0000","scrub_duration":0.0046149509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":494,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:02.539257+0000","last_change":"2024-04-26T11:27:02.539472+0000","last_active":"2024-04-26T11:27:02.539257+0000","last_peered":"2024-04-26T11:27:02.539257+0000","last_clean":"2024-04-26T11:27:02.539257+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:27:02.539257+0000","last_undegraded":"2024-04-26T11:27:02.539257+0000","last_fullsized":"2024-04-26T11:27:02.539257+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_clean_scrub_stamp":"2024-04-26T11:27:02.539206+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:43.230821+0000","scrub_duration":0.003815648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":550,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:18.484587+0000","last_change":"2024-04-26T11:27:18.484810+0000","last_active":"2024-04-26T11:27:18.484587+0000","last_peered":"2024-04-26T11:27:18.484587+0000","last_clean":"2024-04-26T11:27:18.484587+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:27:18.484587+0000","last_undegraded":"2024-04-26T11:27:18.484587+0000","last_fullsized":"2024-04-26T11:27:18.484587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'431","last_scrub_stamp":"2024-04-26T11:27:18.484532+0000","last_deep_scrub":"71'431","last_deep_scrub_stamp":"2024-04-26T11:27:18.484532+0000","last_clean_scrub_stamp":"2024-04-26T11:27:18.484532+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:43.402024+0000","scrub_duration":0.0042561730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":615,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.393743+0000","last_change":"2024-04-26T11:26:54.393969+0000","last_active":"2024-04-26T11:26:54.393743+0000","last_peered":"2024-04-26T11:26:54.393743+0000","last_clean":"2024-04-26T11:26:54.393743+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:54.393743+0000","last_undegraded":"2024-04-26T11:26:54.393743+0000","last_fullsized":"2024-04-26T11:26:54.393743+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'453","last_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_deep_scrub":"71'453","last_deep_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.393690+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:41.730233+0000","scrub_duration":0.0038895330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":589,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:51.960476+0000","last_change":"2024-04-26T11:26:51.960725+0000","last_active":"2024-04-26T11:26:51.960476+0000","last_peered":"2024-04-26T11:26:51.960476+0000","last_clean":"2024-04-26T11:26:51.960476+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:51.960476+0000","last_undegraded":"2024-04-26T11:26:51.960476+0000","last_fullsized":"2024-04-26T11:26:51.960476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_clean_scrub_stamp":"2024-04-26T11:26:51.960424+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:17.833759+0000","scrub_duration":0.0043861689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":596,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:14.223896+0000","last_change":"2024-04-26T11:28:14.224112+0000","last_active":"2024-04-26T11:28:14.223896+0000","last_peered":"2024-04-26T11:28:14.223896+0000","last_clean":"2024-04-26T11:28:14.223896+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:28:14.223896+0000","last_undegraded":"2024-04-26T11:28:14.223896+0000","last_fullsized":"2024-04-26T11:28:14.223896+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-26T11:28:14.223845+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-26T11:28:14.223845+0000","last_clean_scrub_stamp":"2024-04-26T11:28:14.223845+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:18.459175+0000","scrub_duration":0.0046234020000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":635,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.965160+0000","last_change":"2024-04-26T11:27:15.965379+0000","last_active":"2024-04-26T11:27:15.965160+0000","last_peered":"2024-04-26T11:27:15.965160+0000","last_clean":"2024-04-26T11:27:15.965160+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:27:15.965160+0000","last_undegraded":"2024-04-26T11:27:15.965160+0000","last_fullsized":"2024-04-26T11:27:15.965160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-26T11:27:15.965105+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-26T11:27:15.965105+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.965105+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:02.906065+0000","scrub_duration":0.0046149279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":623,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:39.660737+0000","last_change":"2024-04-26T11:27:39.660968+0000","last_active":"2024-04-26T11:27:39.660737+0000","last_peered":"2024-04-26T11:27:39.660737+0000","last_clean":"2024-04-26T11:27:39.660737+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:27:39.660737+0000","last_undegraded":"2024-04-26T11:27:39.660737+0000","last_fullsized":"2024-04-26T11:27:39.660737+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'475","last_scrub_stamp":"2024-04-26T11:27:39.660681+0000","last_deep_scrub":"71'475","last_deep_scrub_stamp":"2024-04-26T11:27:39.660681+0000","last_clean_scrub_stamp":"2024-04-26T11:27:39.660681+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:13.243958+0000","scrub_duration":0.0042850270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":550,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893719+0000","last_change":"2024-04-26T11:26:36.897168+0000","last_active":"2024-04-26T11:26:40.893719+0000","last_peered":"2024-04-26T11:26:40.893719+0000","last_clean":"2024-04-26T11:26:40.893719+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:26:40.893719+0000","last_undegraded":"2024-04-26T11:26:40.893719+0000","last_fullsized":"2024-04-26T11:26:40.893719+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":990,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:54.086650+0000","last_change":"2024-04-26T11:27:54.086867+0000","last_active":"2024-04-26T11:27:54.086650+0000","last_peered":"2024-04-26T11:27:54.086650+0000","last_clean":"2024-04-26T11:27:54.086650+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:27:54.086650+0000","last_undegraded":"2024-04-26T11:27:54.086650+0000","last_fullsized":"2024-04-26T11:27:54.086650+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'440","last_scrub_stamp":"2024-04-26T11:27:54.086592+0000","last_deep_scrub":"71'440","last_deep_scrub_stamp":"2024-04-26T11:27:54.086592+0000","last_clean_scrub_stamp":"2024-04-26T11:27:54.086592+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:13.572538+0000","scrub_duration":0.0036755160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":944,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:34.936983+0000","last_change":"2024-04-26T11:27:34.937203+0000","last_active":"2024-04-26T11:27:34.936983+0000","last_peered":"2024-04-26T11:27:34.936983+0000","last_clean":"2024-04-26T11:27:34.936983+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:27:34.936983+0000","last_undegraded":"2024-04-26T11:27:34.936983+0000","last_fullsized":"2024-04-26T11:27:34.936983+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-26T11:27:34.936929+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-26T11:27:34.936929+0000","last_clean_scrub_stamp":"2024-04-26T11:27:34.936929+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:25.920048+0000","scrub_duration":0.0042325840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":527,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.097877+0000","last_change":"2024-04-26T11:26:58.098112+0000","last_active":"2024-04-26T11:26:58.097877+0000","last_peered":"2024-04-26T11:26:58.097877+0000","last_clean":"2024-04-26T11:26:58.097877+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:58.097877+0000","last_undegraded":"2024-04-26T11:26:58.097877+0000","last_fullsized":"2024-04-26T11:26:58.097877+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'433","last_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_deep_scrub":"71'433","last_deep_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.097826+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:39.261277+0000","scrub_duration":0.0045929860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":961,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:35.990604+0000","last_change":"2024-04-26T11:27:35.990604+0000","last_active":"2024-04-26T11:27:35.990604+0000","last_peered":"2024-04-26T11:27:35.990604+0000","last_clean":"2024-04-26T11:27:35.990604+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:27:35.990604+0000","last_undegraded":"2024-04-26T11:27:35.990604+0000","last_fullsized":"2024-04-26T11:27:35.990604+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'422","last_scrub_stamp":"2024-04-26T11:27:35.990321+0000","last_deep_scrub":"71'422","last_deep_scrub_stamp":"2024-04-26T11:27:35.990321+0000","last_clean_scrub_stamp":"2024-04-26T11:27:35.990321+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:42.180497+0000","scrub_duration":0.0039948070000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1067,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:11.020512+0000","last_change":"2024-04-26T11:27:11.020512+0000","last_active":"2024-04-26T11:27:11.020512+0000","last_peered":"2024-04-26T11:27:11.020512+0000","last_clean":"2024-04-26T11:27:11.020512+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:27:11.020512+0000","last_undegraded":"2024-04-26T11:27:11.020512+0000","last_fullsized":"2024-04-26T11:27:11.020512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-26T11:27:11.020208+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-26T11:27:11.020208+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.020208+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:49.564877+0000","scrub_duration":0.0040859049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":570,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:26.563358+0000","last_change":"2024-04-26T11:28:26.563640+0000","last_active":"2024-04-26T11:28:26.563358+0000","last_peered":"2024-04-26T11:28:26.563358+0000","last_clean":"2024-04-26T11:28:26.563358+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:28:26.563358+0000","last_undegraded":"2024-04-26T11:28:26.563358+0000","last_fullsized":"2024-04-26T11:28:26.563358+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-26T11:28:26.563305+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-26T11:28:26.563305+0000","last_clean_scrub_stamp":"2024-04-26T11:28:26.563305+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:23.006538+0000","scrub_duration":0.0043547969999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":964,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:46.987372+0000","last_change":"2024-04-26T11:27:46.987372+0000","last_active":"2024-04-26T11:27:46.987372+0000","last_peered":"2024-04-26T11:27:46.987372+0000","last_clean":"2024-04-26T11:27:46.987372+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:27:46.987372+0000","last_undegraded":"2024-04-26T11:27:46.987372+0000","last_fullsized":"2024-04-26T11:27:46.987372+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-26T11:27:46.987053+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-26T11:27:46.987053+0000","last_clean_scrub_stamp":"2024-04-26T11:27:46.987053+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:27.678697+0000","scrub_duration":0.003826851,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":521,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:25.073915+0000","last_change":"2024-04-26T11:28:25.074153+0000","last_active":"2024-04-26T11:28:25.073915+0000","last_peered":"2024-04-26T11:28:25.073915+0000","last_clean":"2024-04-26T11:28:25.073915+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:28:25.073915+0000","last_undegraded":"2024-04-26T11:28:25.073915+0000","last_fullsized":"2024-04-26T11:28:25.073915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'396","last_scrub_stamp":"2024-04-26T11:28:25.073856+0000","last_deep_scrub":"71'396","last_deep_scrub_stamp":"2024-04-26T11:28:25.073856+0000","last_clean_scrub_stamp":"2024-04-26T11:28:25.073856+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:57.423315+0000","scrub_duration":0.004787833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":1041,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:09.107336+0000","last_change":"2024-04-26T11:27:09.107336+0000","last_active":"2024-04-26T11:27:09.107336+0000","last_peered":"2024-04-26T11:27:09.107336+0000","last_clean":"2024-04-26T11:27:09.107336+0000","last_became_active":"2024-04-26T11:26:38.373963+0000","last_became_peered":"2024-04-26T11:26:38.373963+0000","last_unstale":"2024-04-26T11:27:09.107336+0000","last_undegraded":"2024-04-26T11:27:09.107336+0000","last_fullsized":"2024-04-26T11:27:09.107336+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'461","last_scrub_stamp":"2024-04-26T11:27:09.107005+0000","last_deep_scrub":"71'461","last_deep_scrub_stamp":"2024-04-26T11:27:09.107005+0000","last_clean_scrub_stamp":"2024-04-26T11:27:09.107005+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:02.026982+0000","scrub_duration":0.0039544200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":641,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:28.974503+0000","last_change":"2024-04-26T11:27:28.974503+0000","last_active":"2024-04-26T11:27:28.974503+0000","last_peered":"2024-04-26T11:27:28.974503+0000","last_clean":"2024-04-26T11:27:28.974503+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:27:28.974503+0000","last_undegraded":"2024-04-26T11:27:28.974503+0000","last_fullsized":"2024-04-26T11:27:28.974503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'452","last_scrub_stamp":"2024-04-26T11:27:28.974238+0000","last_deep_scrub":"71'452","last_deep_scrub_stamp":"2024-04-26T11:27:28.974238+0000","last_clean_scrub_stamp":"2024-04-26T11:27:28.974238+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:48.460183+0000","scrub_duration":0.0047380240000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:17.444221+0000","last_change":"2024-04-26T11:27:17.444506+0000","last_active":"2024-04-26T11:27:17.444221+0000","last_peered":"2024-04-26T11:27:17.444221+0000","last_clean":"2024-04-26T11:27:17.444221+0000","last_became_active":"2024-04-26T11:26:40.895623+0000","last_became_peered":"2024-04-26T11:26:40.895623+0000","last_unstale":"2024-04-26T11:27:17.444221+0000","last_undegraded":"2024-04-26T11:27:17.444221+0000","last_fullsized":"2024-04-26T11:27:17.444221+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'424","last_scrub_stamp":"2024-04-26T11:27:17.444171+0000","last_deep_scrub":"71'424","last_deep_scrub_stamp":"2024-04-26T11:27:17.444171+0000","last_clean_scrub_stamp":"2024-04-26T11:27:17.444171+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:49.762789+0000","scrub_duration":0.0037779910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":497,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:50.003786+0000","last_change":"2024-04-26T11:26:50.004040+0000","last_active":"2024-04-26T11:26:50.003786+0000","last_peered":"2024-04-26T11:26:50.003786+0000","last_clean":"2024-04-26T11:26:50.003786+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:50.003786+0000","last_undegraded":"2024-04-26T11:26:50.003786+0000","last_fullsized":"2024-04-26T11:26:50.003786+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_clean_scrub_stamp":"2024-04-26T11:26:50.003733+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:47.677731+0000","scrub_duration":0.0047410569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"106'475","reported_seq":566,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:06.503180+0000","last_change":"2024-04-26T11:27:06.503394+0000","last_active":"2024-04-26T11:27:06.503180+0000","last_peered":"2024-04-26T11:27:06.503180+0000","last_clean":"2024-04-26T11:27:06.503180+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:27:06.503180+0000","last_undegraded":"2024-04-26T11:27:06.503180+0000","last_fullsized":"2024-04-26T11:27:06.503180+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'475","last_scrub_stamp":"2024-04-26T11:27:06.503128+0000","last_deep_scrub":"106'475","last_deep_scrub_stamp":"2024-04-26T11:27:06.503128+0000","last_clean_scrub_stamp":"2024-04-26T11:27:06.503128+0000","objects_scrubbed":4,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:30.876920+0000","scrub_duration":0.042185009000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":517,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:33.931170+0000","last_change":"2024-04-26T11:27:33.931390+0000","last_active":"2024-04-26T11:27:33.931170+0000","last_peered":"2024-04-26T11:27:33.931170+0000","last_clean":"2024-04-26T11:27:33.931170+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:27:33.931170+0000","last_undegraded":"2024-04-26T11:27:33.931170+0000","last_fullsized":"2024-04-26T11:27:33.931170+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-26T11:27:33.931119+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-26T11:27:33.931119+0000","last_clean_scrub_stamp":"2024-04-26T11:27:33.931119+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:48.509771+0000","scrub_duration":0.0051701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:35.899107+0000","last_change":"2024-04-26T11:27:35.899321+0000","last_active":"2024-04-26T11:27:35.899107+0000","last_peered":"2024-04-26T11:27:35.899107+0000","last_clean":"2024-04-26T11:27:35.899107+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:27:35.899107+0000","last_undegraded":"2024-04-26T11:27:35.899107+0000","last_fullsized":"2024-04-26T11:27:35.899107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'62","last_scrub_stamp":"2024-04-26T11:27:35.899055+0000","last_deep_scrub":"70'62","last_deep_scrub_stamp":"2024-04-26T11:27:35.899055+0000","last_clean_scrub_stamp":"2024-04-26T11:27:35.899055+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:16.959260+0000","scrub_duration":0.003685298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":999,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:46.498440+0000","last_change":"2024-04-26T11:26:23.374244+0000","last_active":"2024-04-26T11:26:46.498440+0000","last_peered":"2024-04-26T11:26:46.498440+0000","last_clean":"2024-04-26T11:26:46.498440+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:26:46.498440+0000","last_undegraded":"2024-04-26T11:26:46.498440+0000","last_fullsized":"2024-04-26T11:26:46.498440+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:00.101549+0000","last_change":"2024-04-26T11:27:00.101771+0000","last_active":"2024-04-26T11:27:00.101549+0000","last_peered":"2024-04-26T11:27:00.101549+0000","last_clean":"2024-04-26T11:27:00.101549+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:27:00.101549+0000","last_undegraded":"2024-04-26T11:27:00.101549+0000","last_fullsized":"2024-04-26T11:27:00.101549+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'72","last_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_deep_scrub":"70'72","last_deep_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_clean_scrub_stamp":"2024-04-26T11:27:00.101498+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:38.755366+0000","scrub_duration":0.0029441889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":950,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.915251+0000","last_change":"2024-04-26T11:27:03.915526+0000","last_active":"2024-04-26T11:27:03.915251+0000","last_peered":"2024-04-26T11:27:03.915251+0000","last_clean":"2024-04-26T11:27:03.915251+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:27:03.915251+0000","last_undegraded":"2024-04-26T11:27:03.915251+0000","last_fullsized":"2024-04-26T11:27:03.915251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'411","last_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_deep_scrub":"71'411","last_deep_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.915200+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:44.598651+0000","scrub_duration":0.0040090890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"106'76","reported_seq":68,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:38.631208+0000","last_change":"2024-04-26T11:27:38.631416+0000","last_active":"2024-04-26T11:27:38.631208+0000","last_peered":"2024-04-26T11:27:38.631208+0000","last_clean":"2024-04-26T11:27:38.631208+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:27:38.631208+0000","last_undegraded":"2024-04-26T11:27:38.631208+0000","last_fullsized":"2024-04-26T11:27:38.631208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'76","last_scrub_stamp":"2024-04-26T11:27:38.631155+0000","last_deep_scrub":"106'76","last_deep_scrub_stamp":"2024-04-26T11:27:38.631155+0000","last_clean_scrub_stamp":"2024-04-26T11:27:38.631155+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:00.190020+0000","scrub_duration":0.012059947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"106'164","reported_seq":257,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:08.511702+0000","last_change":"2024-04-26T11:27:08.511702+0000","last_active":"2024-04-26T11:27:08.511702+0000","last_peered":"2024-04-26T11:27:08.511702+0000","last_clean":"2024-04-26T11:27:08.511702+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:27:08.511702+0000","last_undegraded":"2024-04-26T11:27:08.511702+0000","last_fullsized":"2024-04-26T11:27:08.511702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'164","last_scrub_stamp":"2024-04-26T11:27:08.511426+0000","last_deep_scrub":"106'164","last_deep_scrub_stamp":"2024-04-26T11:27:08.511426+0000","last_clean_scrub_stamp":"2024-04-26T11:27:08.511426+0000","objects_scrubbed":2,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:26.618845+0000","scrub_duration":0.024844353999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":889,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:49.997828+0000","last_change":"2024-04-26T11:27:49.997828+0000","last_active":"2024-04-26T11:27:49.997828+0000","last_peered":"2024-04-26T11:27:49.997828+0000","last_clean":"2024-04-26T11:27:49.997828+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:27:49.997828+0000","last_undegraded":"2024-04-26T11:27:49.997828+0000","last_fullsized":"2024-04-26T11:27:49.997828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'402","last_scrub_stamp":"2024-04-26T11:27:49.997532+0000","last_deep_scrub":"71'402","last_deep_scrub_stamp":"2024-04-26T11:27:49.997532+0000","last_clean_scrub_stamp":"2024-04-26T11:27:49.997532+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:57.638791+0000","scrub_duration":0.0037416060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"106'277","reported_seq":415,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:38.001763+0000","last_change":"2024-04-26T11:27:38.001991+0000","last_active":"2024-04-26T11:27:38.001763+0000","last_peered":"2024-04-26T11:27:38.001763+0000","last_clean":"2024-04-26T11:27:38.001763+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:27:38.001763+0000","last_undegraded":"2024-04-26T11:27:38.001763+0000","last_fullsized":"2024-04-26T11:27:38.001763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'277","last_scrub_stamp":"2024-04-26T11:27:38.001710+0000","last_deep_scrub":"106'277","last_deep_scrub_stamp":"2024-04-26T11:27:38.001710+0000","last_clean_scrub_stamp":"2024-04-26T11:27:38.001710+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.703001+0000","scrub_duration":0.032027241999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":592,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.044886+0000","last_change":"2024-04-26T11:26:54.045110+0000","last_active":"2024-04-26T11:26:54.044886+0000","last_peered":"2024-04-26T11:26:54.044886+0000","last_clean":"2024-04-26T11:26:54.044886+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:54.044886+0000","last_undegraded":"2024-04-26T11:26:54.044886+0000","last_fullsized":"2024-04-26T11:26:54.044886+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'455","last_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_deep_scrub":"71'455","last_deep_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.044831+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:23.986621+0000","scrub_duration":0.0050259290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"106'567","reported_seq":660,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.588510+0000","last_change":"2024-04-26T11:27:01.588510+0000","last_active":"2024-04-26T11:27:01.588510+0000","last_peered":"2024-04-26T11:27:01.588510+0000","last_clean":"2024-04-26T11:27:01.588510+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:27:01.588510+0000","last_undegraded":"2024-04-26T11:27:01.588510+0000","last_fullsized":"2024-04-26T11:27:01.588510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'567","last_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_deep_scrub":"106'567","last_deep_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.588061+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:05.825620+0000","scrub_duration":0.031697134000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":531,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:40.893616+0000","last_change":"2024-04-26T11:26:39.905388+0000","last_active":"2024-04-26T11:26:40.893616+0000","last_peered":"2024-04-26T11:26:40.893616+0000","last_clean":"2024-04-26T11:26:40.893616+0000","last_became_active":"2024-04-26T11:26:39.900162+0000","last_became_peered":"2024-04-26T11:26:39.900162+0000","last_unstale":"2024-04-26T11:26:40.893616+0000","last_undegraded":"2024-04-26T11:26:40.893616+0000","last_fullsized":"2024-04-26T11:26:40.893616+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:21:53.304950+0000","last_clean_scrub_stamp":"2024-04-26T11:21:53.304950+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:40.652134+0000","last_change":"2024-04-26T11:27:40.652134+0000","last_active":"2024-04-26T11:27:40.652134+0000","last_peered":"2024-04-26T11:27:40.652134+0000","last_clean":"2024-04-26T11:27:40.652134+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:27:40.652134+0000","last_undegraded":"2024-04-26T11:27:40.652134+0000","last_fullsized":"2024-04-26T11:27:40.652134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'58","last_scrub_stamp":"2024-04-26T11:27:40.651867+0000","last_deep_scrub":"70'58","last_deep_scrub_stamp":"2024-04-26T11:27:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T11:27:40.651867+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:53.157507+0000","scrub_duration":0.0035582550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":970,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:05.965271+0000","last_change":"2024-04-26T11:27:05.965500+0000","last_active":"2024-04-26T11:27:05.965271+0000","last_peered":"2024-04-26T11:27:05.965271+0000","last_clean":"2024-04-26T11:27:05.965271+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:27:05.965271+0000","last_undegraded":"2024-04-26T11:27:05.965271+0000","last_fullsized":"2024-04-26T11:27:05.965271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_clean_scrub_stamp":"2024-04-26T11:27:05.965214+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:34:49.834938+0000","scrub_duration":0.0039580659999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"106'185","reported_seq":325,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:46.946204+0000","last_change":"2024-04-26T11:27:46.946454+0000","last_active":"2024-04-26T11:27:46.946204+0000","last_peered":"2024-04-26T11:27:46.946204+0000","last_clean":"2024-04-26T11:27:46.946204+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:27:46.946204+0000","last_undegraded":"2024-04-26T11:27:46.946204+0000","last_fullsized":"2024-04-26T11:27:46.946204+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'185","last_scrub_stamp":"2024-04-26T11:27:46.946144+0000","last_deep_scrub":"106'185","last_deep_scrub_stamp":"2024-04-26T11:27:46.946144+0000","last_clean_scrub_stamp":"2024-04-26T11:27:46.946144+0000","objects_scrubbed":3,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:31.045011+0000","scrub_duration":0.040368755999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":539,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:33.534181+0000","last_change":"2024-04-26T11:27:33.534438+0000","last_active":"2024-04-26T11:27:33.534181+0000","last_peered":"2024-04-26T11:27:33.534181+0000","last_clean":"2024-04-26T11:27:33.534181+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:27:33.534181+0000","last_undegraded":"2024-04-26T11:27:33.534181+0000","last_fullsized":"2024-04-26T11:27:33.534181+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'454","last_scrub_stamp":"2024-04-26T11:27:33.534129+0000","last_deep_scrub":"71'454","last_deep_scrub_stamp":"2024-04-26T11:27:33.534129+0000","last_clean_scrub_stamp":"2024-04-26T11:27:33.534129+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:47.874020+0000","scrub_duration":0.004313679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"106'224","reported_seq":309,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:25.516689+0000","last_change":"2024-04-26T11:27:25.516689+0000","last_active":"2024-04-26T11:27:25.516689+0000","last_peered":"2024-04-26T11:27:25.516689+0000","last_clean":"2024-04-26T11:27:25.516689+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:27:25.516689+0000","last_undegraded":"2024-04-26T11:27:25.516689+0000","last_fullsized":"2024-04-26T11:27:25.516689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'224","last_scrub_stamp":"2024-04-26T11:27:25.516369+0000","last_deep_scrub":"106'224","last_deep_scrub_stamp":"2024-04-26T11:27:25.516369+0000","last_clean_scrub_stamp":"2024-04-26T11:27:25.516369+0000","objects_scrubbed":1,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:04.438733+0000","scrub_duration":0.023037851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":483,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:28.532289+0000","last_change":"2024-04-26T11:27:28.532511+0000","last_active":"2024-04-26T11:27:28.532289+0000","last_peered":"2024-04-26T11:27:28.532289+0000","last_clean":"2024-04-26T11:27:28.532289+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:27:28.532289+0000","last_undegraded":"2024-04-26T11:27:28.532289+0000","last_fullsized":"2024-04-26T11:27:28.532289+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-26T11:27:28.532239+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-26T11:27:28.532239+0000","last_clean_scrub_stamp":"2024-04-26T11:27:28.532239+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:56.163930+0000","scrub_duration":0.003558299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:05.238476+0000","last_change":"2024-04-26T11:28:05.238702+0000","last_active":"2024-04-26T11:28:05.238476+0000","last_peered":"2024-04-26T11:28:05.238476+0000","last_clean":"2024-04-26T11:28:05.238476+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:28:05.238476+0000","last_undegraded":"2024-04-26T11:28:05.238476+0000","last_fullsized":"2024-04-26T11:28:05.238476+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'59","last_scrub_stamp":"2024-04-26T11:28:05.238424+0000","last_deep_scrub":"70'59","last_deep_scrub_stamp":"2024-04-26T11:28:05.238424+0000","last_clean_scrub_stamp":"2024-04-26T11:28:05.238424+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:05.376023+0000","scrub_duration":0.003275133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":458,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:05.437065+0000","last_change":"2024-04-26T11:27:05.437300+0000","last_active":"2024-04-26T11:27:05.437065+0000","last_peered":"2024-04-26T11:27:05.437065+0000","last_clean":"2024-04-26T11:27:05.437065+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:27:05.437065+0000","last_undegraded":"2024-04-26T11:27:05.437065+0000","last_fullsized":"2024-04-26T11:27:05.437065+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'359","last_scrub_stamp":"2024-04-26T11:27:05.437012+0000","last_deep_scrub":"71'359","last_deep_scrub_stamp":"2024-04-26T11:27:05.437012+0000","last_clean_scrub_stamp":"2024-04-26T11:27:05.437012+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.035867+0000","scrub_duration":0.0040043329999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"106'360","reported_seq":365,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:26.055820+0000","last_change":"2024-04-26T11:27:26.056052+0000","last_active":"2024-04-26T11:27:26.055820+0000","last_peered":"2024-04-26T11:27:26.055820+0000","last_clean":"2024-04-26T11:27:26.055820+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:27:26.055820+0000","last_undegraded":"2024-04-26T11:27:26.055820+0000","last_fullsized":"2024-04-26T11:27:26.055820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'360","last_scrub_stamp":"2024-04-26T11:27:26.055763+0000","last_deep_scrub":"106'360","last_deep_scrub_stamp":"2024-04-26T11:27:26.055763+0000","last_clean_scrub_stamp":"2024-04-26T11:27:26.055763+0000","objects_scrubbed":1,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:24.969559+0000","scrub_duration":0.033125239000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":565,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.907340+0000","last_change":"2024-04-26T11:27:01.907573+0000","last_active":"2024-04-26T11:27:01.907340+0000","last_peered":"2024-04-26T11:27:01.907340+0000","last_clean":"2024-04-26T11:27:01.907340+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:27:01.907340+0000","last_undegraded":"2024-04-26T11:27:01.907340+0000","last_fullsized":"2024-04-26T11:27:01.907340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.907287+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:00.821083+0000","scrub_duration":0.0045510610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"106'159","reported_seq":262,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:43.696225+0000","last_change":"2024-04-26T11:27:43.696225+0000","last_active":"2024-04-26T11:27:43.696225+0000","last_peered":"2024-04-26T11:27:43.696225+0000","last_clean":"2024-04-26T11:27:43.696225+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:27:43.696225+0000","last_undegraded":"2024-04-26T11:27:43.696225+0000","last_fullsized":"2024-04-26T11:27:43.696225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'159","last_scrub_stamp":"2024-04-26T11:27:43.695947+0000","last_deep_scrub":"106'159","last_deep_scrub_stamp":"2024-04-26T11:27:43.695947+0000","last_clean_scrub_stamp":"2024-04-26T11:27:43.695947+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:18.719077+0000","scrub_duration":0.0098550570000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:14.398442+0000","last_change":"2024-04-26T11:27:14.398442+0000","last_active":"2024-04-26T11:27:14.398442+0000","last_peered":"2024-04-26T11:27:14.398442+0000","last_clean":"2024-04-26T11:27:14.398442+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:27:14.398442+0000","last_undegraded":"2024-04-26T11:27:14.398442+0000","last_fullsized":"2024-04-26T11:27:14.398442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:14.398118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:14.398118+0000","last_clean_scrub_stamp":"2024-04-26T11:27:14.398118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:26.192505+0000","scrub_duration":0.0032486720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"106'755","reported_seq":866,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:16.021478+0000","last_change":"2024-04-26T11:28:16.021694+0000","last_active":"2024-04-26T11:28:16.021478+0000","last_peered":"2024-04-26T11:28:16.021478+0000","last_clean":"2024-04-26T11:28:16.021478+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:28:16.021478+0000","last_undegraded":"2024-04-26T11:28:16.021478+0000","last_fullsized":"2024-04-26T11:28:16.021478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'755","last_scrub_stamp":"2024-04-26T11:28:16.021422+0000","last_deep_scrub":"106'755","last_deep_scrub_stamp":"2024-04-26T11:28:16.021422+0000","last_clean_scrub_stamp":"2024-04-26T11:28:16.021422+0000","objects_scrubbed":2,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:29.929659+0000","scrub_duration":0.052889548000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":527,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:27.528213+0000","last_change":"2024-04-26T11:28:27.528213+0000","last_active":"2024-04-26T11:28:27.528213+0000","last_peered":"2024-04-26T11:28:27.528213+0000","last_clean":"2024-04-26T11:28:27.528213+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:28:27.528213+0000","last_undegraded":"2024-04-26T11:28:27.528213+0000","last_fullsized":"2024-04-26T11:28:27.528213+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'430","last_scrub_stamp":"2024-04-26T11:28:27.527945+0000","last_deep_scrub":"71'430","last_deep_scrub_stamp":"2024-04-26T11:28:27.527945+0000","last_clean_scrub_stamp":"2024-04-26T11:28:27.527945+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:24.277191+0000","scrub_duration":0.0038232439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.409932+0000","last_change":"2024-04-26T11:27:15.409932+0000","last_active":"2024-04-26T11:27:15.409932+0000","last_peered":"2024-04-26T11:27:15.409932+0000","last_clean":"2024-04-26T11:27:15.409932+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:27:15.409932+0000","last_undegraded":"2024-04-26T11:27:15.409932+0000","last_fullsized":"2024-04-26T11:27:15.409932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:15.409633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:15.409633+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.409633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:38.286104+0000","scrub_duration":0.0031725590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"106'115","reported_seq":306,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:19.034892+0000","last_change":"2024-04-26T11:28:19.035222+0000","last_active":"2024-04-26T11:28:19.034892+0000","last_peered":"2024-04-26T11:28:19.034892+0000","last_clean":"2024-04-26T11:28:19.034892+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:28:19.034892+0000","last_undegraded":"2024-04-26T11:28:19.034892+0000","last_fullsized":"2024-04-26T11:28:19.034892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'115","last_scrub_stamp":"2024-04-26T11:28:19.034835+0000","last_deep_scrub":"106'115","last_deep_scrub_stamp":"2024-04-26T11:28:19.034835+0000","last_clean_scrub_stamp":"2024-04-26T11:28:19.034835+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:41.285977+0000","scrub_duration":0.011043624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":574,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:22.039392+0000","last_change":"2024-04-26T11:27:22.039648+0000","last_active":"2024-04-26T11:27:22.039392+0000","last_peered":"2024-04-26T11:27:22.039392+0000","last_clean":"2024-04-26T11:27:22.039392+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:27:22.039392+0000","last_undegraded":"2024-04-26T11:27:22.039392+0000","last_fullsized":"2024-04-26T11:27:22.039392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'444","last_scrub_stamp":"2024-04-26T11:27:22.039342+0000","last_deep_scrub":"71'444","last_deep_scrub_stamp":"2024-04-26T11:27:22.039342+0000","last_clean_scrub_stamp":"2024-04-26T11:27:22.039342+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:51.178326+0000","scrub_duration":0.0046559649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":117,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:41.891342+0000","last_change":"2024-04-26T11:27:41.891342+0000","last_active":"2024-04-26T11:27:41.891342+0000","last_peered":"2024-04-26T11:27:41.891342+0000","last_clean":"2024-04-26T11:27:41.891342+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:27:41.891342+0000","last_undegraded":"2024-04-26T11:27:41.891342+0000","last_fullsized":"2024-04-26T11:27:41.891342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:41.891074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:41.891074+0000","last_clean_scrub_stamp":"2024-04-26T11:27:41.891074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:42.028673+0000","scrub_duration":0.0032036479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"106'379","reported_seq":497,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:00.161581+0000","last_change":"2024-04-26T11:28:00.161893+0000","last_active":"2024-04-26T11:28:00.161581+0000","last_peered":"2024-04-26T11:28:00.161581+0000","last_clean":"2024-04-26T11:28:00.161581+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:28:00.161581+0000","last_undegraded":"2024-04-26T11:28:00.161581+0000","last_fullsized":"2024-04-26T11:28:00.161581+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'379","last_scrub_stamp":"2024-04-26T11:28:00.161528+0000","last_deep_scrub":"106'379","last_deep_scrub_stamp":"2024-04-26T11:28:00.161528+0000","last_clean_scrub_stamp":"2024-04-26T11:28:00.161528+0000","objects_scrubbed":2,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:51.144647+0000","scrub_duration":0.036958244000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":466,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:13.017795+0000","last_change":"2024-04-26T11:27:13.017795+0000","last_active":"2024-04-26T11:27:13.017795+0000","last_peered":"2024-04-26T11:27:13.017795+0000","last_clean":"2024-04-26T11:27:13.017795+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:27:13.017795+0000","last_undegraded":"2024-04-26T11:27:13.017795+0000","last_fullsized":"2024-04-26T11:27:13.017795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'334","last_scrub_stamp":"2024-04-26T11:27:13.017468+0000","last_deep_scrub":"71'334","last_deep_scrub_stamp":"2024-04-26T11:27:13.017468+0000","last_clean_scrub_stamp":"2024-04-26T11:27:13.017468+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:48.346628+0000","scrub_duration":0.0044577050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:52.649768+0000","last_change":"2024-04-26T11:27:52.649768+0000","last_active":"2024-04-26T11:27:52.649768+0000","last_peered":"2024-04-26T11:27:52.649768+0000","last_clean":"2024-04-26T11:27:52.649768+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:27:52.649768+0000","last_undegraded":"2024-04-26T11:27:52.649768+0000","last_fullsized":"2024-04-26T11:27:52.649768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:52.649503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:52.649503+0000","last_clean_scrub_stamp":"2024-04-26T11:27:52.649503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:54.233318+0000","scrub_duration":0.003234579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:04.484225+0000","last_change":"2024-04-26T11:28:04.484225+0000","last_active":"2024-04-26T11:28:04.484225+0000","last_peered":"2024-04-26T11:28:04.484225+0000","last_clean":"2024-04-26T11:28:04.484225+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:28:04.484225+0000","last_undegraded":"2024-04-26T11:28:04.484225+0000","last_fullsized":"2024-04-26T11:28:04.484225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'79","last_scrub_stamp":"2024-04-26T11:28:04.483898+0000","last_deep_scrub":"70'79","last_deep_scrub_stamp":"2024-04-26T11:28:04.483898+0000","last_clean_scrub_stamp":"2024-04-26T11:28:04.483898+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:41.466273+0000","scrub_duration":0.0033086280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":575,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:22.966985+0000","last_change":"2024-04-26T11:27:22.966985+0000","last_active":"2024-04-26T11:27:22.966985+0000","last_peered":"2024-04-26T11:27:22.966985+0000","last_clean":"2024-04-26T11:27:22.966985+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:27:22.966985+0000","last_undegraded":"2024-04-26T11:27:22.966985+0000","last_fullsized":"2024-04-26T11:27:22.966985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-26T11:27:22.966689+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-26T11:27:22.966689+0000","last_clean_scrub_stamp":"2024-04-26T11:27:22.966689+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:56.913479+0000","scrub_duration":0.0049556590000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"106'499","reported_seq":584,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:12.592546+0000","last_change":"2024-04-26T11:28:12.592546+0000","last_active":"2024-04-26T11:28:12.592546+0000","last_peered":"2024-04-26T11:28:12.592546+0000","last_clean":"2024-04-26T11:28:12.592546+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:28:12.592546+0000","last_undegraded":"2024-04-26T11:28:12.592546+0000","last_fullsized":"2024-04-26T11:28:12.592546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'499","last_scrub_stamp":"2024-04-26T11:28:12.592270+0000","last_deep_scrub":"106'499","last_deep_scrub_stamp":"2024-04-26T11:28:12.592270+0000","last_clean_scrub_stamp":"2024-04-26T11:28:12.592270+0000","objects_scrubbed":1,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:18.220689+0000","scrub_duration":0.029304797,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:23.029093+0000","last_change":"2024-04-26T11:28:23.029307+0000","last_active":"2024-04-26T11:28:23.029093+0000","last_peered":"2024-04-26T11:28:23.029093+0000","last_clean":"2024-04-26T11:28:23.029093+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:28:23.029093+0000","last_undegraded":"2024-04-26T11:28:23.029093+0000","last_fullsized":"2024-04-26T11:28:23.029093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:28:23.029048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:28:23.029048+0000","last_clean_scrub_stamp":"2024-04-26T11:28:23.029048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:13.377365+0000","scrub_duration":0.0033069710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":805,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:29.994255+0000","last_change":"2024-04-26T11:27:29.994255+0000","last_active":"2024-04-26T11:27:29.994255+0000","last_peered":"2024-04-26T11:27:29.994255+0000","last_clean":"2024-04-26T11:27:29.994255+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:27:29.994255+0000","last_undegraded":"2024-04-26T11:27:29.994255+0000","last_fullsized":"2024-04-26T11:27:29.994255+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'351","last_scrub_stamp":"2024-04-26T11:27:29.993974+0000","last_deep_scrub":"71'351","last_deep_scrub_stamp":"2024-04-26T11:27:29.993974+0000","last_clean_scrub_stamp":"2024-04-26T11:27:29.993974+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:35:13.863697+0000","scrub_duration":0.0044014229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:48.898532+0000","last_change":"2024-04-26T11:27:48.898532+0000","last_active":"2024-04-26T11:27:48.898532+0000","last_peered":"2024-04-26T11:27:48.898532+0000","last_clean":"2024-04-26T11:27:48.898532+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:27:48.898532+0000","last_undegraded":"2024-04-26T11:27:48.898532+0000","last_fullsized":"2024-04-26T11:27:48.898532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'57","last_scrub_stamp":"2024-04-26T11:27:48.898263+0000","last_deep_scrub":"70'57","last_deep_scrub_stamp":"2024-04-26T11:27:48.898263+0000","last_clean_scrub_stamp":"2024-04-26T11:27:48.898263+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:02.150454+0000","scrub_duration":0.003307787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:20.260870+0000","last_change":"2024-04-26T11:28:20.260870+0000","last_active":"2024-04-26T11:28:20.260870+0000","last_peered":"2024-04-26T11:28:20.260870+0000","last_clean":"2024-04-26T11:28:20.260870+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:28:20.260870+0000","last_undegraded":"2024-04-26T11:28:20.260870+0000","last_fullsized":"2024-04-26T11:28:20.260870+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:28:20.260603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:28:20.260603+0000","last_clean_scrub_stamp":"2024-04-26T11:28:20.260603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:10.651315+0000","scrub_duration":0.0032404170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":830,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:21.038232+0000","last_change":"2024-04-26T11:27:21.038232+0000","last_active":"2024-04-26T11:27:21.038232+0000","last_peered":"2024-04-26T11:27:21.038232+0000","last_clean":"2024-04-26T11:27:21.038232+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:27:21.038232+0000","last_undegraded":"2024-04-26T11:27:21.038232+0000","last_fullsized":"2024-04-26T11:27:21.038232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'376","last_scrub_stamp":"2024-04-26T11:27:21.037943+0000","last_deep_scrub":"71'376","last_deep_scrub_stamp":"2024-04-26T11:27:21.037943+0000","last_clean_scrub_stamp":"2024-04-26T11:27:21.037943+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.198741+0000","scrub_duration":0.0040199060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"106'61","reported_seq":175,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:50.931076+0000","last_change":"2024-04-26T11:27:50.931076+0000","last_active":"2024-04-26T11:27:50.931076+0000","last_peered":"2024-04-26T11:27:50.931076+0000","last_clean":"2024-04-26T11:27:50.931076+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:27:50.931076+0000","last_undegraded":"2024-04-26T11:27:50.931076+0000","last_fullsized":"2024-04-26T11:27:50.931076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'61","last_scrub_stamp":"2024-04-26T11:27:50.930733+0000","last_deep_scrub":"106'61","last_deep_scrub_stamp":"2024-04-26T11:27:50.930733+0000","last_clean_scrub_stamp":"2024-04-26T11:27:50.930733+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:36.226248+0000","scrub_duration":0.0067521899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:16.979126+0000","last_change":"2024-04-26T11:28:16.979126+0000","last_active":"2024-04-26T11:28:16.979126+0000","last_peered":"2024-04-26T11:28:16.979126+0000","last_clean":"2024-04-26T11:28:16.979126+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:28:16.979126+0000","last_undegraded":"2024-04-26T11:28:16.979126+0000","last_fullsized":"2024-04-26T11:28:16.979126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:28:16.978793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:28:16.978793+0000","last_clean_scrub_stamp":"2024-04-26T11:28:16.978793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:52.598748+0000","scrub_duration":0.003121282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":939,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:20.056130+0000","last_change":"2024-04-26T11:28:20.056355+0000","last_active":"2024-04-26T11:28:20.056130+0000","last_peered":"2024-04-26T11:28:20.056130+0000","last_clean":"2024-04-26T11:28:20.056130+0000","last_became_active":"2024-04-26T11:26:39.375075+0000","last_became_peered":"2024-04-26T11:26:39.375075+0000","last_unstale":"2024-04-26T11:28:20.056130+0000","last_undegraded":"2024-04-26T11:28:20.056130+0000","last_fullsized":"2024-04-26T11:28:20.056130+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'423","last_scrub_stamp":"2024-04-26T11:28:20.056069+0000","last_deep_scrub":"71'423","last_deep_scrub_stamp":"2024-04-26T11:28:20.056069+0000","last_clean_scrub_stamp":"2024-04-26T11:28:20.056069+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:38.597307+0000","scrub_duration":0.0041170349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"106'72","reported_seq":204,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:49.926492+0000","last_change":"2024-04-26T11:27:49.926492+0000","last_active":"2024-04-26T11:27:49.926492+0000","last_peered":"2024-04-26T11:27:49.926492+0000","last_clean":"2024-04-26T11:27:49.926492+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:27:49.926492+0000","last_undegraded":"2024-04-26T11:27:49.926492+0000","last_fullsized":"2024-04-26T11:27:49.926492+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'72","last_scrub_stamp":"2024-04-26T11:27:49.926200+0000","last_deep_scrub":"106'72","last_deep_scrub_stamp":"2024-04-26T11:27:49.926200+0000","last_clean_scrub_stamp":"2024-04-26T11:27:49.926200+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.161530+0000","scrub_duration":0.026289052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:06.547357+0000","last_change":"2024-04-26T11:28:06.547357+0000","last_active":"2024-04-26T11:28:06.547357+0000","last_peered":"2024-04-26T11:28:06.547357+0000","last_clean":"2024-04-26T11:28:06.547357+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:28:06.547357+0000","last_undegraded":"2024-04-26T11:28:06.547357+0000","last_fullsized":"2024-04-26T11:28:06.547357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:28:06.547079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:28:06.547079+0000","last_clean_scrub_stamp":"2024-04-26T11:28:06.547079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:12.810401+0000","scrub_duration":0.003433714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":943,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:39.937043+0000","last_change":"2024-04-26T11:27:39.937043+0000","last_active":"2024-04-26T11:27:39.937043+0000","last_peered":"2024-04-26T11:27:39.937043+0000","last_clean":"2024-04-26T11:27:39.937043+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:27:39.937043+0000","last_undegraded":"2024-04-26T11:27:39.937043+0000","last_fullsized":"2024-04-26T11:27:39.937043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-26T11:27:39.936745+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-26T11:27:39.936745+0000","last_clean_scrub_stamp":"2024-04-26T11:27:39.936745+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:26.877705+0000","scrub_duration":0.0041433700000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":524,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:53.400187+0000","last_change":"2024-04-26T11:26:53.400430+0000","last_active":"2024-04-26T11:26:53.400187+0000","last_peered":"2024-04-26T11:26:53.400187+0000","last_clean":"2024-04-26T11:26:53.400187+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:53.400187+0000","last_undegraded":"2024-04-26T11:26:53.400187+0000","last_fullsized":"2024-04-26T11:26:53.400187+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'415","last_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_deep_scrub":"71'415","last_deep_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_clean_scrub_stamp":"2024-04-26T11:26:53.400136+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:43.847441+0000","scrub_duration":0.0041863550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"106'410","reported_seq":509,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:53.676581+0000","last_change":"2024-04-26T11:27:53.676852+0000","last_active":"2024-04-26T11:27:53.676581+0000","last_peered":"2024-04-26T11:27:53.676581+0000","last_clean":"2024-04-26T11:27:53.676581+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:27:53.676581+0000","last_undegraded":"2024-04-26T11:27:53.676581+0000","last_fullsized":"2024-04-26T11:27:53.676581+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'410","last_scrub_stamp":"2024-04-26T11:27:53.676525+0000","last_deep_scrub":"106'410","last_deep_scrub_stamp":"2024-04-26T11:27:53.676525+0000","last_clean_scrub_stamp":"2024-04-26T11:27:53.676525+0000","objects_scrubbed":6,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:57.894166+0000","scrub_duration":0.044552915999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":568,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:56.983899+0000","last_change":"2024-04-26T11:26:56.984139+0000","last_active":"2024-04-26T11:26:56.983899+0000","last_peered":"2024-04-26T11:26:56.983899+0000","last_clean":"2024-04-26T11:26:56.983899+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:56.983899+0000","last_undegraded":"2024-04-26T11:26:56.983899+0000","last_fullsized":"2024-04-26T11:26:56.983899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'425","last_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_deep_scrub":"71'425","last_deep_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_clean_scrub_stamp":"2024-04-26T11:26:56.983841+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:06.726299+0000","scrub_duration":0.0046040439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"106'92","reported_seq":196,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:11.288096+0000","last_change":"2024-04-26T11:28:11.288413+0000","last_active":"2024-04-26T11:28:11.288096+0000","last_peered":"2024-04-26T11:28:11.288096+0000","last_clean":"2024-04-26T11:28:11.288096+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:28:11.288096+0000","last_undegraded":"2024-04-26T11:28:11.288096+0000","last_fullsized":"2024-04-26T11:28:11.288096+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'92","last_scrub_stamp":"2024-04-26T11:28:11.288042+0000","last_deep_scrub":"106'92","last_deep_scrub_stamp":"2024-04-26T11:28:11.288042+0000","last_clean_scrub_stamp":"2024-04-26T11:28:11.288042+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:55.386908+0000","scrub_duration":0.0078133160000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"106'345","reported_seq":429,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:32.598123+0000","last_change":"2024-04-26T11:27:32.598338+0000","last_active":"2024-04-26T11:27:32.598123+0000","last_peered":"2024-04-26T11:27:32.598123+0000","last_clean":"2024-04-26T11:27:32.598123+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:27:32.598123+0000","last_undegraded":"2024-04-26T11:27:32.598123+0000","last_fullsized":"2024-04-26T11:27:32.598123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'345","last_scrub_stamp":"2024-04-26T11:27:32.598068+0000","last_deep_scrub":"106'345","last_deep_scrub_stamp":"2024-04-26T11:27:32.598068+0000","last_clean_scrub_stamp":"2024-04-26T11:27:32.598068+0000","objects_scrubbed":1,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:49.040005+0000","scrub_duration":0.028263885999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":1037,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:57.986343+0000","last_change":"2024-04-26T11:26:57.986559+0000","last_active":"2024-04-26T11:26:57.986343+0000","last_peered":"2024-04-26T11:26:57.986343+0000","last_clean":"2024-04-26T11:26:57.986343+0000","last_became_active":"2024-04-26T11:26:38.373800+0000","last_became_peered":"2024-04-26T11:26:38.373800+0000","last_unstale":"2024-04-26T11:26:57.986343+0000","last_undegraded":"2024-04-26T11:26:57.986343+0000","last_fullsized":"2024-04-26T11:26:57.986343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'468","last_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_deep_scrub":"71'468","last_deep_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_clean_scrub_stamp":"2024-04-26T11:26:57.986292+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:27.125276+0000","scrub_duration":0.0037409510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":178,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:30.984202+0000","last_change":"2024-04-26T11:27:30.984422+0000","last_active":"2024-04-26T11:27:30.984202+0000","last_peered":"2024-04-26T11:27:30.984202+0000","last_clean":"2024-04-26T11:27:30.984202+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:27:30.984202+0000","last_undegraded":"2024-04-26T11:27:30.984202+0000","last_fullsized":"2024-04-26T11:27:30.984202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'52","last_scrub_stamp":"2024-04-26T11:27:30.984151+0000","last_deep_scrub":"70'52","last_deep_scrub_stamp":"2024-04-26T11:27:30.984151+0000","last_clean_scrub_stamp":"2024-04-26T11:27:30.984151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:01.509557+0000","scrub_duration":0.0034089770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":582,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.962038+0000","last_change":"2024-04-26T11:26:58.962297+0000","last_active":"2024-04-26T11:26:58.962038+0000","last_peered":"2024-04-26T11:26:58.962038+0000","last_clean":"2024-04-26T11:26:58.962038+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:58.962038+0000","last_undegraded":"2024-04-26T11:26:58.962038+0000","last_fullsized":"2024-04-26T11:26:58.962038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'454","last_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_deep_scrub":"71'454","last_deep_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.961980+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:21.020921+0000","scrub_duration":0.0044732579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":805,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:23.051045+0000","last_change":"2024-04-26T11:27:23.051045+0000","last_active":"2024-04-26T11:27:23.051045+0000","last_peered":"2024-04-26T11:27:23.051045+0000","last_clean":"2024-04-26T11:27:23.051045+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:27:23.051045+0000","last_undegraded":"2024-04-26T11:27:23.051045+0000","last_fullsized":"2024-04-26T11:27:23.051045+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'352","last_scrub_stamp":"2024-04-26T11:27:23.050694+0000","last_deep_scrub":"71'352","last_deep_scrub_stamp":"2024-04-26T11:27:23.050694+0000","last_clean_scrub_stamp":"2024-04-26T11:27:23.050694+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:45.109635+0000","scrub_duration":0.0037690789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"106'589","reported_seq":702,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:42.979638+0000","last_change":"2024-04-26T11:27:42.979875+0000","last_active":"2024-04-26T11:27:42.979638+0000","last_peered":"2024-04-26T11:27:42.979638+0000","last_clean":"2024-04-26T11:27:42.979638+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:27:42.979638+0000","last_undegraded":"2024-04-26T11:27:42.979638+0000","last_fullsized":"2024-04-26T11:27:42.979638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'589","last_scrub_stamp":"2024-04-26T11:27:42.979583+0000","last_deep_scrub":"106'589","last_deep_scrub_stamp":"2024-04-26T11:27:42.979583+0000","last_clean_scrub_stamp":"2024-04-26T11:27:42.979583+0000","objects_scrubbed":2,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:29.434420+0000","scrub_duration":0.052572714999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":935,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:13.938408+0000","last_change":"2024-04-26T11:28:13.938673+0000","last_active":"2024-04-26T11:28:13.938408+0000","last_peered":"2024-04-26T11:28:13.938408+0000","last_clean":"2024-04-26T11:28:13.938408+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:28:13.938408+0000","last_undegraded":"2024-04-26T11:28:13.938408+0000","last_fullsized":"2024-04-26T11:28:13.938408+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-26T11:28:13.938352+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-26T11:28:13.938352+0000","last_clean_scrub_stamp":"2024-04-26T11:28:13.938352+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:23.483074+0000","scrub_duration":0.0042705340000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"106'271","reported_seq":408,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:56.059175+0000","last_change":"2024-04-26T11:27:56.059489+0000","last_active":"2024-04-26T11:27:56.059175+0000","last_peered":"2024-04-26T11:27:56.059175+0000","last_clean":"2024-04-26T11:27:56.059175+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:27:56.059175+0000","last_undegraded":"2024-04-26T11:27:56.059175+0000","last_fullsized":"2024-04-26T11:27:56.059175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'271","last_scrub_stamp":"2024-04-26T11:27:56.059067+0000","last_deep_scrub":"106'271","last_deep_scrub_stamp":"2024-04-26T11:27:56.059067+0000","last_clean_scrub_stamp":"2024-04-26T11:27:56.059067+0000","objects_scrubbed":1,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:38.198483+0000","scrub_duration":0.029952316999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1029,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.080170+0000","last_change":"2024-04-26T11:27:15.080408+0000","last_active":"2024-04-26T11:27:15.080170+0000","last_peered":"2024-04-26T11:27:15.080170+0000","last_clean":"2024-04-26T11:27:15.080170+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:27:15.080170+0000","last_undegraded":"2024-04-26T11:27:15.080170+0000","last_fullsized":"2024-04-26T11:27:15.080170+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'439","last_scrub_stamp":"2024-04-26T11:27:15.080115+0000","last_deep_scrub":"71'439","last_deep_scrub_stamp":"2024-04-26T11:27:15.080115+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.080115+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:37.378024+0000","scrub_duration":0.0040451460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"106'377","reported_seq":446,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:02.238246+0000","last_change":"2024-04-26T11:28:02.238492+0000","last_active":"2024-04-26T11:28:02.238246+0000","last_peered":"2024-04-26T11:28:02.238246+0000","last_clean":"2024-04-26T11:28:02.238246+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:28:02.238246+0000","last_undegraded":"2024-04-26T11:28:02.238246+0000","last_fullsized":"2024-04-26T11:28:02.238246+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'377","last_scrub_stamp":"2024-04-26T11:28:02.238190+0000","last_deep_scrub":"106'377","last_deep_scrub_stamp":"2024-04-26T11:28:02.238190+0000","last_clean_scrub_stamp":"2024-04-26T11:28:02.238190+0000","objects_scrubbed":3,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:12.560437+0000","scrub_duration":0.052441278000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:52.009464+0000","last_change":"2024-04-26T11:26:52.009713+0000","last_active":"2024-04-26T11:26:52.009464+0000","last_peered":"2024-04-26T11:26:52.009464+0000","last_clean":"2024-04-26T11:26:52.009464+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:52.009464+0000","last_undegraded":"2024-04-26T11:26:52.009464+0000","last_fullsized":"2024-04-26T11:26:52.009464+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_clean_scrub_stamp":"2024-04-26T11:26:52.009412+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:59.423751+0000","scrub_duration":0.0045503360000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"106'62","reported_seq":166,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:15.206585+0000","last_change":"2024-04-26T11:28:15.206904+0000","last_active":"2024-04-26T11:28:15.206585+0000","last_peered":"2024-04-26T11:28:15.206585+0000","last_clean":"2024-04-26T11:28:15.206585+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:28:15.206585+0000","last_undegraded":"2024-04-26T11:28:15.206585+0000","last_fullsized":"2024-04-26T11:28:15.206585+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'62","last_scrub_stamp":"2024-04-26T11:28:15.206529+0000","last_deep_scrub":"106'62","last_deep_scrub_stamp":"2024-04-26T11:28:15.206529+0000","last_clean_scrub_stamp":"2024-04-26T11:28:15.206529+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.502044+0000","scrub_duration":0.01665635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":487,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.491082+0000","last_change":"2024-04-26T11:27:03.491361+0000","last_active":"2024-04-26T11:27:03.491082+0000","last_peered":"2024-04-26T11:27:03.491082+0000","last_clean":"2024-04-26T11:27:03.491082+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:27:03.491082+0000","last_undegraded":"2024-04-26T11:27:03.491082+0000","last_fullsized":"2024-04-26T11:27:03.491082+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'375","last_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_deep_scrub":"71'375","last_deep_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.491032+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:52.444748+0000","scrub_duration":0.0043129789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"106'328","reported_seq":418,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:57.584921+0000","last_change":"2024-04-26T11:27:57.585141+0000","last_active":"2024-04-26T11:27:57.584921+0000","last_peered":"2024-04-26T11:27:57.584921+0000","last_clean":"2024-04-26T11:27:57.584921+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:27:57.584921+0000","last_undegraded":"2024-04-26T11:27:57.584921+0000","last_fullsized":"2024-04-26T11:27:57.584921+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'328","last_scrub_stamp":"2024-04-26T11:27:57.584866+0000","last_deep_scrub":"106'328","last_deep_scrub_stamp":"2024-04-26T11:27:57.584866+0000","last_clean_scrub_stamp":"2024-04-26T11:27:57.584866+0000","objects_scrubbed":2,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:15.471404+0000","scrub_duration":0.026502560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":503,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:09.525104+0000","last_change":"2024-04-26T11:27:09.525341+0000","last_active":"2024-04-26T11:27:09.525104+0000","last_peered":"2024-04-26T11:27:09.525104+0000","last_clean":"2024-04-26T11:27:09.525104+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:27:09.525104+0000","last_undegraded":"2024-04-26T11:27:09.525104+0000","last_fullsized":"2024-04-26T11:27:09.525104+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-26T11:27:09.525054+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-26T11:27:09.525054+0000","last_clean_scrub_stamp":"2024-04-26T11:27:09.525054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:30.705220+0000","scrub_duration":0.0044574929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"106'394","reported_seq":514,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:04.167993+0000","last_change":"2024-04-26T11:27:04.168232+0000","last_active":"2024-04-26T11:27:04.167993+0000","last_peered":"2024-04-26T11:27:04.167993+0000","last_clean":"2024-04-26T11:27:04.167993+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:27:04.167993+0000","last_undegraded":"2024-04-26T11:27:04.167993+0000","last_fullsized":"2024-04-26T11:27:04.167993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'394","last_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_deep_scrub":"106'394","last_deep_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_clean_scrub_stamp":"2024-04-26T11:27:04.167933+0000","objects_scrubbed":4,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.292388+0000","scrub_duration":0.059480993000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":510,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:13.258783+0000","last_change":"2024-04-26T11:28:13.259019+0000","last_active":"2024-04-26T11:28:13.258783+0000","last_peered":"2024-04-26T11:28:13.258783+0000","last_clean":"2024-04-26T11:28:13.258783+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:28:13.258783+0000","last_undegraded":"2024-04-26T11:28:13.258783+0000","last_fullsized":"2024-04-26T11:28:13.258783+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'405","last_scrub_stamp":"2024-04-26T11:28:13.258733+0000","last_deep_scrub":"71'405","last_deep_scrub_stamp":"2024-04-26T11:28:13.258733+0000","last_clean_scrub_stamp":"2024-04-26T11:28:13.258733+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:26.510924+0000","scrub_duration":0.0055196990000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"106'58","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:04.024643+0000","last_change":"2024-04-26T11:28:04.024856+0000","last_active":"2024-04-26T11:28:04.024643+0000","last_peered":"2024-04-26T11:28:04.024643+0000","last_clean":"2024-04-26T11:28:04.024643+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:28:04.024643+0000","last_undegraded":"2024-04-26T11:28:04.024643+0000","last_fullsized":"2024-04-26T11:28:04.024643+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'58","last_scrub_stamp":"2024-04-26T11:28:04.024591+0000","last_deep_scrub":"106'58","last_deep_scrub_stamp":"2024-04-26T11:28:04.024591+0000","last_clean_scrub_stamp":"2024-04-26T11:28:04.024591+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:46.722631+0000","scrub_duration":0.016948365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":554,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:59.498154+0000","last_change":"2024-04-26T11:26:59.498428+0000","last_active":"2024-04-26T11:26:59.498154+0000","last_peered":"2024-04-26T11:26:59.498154+0000","last_clean":"2024-04-26T11:26:59.498154+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:59.498154+0000","last_undegraded":"2024-04-26T11:26:59.498154+0000","last_fullsized":"2024-04-26T11:26:59.498154+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'446","last_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_deep_scrub":"71'446","last_deep_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_clean_scrub_stamp":"2024-04-26T11:26:59.498100+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:08.316575+0000","scrub_duration":0.003708294,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"106'133","reported_seq":272,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:25.003403+0000","last_change":"2024-04-26T11:27:25.003403+0000","last_active":"2024-04-26T11:27:25.003403+0000","last_peered":"2024-04-26T11:27:25.003403+0000","last_clean":"2024-04-26T11:27:25.003403+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:27:25.003403+0000","last_undegraded":"2024-04-26T11:27:25.003403+0000","last_fullsized":"2024-04-26T11:27:25.003403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'133","last_scrub_stamp":"2024-04-26T11:27:25.003082+0000","last_deep_scrub":"106'133","last_deep_scrub_stamp":"2024-04-26T11:27:25.003082+0000","last_clean_scrub_stamp":"2024-04-26T11:27:25.003082+0000","objects_scrubbed":3,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:32.644341+0000","scrub_duration":0.025665877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7707,"ondisk_log_size":7707,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738454,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146528,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94225312,"statfs":{"total":96636764160,"available":96486719488,"internally_reserved":0,"allocated":31744000,"data_stored":81613145,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:28:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.54400000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Apr 26 11:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.66400000000000003,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.84299999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.629,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.67600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359738454,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124348,"kb_used_data":30964,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247492,"statfs":{"total":96636764160,"available":96509431808,"internally_reserved":0,"allocated":31707136,"data_stored":86117265,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.67800000000000005}]},{"osd":2,"last update":"Fri Apr 26 11:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.68200000000000005},"min":{"1min":0.54700000000000004,"5min":0.312,"15min":0.312},"max":{"1min":0.755,"5min":0.80400000000000005,"15min":0.93000000000000005},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63100000000000001,"15min":0.68100000000000005},"min":{"1min":0.52600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.80500000000000005,"5min":0.83999999999999997,"15min":0.84499999999999997},"last":0.71599999999999997}]}]},{"osd":0,"up_from":75,"seq":322122547230,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75932,"kb_used_data":18068,"kb_used_omap":7,"kb_used_meta":57848,"kb_avail":94295908,"statfs":{"total":96636764160,"available":96559009792,"internally_reserved":0,"allocated":18501632,"data_stored":91781533,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":59237367},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.53900000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.622},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59599999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63900000000000001,"15min":0.63200000000000001},"min":{"1min":0.58899999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.65000000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.66600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:28:32.429 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:32.429 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:32.429 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:32.430 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:32.430 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T11:21:53.304950+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=21, tm_sec=53, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=11, tm_min=26, tm_sec=47, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T11:28:32.431 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T11:28:52.432 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T11:28:52.748 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:28:52.750 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2024-04-26T11:28:52.765 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-04-26T11:28:51.500426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129078864,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":2963,"num_read_kb":1500913,"num_write":30423,"num_write_kb":4402066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7334,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34417,"ondisk_log_size":34417,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":346808,"kb_used_data":80032,"kb_used_omap":10,"kb_used_meta":266741,"kb_avail":282768712,"statfs":{"total":289910292480,"available":289555161088,"internally_reserved":0,"allocated":81952768,"data_stored":259511943,"data_compressed":37590969,"data_compressed_allocated":47403008,"data_compressed_original":226631680,"omap_allocated":10365,"internal_metadata":273143683},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004774"},"pg_stats":[{"pgid":"4.3f","version":"71'426","reported_seq":522,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:11.073124+0000","last_change":"2024-04-26T11:27:11.073124+0000","last_active":"2024-04-26T11:27:11.073124+0000","last_peered":"2024-04-26T11:27:11.073124+0000","last_clean":"2024-04-26T11:27:11.073124+0000","last_became_active":"2024-04-26T11:26:22.379738+0000","last_became_peered":"2024-04-26T11:26:22.379738+0000","last_unstale":"2024-04-26T11:27:11.073124+0000","last_undegraded":"2024-04-26T11:27:11.073124+0000","last_fullsized":"2024-04-26T11:27:11.073124+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:27:11.072854+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:27:11.072854+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.072854+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:41.048439+0000","scrub_duration":0.0036583589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":12894,"num_write":392,"num_write_kb":96080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"71'427","reported_seq":578,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:16.039433+0000","last_change":"2024-04-26T11:27:16.039433+0000","last_active":"2024-04-26T11:27:16.039433+0000","last_peered":"2024-04-26T11:27:16.039433+0000","last_clean":"2024-04-26T11:27:16.039433+0000","last_became_active":"2024-04-26T11:26:22.376977+0000","last_became_peered":"2024-04-26T11:26:22.376977+0000","last_unstale":"2024-04-26T11:27:16.039433+0000","last_undegraded":"2024-04-26T11:27:16.039433+0000","last_fullsized":"2024-04-26T11:27:16.039433+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'427","last_scrub_stamp":"2024-04-26T11:27:16.039112+0000","last_deep_scrub":"71'427","last_deep_scrub_stamp":"2024-04-26T11:27:16.039112+0000","last_clean_scrub_stamp":"2024-04-26T11:27:16.039112+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:41.912448+0000","scrub_duration":0.0051090520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":42011,"num_write":404,"num_write_kb":96003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"71'372","reported_seq":453,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:43.521777+0000","last_change":"2024-04-26T11:28:43.521993+0000","last_active":"2024-04-26T11:28:43.521777+0000","last_peered":"2024-04-26T11:28:43.521777+0000","last_clean":"2024-04-26T11:28:43.521777+0000","last_became_active":"2024-04-26T11:26:22.890675+0000","last_became_peered":"2024-04-26T11:26:22.890675+0000","last_unstale":"2024-04-26T11:28:43.521777+0000","last_undegraded":"2024-04-26T11:28:43.521777+0000","last_fullsized":"2024-04-26T11:28:43.521777+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'372","last_scrub_stamp":"2024-04-26T11:28:43.521725+0000","last_deep_scrub":"71'372","last_deep_scrub_stamp":"2024-04-26T11:28:43.521725+0000","last_clean_scrub_stamp":"2024-04-26T11:28:43.521725+0000","objects_scrubbed":0,"log_size":372,"log_dups_size":0,"ondisk_log_size":372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:41.205383+0000","scrub_duration":0.0040858489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":174,"num_write":347,"num_write_kb":34511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"71'391","reported_seq":502,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:14.553869+0000","last_change":"2024-04-26T11:28:14.553869+0000","last_active":"2024-04-26T11:28:14.553869+0000","last_peered":"2024-04-26T11:28:14.553869+0000","last_clean":"2024-04-26T11:28:14.553869+0000","last_became_active":"2024-04-26T11:26:27.894554+0000","last_became_peered":"2024-04-26T11:26:27.894554+0000","last_unstale":"2024-04-26T11:28:14.553869+0000","last_undegraded":"2024-04-26T11:28:14.553869+0000","last_fullsized":"2024-04-26T11:28:14.553869+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'391","last_scrub_stamp":"2024-04-26T11:28:14.553593+0000","last_deep_scrub":"71'391","last_deep_scrub_stamp":"2024-04-26T11:28:14.553593+0000","last_clean_scrub_stamp":"2024-04-26T11:28:14.553593+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:35.685181+0000","scrub_duration":0.0035977100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":21502,"num_write":352,"num_write_kb":55529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":165,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"71'432","reported_seq":552,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:06.222463+0000","last_change":"2024-04-26T11:28:06.222682+0000","last_active":"2024-04-26T11:28:06.222463+0000","last_peered":"2024-04-26T11:28:06.222463+0000","last_clean":"2024-04-26T11:28:06.222463+0000","last_became_active":"2024-04-26T11:26:22.393045+0000","last_became_peered":"2024-04-26T11:26:22.393045+0000","last_unstale":"2024-04-26T11:28:06.222463+0000","last_undegraded":"2024-04-26T11:28:06.222463+0000","last_fullsized":"2024-04-26T11:28:06.222463+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'432","last_scrub_stamp":"2024-04-26T11:28:06.222413+0000","last_deep_scrub":"71'432","last_deep_scrub_stamp":"2024-04-26T11:28:06.222413+0000","last_clean_scrub_stamp":"2024-04-26T11:28:06.222413+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:03.342933+0000","scrub_duration":0.0044749630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":17190,"num_write":406,"num_write_kb":60073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"71'401","reported_seq":505,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:19.665433+0000","last_change":"2024-04-26T11:28:19.665709+0000","last_active":"2024-04-26T11:28:19.665433+0000","last_peered":"2024-04-26T11:28:19.665433+0000","last_clean":"2024-04-26T11:28:19.665433+0000","last_became_active":"2024-04-26T11:26:28.902190+0000","last_became_peered":"2024-04-26T11:26:28.902190+0000","last_unstale":"2024-04-26T11:28:19.665433+0000","last_undegraded":"2024-04-26T11:28:19.665433+0000","last_fullsized":"2024-04-26T11:28:19.665433+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'401","last_scrub_stamp":"2024-04-26T11:28:19.665380+0000","last_deep_scrub":"71'401","last_deep_scrub_stamp":"2024-04-26T11:28:19.665380+0000","last_clean_scrub_stamp":"2024-04-26T11:28:19.665380+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:40.327138+0000","scrub_duration":0.0044913619999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":11921,"num_write":374,"num_write_kb":43341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"71'442","reported_seq":606,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:16.605754+0000","last_change":"2024-04-26T11:28:16.605975+0000","last_active":"2024-04-26T11:28:16.605754+0000","last_peered":"2024-04-26T11:28:16.605754+0000","last_clean":"2024-04-26T11:28:16.605754+0000","last_became_active":"2024-04-26T11:26:20.910945+0000","last_became_peered":"2024-04-26T11:26:20.910945+0000","last_unstale":"2024-04-26T11:28:16.605754+0000","last_undegraded":"2024-04-26T11:28:16.605754+0000","last_fullsized":"2024-04-26T11:28:16.605754+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'442","last_scrub_stamp":"2024-04-26T11:28:16.605697+0000","last_deep_scrub":"71'442","last_deep_scrub_stamp":"2024-04-26T11:28:16.605697+0000","last_clean_scrub_stamp":"2024-04-26T11:28:16.605697+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:21.820675+0000","scrub_duration":0.0046125239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43127,"num_write":413,"num_write_kb":80258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"71'373","reported_seq":474,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:04.461767+0000","last_change":"2024-04-26T11:27:04.461975+0000","last_active":"2024-04-26T11:27:04.461767+0000","last_peered":"2024-04-26T11:27:04.461767+0000","last_clean":"2024-04-26T11:27:04.461767+0000","last_became_active":"2024-04-26T11:26:25.905490+0000","last_became_peered":"2024-04-26T11:26:25.905490+0000","last_unstale":"2024-04-26T11:27:04.461767+0000","last_undegraded":"2024-04-26T11:27:04.461767+0000","last_fullsized":"2024-04-26T11:27:04.461767+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'373","last_scrub_stamp":"2024-04-26T11:27:04.461717+0000","last_deep_scrub":"71'373","last_deep_scrub_stamp":"2024-04-26T11:27:04.461717+0000","last_clean_scrub_stamp":"2024-04-26T11:27:04.461717+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:11:24.859328+0000","scrub_duration":0.0041768209999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":11473,"num_write":330,"num_write_kb":46991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"71'447","reported_seq":609,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:23.965512+0000","last_change":"2024-04-26T11:27:23.965730+0000","last_active":"2024-04-26T11:27:23.965512+0000","last_peered":"2024-04-26T11:27:23.965512+0000","last_clean":"2024-04-26T11:27:23.965512+0000","last_became_active":"2024-04-26T11:21:53.709624+0000","last_became_peered":"2024-04-26T11:21:53.709624+0000","last_unstale":"2024-04-26T11:27:23.965512+0000","last_undegraded":"2024-04-26T11:27:23.965512+0000","last_fullsized":"2024-04-26T11:27:23.965512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'447","last_scrub_stamp":"2024-04-26T11:27:23.965459+0000","last_deep_scrub":"71'447","last_deep_scrub_stamp":"2024-04-26T11:27:23.965459+0000","last_clean_scrub_stamp":"2024-04-26T11:27:23.965459+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:07:17.028067+0000","scrub_duration":0.0044560520000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":22093,"num_write":407,"num_write_kb":80344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"71'389","reported_seq":519,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:47.980740+0000","last_change":"2024-04-26T11:27:47.980944+0000","last_active":"2024-04-26T11:27:47.980740+0000","last_peered":"2024-04-26T11:27:47.980740+0000","last_clean":"2024-04-26T11:27:47.980740+0000","last_became_active":"2024-04-26T11:21:53.712998+0000","last_became_peered":"2024-04-26T11:21:53.712998+0000","last_unstale":"2024-04-26T11:27:47.980740+0000","last_undegraded":"2024-04-26T11:27:47.980740+0000","last_fullsized":"2024-04-26T11:27:47.980740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'389","last_scrub_stamp":"2024-04-26T11:27:47.980687+0000","last_deep_scrub":"71'389","last_deep_scrub_stamp":"2024-04-26T11:27:47.980687+0000","last_clean_scrub_stamp":"2024-04-26T11:27:47.980687+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:06:14.673060+0000","scrub_duration":0.0047600280000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":12288,"num_write":343,"num_write_kb":54309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"71'386","reported_seq":492,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:35.519491+0000","last_change":"2024-04-26T11:28:35.519715+0000","last_active":"2024-04-26T11:28:35.519491+0000","last_peered":"2024-04-26T11:28:35.519491+0000","last_clean":"2024-04-26T11:28:35.519491+0000","last_became_active":"2024-04-26T11:26:32.890598+0000","last_became_peered":"2024-04-26T11:26:32.890598+0000","last_unstale":"2024-04-26T11:28:35.519491+0000","last_undegraded":"2024-04-26T11:28:35.519491+0000","last_fullsized":"2024-04-26T11:28:35.519491+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'386","last_scrub_stamp":"2024-04-26T11:28:35.519442+0000","last_deep_scrub":"71'386","last_deep_scrub_stamp":"2024-04-26T11:28:35.519442+0000","last_clean_scrub_stamp":"2024-04-26T11:28:35.519442+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:29:53.420530+0000","scrub_duration":0.0044795449999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":22686,"num_write":366,"num_write_kb":67274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"71'350","reported_seq":795,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:55.137005+0000","last_change":"2024-04-26T11:27:55.137295+0000","last_active":"2024-04-26T11:27:55.137005+0000","last_peered":"2024-04-26T11:27:55.137005+0000","last_clean":"2024-04-26T11:27:55.137005+0000","last_became_active":"2024-04-26T11:26:22.377812+0000","last_became_peered":"2024-04-26T11:26:22.377812+0000","last_unstale":"2024-04-26T11:27:55.137005+0000","last_undegraded":"2024-04-26T11:27:55.137005+0000","last_fullsized":"2024-04-26T11:27:55.137005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'350","last_scrub_stamp":"2024-04-26T11:27:55.136953+0000","last_deep_scrub":"71'350","last_deep_scrub_stamp":"2024-04-26T11:27:55.136953+0000","last_clean_scrub_stamp":"2024-04-26T11:27:55.136953+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:25.662360+0000","scrub_duration":0.0045968290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":5052,"num_write":322,"num_write_kb":33657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":158,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"71'385","reported_seq":466,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:07.138812+0000","last_change":"2024-04-26T11:27:07.138812+0000","last_active":"2024-04-26T11:27:07.138812+0000","last_peered":"2024-04-26T11:27:07.138812+0000","last_clean":"2024-04-26T11:27:07.138812+0000","last_became_active":"2024-04-26T11:26:22.372510+0000","last_became_peered":"2024-04-26T11:26:22.372510+0000","last_unstale":"2024-04-26T11:27:07.138812+0000","last_undegraded":"2024-04-26T11:27:07.138812+0000","last_fullsized":"2024-04-26T11:27:07.138812+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'385","last_scrub_stamp":"2024-04-26T11:27:07.138550+0000","last_deep_scrub":"71'385","last_deep_scrub_stamp":"2024-04-26T11:27:07.138550+0000","last_clean_scrub_stamp":"2024-04-26T11:27:07.138550+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:06:51.494043+0000","scrub_duration":0.0046149509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7301,"num_write":342,"num_write_kb":29585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"71'398","reported_seq":495,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:02.539472+0000","last_change":"2024-04-26T11:27:02.539472+0000","last_active":"2024-04-26T11:27:02.539472+0000","last_peered":"2024-04-26T11:27:02.539472+0000","last_clean":"2024-04-26T11:27:02.539472+0000","last_became_active":"2024-04-26T11:26:21.924054+0000","last_became_peered":"2024-04-26T11:26:21.924054+0000","last_unstale":"2024-04-26T11:27:02.539472+0000","last_undegraded":"2024-04-26T11:27:02.539472+0000","last_fullsized":"2024-04-26T11:27:02.539472+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-26T11:27:02.539206+0000","last_clean_scrub_stamp":"2024-04-26T11:27:02.539206+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:27:43.230821+0000","scrub_duration":0.003815648,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9703,"num_write":369,"num_write_kb":70983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"71'431","reported_seq":551,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:18.484810+0000","last_change":"2024-04-26T11:27:18.484810+0000","last_active":"2024-04-26T11:27:18.484810+0000","last_peered":"2024-04-26T11:27:18.484810+0000","last_clean":"2024-04-26T11:27:18.484810+0000","last_became_active":"2024-04-26T11:26:16.145664+0000","last_became_peered":"2024-04-26T11:26:16.145664+0000","last_unstale":"2024-04-26T11:27:18.484810+0000","last_undegraded":"2024-04-26T11:27:18.484810+0000","last_fullsized":"2024-04-26T11:27:18.484810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'431","last_scrub_stamp":"2024-04-26T11:27:18.484532+0000","last_deep_scrub":"71'431","last_deep_scrub_stamp":"2024-04-26T11:27:18.484532+0000","last_clean_scrub_stamp":"2024-04-26T11:27:18.484532+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:43.402024+0000","scrub_duration":0.0042561730000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20168,"num_write":395,"num_write_kb":96220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"71'453","reported_seq":616,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.393969+0000","last_change":"2024-04-26T11:26:54.393969+0000","last_active":"2024-04-26T11:26:54.393969+0000","last_peered":"2024-04-26T11:26:54.393969+0000","last_clean":"2024-04-26T11:26:54.393969+0000","last_became_active":"2024-04-26T11:26:24.900046+0000","last_became_peered":"2024-04-26T11:26:24.900046+0000","last_unstale":"2024-04-26T11:26:54.393969+0000","last_undegraded":"2024-04-26T11:26:54.393969+0000","last_fullsized":"2024-04-26T11:26:54.393969+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'453","last_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_deep_scrub":"71'453","last_deep_scrub_stamp":"2024-04-26T11:26:54.393690+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.393690+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:39:41.730233+0000","scrub_duration":0.0038895330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":46492,"num_write":422,"num_write_kb":84156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"71'419","reported_seq":589,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:51.960476+0000","last_change":"2024-04-26T11:26:51.960725+0000","last_active":"2024-04-26T11:26:51.960476+0000","last_peered":"2024-04-26T11:26:51.960476+0000","last_clean":"2024-04-26T11:26:51.960476+0000","last_became_active":"2024-04-26T11:22:40.574123+0000","last_became_peered":"2024-04-26T11:22:40.574123+0000","last_unstale":"2024-04-26T11:26:51.960476+0000","last_undegraded":"2024-04-26T11:26:51.960476+0000","last_fullsized":"2024-04-26T11:26:51.960476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-26T11:26:51.960424+0000","last_clean_scrub_stamp":"2024-04-26T11:26:51.960424+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:13:17.833759+0000","scrub_duration":0.0043861689999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":38261,"num_write":390,"num_write_kb":59445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"71'419","reported_seq":597,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:14.224112+0000","last_change":"2024-04-26T11:28:14.224112+0000","last_active":"2024-04-26T11:28:14.224112+0000","last_peered":"2024-04-26T11:28:14.224112+0000","last_clean":"2024-04-26T11:28:14.224112+0000","last_became_active":"2024-04-26T11:26:22.390818+0000","last_became_peered":"2024-04-26T11:26:22.390818+0000","last_unstale":"2024-04-26T11:28:14.224112+0000","last_undegraded":"2024-04-26T11:28:14.224112+0000","last_fullsized":"2024-04-26T11:28:14.224112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'419","last_scrub_stamp":"2024-04-26T11:28:14.223845+0000","last_deep_scrub":"71'419","last_deep_scrub_stamp":"2024-04-26T11:28:14.223845+0000","last_clean_scrub_stamp":"2024-04-26T11:28:14.223845+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:46:18.459175+0000","scrub_duration":0.0046234020000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":50600,"num_write":382,"num_write_kb":87728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"71'445","reported_seq":636,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.965379+0000","last_change":"2024-04-26T11:27:15.965379+0000","last_active":"2024-04-26T11:27:15.965379+0000","last_peered":"2024-04-26T11:27:15.965379+0000","last_clean":"2024-04-26T11:27:15.965379+0000","last_became_active":"2024-04-26T11:21:53.707032+0000","last_became_peered":"2024-04-26T11:21:53.707032+0000","last_unstale":"2024-04-26T11:27:15.965379+0000","last_undegraded":"2024-04-26T11:27:15.965379+0000","last_fullsized":"2024-04-26T11:27:15.965379+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'445","last_scrub_stamp":"2024-04-26T11:27:15.965105+0000","last_deep_scrub":"71'445","last_deep_scrub_stamp":"2024-04-26T11:27:15.965105+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.965105+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:02.906065+0000","scrub_duration":0.0046149279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50031,"num_write":408,"num_write_kb":108974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"71'475","reported_seq":624,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:39.660968+0000","last_change":"2024-04-26T11:27:39.660968+0000","last_active":"2024-04-26T11:27:39.660968+0000","last_peered":"2024-04-26T11:27:39.660968+0000","last_clean":"2024-04-26T11:27:39.660968+0000","last_became_active":"2024-04-26T11:26:29.902525+0000","last_became_peered":"2024-04-26T11:26:29.902525+0000","last_unstale":"2024-04-26T11:27:39.660968+0000","last_undegraded":"2024-04-26T11:27:39.660968+0000","last_fullsized":"2024-04-26T11:27:39.660968+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'475","last_scrub_stamp":"2024-04-26T11:27:39.660681+0000","last_deep_scrub":"71'475","last_deep_scrub_stamp":"2024-04-26T11:27:39.660681+0000","last_clean_scrub_stamp":"2024-04-26T11:27:39.660681+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:55:13.243958+0000","scrub_duration":0.0042850270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40228,"num_write":444,"num_write_kb":117752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":195,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"71'426","reported_seq":561,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:31.475637+0000","last_change":"2024-04-26T11:28:31.475877+0000","last_active":"2024-04-26T11:28:31.475637+0000","last_peered":"2024-04-26T11:28:31.475637+0000","last_clean":"2024-04-26T11:28:31.475637+0000","last_became_active":"2024-04-26T11:26:36.890979+0000","last_became_peered":"2024-04-26T11:26:36.890979+0000","last_unstale":"2024-04-26T11:28:31.475637+0000","last_undegraded":"2024-04-26T11:28:31.475637+0000","last_fullsized":"2024-04-26T11:28:31.475637+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:28:31.475584+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:28:31.475584+0000","last_clean_scrub_stamp":"2024-04-26T11:28:31.475584+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:25.834562+0000","scrub_duration":0.0039426390000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":44057,"num_write":402,"num_write_kb":80621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":181,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"71'440","reported_seq":991,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:54.086867+0000","last_change":"2024-04-26T11:27:54.086867+0000","last_active":"2024-04-26T11:27:54.086867+0000","last_peered":"2024-04-26T11:27:54.086867+0000","last_clean":"2024-04-26T11:27:54.086867+0000","last_became_active":"2024-04-26T11:26:34.383434+0000","last_became_peered":"2024-04-26T11:26:34.383434+0000","last_unstale":"2024-04-26T11:27:54.086867+0000","last_undegraded":"2024-04-26T11:27:54.086867+0000","last_fullsized":"2024-04-26T11:27:54.086867+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'440","last_scrub_stamp":"2024-04-26T11:27:54.086592+0000","last_deep_scrub":"71'440","last_deep_scrub_stamp":"2024-04-26T11:27:54.086592+0000","last_clean_scrub_stamp":"2024-04-26T11:27:54.086592+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:13.572538+0000","scrub_duration":0.0036755160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":21448,"num_write":402,"num_write_kb":43203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"71'408","reported_seq":945,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:34.937203+0000","last_change":"2024-04-26T11:27:34.937203+0000","last_active":"2024-04-26T11:27:34.937203+0000","last_peered":"2024-04-26T11:27:34.937203+0000","last_clean":"2024-04-26T11:27:34.937203+0000","last_became_active":"2024-04-26T11:26:20.375494+0000","last_became_peered":"2024-04-26T11:26:20.375494+0000","last_unstale":"2024-04-26T11:27:34.937203+0000","last_undegraded":"2024-04-26T11:27:34.937203+0000","last_fullsized":"2024-04-26T11:27:34.937203+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-26T11:27:34.936929+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-26T11:27:34.936929+0000","last_clean_scrub_stamp":"2024-04-26T11:27:34.936929+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:25.920048+0000","scrub_duration":0.0042325840000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":39494,"num_write":376,"num_write_kb":51572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":176,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"71'433","reported_seq":528,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.098112+0000","last_change":"2024-04-26T11:26:58.098112+0000","last_active":"2024-04-26T11:26:58.098112+0000","last_peered":"2024-04-26T11:26:58.098112+0000","last_clean":"2024-04-26T11:26:58.098112+0000","last_became_active":"2024-04-26T11:26:22.374229+0000","last_became_peered":"2024-04-26T11:26:22.374229+0000","last_unstale":"2024-04-26T11:26:58.098112+0000","last_undegraded":"2024-04-26T11:26:58.098112+0000","last_fullsized":"2024-04-26T11:26:58.098112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'433","last_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_deep_scrub":"71'433","last_deep_scrub_stamp":"2024-04-26T11:26:58.097826+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.097826+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:39.261277+0000","scrub_duration":0.0045929860000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13958,"num_write":403,"num_write_kb":63213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"71'422","reported_seq":961,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:35.990604+0000","last_change":"2024-04-26T11:27:35.990604+0000","last_active":"2024-04-26T11:27:35.990604+0000","last_peered":"2024-04-26T11:27:35.990604+0000","last_clean":"2024-04-26T11:27:35.990604+0000","last_became_active":"2024-04-26T11:26:31.390049+0000","last_became_peered":"2024-04-26T11:26:31.390049+0000","last_unstale":"2024-04-26T11:27:35.990604+0000","last_undegraded":"2024-04-26T11:27:35.990604+0000","last_fullsized":"2024-04-26T11:27:35.990604+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'422","last_scrub_stamp":"2024-04-26T11:27:35.990321+0000","last_deep_scrub":"71'422","last_deep_scrub_stamp":"2024-04-26T11:27:35.990321+0000","last_clean_scrub_stamp":"2024-04-26T11:27:35.990321+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:42.180497+0000","scrub_duration":0.0039948070000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":10935,"num_write":406,"num_write_kb":46429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"71'470","reported_seq":1067,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:11.020512+0000","last_change":"2024-04-26T11:27:11.020512+0000","last_active":"2024-04-26T11:27:11.020512+0000","last_peered":"2024-04-26T11:27:11.020512+0000","last_clean":"2024-04-26T11:27:11.020512+0000","last_became_active":"2024-04-26T11:26:18.370465+0000","last_became_peered":"2024-04-26T11:26:18.370465+0000","last_unstale":"2024-04-26T11:27:11.020512+0000","last_undegraded":"2024-04-26T11:27:11.020512+0000","last_fullsized":"2024-04-26T11:27:11.020512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'470","last_scrub_stamp":"2024-04-26T11:27:11.020208+0000","last_deep_scrub":"71'470","last_deep_scrub_stamp":"2024-04-26T11:27:11.020208+0000","last_clean_scrub_stamp":"2024-04-26T11:27:11.020208+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:49.564877+0000","scrub_duration":0.0040859049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":29163,"num_write":423,"num_write_kb":59768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":200,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"71'417","reported_seq":571,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:26.563640+0000","last_change":"2024-04-26T11:28:26.563640+0000","last_active":"2024-04-26T11:28:26.563640+0000","last_peered":"2024-04-26T11:28:26.563640+0000","last_clean":"2024-04-26T11:28:26.563640+0000","last_became_active":"2024-04-26T11:26:27.897425+0000","last_became_peered":"2024-04-26T11:26:27.897425+0000","last_unstale":"2024-04-26T11:28:26.563640+0000","last_undegraded":"2024-04-26T11:28:26.563640+0000","last_fullsized":"2024-04-26T11:28:26.563640+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'417","last_scrub_stamp":"2024-04-26T11:28:26.563305+0000","last_deep_scrub":"71'417","last_deep_scrub_stamp":"2024-04-26T11:28:26.563305+0000","last_clean_scrub_stamp":"2024-04-26T11:28:26.563305+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:23.006538+0000","scrub_duration":0.0043547969999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":40123,"num_write":387,"num_write_kb":104143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"71'398","reported_seq":964,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:46.987372+0000","last_change":"2024-04-26T11:27:46.987372+0000","last_active":"2024-04-26T11:27:46.987372+0000","last_peered":"2024-04-26T11:27:46.987372+0000","last_clean":"2024-04-26T11:27:46.987372+0000","last_became_active":"2024-04-26T11:26:26.389483+0000","last_became_peered":"2024-04-26T11:26:26.389483+0000","last_unstale":"2024-04-26T11:27:46.987372+0000","last_undegraded":"2024-04-26T11:27:46.987372+0000","last_fullsized":"2024-04-26T11:27:46.987372+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'398","last_scrub_stamp":"2024-04-26T11:27:46.987053+0000","last_deep_scrub":"71'398","last_deep_scrub_stamp":"2024-04-26T11:27:46.987053+0000","last_clean_scrub_stamp":"2024-04-26T11:27:46.987053+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:27.678697+0000","scrub_duration":0.003826851,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47955,"num_write":373,"num_write_kb":91754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"71'396","reported_seq":521,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:25.073915+0000","last_change":"2024-04-26T11:28:25.074153+0000","last_active":"2024-04-26T11:28:25.073915+0000","last_peered":"2024-04-26T11:28:25.073915+0000","last_clean":"2024-04-26T11:28:25.073915+0000","last_became_active":"2024-04-26T11:22:40.571371+0000","last_became_peered":"2024-04-26T11:22:40.571371+0000","last_unstale":"2024-04-26T11:28:25.073915+0000","last_undegraded":"2024-04-26T11:28:25.073915+0000","last_fullsized":"2024-04-26T11:28:25.073915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'396","last_scrub_stamp":"2024-04-26T11:28:25.073856+0000","last_deep_scrub":"71'396","last_deep_scrub_stamp":"2024-04-26T11:28:25.073856+0000","last_clean_scrub_stamp":"2024-04-26T11:28:25.073856+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:57.423315+0000","scrub_duration":0.004787833,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":6217,"num_write":366,"num_write_kb":75276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"71'461","reported_seq":1041,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:09.107336+0000","last_change":"2024-04-26T11:27:09.107336+0000","last_active":"2024-04-26T11:27:09.107336+0000","last_peered":"2024-04-26T11:27:09.107336+0000","last_clean":"2024-04-26T11:27:09.107336+0000","last_became_active":"2024-04-26T11:26:38.373963+0000","last_became_peered":"2024-04-26T11:26:38.373963+0000","last_unstale":"2024-04-26T11:27:09.107336+0000","last_undegraded":"2024-04-26T11:27:09.107336+0000","last_fullsized":"2024-04-26T11:27:09.107336+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'461","last_scrub_stamp":"2024-04-26T11:27:09.107005+0000","last_deep_scrub":"71'461","last_deep_scrub_stamp":"2024-04-26T11:27:09.107005+0000","last_clean_scrub_stamp":"2024-04-26T11:27:09.107005+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:55:02.026982+0000","scrub_duration":0.0039544200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":21575,"num_write":423,"num_write_kb":55095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"71'452","reported_seq":641,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:28.974503+0000","last_change":"2024-04-26T11:27:28.974503+0000","last_active":"2024-04-26T11:27:28.974503+0000","last_peered":"2024-04-26T11:27:28.974503+0000","last_clean":"2024-04-26T11:27:28.974503+0000","last_became_active":"2024-04-26T11:22:40.571636+0000","last_became_peered":"2024-04-26T11:22:40.571636+0000","last_unstale":"2024-04-26T11:27:28.974503+0000","last_undegraded":"2024-04-26T11:27:28.974503+0000","last_fullsized":"2024-04-26T11:27:28.974503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'452","last_scrub_stamp":"2024-04-26T11:27:28.974238+0000","last_deep_scrub":"71'452","last_deep_scrub_stamp":"2024-04-26T11:27:28.974238+0000","last_clean_scrub_stamp":"2024-04-26T11:27:28.974238+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:43:48.460183+0000","scrub_duration":0.0047380240000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":50245,"num_write":418,"num_write_kb":124874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"71'424","reported_seq":512,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:17.444506+0000","last_change":"2024-04-26T11:27:17.444506+0000","last_active":"2024-04-26T11:27:17.444506+0000","last_peered":"2024-04-26T11:27:17.444506+0000","last_clean":"2024-04-26T11:27:17.444506+0000","last_became_active":"2024-04-26T11:26:40.895623+0000","last_became_peered":"2024-04-26T11:26:40.895623+0000","last_unstale":"2024-04-26T11:27:17.444506+0000","last_undegraded":"2024-04-26T11:27:17.444506+0000","last_fullsized":"2024-04-26T11:27:17.444506+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'424","last_scrub_stamp":"2024-04-26T11:27:17.444171+0000","last_deep_scrub":"71'424","last_deep_scrub_stamp":"2024-04-26T11:27:17.444171+0000","last_clean_scrub_stamp":"2024-04-26T11:27:17.444171+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:49.762789+0000","scrub_duration":0.0037779910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":21234,"num_write":391,"num_write_kb":43587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":190,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"71'392","reported_seq":498,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:50.004040+0000","last_change":"2024-04-26T11:26:50.004040+0000","last_active":"2024-04-26T11:26:50.004040+0000","last_peered":"2024-04-26T11:26:50.004040+0000","last_clean":"2024-04-26T11:26:50.004040+0000","last_became_active":"2024-04-26T11:26:22.389477+0000","last_became_peered":"2024-04-26T11:26:22.389477+0000","last_unstale":"2024-04-26T11:26:50.004040+0000","last_undegraded":"2024-04-26T11:26:50.004040+0000","last_fullsized":"2024-04-26T11:26:50.004040+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-26T11:26:50.003733+0000","last_clean_scrub_stamp":"2024-04-26T11:26:50.003733+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:09:47.677731+0000","scrub_duration":0.0047410569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16282,"num_write":359,"num_write_kb":88396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"106'475","reported_seq":567,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:06.503394+0000","last_change":"2024-04-26T11:27:06.503394+0000","last_active":"2024-04-26T11:27:06.503394+0000","last_peered":"2024-04-26T11:27:06.503394+0000","last_clean":"2024-04-26T11:27:06.503394+0000","last_became_active":"2024-04-26T11:26:14.129722+0000","last_became_peered":"2024-04-26T11:26:14.129722+0000","last_unstale":"2024-04-26T11:27:06.503394+0000","last_undegraded":"2024-04-26T11:27:06.503394+0000","last_fullsized":"2024-04-26T11:27:06.503394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'475","last_scrub_stamp":"2024-04-26T11:27:06.503128+0000","last_deep_scrub":"106'475","last_deep_scrub_stamp":"2024-04-26T11:27:06.503128+0000","last_clean_scrub_stamp":"2024-04-26T11:27:06.503128+0000","objects_scrubbed":4,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:30.876920+0000","scrub_duration":0.042185009000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":8358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"71'404","reported_seq":518,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:33.931390+0000","last_change":"2024-04-26T11:27:33.931390+0000","last_active":"2024-04-26T11:27:33.931390+0000","last_peered":"2024-04-26T11:27:33.931390+0000","last_clean":"2024-04-26T11:27:33.931390+0000","last_became_active":"2024-04-26T11:26:22.389432+0000","last_became_peered":"2024-04-26T11:26:22.389432+0000","last_unstale":"2024-04-26T11:27:33.931390+0000","last_undegraded":"2024-04-26T11:27:33.931390+0000","last_fullsized":"2024-04-26T11:27:33.931390+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-26T11:27:33.931119+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-26T11:27:33.931119+0000","last_clean_scrub_stamp":"2024-04-26T11:27:33.931119+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:48.509771+0000","scrub_duration":0.0051701569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24878,"num_write":369,"num_write_kb":63436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"70'62","reported_seq":188,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:35.899107+0000","last_change":"2024-04-26T11:27:35.899321+0000","last_active":"2024-04-26T11:27:35.899107+0000","last_peered":"2024-04-26T11:27:35.899107+0000","last_clean":"2024-04-26T11:27:35.899107+0000","last_became_active":"2024-04-26T11:26:11.614650+0000","last_became_peered":"2024-04-26T11:26:11.614650+0000","last_unstale":"2024-04-26T11:27:35.899107+0000","last_undegraded":"2024-04-26T11:27:35.899107+0000","last_fullsized":"2024-04-26T11:27:35.899107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'62","last_scrub_stamp":"2024-04-26T11:27:35.899055+0000","last_deep_scrub":"70'62","last_deep_scrub_stamp":"2024-04-26T11:27:35.899055+0000","last_clean_scrub_stamp":"2024-04-26T11:27:35.899055+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:16.959260+0000","scrub_duration":0.003685298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"71'456","reported_seq":1010,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:31.006633+0000","last_change":"2024-04-26T11:28:31.006882+0000","last_active":"2024-04-26T11:28:31.006633+0000","last_peered":"2024-04-26T11:28:31.006633+0000","last_clean":"2024-04-26T11:28:31.006633+0000","last_became_active":"2024-04-26T11:26:23.371301+0000","last_became_peered":"2024-04-26T11:26:23.371301+0000","last_unstale":"2024-04-26T11:28:31.006633+0000","last_undegraded":"2024-04-26T11:28:31.006633+0000","last_fullsized":"2024-04-26T11:28:31.006633+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'456","last_scrub_stamp":"2024-04-26T11:28:31.006581+0000","last_deep_scrub":"71'456","last_deep_scrub_stamp":"2024-04-26T11:28:31.006581+0000","last_clean_scrub_stamp":"2024-04-26T11:28:31.006581+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:29.842949+0000","scrub_duration":0.0037846139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25189,"num_write":422,"num_write_kb":80799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"70'72","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:00.101549+0000","last_change":"2024-04-26T11:27:00.101771+0000","last_active":"2024-04-26T11:27:00.101549+0000","last_peered":"2024-04-26T11:27:00.101549+0000","last_clean":"2024-04-26T11:27:00.101549+0000","last_became_active":"2024-04-26T11:26:22.384873+0000","last_became_peered":"2024-04-26T11:26:22.384873+0000","last_unstale":"2024-04-26T11:27:00.101549+0000","last_undegraded":"2024-04-26T11:27:00.101549+0000","last_fullsized":"2024-04-26T11:27:00.101549+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'72","last_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_deep_scrub":"70'72","last_deep_scrub_stamp":"2024-04-26T11:27:00.101498+0000","last_clean_scrub_stamp":"2024-04-26T11:27:00.101498+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:38.755366+0000","scrub_duration":0.0029441889999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"71'411","reported_seq":950,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.915251+0000","last_change":"2024-04-26T11:27:03.915526+0000","last_active":"2024-04-26T11:27:03.915251+0000","last_peered":"2024-04-26T11:27:03.915251+0000","last_clean":"2024-04-26T11:27:03.915251+0000","last_became_active":"2024-04-26T11:26:16.626801+0000","last_became_peered":"2024-04-26T11:26:16.626801+0000","last_unstale":"2024-04-26T11:27:03.915251+0000","last_undegraded":"2024-04-26T11:27:03.915251+0000","last_fullsized":"2024-04-26T11:27:03.915251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'411","last_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_deep_scrub":"71'411","last_deep_scrub_stamp":"2024-04-26T11:27:03.915200+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.915200+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:44.598651+0000","scrub_duration":0.0040090890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":38321,"num_write":384,"num_write_kb":84275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":174,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"106'76","reported_seq":69,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:38.631416+0000","last_change":"2024-04-26T11:27:38.631416+0000","last_active":"2024-04-26T11:27:38.631416+0000","last_peered":"2024-04-26T11:27:38.631416+0000","last_clean":"2024-04-26T11:27:38.631416+0000","last_became_active":"2024-04-26T11:26:11.129689+0000","last_became_peered":"2024-04-26T11:26:11.129689+0000","last_unstale":"2024-04-26T11:27:38.631416+0000","last_undegraded":"2024-04-26T11:27:38.631416+0000","last_fullsized":"2024-04-26T11:27:38.631416+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'76","last_scrub_stamp":"2024-04-26T11:27:38.631155+0000","last_deep_scrub":"106'76","last_deep_scrub_stamp":"2024-04-26T11:27:38.631155+0000","last_clean_scrub_stamp":"2024-04-26T11:27:38.631155+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:00.190020+0000","scrub_duration":0.012059947,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"106'164","reported_seq":257,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:08.511702+0000","last_change":"2024-04-26T11:27:08.511702+0000","last_active":"2024-04-26T11:27:08.511702+0000","last_peered":"2024-04-26T11:27:08.511702+0000","last_clean":"2024-04-26T11:27:08.511702+0000","last_became_active":"2024-04-26T11:26:14.132970+0000","last_became_peered":"2024-04-26T11:26:14.132970+0000","last_unstale":"2024-04-26T11:27:08.511702+0000","last_undegraded":"2024-04-26T11:27:08.511702+0000","last_fullsized":"2024-04-26T11:27:08.511702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'164","last_scrub_stamp":"2024-04-26T11:27:08.511426+0000","last_deep_scrub":"106'164","last_deep_scrub_stamp":"2024-04-26T11:27:08.511426+0000","last_clean_scrub_stamp":"2024-04-26T11:27:08.511426+0000","objects_scrubbed":2,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:26.618845+0000","scrub_duration":0.024844353999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":109,"num_write_kb":4162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"71'402","reported_seq":889,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:49.997828+0000","last_change":"2024-04-26T11:27:49.997828+0000","last_active":"2024-04-26T11:27:49.997828+0000","last_peered":"2024-04-26T11:27:49.997828+0000","last_clean":"2024-04-26T11:27:49.997828+0000","last_became_active":"2024-04-26T11:26:22.384833+0000","last_became_peered":"2024-04-26T11:26:22.384833+0000","last_unstale":"2024-04-26T11:27:49.997828+0000","last_undegraded":"2024-04-26T11:27:49.997828+0000","last_fullsized":"2024-04-26T11:27:49.997828+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'402","last_scrub_stamp":"2024-04-26T11:27:49.997532+0000","last_deep_scrub":"71'402","last_deep_scrub_stamp":"2024-04-26T11:27:49.997532+0000","last_clean_scrub_stamp":"2024-04-26T11:27:49.997532+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:57.638791+0000","scrub_duration":0.0037416060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":10162,"num_write":362,"num_write_kb":22049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":177,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"106'277","reported_seq":416,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:38.001991+0000","last_change":"2024-04-26T11:27:38.001991+0000","last_active":"2024-04-26T11:27:38.001991+0000","last_peered":"2024-04-26T11:27:38.001991+0000","last_clean":"2024-04-26T11:27:38.001991+0000","last_became_active":"2024-04-26T11:26:14.613442+0000","last_became_peered":"2024-04-26T11:26:14.613442+0000","last_unstale":"2024-04-26T11:27:38.001991+0000","last_undegraded":"2024-04-26T11:27:38.001991+0000","last_fullsized":"2024-04-26T11:27:38.001991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'277","last_scrub_stamp":"2024-04-26T11:27:38.001710+0000","last_deep_scrub":"106'277","last_deep_scrub_stamp":"2024-04-26T11:27:38.001710+0000","last_clean_scrub_stamp":"2024-04-26T11:27:38.001710+0000","objects_scrubbed":2,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:46:25.703001+0000","scrub_duration":0.032027241999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":4219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"71'455","reported_seq":593,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:54.045110+0000","last_change":"2024-04-26T11:26:54.045110+0000","last_active":"2024-04-26T11:26:54.045110+0000","last_peered":"2024-04-26T11:26:54.045110+0000","last_clean":"2024-04-26T11:26:54.045110+0000","last_became_active":"2024-04-26T11:26:22.372038+0000","last_became_peered":"2024-04-26T11:26:22.372038+0000","last_unstale":"2024-04-26T11:26:54.045110+0000","last_undegraded":"2024-04-26T11:26:54.045110+0000","last_fullsized":"2024-04-26T11:26:54.045110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'455","last_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_deep_scrub":"71'455","last_deep_scrub_stamp":"2024-04-26T11:26:54.044831+0000","last_clean_scrub_stamp":"2024-04-26T11:26:54.044831+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:23.986621+0000","scrub_duration":0.0050259290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33906,"num_write":427,"num_write_kb":56056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"106'567","reported_seq":660,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.588510+0000","last_change":"2024-04-26T11:27:01.588510+0000","last_active":"2024-04-26T11:27:01.588510+0000","last_peered":"2024-04-26T11:27:01.588510+0000","last_clean":"2024-04-26T11:27:01.588510+0000","last_became_active":"2024-04-26T11:26:14.133615+0000","last_became_peered":"2024-04-26T11:26:14.133615+0000","last_unstale":"2024-04-26T11:27:01.588510+0000","last_undegraded":"2024-04-26T11:27:01.588510+0000","last_fullsized":"2024-04-26T11:27:01.588510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'567","last_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_deep_scrub":"106'567","last_deep_scrub_stamp":"2024-04-26T11:27:01.588061+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.588061+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:05.825620+0000","scrub_duration":0.031697134000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":508,"num_write_kb":4336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"71'427","reported_seq":543,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:29.476088+0000","last_change":"2024-04-26T11:28:29.476088+0000","last_active":"2024-04-26T11:28:29.476088+0000","last_peered":"2024-04-26T11:28:29.476088+0000","last_clean":"2024-04-26T11:28:29.476088+0000","last_became_active":"2024-04-26T11:26:39.900162+0000","last_became_peered":"2024-04-26T11:26:39.900162+0000","last_unstale":"2024-04-26T11:28:29.476088+0000","last_undegraded":"2024-04-26T11:28:29.476088+0000","last_fullsized":"2024-04-26T11:28:29.476088+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'427","last_scrub_stamp":"2024-04-26T11:28:29.475766+0000","last_deep_scrub":"71'427","last_deep_scrub_stamp":"2024-04-26T11:28:29.475766+0000","last_clean_scrub_stamp":"2024-04-26T11:28:29.475766+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:19:55.779006+0000","scrub_duration":0.0046160539999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":34141,"num_write":396,"num_write_kb":55200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"70'58","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:40.652134+0000","last_change":"2024-04-26T11:27:40.652134+0000","last_active":"2024-04-26T11:27:40.652134+0000","last_peered":"2024-04-26T11:27:40.652134+0000","last_clean":"2024-04-26T11:27:40.652134+0000","last_became_active":"2024-04-26T11:26:11.127809+0000","last_became_peered":"2024-04-26T11:26:11.127809+0000","last_unstale":"2024-04-26T11:27:40.652134+0000","last_undegraded":"2024-04-26T11:27:40.652134+0000","last_fullsized":"2024-04-26T11:27:40.652134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'58","last_scrub_stamp":"2024-04-26T11:27:40.651867+0000","last_deep_scrub":"70'58","last_deep_scrub_stamp":"2024-04-26T11:27:40.651867+0000","last_clean_scrub_stamp":"2024-04-26T11:27:40.651867+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:42:53.157507+0000","scrub_duration":0.0035582550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"71'426","reported_seq":971,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:05.965500+0000","last_change":"2024-04-26T11:27:05.965500+0000","last_active":"2024-04-26T11:27:05.965500+0000","last_peered":"2024-04-26T11:27:05.965500+0000","last_clean":"2024-04-26T11:27:05.965500+0000","last_became_active":"2024-04-26T11:26:19.371460+0000","last_became_peered":"2024-04-26T11:26:19.371460+0000","last_unstale":"2024-04-26T11:27:05.965500+0000","last_undegraded":"2024-04-26T11:27:05.965500+0000","last_fullsized":"2024-04-26T11:27:05.965500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'426","last_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_deep_scrub":"71'426","last_deep_scrub_stamp":"2024-04-26T11:27:05.965214+0000","last_clean_scrub_stamp":"2024-04-26T11:27:05.965214+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:34:49.834938+0000","scrub_duration":0.0039580659999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":16129,"num_write":389,"num_write_kb":46802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"106'185","reported_seq":326,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:46.946454+0000","last_change":"2024-04-26T11:27:46.946454+0000","last_active":"2024-04-26T11:27:46.946454+0000","last_peered":"2024-04-26T11:27:46.946454+0000","last_clean":"2024-04-26T11:27:46.946454+0000","last_became_active":"2024-04-26T11:26:15.625164+0000","last_became_peered":"2024-04-26T11:26:15.625164+0000","last_unstale":"2024-04-26T11:27:46.946454+0000","last_undegraded":"2024-04-26T11:27:46.946454+0000","last_fullsized":"2024-04-26T11:27:46.946454+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'185","last_scrub_stamp":"2024-04-26T11:27:46.946144+0000","last_deep_scrub":"106'185","last_deep_scrub_stamp":"2024-04-26T11:27:46.946144+0000","last_clean_scrub_stamp":"2024-04-26T11:27:46.946144+0000","objects_scrubbed":3,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:31.045011+0000","scrub_duration":0.040368755999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"71'454","reported_seq":539,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:33.534181+0000","last_change":"2024-04-26T11:27:33.534438+0000","last_active":"2024-04-26T11:27:33.534181+0000","last_peered":"2024-04-26T11:27:33.534181+0000","last_clean":"2024-04-26T11:27:33.534181+0000","last_became_active":"2024-04-26T11:26:35.924696+0000","last_became_peered":"2024-04-26T11:26:35.924696+0000","last_unstale":"2024-04-26T11:27:33.534181+0000","last_undegraded":"2024-04-26T11:27:33.534181+0000","last_fullsized":"2024-04-26T11:27:33.534181+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'454","last_scrub_stamp":"2024-04-26T11:27:33.534129+0000","last_deep_scrub":"71'454","last_deep_scrub_stamp":"2024-04-26T11:27:33.534129+0000","last_clean_scrub_stamp":"2024-04-26T11:27:33.534129+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:47.874020+0000","scrub_duration":0.004313679,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":19600,"num_write":423,"num_write_kb":71765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"106'224","reported_seq":309,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:25.516689+0000","last_change":"2024-04-26T11:27:25.516689+0000","last_active":"2024-04-26T11:27:25.516689+0000","last_peered":"2024-04-26T11:27:25.516689+0000","last_clean":"2024-04-26T11:27:25.516689+0000","last_became_active":"2024-04-26T11:26:14.128570+0000","last_became_peered":"2024-04-26T11:26:14.128570+0000","last_unstale":"2024-04-26T11:27:25.516689+0000","last_undegraded":"2024-04-26T11:27:25.516689+0000","last_fullsized":"2024-04-26T11:27:25.516689+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'224","last_scrub_stamp":"2024-04-26T11:27:25.516369+0000","last_deep_scrub":"106'224","last_deep_scrub_stamp":"2024-04-26T11:27:25.516369+0000","last_clean_scrub_stamp":"2024-04-26T11:27:25.516369+0000","objects_scrubbed":1,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:04.438733+0000","scrub_duration":0.023037851000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":4197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"71'400","reported_seq":484,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:28.532511+0000","last_change":"2024-04-26T11:27:28.532511+0000","last_active":"2024-04-26T11:27:28.532511+0000","last_peered":"2024-04-26T11:27:28.532511+0000","last_clean":"2024-04-26T11:27:28.532511+0000","last_became_active":"2024-04-26T11:26:26.889114+0000","last_became_peered":"2024-04-26T11:26:26.889114+0000","last_unstale":"2024-04-26T11:27:28.532511+0000","last_undegraded":"2024-04-26T11:27:28.532511+0000","last_fullsized":"2024-04-26T11:27:28.532511+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-26T11:27:28.532239+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-26T11:27:28.532239+0000","last_clean_scrub_stamp":"2024-04-26T11:27:28.532239+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:56.163930+0000","scrub_duration":0.003558299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4675,"num_write":370,"num_write_kb":38628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"70'59","reported_seq":164,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:05.238702+0000","last_change":"2024-04-26T11:28:05.238702+0000","last_active":"2024-04-26T11:28:05.238702+0000","last_peered":"2024-04-26T11:28:05.238702+0000","last_clean":"2024-04-26T11:28:05.238702+0000","last_became_active":"2024-04-26T11:26:22.385892+0000","last_became_peered":"2024-04-26T11:26:22.385892+0000","last_unstale":"2024-04-26T11:28:05.238702+0000","last_undegraded":"2024-04-26T11:28:05.238702+0000","last_fullsized":"2024-04-26T11:28:05.238702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'59","last_scrub_stamp":"2024-04-26T11:28:05.238424+0000","last_deep_scrub":"70'59","last_deep_scrub_stamp":"2024-04-26T11:28:05.238424+0000","last_clean_scrub_stamp":"2024-04-26T11:28:05.238424+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:53:05.376023+0000","scrub_duration":0.003275133,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"71'359","reported_seq":459,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:05.437300+0000","last_change":"2024-04-26T11:27:05.437300+0000","last_active":"2024-04-26T11:27:05.437300+0000","last_peered":"2024-04-26T11:27:05.437300+0000","last_clean":"2024-04-26T11:27:05.437300+0000","last_became_active":"2024-04-26T11:26:29.905601+0000","last_became_peered":"2024-04-26T11:26:29.905601+0000","last_unstale":"2024-04-26T11:27:05.437300+0000","last_undegraded":"2024-04-26T11:27:05.437300+0000","last_fullsized":"2024-04-26T11:27:05.437300+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'359","last_scrub_stamp":"2024-04-26T11:27:05.437012+0000","last_deep_scrub":"71'359","last_deep_scrub_stamp":"2024-04-26T11:27:05.437012+0000","last_clean_scrub_stamp":"2024-04-26T11:27:05.437012+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:09:58.035867+0000","scrub_duration":0.0040043329999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":20009,"num_write":331,"num_write_kb":42196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"106'360","reported_seq":366,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:26.056052+0000","last_change":"2024-04-26T11:27:26.056052+0000","last_active":"2024-04-26T11:27:26.056052+0000","last_peered":"2024-04-26T11:27:26.056052+0000","last_clean":"2024-04-26T11:27:26.056052+0000","last_became_active":"2024-04-26T11:26:22.371013+0000","last_became_peered":"2024-04-26T11:26:22.371013+0000","last_unstale":"2024-04-26T11:27:26.056052+0000","last_undegraded":"2024-04-26T11:27:26.056052+0000","last_fullsized":"2024-04-26T11:27:26.056052+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'360","last_scrub_stamp":"2024-04-26T11:27:26.055763+0000","last_deep_scrub":"106'360","last_deep_scrub_stamp":"2024-04-26T11:27:26.055763+0000","last_clean_scrub_stamp":"2024-04-26T11:27:26.055763+0000","objects_scrubbed":1,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:24.969559+0000","scrub_duration":0.033125239000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":4214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"71'400","reported_seq":566,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:01.907573+0000","last_change":"2024-04-26T11:27:01.907573+0000","last_active":"2024-04-26T11:27:01.907573+0000","last_peered":"2024-04-26T11:27:01.907573+0000","last_clean":"2024-04-26T11:27:01.907573+0000","last_became_active":"2024-04-26T11:21:53.710280+0000","last_became_peered":"2024-04-26T11:21:53.710280+0000","last_unstale":"2024-04-26T11:27:01.907573+0000","last_undegraded":"2024-04-26T11:27:01.907573+0000","last_fullsized":"2024-04-26T11:27:01.907573+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'400","last_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_deep_scrub":"71'400","last_deep_scrub_stamp":"2024-04-26T11:27:01.907287+0000","last_clean_scrub_stamp":"2024-04-26T11:27:01.907287+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:37:00.821083+0000","scrub_duration":0.0045510610000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37748,"num_write":364,"num_write_kb":63060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"106'159","reported_seq":262,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:43.696225+0000","last_change":"2024-04-26T11:27:43.696225+0000","last_active":"2024-04-26T11:27:43.696225+0000","last_peered":"2024-04-26T11:27:43.696225+0000","last_clean":"2024-04-26T11:27:43.696225+0000","last_became_active":"2024-04-26T11:26:11.125847+0000","last_became_peered":"2024-04-26T11:26:11.125847+0000","last_unstale":"2024-04-26T11:27:43.696225+0000","last_undegraded":"2024-04-26T11:27:43.696225+0000","last_fullsized":"2024-04-26T11:27:43.696225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'159","last_scrub_stamp":"2024-04-26T11:27:43.695947+0000","last_deep_scrub":"106'159","last_deep_scrub_stamp":"2024-04-26T11:27:43.695947+0000","last_clean_scrub_stamp":"2024-04-26T11:27:43.695947+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:37:18.719077+0000","scrub_duration":0.0098550570000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:14.398442+0000","last_change":"2024-04-26T11:27:14.398442+0000","last_active":"2024-04-26T11:27:14.398442+0000","last_peered":"2024-04-26T11:27:14.398442+0000","last_clean":"2024-04-26T11:27:14.398442+0000","last_became_active":"2024-04-26T11:26:11.128400+0000","last_became_peered":"2024-04-26T11:26:11.128400+0000","last_unstale":"2024-04-26T11:27:14.398442+0000","last_undegraded":"2024-04-26T11:27:14.398442+0000","last_fullsized":"2024-04-26T11:27:14.398442+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:14.398118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:14.398118+0000","last_clean_scrub_stamp":"2024-04-26T11:27:14.398118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:49:26.192505+0000","scrub_duration":0.0032486720000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"106'755","reported_seq":866,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:16.021478+0000","last_change":"2024-04-26T11:28:16.021694+0000","last_active":"2024-04-26T11:28:16.021478+0000","last_peered":"2024-04-26T11:28:16.021478+0000","last_clean":"2024-04-26T11:28:16.021478+0000","last_became_active":"2024-04-26T11:22:40.571614+0000","last_became_peered":"2024-04-26T11:22:40.571614+0000","last_unstale":"2024-04-26T11:28:16.021478+0000","last_undegraded":"2024-04-26T11:28:16.021478+0000","last_fullsized":"2024-04-26T11:28:16.021478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'755","last_scrub_stamp":"2024-04-26T11:28:16.021422+0000","last_deep_scrub":"106'755","last_deep_scrub_stamp":"2024-04-26T11:28:16.021422+0000","last_clean_scrub_stamp":"2024-04-26T11:28:16.021422+0000","objects_scrubbed":2,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:07:29.929659+0000","scrub_duration":0.052889548000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":686,"num_write_kb":8552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"71'430","reported_seq":527,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:27.528213+0000","last_change":"2024-04-26T11:28:27.528213+0000","last_active":"2024-04-26T11:28:27.528213+0000","last_peered":"2024-04-26T11:28:27.528213+0000","last_clean":"2024-04-26T11:28:27.528213+0000","last_became_active":"2024-04-26T11:26:24.900659+0000","last_became_peered":"2024-04-26T11:26:24.900659+0000","last_unstale":"2024-04-26T11:28:27.528213+0000","last_undegraded":"2024-04-26T11:28:27.528213+0000","last_fullsized":"2024-04-26T11:28:27.528213+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'430","last_scrub_stamp":"2024-04-26T11:28:27.527945+0000","last_deep_scrub":"71'430","last_deep_scrub_stamp":"2024-04-26T11:28:27.527945+0000","last_clean_scrub_stamp":"2024-04-26T11:28:27.527945+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:24.277191+0000","scrub_duration":0.0038232439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":10043,"num_write":389,"num_write_kb":83502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":182,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.409932+0000","last_change":"2024-04-26T11:27:15.409932+0000","last_active":"2024-04-26T11:27:15.409932+0000","last_peered":"2024-04-26T11:27:15.409932+0000","last_clean":"2024-04-26T11:27:15.409932+0000","last_became_active":"2024-04-26T11:26:11.131340+0000","last_became_peered":"2024-04-26T11:26:11.131340+0000","last_unstale":"2024-04-26T11:27:15.409932+0000","last_undegraded":"2024-04-26T11:27:15.409932+0000","last_fullsized":"2024-04-26T11:27:15.409932+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:15.409633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:15.409633+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.409633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:38.286104+0000","scrub_duration":0.0031725590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"106'115","reported_seq":306,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:19.034892+0000","last_change":"2024-04-26T11:28:19.035222+0000","last_active":"2024-04-26T11:28:19.034892+0000","last_peered":"2024-04-26T11:28:19.034892+0000","last_clean":"2024-04-26T11:28:19.034892+0000","last_became_active":"2024-04-26T11:26:14.610313+0000","last_became_peered":"2024-04-26T11:26:14.610313+0000","last_unstale":"2024-04-26T11:28:19.034892+0000","last_undegraded":"2024-04-26T11:28:19.034892+0000","last_fullsized":"2024-04-26T11:28:19.034892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'115","last_scrub_stamp":"2024-04-26T11:28:19.034835+0000","last_deep_scrub":"106'115","last_deep_scrub_stamp":"2024-04-26T11:28:19.034835+0000","last_clean_scrub_stamp":"2024-04-26T11:28:19.034835+0000","objects_scrubbed":1,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:15:41.285977+0000","scrub_duration":0.011043624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1469348,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":56,"num_write_kb":1474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":1469348,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"71'444","reported_seq":575,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:22.039648+0000","last_change":"2024-04-26T11:27:22.039648+0000","last_active":"2024-04-26T11:27:22.039648+0000","last_peered":"2024-04-26T11:27:22.039648+0000","last_clean":"2024-04-26T11:27:22.039648+0000","last_became_active":"2024-04-26T11:26:22.384861+0000","last_became_peered":"2024-04-26T11:26:22.384861+0000","last_unstale":"2024-04-26T11:27:22.039648+0000","last_undegraded":"2024-04-26T11:27:22.039648+0000","last_fullsized":"2024-04-26T11:27:22.039648+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'444","last_scrub_stamp":"2024-04-26T11:27:22.039342+0000","last_deep_scrub":"71'444","last_deep_scrub_stamp":"2024-04-26T11:27:22.039342+0000","last_clean_scrub_stamp":"2024-04-26T11:27:22.039342+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:51.178326+0000","scrub_duration":0.0046559649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":35368,"num_write":407,"num_write_kb":63705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":117,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:41.891342+0000","last_change":"2024-04-26T11:27:41.891342+0000","last_active":"2024-04-26T11:27:41.891342+0000","last_peered":"2024-04-26T11:27:41.891342+0000","last_clean":"2024-04-26T11:27:41.891342+0000","last_became_active":"2024-04-26T11:21:49.291308+0000","last_became_peered":"2024-04-26T11:21:49.291308+0000","last_unstale":"2024-04-26T11:27:41.891342+0000","last_undegraded":"2024-04-26T11:27:41.891342+0000","last_fullsized":"2024-04-26T11:27:41.891342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:41.891074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:41.891074+0000","last_clean_scrub_stamp":"2024-04-26T11:27:41.891074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:42.028673+0000","scrub_duration":0.0032036479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"106'379","reported_seq":497,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:00.161581+0000","last_change":"2024-04-26T11:28:00.161893+0000","last_active":"2024-04-26T11:28:00.161581+0000","last_peered":"2024-04-26T11:28:00.161581+0000","last_clean":"2024-04-26T11:28:00.161581+0000","last_became_active":"2024-04-26T11:26:22.387210+0000","last_became_peered":"2024-04-26T11:26:22.387210+0000","last_unstale":"2024-04-26T11:28:00.161581+0000","last_undegraded":"2024-04-26T11:28:00.161581+0000","last_fullsized":"2024-04-26T11:28:00.161581+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'379","last_scrub_stamp":"2024-04-26T11:28:00.161528+0000","last_deep_scrub":"106'379","last_deep_scrub_stamp":"2024-04-26T11:28:00.161528+0000","last_clean_scrub_stamp":"2024-04-26T11:28:00.161528+0000","objects_scrubbed":2,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:51.144647+0000","scrub_duration":0.036958244000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":8325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":8388608,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"71'334","reported_seq":466,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:13.017795+0000","last_change":"2024-04-26T11:27:13.017795+0000","last_active":"2024-04-26T11:27:13.017795+0000","last_peered":"2024-04-26T11:27:13.017795+0000","last_clean":"2024-04-26T11:27:13.017795+0000","last_became_active":"2024-04-26T11:21:53.711471+0000","last_became_peered":"2024-04-26T11:21:53.711471+0000","last_unstale":"2024-04-26T11:27:13.017795+0000","last_undegraded":"2024-04-26T11:27:13.017795+0000","last_fullsized":"2024-04-26T11:27:13.017795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'334","last_scrub_stamp":"2024-04-26T11:27:13.017468+0000","last_deep_scrub":"71'334","last_deep_scrub_stamp":"2024-04-26T11:27:13.017468+0000","last_clean_scrub_stamp":"2024-04-26T11:27:13.017468+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:30:48.346628+0000","scrub_duration":0.0044577050000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12340,"num_write":309,"num_write_kb":42378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:52.649768+0000","last_change":"2024-04-26T11:27:52.649768+0000","last_active":"2024-04-26T11:27:52.649768+0000","last_peered":"2024-04-26T11:27:52.649768+0000","last_clean":"2024-04-26T11:27:52.649768+0000","last_became_active":"2024-04-26T11:26:11.127898+0000","last_became_peered":"2024-04-26T11:26:11.127898+0000","last_unstale":"2024-04-26T11:27:52.649768+0000","last_undegraded":"2024-04-26T11:27:52.649768+0000","last_fullsized":"2024-04-26T11:27:52.649768+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:27:52.649503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:27:52.649503+0000","last_clean_scrub_stamp":"2024-04-26T11:27:52.649503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:05:54.233318+0000","scrub_duration":0.003234579,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"70'79","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:04.484225+0000","last_change":"2024-04-26T11:28:04.484225+0000","last_active":"2024-04-26T11:28:04.484225+0000","last_peered":"2024-04-26T11:28:04.484225+0000","last_clean":"2024-04-26T11:28:04.484225+0000","last_became_active":"2024-04-26T11:26:11.128451+0000","last_became_peered":"2024-04-26T11:26:11.128451+0000","last_unstale":"2024-04-26T11:28:04.484225+0000","last_undegraded":"2024-04-26T11:28:04.484225+0000","last_fullsized":"2024-04-26T11:28:04.484225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'79","last_scrub_stamp":"2024-04-26T11:28:04.483898+0000","last_deep_scrub":"70'79","last_deep_scrub_stamp":"2024-04-26T11:28:04.483898+0000","last_clean_scrub_stamp":"2024-04-26T11:28:04.483898+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:41.466273+0000","scrub_duration":0.0033086280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"71'404","reported_seq":575,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:22.966985+0000","last_change":"2024-04-26T11:27:22.966985+0000","last_active":"2024-04-26T11:27:22.966985+0000","last_peered":"2024-04-26T11:27:22.966985+0000","last_clean":"2024-04-26T11:27:22.966985+0000","last_became_active":"2024-04-26T11:21:53.709179+0000","last_became_peered":"2024-04-26T11:21:53.709179+0000","last_unstale":"2024-04-26T11:27:22.966985+0000","last_undegraded":"2024-04-26T11:27:22.966985+0000","last_fullsized":"2024-04-26T11:27:22.966985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'404","last_scrub_stamp":"2024-04-26T11:27:22.966689+0000","last_deep_scrub":"71'404","last_deep_scrub_stamp":"2024-04-26T11:27:22.966689+0000","last_clean_scrub_stamp":"2024-04-26T11:27:22.966689+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:56.913479+0000","scrub_duration":0.0049556590000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":34525,"num_write":367,"num_write_kb":100564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"106'499","reported_seq":584,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:12.592546+0000","last_change":"2024-04-26T11:28:12.592546+0000","last_active":"2024-04-26T11:28:12.592546+0000","last_peered":"2024-04-26T11:28:12.592546+0000","last_clean":"2024-04-26T11:28:12.592546+0000","last_became_active":"2024-04-26T11:26:14.130819+0000","last_became_peered":"2024-04-26T11:26:14.130819+0000","last_unstale":"2024-04-26T11:28:12.592546+0000","last_undegraded":"2024-04-26T11:28:12.592546+0000","last_fullsized":"2024-04-26T11:28:12.592546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'499","last_scrub_stamp":"2024-04-26T11:28:12.592270+0000","last_deep_scrub":"106'499","last_deep_scrub_stamp":"2024-04-26T11:28:12.592270+0000","last_clean_scrub_stamp":"2024-04-26T11:28:12.592270+0000","objects_scrubbed":1,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:38:18.220689+0000","scrub_duration":0.029304797,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":4392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:23.029093+0000","last_change":"2024-04-26T11:28:23.029307+0000","last_active":"2024-04-26T11:28:23.029093+0000","last_peered":"2024-04-26T11:28:23.029093+0000","last_clean":"2024-04-26T11:28:23.029093+0000","last_became_active":"2024-04-26T11:22:40.573490+0000","last_became_peered":"2024-04-26T11:22:40.573490+0000","last_unstale":"2024-04-26T11:28:23.029093+0000","last_undegraded":"2024-04-26T11:28:23.029093+0000","last_fullsized":"2024-04-26T11:28:23.029093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:28:23.029048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:28:23.029048+0000","last_clean_scrub_stamp":"2024-04-26T11:28:23.029048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:28:13.377365+0000","scrub_duration":0.0033069710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"71'351","reported_seq":805,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:29.994255+0000","last_change":"2024-04-26T11:27:29.994255+0000","last_active":"2024-04-26T11:27:29.994255+0000","last_peered":"2024-04-26T11:27:29.994255+0000","last_clean":"2024-04-26T11:27:29.994255+0000","last_became_active":"2024-04-26T11:26:35.386963+0000","last_became_peered":"2024-04-26T11:26:35.386963+0000","last_unstale":"2024-04-26T11:27:29.994255+0000","last_undegraded":"2024-04-26T11:27:29.994255+0000","last_fullsized":"2024-04-26T11:27:29.994255+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'351","last_scrub_stamp":"2024-04-26T11:27:29.993974+0000","last_deep_scrub":"71'351","last_deep_scrub_stamp":"2024-04-26T11:27:29.993974+0000","last_clean_scrub_stamp":"2024-04-26T11:27:29.993974+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:35:13.863697+0000","scrub_duration":0.0044014229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":3440,"num_write":318,"num_write_kb":21232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"70'57","reported_seq":171,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:48.898532+0000","last_change":"2024-04-26T11:27:48.898532+0000","last_active":"2024-04-26T11:27:48.898532+0000","last_peered":"2024-04-26T11:27:48.898532+0000","last_clean":"2024-04-26T11:27:48.898532+0000","last_became_active":"2024-04-26T11:21:53.332249+0000","last_became_peered":"2024-04-26T11:21:53.332249+0000","last_unstale":"2024-04-26T11:27:48.898532+0000","last_undegraded":"2024-04-26T11:27:48.898532+0000","last_fullsized":"2024-04-26T11:27:48.898532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'57","last_scrub_stamp":"2024-04-26T11:27:48.898263+0000","last_deep_scrub":"70'57","last_deep_scrub_stamp":"2024-04-26T11:27:48.898263+0000","last_clean_scrub_stamp":"2024-04-26T11:27:48.898263+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:02.150454+0000","scrub_duration":0.003307787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":78,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:20.260870+0000","last_change":"2024-04-26T11:28:20.260870+0000","last_active":"2024-04-26T11:28:20.260870+0000","last_peered":"2024-04-26T11:28:20.260870+0000","last_clean":"2024-04-26T11:28:20.260870+0000","last_became_active":"2024-04-26T11:26:22.404995+0000","last_became_peered":"2024-04-26T11:26:22.404995+0000","last_unstale":"2024-04-26T11:28:20.260870+0000","last_undegraded":"2024-04-26T11:28:20.260870+0000","last_fullsized":"2024-04-26T11:28:20.260870+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:28:20.260603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:28:20.260603+0000","last_clean_scrub_stamp":"2024-04-26T11:28:20.260603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:48:10.651315+0000","scrub_duration":0.0032404170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"71'376","reported_seq":830,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:21.038232+0000","last_change":"2024-04-26T11:27:21.038232+0000","last_active":"2024-04-26T11:27:21.038232+0000","last_peered":"2024-04-26T11:27:21.038232+0000","last_clean":"2024-04-26T11:27:21.038232+0000","last_became_active":"2024-04-26T11:26:22.388586+0000","last_became_peered":"2024-04-26T11:26:22.388586+0000","last_unstale":"2024-04-26T11:27:21.038232+0000","last_undegraded":"2024-04-26T11:27:21.038232+0000","last_fullsized":"2024-04-26T11:27:21.038232+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'376","last_scrub_stamp":"2024-04-26T11:27:21.037943+0000","last_deep_scrub":"71'376","last_deep_scrub_stamp":"2024-04-26T11:27:21.037943+0000","last_clean_scrub_stamp":"2024-04-26T11:27:21.037943+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:27.198741+0000","scrub_duration":0.0040199060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":340,"num_write_kb":25745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"106'61","reported_seq":175,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:50.931076+0000","last_change":"2024-04-26T11:27:50.931076+0000","last_active":"2024-04-26T11:27:50.931076+0000","last_peered":"2024-04-26T11:27:50.931076+0000","last_clean":"2024-04-26T11:27:50.931076+0000","last_became_active":"2024-04-26T11:21:53.330021+0000","last_became_peered":"2024-04-26T11:21:53.330021+0000","last_unstale":"2024-04-26T11:27:50.931076+0000","last_undegraded":"2024-04-26T11:27:50.931076+0000","last_fullsized":"2024-04-26T11:27:50.931076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'61","last_scrub_stamp":"2024-04-26T11:27:50.930733+0000","last_deep_scrub":"106'61","last_deep_scrub_stamp":"2024-04-26T11:27:50.930733+0000","last_clean_scrub_stamp":"2024-04-26T11:27:50.930733+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:36.226248+0000","scrub_duration":0.0067521899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":114,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:16.979126+0000","last_change":"2024-04-26T11:28:16.979126+0000","last_active":"2024-04-26T11:28:16.979126+0000","last_peered":"2024-04-26T11:28:16.979126+0000","last_clean":"2024-04-26T11:28:16.979126+0000","last_became_active":"2024-04-26T11:22:40.574577+0000","last_became_peered":"2024-04-26T11:22:40.574577+0000","last_unstale":"2024-04-26T11:28:16.979126+0000","last_undegraded":"2024-04-26T11:28:16.979126+0000","last_fullsized":"2024-04-26T11:28:16.979126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:28:16.978793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:28:16.978793+0000","last_clean_scrub_stamp":"2024-04-26T11:28:16.978793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:52.598748+0000","scrub_duration":0.003121282,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"71'423","reported_seq":939,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:20.056130+0000","last_change":"2024-04-26T11:28:20.056355+0000","last_active":"2024-04-26T11:28:20.056130+0000","last_peered":"2024-04-26T11:28:20.056130+0000","last_clean":"2024-04-26T11:28:20.056130+0000","last_became_active":"2024-04-26T11:26:39.375075+0000","last_became_peered":"2024-04-26T11:26:39.375075+0000","last_unstale":"2024-04-26T11:28:20.056130+0000","last_undegraded":"2024-04-26T11:28:20.056130+0000","last_fullsized":"2024-04-26T11:28:20.056130+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'423","last_scrub_stamp":"2024-04-26T11:28:20.056069+0000","last_deep_scrub":"71'423","last_deep_scrub_stamp":"2024-04-26T11:28:20.056069+0000","last_clean_scrub_stamp":"2024-04-26T11:28:20.056069+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:38.597307+0000","scrub_duration":0.0041170349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":10195,"num_write":387,"num_write_kb":67172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"106'72","reported_seq":204,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:49.926492+0000","last_change":"2024-04-26T11:27:49.926492+0000","last_active":"2024-04-26T11:27:49.926492+0000","last_peered":"2024-04-26T11:27:49.926492+0000","last_clean":"2024-04-26T11:27:49.926492+0000","last_became_active":"2024-04-26T11:26:11.611339+0000","last_became_peered":"2024-04-26T11:26:11.611339+0000","last_unstale":"2024-04-26T11:27:49.926492+0000","last_undegraded":"2024-04-26T11:27:49.926492+0000","last_fullsized":"2024-04-26T11:27:49.926492+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'72","last_scrub_stamp":"2024-04-26T11:27:49.926200+0000","last_deep_scrub":"106'72","last_deep_scrub_stamp":"2024-04-26T11:27:49.926200+0000","last_clean_scrub_stamp":"2024-04-26T11:27:49.926200+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:45:54.161530+0000","scrub_duration":0.026289052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:06.547357+0000","last_change":"2024-04-26T11:28:06.547357+0000","last_active":"2024-04-26T11:28:06.547357+0000","last_peered":"2024-04-26T11:28:06.547357+0000","last_clean":"2024-04-26T11:28:06.547357+0000","last_became_active":"2024-04-26T11:26:11.119452+0000","last_became_peered":"2024-04-26T11:26:11.119452+0000","last_unstale":"2024-04-26T11:28:06.547357+0000","last_undegraded":"2024-04-26T11:28:06.547357+0000","last_fullsized":"2024-04-26T11:28:06.547357+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T11:28:06.547079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T11:28:06.547079+0000","last_clean_scrub_stamp":"2024-04-26T11:28:06.547079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:26:12.810401+0000","scrub_duration":0.003433714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"71'392","reported_seq":943,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:39.937043+0000","last_change":"2024-04-26T11:27:39.937043+0000","last_active":"2024-04-26T11:27:39.937043+0000","last_peered":"2024-04-26T11:27:39.937043+0000","last_clean":"2024-04-26T11:27:39.937043+0000","last_became_active":"2024-04-26T11:26:17.361974+0000","last_became_peered":"2024-04-26T11:26:17.361974+0000","last_unstale":"2024-04-26T11:27:39.937043+0000","last_undegraded":"2024-04-26T11:27:39.937043+0000","last_fullsized":"2024-04-26T11:27:39.937043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'392","last_scrub_stamp":"2024-04-26T11:27:39.936745+0000","last_deep_scrub":"71'392","last_deep_scrub_stamp":"2024-04-26T11:27:39.936745+0000","last_clean_scrub_stamp":"2024-04-26T11:27:39.936745+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:26.877705+0000","scrub_duration":0.0041433700000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":42048,"num_write":358,"num_write_kb":59604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"71'415","reported_seq":525,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:53.400430+0000","last_change":"2024-04-26T11:26:53.400430+0000","last_active":"2024-04-26T11:26:53.400430+0000","last_peered":"2024-04-26T11:26:53.400430+0000","last_clean":"2024-04-26T11:26:53.400430+0000","last_became_active":"2024-04-26T11:26:17.889168+0000","last_became_peered":"2024-04-26T11:26:17.889168+0000","last_unstale":"2024-04-26T11:26:53.400430+0000","last_undegraded":"2024-04-26T11:26:53.400430+0000","last_fullsized":"2024-04-26T11:26:53.400430+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'415","last_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_deep_scrub":"71'415","last_deep_scrub_stamp":"2024-04-26T11:26:53.400136+0000","last_clean_scrub_stamp":"2024-04-26T11:26:53.400136+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:23:43.847441+0000","scrub_duration":0.0041863550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":13973,"num_write":371,"num_write_kb":104928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":169,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"106'410","reported_seq":510,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:53.676852+0000","last_change":"2024-04-26T11:27:53.676852+0000","last_active":"2024-04-26T11:27:53.676852+0000","last_peered":"2024-04-26T11:27:53.676852+0000","last_clean":"2024-04-26T11:27:53.676852+0000","last_became_active":"2024-04-26T11:26:14.130162+0000","last_became_peered":"2024-04-26T11:26:14.130162+0000","last_unstale":"2024-04-26T11:27:53.676852+0000","last_undegraded":"2024-04-26T11:27:53.676852+0000","last_fullsized":"2024-04-26T11:27:53.676852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'410","last_scrub_stamp":"2024-04-26T11:27:53.676525+0000","last_deep_scrub":"106'410","last_deep_scrub_stamp":"2024-04-26T11:27:53.676525+0000","last_clean_scrub_stamp":"2024-04-26T11:27:53.676525+0000","objects_scrubbed":6,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:51:57.894166+0000","scrub_duration":0.044552915999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9577838,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":349,"num_write_kb":9574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":9571421,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"71'425","reported_seq":568,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:56.983899+0000","last_change":"2024-04-26T11:26:56.984139+0000","last_active":"2024-04-26T11:26:56.983899+0000","last_peered":"2024-04-26T11:26:56.983899+0000","last_clean":"2024-04-26T11:26:56.983899+0000","last_became_active":"2024-04-26T11:21:53.702144+0000","last_became_peered":"2024-04-26T11:21:53.702144+0000","last_unstale":"2024-04-26T11:26:56.983899+0000","last_undegraded":"2024-04-26T11:26:56.983899+0000","last_fullsized":"2024-04-26T11:26:56.983899+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'425","last_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_deep_scrub":"71'425","last_deep_scrub_stamp":"2024-04-26T11:26:56.983841+0000","last_clean_scrub_stamp":"2024-04-26T11:26:56.983841+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:06.726299+0000","scrub_duration":0.0046040439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11439,"num_write":387,"num_write_kb":42809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"106'92","reported_seq":196,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:11.288096+0000","last_change":"2024-04-26T11:28:11.288413+0000","last_active":"2024-04-26T11:28:11.288096+0000","last_peered":"2024-04-26T11:28:11.288096+0000","last_clean":"2024-04-26T11:28:11.288096+0000","last_became_active":"2024-04-26T11:26:22.405417+0000","last_became_peered":"2024-04-26T11:26:22.405417+0000","last_unstale":"2024-04-26T11:28:11.288096+0000","last_undegraded":"2024-04-26T11:28:11.288096+0000","last_fullsized":"2024-04-26T11:28:11.288096+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'92","last_scrub_stamp":"2024-04-26T11:28:11.288042+0000","last_deep_scrub":"106'92","last_deep_scrub_stamp":"2024-04-26T11:28:11.288042+0000","last_clean_scrub_stamp":"2024-04-26T11:28:11.288042+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:55.386908+0000","scrub_duration":0.0078133160000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"106'345","reported_seq":430,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:32.598338+0000","last_change":"2024-04-26T11:27:32.598338+0000","last_active":"2024-04-26T11:27:32.598338+0000","last_peered":"2024-04-26T11:27:32.598338+0000","last_clean":"2024-04-26T11:27:32.598338+0000","last_became_active":"2024-04-26T11:26:14.132976+0000","last_became_peered":"2024-04-26T11:26:14.132976+0000","last_unstale":"2024-04-26T11:27:32.598338+0000","last_undegraded":"2024-04-26T11:27:32.598338+0000","last_fullsized":"2024-04-26T11:27:32.598338+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'345","last_scrub_stamp":"2024-04-26T11:27:32.598068+0000","last_deep_scrub":"106'345","last_deep_scrub_stamp":"2024-04-26T11:27:32.598068+0000","last_clean_scrub_stamp":"2024-04-26T11:27:32.598068+0000","objects_scrubbed":1,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:47:49.040005+0000","scrub_duration":0.028263885999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":4269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"71'468","reported_seq":1037,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:57.986343+0000","last_change":"2024-04-26T11:26:57.986559+0000","last_active":"2024-04-26T11:26:57.986343+0000","last_peered":"2024-04-26T11:26:57.986343+0000","last_clean":"2024-04-26T11:26:57.986343+0000","last_became_active":"2024-04-26T11:26:38.373800+0000","last_became_peered":"2024-04-26T11:26:38.373800+0000","last_unstale":"2024-04-26T11:26:57.986343+0000","last_undegraded":"2024-04-26T11:26:57.986343+0000","last_fullsized":"2024-04-26T11:26:57.986343+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'468","last_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_deep_scrub":"71'468","last_deep_scrub_stamp":"2024-04-26T11:26:57.986292+0000","last_clean_scrub_stamp":"2024-04-26T11:26:57.986292+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:27.125276+0000","scrub_duration":0.0037409510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":12869,"num_write":431,"num_write_kb":76415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"70'52","reported_seq":178,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:30.984202+0000","last_change":"2024-04-26T11:27:30.984422+0000","last_active":"2024-04-26T11:27:30.984202+0000","last_peered":"2024-04-26T11:27:30.984202+0000","last_clean":"2024-04-26T11:27:30.984202+0000","last_became_active":"2024-04-26T11:26:11.604886+0000","last_became_peered":"2024-04-26T11:26:11.604886+0000","last_unstale":"2024-04-26T11:27:30.984202+0000","last_undegraded":"2024-04-26T11:27:30.984202+0000","last_fullsized":"2024-04-26T11:27:30.984202+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"70'52","last_scrub_stamp":"2024-04-26T11:27:30.984151+0000","last_deep_scrub":"70'52","last_deep_scrub_stamp":"2024-04-26T11:27:30.984151+0000","last_clean_scrub_stamp":"2024-04-26T11:27:30.984151+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:01.509557+0000","scrub_duration":0.0034089770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"71'454","reported_seq":582,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:58.962038+0000","last_change":"2024-04-26T11:26:58.962297+0000","last_active":"2024-04-26T11:26:58.962038+0000","last_peered":"2024-04-26T11:26:58.962038+0000","last_clean":"2024-04-26T11:26:58.962038+0000","last_became_active":"2024-04-26T11:21:53.705026+0000","last_became_peered":"2024-04-26T11:21:53.705026+0000","last_unstale":"2024-04-26T11:26:58.962038+0000","last_undegraded":"2024-04-26T11:26:58.962038+0000","last_fullsized":"2024-04-26T11:26:58.962038+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'454","last_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_deep_scrub":"71'454","last_deep_scrub_stamp":"2024-04-26T11:26:58.961980+0000","last_clean_scrub_stamp":"2024-04-26T11:26:58.961980+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:21.020921+0000","scrub_duration":0.0044732579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22877,"num_write":432,"num_write_kb":76048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"71'352","reported_seq":805,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:23.051045+0000","last_change":"2024-04-26T11:27:23.051045+0000","last_active":"2024-04-26T11:27:23.051045+0000","last_peered":"2024-04-26T11:27:23.051045+0000","last_clean":"2024-04-26T11:27:23.051045+0000","last_became_active":"2024-04-26T11:26:32.370205+0000","last_became_peered":"2024-04-26T11:26:32.370205+0000","last_unstale":"2024-04-26T11:27:23.051045+0000","last_undegraded":"2024-04-26T11:27:23.051045+0000","last_fullsized":"2024-04-26T11:27:23.051045+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'352","last_scrub_stamp":"2024-04-26T11:27:23.050694+0000","last_deep_scrub":"71'352","last_deep_scrub_stamp":"2024-04-26T11:27:23.050694+0000","last_clean_scrub_stamp":"2024-04-26T11:27:23.050694+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:03:45.109635+0000","scrub_duration":0.0037690789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5283,"num_write":322,"num_write_kb":30561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":154,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"106'589","reported_seq":702,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:42.979638+0000","last_change":"2024-04-26T11:27:42.979875+0000","last_active":"2024-04-26T11:27:42.979638+0000","last_peered":"2024-04-26T11:27:42.979638+0000","last_clean":"2024-04-26T11:27:42.979638+0000","last_became_active":"2024-04-26T11:21:53.327333+0000","last_became_peered":"2024-04-26T11:21:53.327333+0000","last_unstale":"2024-04-26T11:27:42.979638+0000","last_undegraded":"2024-04-26T11:27:42.979638+0000","last_fullsized":"2024-04-26T11:27:42.979638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'589","last_scrub_stamp":"2024-04-26T11:27:42.979583+0000","last_deep_scrub":"106'589","last_deep_scrub_stamp":"2024-04-26T11:27:42.979583+0000","last_clean_scrub_stamp":"2024-04-26T11:27:42.979583+0000","objects_scrubbed":2,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:29.434420+0000","scrub_duration":0.052572714999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":522,"num_write_kb":8457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"71'410","reported_seq":935,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:13.938408+0000","last_change":"2024-04-26T11:28:13.938673+0000","last_active":"2024-04-26T11:28:13.938408+0000","last_peered":"2024-04-26T11:28:13.938408+0000","last_clean":"2024-04-26T11:28:13.938408+0000","last_became_active":"2024-04-26T11:26:24.379340+0000","last_became_peered":"2024-04-26T11:26:24.379340+0000","last_unstale":"2024-04-26T11:28:13.938408+0000","last_undegraded":"2024-04-26T11:28:13.938408+0000","last_fullsized":"2024-04-26T11:28:13.938408+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'410","last_scrub_stamp":"2024-04-26T11:28:13.938352+0000","last_deep_scrub":"71'410","last_deep_scrub_stamp":"2024-04-26T11:28:13.938352+0000","last_clean_scrub_stamp":"2024-04-26T11:28:13.938352+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:32:23.483074+0000","scrub_duration":0.0042705340000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":15183,"num_write":378,"num_write_kb":60251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"106'271","reported_seq":408,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:56.059175+0000","last_change":"2024-04-26T11:27:56.059489+0000","last_active":"2024-04-26T11:27:56.059175+0000","last_peered":"2024-04-26T11:27:56.059175+0000","last_clean":"2024-04-26T11:27:56.059175+0000","last_became_active":"2024-04-26T11:26:14.607071+0000","last_became_peered":"2024-04-26T11:26:14.607071+0000","last_unstale":"2024-04-26T11:27:56.059175+0000","last_undegraded":"2024-04-26T11:27:56.059175+0000","last_fullsized":"2024-04-26T11:27:56.059175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'271","last_scrub_stamp":"2024-04-26T11:27:56.059067+0000","last_deep_scrub":"106'271","last_deep_scrub_stamp":"2024-04-26T11:27:56.059067+0000","last_clean_scrub_stamp":"2024-04-26T11:27:56.059067+0000","objects_scrubbed":1,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:13:38.198483+0000","scrub_duration":0.029952316999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":4237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"71'439","reported_seq":1029,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:15.080170+0000","last_change":"2024-04-26T11:27:15.080408+0000","last_active":"2024-04-26T11:27:15.080170+0000","last_peered":"2024-04-26T11:27:15.080170+0000","last_clean":"2024-04-26T11:27:15.080170+0000","last_became_active":"2024-04-26T11:26:36.403506+0000","last_became_peered":"2024-04-26T11:26:36.403506+0000","last_unstale":"2024-04-26T11:27:15.080170+0000","last_undegraded":"2024-04-26T11:27:15.080170+0000","last_fullsized":"2024-04-26T11:27:15.080170+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'439","last_scrub_stamp":"2024-04-26T11:27:15.080115+0000","last_deep_scrub":"71'439","last_deep_scrub_stamp":"2024-04-26T11:27:15.080115+0000","last_clean_scrub_stamp":"2024-04-26T11:27:15.080115+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:29:37.378024+0000","scrub_duration":0.0040451460000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":65724,"num_write":399,"num_write_kb":130276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":166,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"106'377","reported_seq":446,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:02.238246+0000","last_change":"2024-04-26T11:28:02.238492+0000","last_active":"2024-04-26T11:28:02.238246+0000","last_peered":"2024-04-26T11:28:02.238246+0000","last_clean":"2024-04-26T11:28:02.238246+0000","last_became_active":"2024-04-26T11:26:22.377723+0000","last_became_peered":"2024-04-26T11:26:22.377723+0000","last_unstale":"2024-04-26T11:28:02.238246+0000","last_undegraded":"2024-04-26T11:28:02.238246+0000","last_fullsized":"2024-04-26T11:28:02.238246+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'377","last_scrub_stamp":"2024-04-26T11:28:02.238190+0000","last_deep_scrub":"106'377","last_deep_scrub_stamp":"2024-04-26T11:28:02.238190+0000","last_clean_scrub_stamp":"2024-04-26T11:28:02.238190+0000","objects_scrubbed":3,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:49:12.560437+0000","scrub_duration":0.052441278000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":316,"num_write_kb":12485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"71'408","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:52.009464+0000","last_change":"2024-04-26T11:26:52.009713+0000","last_active":"2024-04-26T11:26:52.009464+0000","last_peered":"2024-04-26T11:26:52.009464+0000","last_clean":"2024-04-26T11:26:52.009464+0000","last_became_active":"2024-04-26T11:26:22.389918+0000","last_became_peered":"2024-04-26T11:26:22.389918+0000","last_unstale":"2024-04-26T11:26:52.009464+0000","last_undegraded":"2024-04-26T11:26:52.009464+0000","last_fullsized":"2024-04-26T11:26:52.009464+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'408","last_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_deep_scrub":"71'408","last_deep_scrub_stamp":"2024-04-26T11:26:52.009412+0000","last_clean_scrub_stamp":"2024-04-26T11:26:52.009412+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:57:59.423751+0000","scrub_duration":0.0045503360000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":14521,"num_write":369,"num_write_kb":125293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"106'62","reported_seq":166,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:15.206585+0000","last_change":"2024-04-26T11:28:15.206904+0000","last_active":"2024-04-26T11:28:15.206585+0000","last_peered":"2024-04-26T11:28:15.206585+0000","last_clean":"2024-04-26T11:28:15.206585+0000","last_became_active":"2024-04-26T11:26:22.395896+0000","last_became_peered":"2024-04-26T11:26:22.395896+0000","last_unstale":"2024-04-26T11:28:15.206585+0000","last_undegraded":"2024-04-26T11:28:15.206585+0000","last_fullsized":"2024-04-26T11:28:15.206585+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'62","last_scrub_stamp":"2024-04-26T11:28:15.206529+0000","last_deep_scrub":"106'62","last_deep_scrub_stamp":"2024-04-26T11:28:15.206529+0000","last_clean_scrub_stamp":"2024-04-26T11:28:15.206529+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:00.502044+0000","scrub_duration":0.01665635,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"71'375","reported_seq":488,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:03.491361+0000","last_change":"2024-04-26T11:27:03.491361+0000","last_active":"2024-04-26T11:27:03.491361+0000","last_peered":"2024-04-26T11:27:03.491361+0000","last_clean":"2024-04-26T11:27:03.491361+0000","last_became_active":"2024-04-26T11:26:16.880975+0000","last_became_peered":"2024-04-26T11:26:16.880975+0000","last_unstale":"2024-04-26T11:27:03.491361+0000","last_undegraded":"2024-04-26T11:27:03.491361+0000","last_fullsized":"2024-04-26T11:27:03.491361+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'375","last_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_deep_scrub":"71'375","last_deep_scrub_stamp":"2024-04-26T11:27:03.491032+0000","last_clean_scrub_stamp":"2024-04-26T11:27:03.491032+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:52.444748+0000","scrub_duration":0.0043129789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":15683,"num_write":350,"num_write_kb":46677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":164,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"106'328","reported_seq":419,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:57.585141+0000","last_change":"2024-04-26T11:27:57.585141+0000","last_active":"2024-04-26T11:27:57.585141+0000","last_peered":"2024-04-26T11:27:57.585141+0000","last_clean":"2024-04-26T11:27:57.585141+0000","last_became_active":"2024-04-26T11:26:15.145312+0000","last_became_peered":"2024-04-26T11:26:15.145312+0000","last_unstale":"2024-04-26T11:27:57.585141+0000","last_undegraded":"2024-04-26T11:27:57.585141+0000","last_fullsized":"2024-04-26T11:27:57.585141+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'328","last_scrub_stamp":"2024-04-26T11:27:57.584866+0000","last_deep_scrub":"106'328","last_deep_scrub_stamp":"2024-04-26T11:27:57.584866+0000","last_clean_scrub_stamp":"2024-04-26T11:27:57.584866+0000","objects_scrubbed":2,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:15.471404+0000","scrub_duration":0.026502560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":272,"num_write_kb":4266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"71'406","reported_seq":503,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:09.525104+0000","last_change":"2024-04-26T11:27:09.525341+0000","last_active":"2024-04-26T11:27:09.525104+0000","last_peered":"2024-04-26T11:27:09.525104+0000","last_clean":"2024-04-26T11:27:09.525104+0000","last_became_active":"2024-04-26T11:26:31.888161+0000","last_became_peered":"2024-04-26T11:26:31.888161+0000","last_unstale":"2024-04-26T11:27:09.525104+0000","last_undegraded":"2024-04-26T11:27:09.525104+0000","last_fullsized":"2024-04-26T11:27:09.525104+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'406","last_scrub_stamp":"2024-04-26T11:27:09.525054+0000","last_deep_scrub":"71'406","last_deep_scrub_stamp":"2024-04-26T11:27:09.525054+0000","last_clean_scrub_stamp":"2024-04-26T11:27:09.525054+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:30.705220+0000","scrub_duration":0.0044574929999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":11677,"num_write":375,"num_write_kb":46634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":180,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"106'394","reported_seq":514,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:04.167993+0000","last_change":"2024-04-26T11:27:04.168232+0000","last_active":"2024-04-26T11:27:04.167993+0000","last_peered":"2024-04-26T11:27:04.167993+0000","last_clean":"2024-04-26T11:27:04.167993+0000","last_became_active":"2024-04-26T11:26:22.403335+0000","last_became_peered":"2024-04-26T11:26:22.403335+0000","last_unstale":"2024-04-26T11:27:04.167993+0000","last_undegraded":"2024-04-26T11:27:04.167993+0000","last_fullsized":"2024-04-26T11:27:04.167993+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'394","last_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_deep_scrub":"106'394","last_deep_scrub_stamp":"2024-04-26T11:27:04.167933+0000","last_clean_scrub_stamp":"2024-04-26T11:27:04.167933+0000","objects_scrubbed":4,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:33:54.292388+0000","scrub_duration":0.059480993000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":319,"num_write_kb":12482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"71'405","reported_seq":511,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:13.259019+0000","last_change":"2024-04-26T11:28:13.259019+0000","last_active":"2024-04-26T11:28:13.259019+0000","last_peered":"2024-04-26T11:28:13.259019+0000","last_clean":"2024-04-26T11:28:13.259019+0000","last_became_active":"2024-04-26T11:26:22.382826+0000","last_became_peered":"2024-04-26T11:26:22.382826+0000","last_unstale":"2024-04-26T11:28:13.259019+0000","last_undegraded":"2024-04-26T11:28:13.259019+0000","last_fullsized":"2024-04-26T11:28:13.259019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'405","last_scrub_stamp":"2024-04-26T11:28:13.258733+0000","last_deep_scrub":"71'405","last_deep_scrub_stamp":"2024-04-26T11:28:13.258733+0000","last_clean_scrub_stamp":"2024-04-26T11:28:13.258733+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:26.510924+0000","scrub_duration":0.0055196990000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":20091,"num_write":368,"num_write_kb":46572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"106'58","reported_seq":172,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:28:04.024643+0000","last_change":"2024-04-26T11:28:04.024856+0000","last_active":"2024-04-26T11:28:04.024643+0000","last_peered":"2024-04-26T11:28:04.024643+0000","last_clean":"2024-04-26T11:28:04.024643+0000","last_became_active":"2024-04-26T11:21:53.329219+0000","last_became_peered":"2024-04-26T11:21:53.329219+0000","last_unstale":"2024-04-26T11:28:04.024643+0000","last_undegraded":"2024-04-26T11:28:04.024643+0000","last_fullsized":"2024-04-26T11:28:04.024643+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'58","last_scrub_stamp":"2024-04-26T11:28:04.024591+0000","last_deep_scrub":"106'58","last_deep_scrub_stamp":"2024-04-26T11:28:04.024591+0000","last_clean_scrub_stamp":"2024-04-26T11:28:04.024591+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:46.722631+0000","scrub_duration":0.016948365,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"71'446","reported_seq":554,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:26:59.498154+0000","last_change":"2024-04-26T11:26:59.498428+0000","last_active":"2024-04-26T11:26:59.498154+0000","last_peered":"2024-04-26T11:26:59.498154+0000","last_clean":"2024-04-26T11:26:59.498154+0000","last_became_active":"2024-04-26T11:26:33.899698+0000","last_became_peered":"2024-04-26T11:26:33.899698+0000","last_unstale":"2024-04-26T11:26:59.498154+0000","last_undegraded":"2024-04-26T11:26:59.498154+0000","last_fullsized":"2024-04-26T11:26:59.498154+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"71'446","last_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_deep_scrub":"71'446","last_deep_scrub_stamp":"2024-04-26T11:26:59.498100+0000","last_clean_scrub_stamp":"2024-04-26T11:26:59.498100+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:08.316575+0000","scrub_duration":0.003708294,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":25307,"num_write":419,"num_write_kb":63288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":198,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"106'133","reported_seq":272,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T11:27:25.003403+0000","last_change":"2024-04-26T11:27:25.003403+0000","last_active":"2024-04-26T11:27:25.003403+0000","last_peered":"2024-04-26T11:27:25.003403+0000","last_clean":"2024-04-26T11:27:25.003403+0000","last_became_active":"2024-04-26T11:26:14.615856+0000","last_became_peered":"2024-04-26T11:26:14.615856+0000","last_unstale":"2024-04-26T11:27:25.003403+0000","last_undegraded":"2024-04-26T11:27:25.003403+0000","last_fullsized":"2024-04-26T11:27:25.003403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'133","last_scrub_stamp":"2024-04-26T11:27:25.003082+0000","last_deep_scrub":"106'133","last_deep_scrub_stamp":"2024-04-26T11:27:25.003082+0000","last_clean_scrub_stamp":"2024-04-26T11:27:25.003082+0000","objects_scrubbed":3,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:21:32.644341+0000","scrub_duration":0.025665877,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":79,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2771,"num_read_kb":1499321,"num_write":24450,"num_write_kb":4269064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7310,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26551,"ondisk_log_size":26551,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":128488496,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":56,"num_read_kb":1474,"num_write":5770,"num_write_kb":129542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":86538241,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":78880768,"data_stored":256976992,"data_compressed":37568603,"data_compressed_allocated":47321088,"data_compressed_original":225484800,"omap_allocated":5584,"internal_metadata":0},"log_size":7707,"ondisk_log_size":7707,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":1180736,"data_compressed":22366,"data_compressed_allocated":81920,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738458,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146528,"kb_used_data":31000,"kb_used_omap":1,"kb_used_meta":115518,"kb_avail":94225312,"statfs":{"total":96636764160,"available":96486719488,"internally_reserved":0,"allocated":31744000,"data_stored":81613145,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":1594,"internal_metadata":118290886},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:28:11 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.64900000000000002,"15min":0.63900000000000001},"min":{"1min":0.54400000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Apr 26 11:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65700000000000003,"15min":0.66300000000000003},"min":{"1min":0.66400000000000003,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.84299999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.629,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.69199999999999995}]}]},{"osd":1,"up_from":8,"seq":34359738458,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124348,"kb_used_data":30964,"kb_used_omap":1,"kb_used_meta":93374,"kb_avail":94247492,"statfs":{"total":96636764160,"available":96509431808,"internally_reserved":0,"allocated":31707136,"data_stored":86117265,"data_compressed":11637835,"data_compressed_allocated":15388672,"data_compressed_original":70356992,"omap_allocated":1594,"internal_metadata":95615430},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 11:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.67100000000000004}]},{"osd":2,"last update":"Fri Apr 26 11:27:53 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64000000000000001,"15min":0.68200000000000005},"min":{"1min":0.54700000000000004,"5min":0.312,"15min":0.312},"max":{"1min":0.755,"5min":0.80400000000000005,"15min":0.93000000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63100000000000001,"15min":0.68100000000000005},"min":{"1min":0.52600000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.80500000000000005,"5min":0.83999999999999997,"15min":0.84499999999999997},"last":0.71399999999999997}]}]},{"osd":0,"up_from":75,"seq":322122547234,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75932,"kb_used_data":18068,"kb_used_omap":7,"kb_used_meta":57848,"kb_avail":94295908,"statfs":{"total":96636764160,"available":96559009792,"internally_reserved":0,"allocated":18501632,"data_stored":91781533,"data_compressed":15018019,"data_compressed_allocated":17436672,"data_compressed_original":91287552,"omap_allocated":7177,"internal_metadata":59237367},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 11:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.53900000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60499999999999998,"15min":0.59899999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Apr 26 11:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63900000000000001,"15min":0.63200000000000001},"min":{"1min":0.58899999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.622},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68600000000000005,"15min":0.68000000000000005},"min":{"1min":0.65000000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.65200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":11183,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17457152,"data_stored":90739760,"data_compressed":15006836,"data_compressed_allocated":17395712,"data_compressed_original":90714112,"omap_allocated":5584,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":30662656,"data_stored":85075492,"data_compressed":11626652,"data_compressed_allocated":15347712,"data_compressed_original":69783552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30760960,"data_stored":81161740,"data_compressed":10935115,"data_compressed_allocated":14577664,"data_compressed_original":64987136,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T11:28:52.772 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T11:28:53.099 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T11:28:53.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:28:53.391 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:28:53.391 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:21:53.671194+0000","modified":"2024-04-26T11:21:55.684708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/3100108986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3100108986},{"type":"v1","addr":"172.21.15.73:6803","nonce":3100108986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:28:53.392 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-26T11:28:53.409 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T11:28:53.730 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:28:53.730 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T11:21:53.671194+0000","modified":"2024-04-26T11:21:55.684708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4207":{"gid":4207,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6803/3100108986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3100108986},{"type":"v1","addr":"172.21.15.73:6803","nonce":3100108986}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T11:28:53.731 INFO:teuthology.orchestra.run.smithi073.stderr:dumped fsmap epoch 5 2024-04-26T11:28:53.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T11:28:54.019 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-04-26T11:28:54.019 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":106,"fsid":"ce8f5a6d-6ae3-4802-8259-a3a101a3c6c4","created":"2024-04-26T11:21:32.561072+0000","modified":"2024-04-26T11:26:41.366381+0000","last_up_change":"2024-04-26T11:26:10.538684+0000","last_in_change":"2024-04-26T11:21:33.824306+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T11:21:41.373843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T11:21:48.112664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T11:21:52.071918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T11:21:52.677679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b4f67c6-5cab-46bf-b296-34fcc29c7766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":49,"up_from":75,"up_thru":105,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":1525},{"type":"v1","addr":"172.21.15.88:6801","nonce":1525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1525},{"type":"v1","addr":"172.21.15.88:6803","nonce":1525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1525},{"type":"v1","addr":"172.21.15.88:6807","nonce":1525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1525},{"type":"v1","addr":"172.21.15.88:6805","nonce":1525}]},"public_addr":"172.21.15.88:6801/1525","cluster_addr":"172.21.15.88:6803/1525","heartbeat_back_addr":"172.21.15.88:6807/1525","heartbeat_front_addr":"172.21.15.88:6805/1525","state":["exists","up"]},{"osd":1,"uuid":"d465bcda-9e32-469e-82f3-077db852411e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":21474},{"type":"v1","addr":"172.21.15.107:6801","nonce":21474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":21474},{"type":"v1","addr":"172.21.15.107:6803","nonce":21474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":21474},{"type":"v1","addr":"172.21.15.107:6807","nonce":21474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":21474},{"type":"v1","addr":"172.21.15.107:6805","nonce":21474}]},"public_addr":"172.21.15.107:6801/21474","cluster_addr":"172.21.15.107:6803/21474","heartbeat_back_addr":"172.21.15.107:6807/21474","heartbeat_front_addr":"172.21.15.107:6805/21474","state":["exists","up"]},{"osd":2,"uuid":"61e99173-e480-4da1-a95b-d98715c3e713","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":21537},{"type":"v1","addr":"172.21.15.175:6801","nonce":21537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":21537},{"type":"v1","addr":"172.21.15.175:6803","nonce":21537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":21537},{"type":"v1","addr":"172.21.15.175:6807","nonce":21537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":21537},{"type":"v1","addr":"172.21.15.175:6805","nonce":21537}]},"public_addr":"172.21.15.175:6801/21537","cluster_addr":"172.21.15.175:6803/21537","heartbeat_back_addr":"172.21.15.175:6807/21537","heartbeat_front_addr":"172.21.15.175:6805/21537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.131929+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.107573+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T11:21:39.162743+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T11:28:54.038 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T11:28:54.363 INFO:teuthology.orchestra.run.smithi073.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T11:28:54.381 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T11:28:54.405 INFO:tasks.ceph.mds.a.smithi073.stdout:starting mds.a at 2024-04-26T11:28:55.389 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T11:28:56.374 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_metadata' removed 2024-04-26T11:28:56.396 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T11:28:57.375 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'cephfs_data' removed 2024-04-26T11:28:57.400 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T11:28:57.400 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T11:28:57.400 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:28:57.410 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T11:28:57.410 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T11:28:57.410 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T11:28:57.410 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:28:57.476 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T11:28:57.477 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T11:28:57.477 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:28:57.572 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T11:28:57.573 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T11:28:57.573 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:28:57.656 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T11:28:57.656 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T11:28:57.656 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T11:28:57.656 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:28:57.692 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T11:28:57.692 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T11:28:57.692 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:28:57.758 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T11:28:57.758 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T11:28:57.759 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T11:28:57.759 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:28:57.814 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T11:28:57.814 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T11:28:57.814 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:28:57.873 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T11:28:57.873 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T11:28:57.873 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T11:28:57.936 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T11:28:57.936 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T11:28:57.936 DEBUG:teuthology.orchestra.run.smithi073:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-26T11:28:57.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T11:28:57.993 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T11:28:58.119 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi107.front.sepia.ceph.com 2024-04-26T11:28:58.119 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T11:28:58.309 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T11:28:58.310 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T11:28:58.494 INFO:tasks.ceph:Archiving mon data... 2024-04-26T11:28:58.496 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/data/mon.a.tgz 2024-04-26T11:28:58.496 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-04-26T11:28:58.502 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.eh1dkxLgtP 2024-04-26T11:28:58.502 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.eh1dkxLgtP 2024-04-26T11:28:58.646 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.eh1dkxLgtP 2024-04-26T11:28:58.709 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.eh1dkxLgtP is 413KB 2024-04-26T11:28:58.771 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.eh1dkxLgtP 2024-04-26T11:28:58.776 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/data/mon.b.tgz 2024-04-26T11:28:58.777 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-04-26T11:28:58.822 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.CBWL3od6iI 2024-04-26T11:28:58.822 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.CBWL3od6iI 2024-04-26T11:28:59.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.CBWL3od6iI 2024-04-26T11:28:59.069 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.CBWL3od6iI is 579KB 2024-04-26T11:28:59.131 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.CBWL3od6iI 2024-04-26T11:28:59.137 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/data/mon.c.tgz 2024-04-26T11:28:59.137 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-04-26T11:28:59.185 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.R50zYWr61t 2024-04-26T11:28:59.186 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.R50zYWr61t 2024-04-26T11:28:59.372 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.R50zYWr61t 2024-04-26T11:28:59.437 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.R50zYWr61t is 579KB 2024-04-26T11:28:59.503 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.R50zYWr61t 2024-04-26T11:28:59.509 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T11:28:59.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:28:59.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:28:59.557 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:28:59.560 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T11:28:59.643 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T11:28:59.643 DEBUG:teuthology.orchestra.run.smithi073:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:28:59.646 DEBUG:teuthology.orchestra.run.smithi088:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:28:59.648 DEBUG:teuthology.orchestra.run.smithi107:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:28:59.650 DEBUG:teuthology.orchestra.run.smithi175:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T11:28:59.668 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:28:59.691 INFO:teuthology.orchestra.run.smithi088.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:28:59.741 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:28:59.916 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T11:28:59.920 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T11:28:59.922 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi073/crash 2024-04-26T11:28:59.923 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:28:59.938 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi088/crash 2024-04-26T11:28:59.939 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:28:59.970 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi107/crash 2024-04-26T11:28:59.971 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:28:59.984 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi175/crash 2024-04-26T11:28:59.985 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T11:28:59.999 INFO:tasks.ceph:Compressing logs... 2024-04-26T11:28:59.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:29:00.002 DEBUG:teuthology.orchestra.run.smithi088:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:29:00.018 DEBUG:teuthology.orchestra.run.smithi107:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:29:00.032 DEBUG:teuthology.orchestra.run.smithi175:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:29:07.086 INFO:tasks.ceph:Archiving logs... 2024-04-26T11:29:07.087 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi073/log 2024-04-26T11:29:07.088 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:29:07.434 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi088/log 2024-04-26T11:29:07.435 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:29:07.612 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi107/log 2024-04-26T11:29:07.612 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:29:08.081 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi175/log 2024-04-26T11:29:08.086 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T11:29:08.795 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T11:29:08.804 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T11:29:08.804 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:29:08.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:29:08.809 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:29:08.812 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T11:29:08.925 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T11:29:08.937 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T11:29:08.937 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:29:08.940 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:29:08.942 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:29:08.944 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T11:29:08.951 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:29:08.951 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2024-04-26T11:29:08.951 INFO:teuthology.orchestra.run.smithi073.stdout:*hv01.front.sepi 67.205.162.81 3 u 13 64 377 0.100 -2.617 0.572 2024-04-26T11:29:08.951 INFO:teuthology.orchestra.run.smithi073.stdout:+hv02.front.sepi 63.231.80.2 3 u 14 64 377 0.060 -1.028 1.165 2024-04-26T11:29:08.952 INFO:teuthology.orchestra.run.smithi073.stdout:+hv03.front.sepi 74.6.168.72 3 u 12 64 377 0.091 -2.432 1.210 2024-04-26T11:29:08.952 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-26T11:29:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:29:08.953 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================== 2024-04-26T11:29:08.953 INFO:teuthology.orchestra.run.smithi107.stdout:+hv01.front.sepi 67.205.162.81 3 u 14 64 377 0.074 -1.779 1.260 2024-04-26T11:29:08.953 INFO:teuthology.orchestra.run.smithi107.stdout:*hv02.front.sepi 63.231.80.2 3 u 21 64 377 0.111 +0.407 1.022 2024-04-26T11:29:08.953 INFO:teuthology.orchestra.run.smithi107.stdout:+hv03.front.sepi 74.6.168.72 3 u 13 64 377 0.080 -1.579 0.947 2024-04-26T11:29:08.953 INFO:teuthology.orchestra.run.smithi107.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-26T11:29:08.957 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:29:08.957 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2024-04-26T11:29:08.957 INFO:teuthology.orchestra.run.smithi175.stdout:+hv01.front.sepi 67.205.162.81 3 u 14 64 377 0.079 -3.766 1.665 2024-04-26T11:29:08.957 INFO:teuthology.orchestra.run.smithi175.stdout:*hv02.front.sepi 63.231.80.2 3 u 18 64 377 0.087 -0.920 1.342 2024-04-26T11:29:08.958 INFO:teuthology.orchestra.run.smithi175.stdout:+hv03.front.sepi 74.6.168.72 3 u 18 64 377 0.094 -2.920 1.991 2024-04-26T11:29:08.958 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-04-26T11:29:08.959 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T11:29:08.959 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2024-04-26T11:29:08.959 INFO:teuthology.orchestra.run.smithi088.stdout: hv01.front.sepi 67.205.162.81 3 u 63 64 7 0.093 +477.59 1.171 2024-04-26T11:29:08.959 INFO:teuthology.orchestra.run.smithi088.stdout: hv02.front.sepi 63.231.80.2 3 u 63 64 7 0.144 +480.04 1.196 2024-04-26T11:29:08.959 INFO:teuthology.orchestra.run.smithi088.stdout: hv03.front.sepi 74.6.168.72 3 u 58 64 7 0.137 +478.90 1.077 2024-04-26T11:29:08.959 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T11:29:08.960 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T11:29:08.969 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T11:29:08.969 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T11:29:08.995 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T11:29:09.028 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T11:29:09.062 INFO:teuthology.task.internal:Duration was 1046.053687 seconds 2024-04-26T11:29:09.062 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T11:29:09.096 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T11:29:09.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:29:09.099 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:29:09.101 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:29:09.106 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T11:29:09.143 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T11:29:09.143 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-04-26T11:29:09.144 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:29:09.190 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-04-26T11:29:09.190 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:29:09.201 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-04-26T11:29:09.201 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:29:09.211 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T11:29:09.212 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T11:29:09.222 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T11:29:09.222 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:29:09.236 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:29:09.245 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:29:09.256 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T11:29:09.297 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T11:29:09.297 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:29:09.302 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:29:09.304 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:29:09.328 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T11:29:09.414 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T11:29:09.424 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T11:29:09.425 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:29:09.439 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:29:09.453 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:29:09.467 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T11:29:09.480 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T11:29:09.493 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:29:09.496 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:29:09.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:29:09.505 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-04-26T11:29:09.513 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:29:09.521 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-04-26T11:29:09.521 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-04-26T11:29:09.530 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-04-26T11:29:09.555 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:29:09.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:29:09.565 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:29:09.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:29:09.600 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:29:09.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:29:09.605 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T11:29:09.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T11:29:09.609 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T11:29:09.622 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T11:29:09.623 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi073 2024-04-26T11:29:09.623 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:29:09.646 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi088 2024-04-26T11:29:09.646 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:29:09.666 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi107 2024-04-26T11:29:09.666 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:29:09.690 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674158/remote/smithi175 2024-04-26T11:29:09.690 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T11:29:09.711 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T11:29:09.711 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:29:09.713 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:29:09.719 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:29:09.728 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T11:29:09.753 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T11:29:09.765 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T11:29:09.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T11:29:09.787 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T11:29:09.787 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:29:09.790 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:29:09.792 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:29:09.793 INFO:teuthology.orchestra.run.smithi073.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:29 /home/ubuntu/cephtest 2024-04-26T11:29:09.795 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T11:29:09.796 INFO:teuthology.orchestra.run.smithi088.stdout: 658434 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:29 /home/ubuntu/cephtest 2024-04-26T11:29:09.798 INFO:teuthology.orchestra.run.smithi107.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:29 /home/ubuntu/cephtest 2024-04-26T11:29:09.802 INFO:teuthology.orchestra.run.smithi175.stdout: 658467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 11:29 /home/ubuntu/cephtest 2024-04-26T11:29:09.803 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T11:29:09.817 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T11:29:09.890 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} duration: 1046.0536873340607 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T11:29:09.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T11:29:09.977 INFO:teuthology.run:pass